Trending Topics

According to sort Benchmark's latest news, Databricks's spark tritonsort two systems at the University of California, San Diego, 2014 in the Daytona graysort tied sorting contest. Among them, Tritonsort is a multi-year academic project, using 186 EC2 i2.8xlarge nodes in 1378 seconds to complete the sorting of 100TB data, while Spark is a production environment general-purpose large-scale iterative computing tool, it uses 207 ...

In the past few years, the use of Apache Spark has increased at an alarming rate, usually as a successor to the MapReduce, which can support thousands of-node-scale cluster deployments. In the memory data processing, the Apache spark is more efficient than the mapreduce has been widely recognized, but when the amount of data is far beyond memory capacity, we also hear some organizations in the spark use of trouble. Therefore, with the spark community, we put a lot of energy to do spark stability, scalability, performance, etc...

Sponsored by the China Computer Society (CCF), CCF large data expert committee, the Institute of Computing Technology of the Chinese Academy of Sciences and CSDN co-organized the "2014 China Large Data Technology conference" (DA data Marvell Conference 2014,BDTC 2014) will be held in December 2014 12-14th at Crowne Plaza Hotel Beijing New Yunnan. "The second CCF large data academic conference" will also be held at the same time, and the technical conference to share the theme of the report. This conference will last three days, the General Assembly ...

The drawbacks of "editor's note" Hadoop are also as stark as its virtues--large latency, slow response, and complex operation. is widely criticized, but there is demand for the creation, in Hadoop basically laid a large data hegemony, many of the open source project is to make up for the real-time nature of Hadoop as the goal is created, Storm is at this time turned out, Storm is a free open source, distributed, A highly fault-tolerant real-time computing system. The storm makes continuous flow calculation easy, making up for the real-time ...

"Editor's note" WiX has been operating the site for a long time, and after the launch of the WYSIWYG web platform based on HTML5, users have established more than 54 million sites in the company, and most of these sites have less than 100 solar PV. Since the PV of each page is low, the traditional caching strategy does not apply. Even so, however, the company has done so with only 4 Web servers. Recently, WiX chief back-end engineer Aviran Mordo in "...

The "Editor's note" machine learning seems to have turned from obscurity to the limelight overnight, as well as more open source tools for machine learning, but the challenge now is how to get developers interested in machine learning and the data they are prepared to use to actually use them, This paper collects the common and practical open source machine learning tools in several languages, which is worth paying attention to, which is from InfoWorld. The following is the original: After decades of development as a professional discipline, machine learning seems to appear overnight as a popular business tool ...

Spam filtering, face recognition, recommendation engine-when you have a large dataset and want to use them to perform predictive analysis and pattern recognition, machine learning is the only way. In this science, computers can learn, analyze and manipulate data independently without prior planning, and more and more developers are now concerned with machine learning. The rise of machine learning technology is also important not only because hardware costs are getting cheaper and more powerful, but free software surges that machine learning is easily deployed on stand-alone or large-scale clusters The diversity of machine learning libraries means that whatever language you like ...

The study is based on the thought that humans tend to think and make decisions based on their experiences and the examples they see. For example, a child may know from several words spoken by his parents that they are talking about summer camp because they have been there last year and they know that words such as "month," "Lake" and "counselors" will only be used together in this situation. However, if we have limited experience or perhaps no experience in a particular field, a little help may be necessary--that is Bayesian Cas ...

"Editor's note" Nvidia links GPU to machine learning more closely with the release of the Cudnn library, while achieving direct integration of the CUDNN and depth learning frameworks, allowing researchers to seamlessly utilize the GPU on these frameworks, ignoring low-level optimizations in the deep learning system, Focus more on more advanced machine learning issues. By releasing a set of libraries called CUDNN, nvidia links the GPU to machine learning more closely. It is reported that CUDNN can be directly integrated with the current popular depth learning framework. Nvid ...

Bo Main Kin Lane has 20 experience in software development, focusing on API-related areas. The experience of having a custom-write database and using a floppy disk to build a stack of media for the client to install the software was the earliest. Kin Lane is an Internet supporter and most of the work experience is related to it. Kin Lane has a wealth of business development experience in a number of occupations such as programmers, database administrators, architects, product designers, managers, managers, sales and marketing. And this time, he will bring us 22 ...

"Editor's note" Recently, MAPR has formally integrated the Apache drill into the company's large data-processing platform, and opened up a series of large database-related tools. Today, in the highly competitive field of Hadoop, open source has become a tool for many companies, they have to contribute more code to protect themselves, but also through open source to attack other companies. In this case, Derrick Harris made a brief analysis on Gigaom. Recently, Mapr,apache Drill Project founder, has ...

"Editor's note" At present, the major technology giants, including Google, Microsoft and so on are vigorously developing in-depth learning technology, through various ways to dig deep learning talent, Mark Zuckerberg appointed Yann LeCun as director of the Facebook Artificial Intelligence Laboratory. These High-tech companies are exploring a special form of depth learning-convolution neural networks, which lecun more than others for visualizing convolution neural networks. The following is the original: Mark Zuckerberg carefully selected in-depth learning expert Yann LeCun as Faceboo ...

"Editor's note" with the development of deep learning technology, the current depth of learning is not only to understand our language and identify our voices, the United States North Carolina State researchers have established a deep learning system, which can be in an open video game environment with 63% accuracy to predict the player's goals, Lenovo to Google's previous acquisition of 400 million U.S. dollars DeepMind, it is not difficult to find in-depth learning in the field of video games is also increasing competition. Deep learning is now hot, though most of the time we know it can recognize the specific pair in the picture ...

"Editor's note" Deep convolution neural network has a wide range of application scenarios, in this paper, the deep convolution neural network deep CNNs multi-GPU model parallel and data parallel framework for the detailed sharing, through a number of worker group to achieve data parallelism, the same worker Multiple worker implementation models in a group are parallel. In the framework, the three-stage parallel pipelined I/O and CPU processing time are implemented, and the model parallel engine is designed and implemented, which improves the execution efficiency of the model parallel computation, and solves the data by transmits layer ...

"Editor's note" ebay opens up a database technology called Kylin, and ebay shared many of the details of Kylin on a Wednesday blog, providing SQL interfaces and OLAP interfaces based on Hadoop, supporting terabytes to petabytes of data, Kylin is designed to reduce the query latency of Hadoop at more than 1 billion rows of data levels. All this shows that ebay has made good progress in using Hadoop technology. Below: Online auction website ...

This ranking is based on the DB engines list, which analyses 200 different databases on the market, listing top 10. The undisputed top 3 Oracle, MySQL, and Microsoft SQL Server have all along been occupying the first three of the rankings with an absolute advantage, carving out the largest number of users in the market with unique advantages. 1. Oracle 11g First release: 1980 Licensing mechanism: Proprietary SQL: Yes ...

On the afternoon of February 4, 2015, under the guidance of the Ministry of Public Security and the Ministry of Information Technology Informatization, the Third Research Institute of the Ministry of Public Security and other relevant departments, the deep convincing science and technology, NSFocus and the net God Information technology were jointly held by the second generation Firewall standard conference in Beijing National Conference Center. The chief engineer of the Network Security Bureau of the Ministry of Public Safety, Shun Chunming of the Third Institute of the Ministry of Public Security, as well as the senior security experts who are deeply convinced, NSFocus and Guo Qiquan, made an important speech at the meeting. The second generation firewall standard should rise to the national standard Guo Qiquan introduced our country network security development ...

A round of financing amounts to tens of millions of yuan, the B-round financing obtains SIG, Intel invests 50 million US dollar Huayun data, its innovation mode is "the traditional IDC turns the cloud and to the software company carries on the cloud". As a force in the domestic cloud computing industry, the representative of IDC Cloud, CSDN Cloud computing has made in-depth reports on the Huayun data development path, technical means and industrial viewpoints. It is also from the Huayun data enterprise executives, these decades of IDC veterans, we can observe the domestic IDC industry is undergoing drastic changes. Huayun Data Vice President Cao Jie ...

In the use of Team collaboration tool Worktile, you will notice whether the message is in the upper-right corner, drag the task in the Task panel, and the user's online status is refreshed in real time. Worktile in the push service is based on the XMPP protocol, Erlang language implementation of the Ejabberd, and on its source code based on the combination of our business, the source code has been modified to fit our own needs. In addition, based on the AMQP protocol can also be used as a real-time message to push a choice, kick the net is to use rabbitmq+ ...

Recently, China's ICBC headquarters issued the "2014 Server and network equipment (second batch) of the results of the announcement", the announcement, the Tide won the purchase of dual-road and eight X86 the entire share of the server, become the core server of ICBC designated suppliers. Prior to that, the wave server has been China Construction Bank, the Chinese bank and Postal Savings Bank and other large national banks tender purchase orders, the industry accumulated shipments of more than 5000 units. Wave and other local server enterprises in the financial industry share is expanding, not only from the national macro-policy of the favorable guidance, but also from the local enterprises in ...