Bi Programming Languages

In January 2014, Aliyun opened up its ODPS service to open beta. In April 2014, all contestants of the Alibaba big data contest will commission and test the algorithm on the ODPS platform. In the same month, ODPS will also open more advanced functions into the open beta. InfoQ Chinese Station recently conducted an interview with Xu Changliang, the technical leader of the ODPS platform, and exchanged such topics as the vision, technology implementation and implementation difficulties of ODPS. InfoQ: Let's talk about the current situation of ODPS. What can this product do? Xu Changliang: ODPS is officially in 2011 ...

Google created a mapreduce,mapreduce cluster in 2004 that could include thousands of parallel-operation computers. At the same time, MapReduce allows programmers to quickly transform data and execute data in such a large cluster. From MapReduce to Hadoop, this has undergone an interesting shift. MapReduce was originally a huge amount of data that helped search engine companies respond to the creation of indexes created by the World Wide Web. Google initially recruited some Silicon Valley elites and hired a large number of engineers to ...

As data grows in hundreds of terabytes, we need a unique technology to address this unprecedented challenge. Big data analysis ushered in the great era of the global organizations of all walks of life have realized that the most accurate business decisions from the facts, not a figment of the imagination. This means that they need to use the decision model and technical support based on data analysis in addition to the historical information of the internal trading system. Internet-clicked data, sensing data, log files, mobile data with rich geospatial information and various kinds of comments involving the network have become various forms of mass information. ...

As data grows in hundreds of terabytes, we need a unique technology to address this unprecedented challenge. Big data analysis ushered in the great era of the global organizations of all walks of life have realized that the most accurate business decisions from the facts, not a figment of the imagination. This means that they need to use the decision model and technical support based on data analysis in addition to the historical information of the internal trading system. Internet-clicked data, sensing data, log files, mobile data with rich geospatial information and various kinds of comments involving the network have become various forms of mass information. Have a great ...

As two of the most popular technologies in the field of information management, the hardware architecture of database integration machine and large data technology is basically the same, but the software system has the essential difference, which leads to the different characteristic performance. With the rapid growth of enterprise data and the continuous improvement of users ' requirements for service level, the traditional relational database technology has shown obvious lack of ability in production practice for a long time. How to obtain high availability of massive data at reasonable cost has become a major challenge in modern it field. In order to meet this challenge, in recent years, it market ...

"51CTO exclusive feature" 2010 should be remembered, because the SQL will die in the year. This year's relational database is on the go, and this year developers find that they don't need long, laborious construction columns or tables to store data. 2010 will be the starting year for a document database. Although the momentum has been going on for years, now is the age when more and more extensive document databases appear. From cloud-based Amazon to Google, a number of open-source tools, along with the birth of Couchdb and MongoDB. So what ...

Large data areas of processing, my own contact time is not long, formal projects are still in development, by the large data processing attraction, so there is the idea of writing articles. Large data is presented in the form of database technologies such as Hadoop and "NO SQL", Mongo and Cassandra. Real-time analysis of data is now likely to be easier. Now the transformation of the cluster will be more and more reliable, can be completed within 20 minutes. Because we support it with a table? But these are just some of the newer, untapped advantages and ...

Hadoop is very hot, but what is Hadoop? In fact, it is not a specific software. Hadoop is a project of the Apache Software Foundation, which contains a number of core tools for handling massive data and large compute clusters. Around Hadoop, there is a huge ecosystem, and there are a lot of packaged business solutions that we usually call the Hadoop release (Hadoop distribution), such as Cloudera, Hortonworks, IBM ...