NoSQL: How developers respond to large data-products and technologies

At present, large data is the hottest trend in the field of High-performance computing. Large data processing is characterized by: we need real-time collection, analysis, transmission of massive information, data set to PB or even ZB (1 million PB) as a unit, the large number of developers to bring new challenges, talking about large data, can not help but say Hadoop and NoSQL.

NoSQL is the darling of today's non-relational database

NoSQL is a distributed, large-scale data management database system, in the interconnection network of massive data management, has a very good performance. Today, companies are demanding more and more of the Internet's massive data, high availability, large throughput, low latency, high data security, and the business of the low peak time is getting shorter, storage capacity expansion, downtime adjustment is difficult to accept, the smooth expansion, automatic failover requirements also come. Enterprise IT developers can deal with and resolve these contradictions by deeply developing nosql systems.

NoSQL (NoSQL = not just sql), meaning that the anti-SQL movement, is a new revolutionary database revolution, it was suggested early on, the trend of development to the 2009 has become increasingly high. NoSQL advocates of the use of non relational data storage, compared to the current overwhelming use of relational databases, this concept is undoubtedly a new thinking of the injection.

Today's computer architectures require a huge level of scalability in data storage, and NoSQL is committed to changing the status quo. Google's BigTable and Amazon's Dynamo are using NoSQL databases.

The name of the NoSQL project does not see anything in common, but they are usually the same in some ways: they can handle huge amounts of data.

The revolution still needs to wait. True, NoSQL is not mainstream for big businesses, but it's likely to change in a year or two. At the latest gathering of the NoSQL movement, 150 people from around the world packed a conference room in CBS Interactive. Share how they overthrow the tyranny of slow and expensive relational databases, and how to manage data using more efficient and inexpensive methods.

"Relational databases impose too many things on you. They want you to force the modification of object data to meet the needs of RDBMS (relational database management system, relational DBMS), "as NoSQL proponents see, NoSQL alternatives" Just give you what you need.

NoSQL is a generalized definition of non relational data storage. It breaks the long-standing situation that relational database and acid theory unification. NoSQL data storage does not require a fixed table structure, and there is usually no connection operation. In large data access has a relational database unmatched performance advantages. The term was widely recognized at the beginning of the 2009.

Hadoop is the best solution for massive data analysis

The development of Hadoop has basically gone through a process: from an open source Apache Foundation project, as more and more users join in, continue to use, contribute and improve to form a strong ecosystem, starting from 2009, with cloud computing and large data development, Hadoop, the best solution for massive data analysis, began to be the focus of many it vendors, resulting in many business versions of Hadoop and products that support Hadoop, including software and hardware.

Hadoop is a software framework that enables distributed processing of large amounts of data. But Hadoop is handled in a reliable, efficient, scalable way. Hadoop is reliable because it assumes that the compute element and store will fail, so it maintains multiple copies of the work data, ensuring that the processing can be redistribution for failed nodes. Hadoop is efficient because it works in parallel and speeds up processing through parallel processing. Hadoop is also scalable to handle PB-level data. In addition, Hadoop relies on the community server, so its cost is low and can be used by anyone to apply to various industries.

Qcon Global Software Development Conference

From April 18, 2012 to 20th, the Qcon Global Software Development Conference (Beijing Station), hosted by the Infoq Chinese site, will focus on the focus of NoSQL and large data developers.

Qcon the world's top technology event, held annually in London, Beijing, Tokyo, New York, Sao Paulo, Hangzhou and San Francisco. Since its first hosting in March 2007, there have been nearly million architects, project managers, team leaders and senior developers from the traditional manufacturing, finance, telecommunications, Internet, aerospace and other fields to attend the Qcon conference.