Massive Amount Of Data

The author of this article, Shesu is Admaster data mining director, Cloud computing practitioners, 10 data warehousing and data mining consulting experience, is focused on the distributed platform of mass data mining and machine learning. The following is the full text of the article: with the Internet, mobile Internet and the development of things, no one can deny that we have effectively ushered in a massive data era, IDC, a data-research firm, expects 2011 data to reach 1.8 trillion GB, and the analysis of these massive data has become a very important and urgent requirement. As an Internet number ...

Microsoft recently announced the development of a open-source version of Hadoop compatible with Windows Server and Windows Azure platform. IBM announced the creation of a new storage architecture on Hadoop to run DB2 or Oracle databases as a cluster to enable applications to support high-performance Analytics, data warehousing applications, and cloud computing purposes. EMC has also launched the world's first custom, high-performance Hadoop dedicated data processing equipment--greenplum HD Data computing equipment, providing customers with the most powerful 、...

As a long history of development and relatively mature ecosystem, radio and television industry plays an important role in the process of China's modernization construction. However, with the rapid development of the communication carrier and the content of the Internet, especially the social network of micro-blog and micro-credit and the new media, the impact on the traditional radio and TV system is more and more obvious. So, in the context of the big Data era, how to deal with radio and television? How to choose a suitable platform? 　　How to tap and use large data technology to achieve "network linkage" to provide more quality services? To this end, the dawn with a solid large number ...

Large data processing technology is changing the current operating mode of the computer. We've got a lot of revenue from that because it's the big data processing technology that brings us search engine Google. 　　But the story is just beginning, and for several reasons, we say that large data processing technology is changing the world: * It can handle almost every type of data, whether it's microblogging, articles, emails, documents, audio, video, or other forms of data. 　　* It works very fast: practically in real time. * It's universal: because it's ...

This article describes ways to perform large data analysis using the R language and similar tools, and to extend large data services in the cloud. In this paper, a kind of digital photo management which is a simple and large data service is analyzed in detail, and the key elements of searching, analyzing and machine learning are applied to the unstructured data. This article focuses on applications that use large data, explains the basic concepts behind large data analysis, and how to combine these concepts with business intelligence (BI) applications and parallel technologies, such as the computer Vision (CV) and ... as described in part 3rd of the Cloud Extensions series.

With the development of cloud computing, the new data (position, state, what you see, what you hear, what you think, what you say ...) is produced every day and every second of everything in the world. have been able to be more complete and rich in digital, and all linked to the Internet. As I've said, Cloud computing is the biggest technology trend and the new generation technology based on the Internet. Broadly, in addition to the infrastructure level of new hardware and data centers, distributed computing, massive data storage and processing technology, but also includes more communication between people (social network), terminal equipment diversification (shift ...).

The development of new concepts and new technologies, such as cloud computing and Gengjiguang, which is based on HBase, has promoted the rapid growth of data center construction, and a large amount of energy consumption equipment will produce large-scale energy consumption data. Aiming at the storage problem of the data of massive energy consumption data center, a large scale distributed data storage architecture based on HBase is proposed, which realizes the storage system of the data center massive energy consumption data by using the distributed database HBase. Experimental results show that the system has good usability, scalability and storage query efficiency. Based on HB ...

Research on development model of massive data extraction in large data age Ron Hu Zhigang Lin with the advent of the cloud era, the current focus and research on large data is getting higher, and large data is often used to describe a large number of unstructured and semi-structured data, and as large data growth increases, the volume of data is increased, Data redundancy will be more and more, the traditional data software analysis model can not meet the needs of the processing and analysis of massive information, how to extract effective information from large data, effective analysis of data.

The rapid expansion of enterprise data, the challenges of massive storage is becoming more severe. For users in a wide range of industries, explosive growth of massive amounts of data is flooding their storage systems. At the same time, the data security requirements of various industries are increasingly high. In particular, video surveillance, High-performance computing and other industries, not only the storage system capacity, reliability requirements are increasing, but also for the transmission bandwidth has put forward higher requirements. Now, as a new technology concept, cloud storage is changing the way of providing and using traditional storage, and also has a far-reaching impact on the storage industry. Recently, the innovation division after long ...

Massive data overwhelm "traditional security" information technology has penetrated into every industry and business functional area and is becoming an important productivity. 　　But this does not seem to have the benefit of network security management, the increasing equipment and network behavior has produced a huge amount of data difficult to control, and relying on human or traditional threat monitoring technology, will make the management efficiency and the threat of the outbreak of the more distant. The traditional security scheme is to prevent malicious behavior, such as network firewall, intrusion defense system or anti-virus software by monitoring network traffic or system operation, which requires systematic re ...