Online Trends

Large flow of log if the direct write Hadoop to Namenode load, so the merge before storage, you can each node log together into a file to write HDFs.  It is synthesized on a regular basis and written to the HDFs. Let's look at the size of the log, 200G DNS log files, I compress to 18G, if you can use Awk Perl, of course, but the processing speed is certainly not distributed as the force. Hadoop Streaming principle Mapper and reducer ...

A few years ago, cloud computing in China is still a new product, the "cloud" era is a misty vision. There was a lot of cloud computing that was about to quietly change the way people live: Online office is the kind of work that has to be done in an office where there is a traditional internet. Because the cloud computing model lets the individual no longer be subject to the application software, the storage data or even the hardware restriction, lets "the ubiquitous network" become "the everywhere computer". Cloud storage requires only one account and password, and far below the price of a mobile hard drive, it can be used anywhere with the internet than the mobile hard drive ...

Research on energy-efficient data acquisition technology in Mobile cloud computing Yin Sheng This paper, based on the analysis of data acquisition mechanism in mobile cloud computing environment, in this paper, the data caching technology, data prefetching technology and data replication technology in data acquisition are studied in three aspects, based on the research actuality and practical application at home and abroad. and put forward the corresponding energy-saving strategy, mainly includes the following three aspects of work: (1) Data caching technology: Through the traditional replica replacement algorithm research and analysis, according to the traditional strategy, and the United States, Ohio State University professor Zhang Lirs (...

By the Chinese Academy of Sciences "Internet weekly" and the China Academy of Social Sciences Information Research Center hosted the 2013 China Internet Economic Forum and "Gold I Award" awards ceremony held in Beijing on December 12, will be on the Wuxi Huayun Data Technology Services Co., Ltd. won the 2013 Best cloud computing Products Provider Award. As the award-winning organization, the China Internet Economic Forum has successfully hosted 11 sessions since 2003 and has become the most influential annual event of the Internet industry in China, representing all walks of life who are reborn as the best innovation in the network. Award of "Gold I" ...

Web application and development based on Gae Cloud computing Nanjing University of Posts and Telecommunications Qin This paper studies The cloud Computing, explores and analyzes the advantages of cloud computing and develops a mobile cloud application example. Firstly, the concept, classification and key technologies of cloud computing are introduced in detail. Secondly, the current mainstream of cloud computing platform providers do in-depth research and focus analysis, through comparison, choose Googleapp engine as a development platform. Then, according to the characteristics of today's web programs, we put forward the NASA test ideas and mobile cloud meters ...

According to Yahoo News reports, Midori is secretly developed within Microsoft, a cloud-based services based on the non-Windows operating system, for various reasons, Midori was hidden by Microsoft Snow. However, the latest news shows that Midori has been recognized by the company's management, was assigned to Microsoft Executive Vice President Trie Meiersen led the unified Operating system group, system development has entered the final stage. Microsoft non-Windows operating system Midori project is expected to reboot (photo from wikiped ...

Dalberg, President of the Asia Cloud Computing Association in November 2013, said that in 2015 cloud computing would bring 14 million jobs, about 10 million of which are in China. Its push for it innovation is expected to generate 1.1 trillion of dollars in new business revenue each year, and in Europe 2% of GDP is expected to come from cloud computing innovation by 2020. Cloud computing becomes the cornerstone of the IT industry why does cloud computing contribute so much to China's information and communications industry? From the industrial structure, the various parts of it have evolved from the 2010 to gradually connect to a whole ...

Application of cloud computing technology in building regional agricultural science and technology open access platform Li Xiaojing based on the analysis of the current research situation and development trend of agricultural OA platform at home and abroad, this paper integrates the technology OA resources of Qingdao area, puts forward the conception of the highly interactive OA platform of agricultural technology based on cloud computing technology, and expounds in detail the service layer of infrastructure, The architecture of Platform service layer, application service layer and cloud client. The construction of the platform can not only integrate the information of the Qingdao Agricultural Research Institute, but also provide information service for the scientific research institutes and Qingdao grass-roots technology extension personnel and farmers.

The concept of a family cloud has been frequently mentioned, and it is still to be said from his fundamental concept of cloud computing. Cloud computing has been a very hot-burning word in the last few years, and it doesn't seem to be a fashionable it person to say a few words about cloud computing. Although for ordinary people, it is not clear what cloud computing can bring to us, but in daily life, every time we surf the Internet to search information, every time the mobilization of Internet resources, and this concept has a close relationship. With more and more only mobile phones, Pad, PC and other personal intelligent terminals chant widely used, the concept of interconnection before ...

The coming 2013 is considered to be a "year of big Data" with a trans-era significance. In this year, the data is more precious than ever, and even become a new energy source comparable to the oil resources, the big data is considered as the information and the Internet after the whole revolution of the message again peak. However, large data is not a slogan, and more enterprises need to be put into practice to dig out the potential value from the monotonous data. A survey earlier this year pointed out that 28% of global companies and 25% of Chinese companies have started to practice big data. In order to further understand the real situation of large data application of Chinese enterprises ...

Study on meteorological information Service system based on cloud computing model Wang Yu Zhang to efficiently integrate the calculation, storage and communication resources dispersed in meteorological stations and regional security centers, to solve the problem of the inconvenience of meteorological data, the timeliness of numerical prediction and the low resolution in the aviation meteorological guarantee work, The framework of meteorological information Service system based on cloud computing model is presented. This paper introduces the structure and function of the system, describes the detailed design of the system in 3 levels, gives the realization scheme of the core service components, and analyzes the system with the current situation of aviation meteorological guarantee. The results show that,...

Airlines cloud computing application Analysis Huangsongxiang cloud computing is a delivery and usage model of IT resources, which means acquiring the hardware, platform, software, and services needed, on an as-needed and scalable basis, across the network, including the Internet and intranet intranets. Cloud computing has the advantages of fast construction, low cost, flexible investment, easy to realize data sharing between different equipments and applications, and greatly enhances the utilization efficiency of IT resources, so it is sought after by various industries. Airlines Cloud computing Application analysis

Cross-pipe integrated application in large data era cloud platform Xu Wenbin Big Data Change the way we work, live and think, cloud change is it consumption patterns, the large data era unified construction of integrated application cloud platform, on demand for the provinces, regions, distribution of resources, provide services, will be a landmark development in the construction of public security information management. Through the elaboration of the concepts of large data, cloud computing and virtualization, this paper introduces the application of Internet advanced cloud platform, and puts forward the idea of implementing cloud Platform for future traffic management. A cloud platform for cross-pipe integrated application in large data age

Recently, VMware announced that it will continue to actively participate in and lead the OpenStack community. VMware is once again among the top ten contributors to the OpenStack, while extending the scope of contributions to computing, networking and storage. "The OpenStack itself is a framework that enables customers to leverage different computing, network, and storage technologies to build the cloud," says John Gilmartin, vice president of VMware Cloud infrastructure. Whether consumers or operators, the use of OpenStack to build the quality of the cloud in a large extent ...

The application of cloud computing in University Computing Center Guo Yao with the development of the national higher education, all the universities have established computer software and hardware laboratories such as computing center. Due to the rapid progress of computer technology, computing center is facing problems such as unbalanced utilization of hardware resources, large amount of hardware and software maintenance and outdated performance. Cloud computing through the Internet to provide users with resource virtualization solutions, with strong data processing capabilities, high equipment reliability and relatively inexpensive equipment input, flexible scalability and so on, to solve the above problems provide a flexible solution. &nb ...

The framework of enterprise IT decision-making mechanism in the background of cloud computing Yang Yikang The different application levels of cloud computing will affect the enterprise's it decision in varying degrees, and the corresponding IT decision mechanism will change accordingly.  This paper deeply analyzes the impact of the three-tier service model of cloud computing on it decision making, and proposes the framework of IT decision mechanism based on cloud computing background. And through the successful implementation of cloud computing enterprise case Analysis and validation of this paper to draw the framework of it decision-making mechanism ....

Research on distributed processing of network monitoring information flow based on Hadoop Chen Guoliang A new method of distributed cluster processing based on Hadoop cloud computing framework is proposed for the monitoring of information flow of large data sets in intelligent power grid dispatching system. By analyzing the characteristics of information flow in power grid monitoring system, extracting 3 kinds of critical information flow, using the Distributed File system HDFs and Mapping aggregation model Map/reduce, establishing the distributed processing platform of Cluster group, and realizing the high efficient parallel processing of the monitoring data. Taking the data set of section measurement record of a distribution network as an example.

Recently, the National Information Technology Standardization Technical Committee cloud Computing Standard Working Group and China Electronic Technology Standardization Institute jointly held the "Third China Cloud Computing standardization Conference." As a result of the outstanding contribution to the national standard setting process of the cloud Computing data Center Reference Architecture, the Universal Data (GDS) (the group leader Unit for this standard) was selected by the cloud computing standards team as an excellent unit, and the GDS Senior consultant Li was awarded the Outstanding Individual Award as the main creator of the cloud Computing data Center Reference Architecture. Cloud computing Standardization Seminar has been committed to China's cloud computing software technology, production ...

Research and application of cloud Manufacturing resource service platform for coal mine equipment Wang Xuewen Yang Shaojian Dinghua Chere Shi Rimin Li Huaiwen to solve the demand for design resources of coal machine equipment design and manufacturing enterprises, based on the analysis of regional industry demand, this paper expounds the necessity and design features of the establishment of "coal mine equipment cloud Manufacturing Resource Service Platform", describes "platform" architecture , Key technologies and development tools, the paper studies the design method of "platform", and describes the three functional systems of "platform", including general technical support system for general mechanical equipment and Technical Service support Department for coal mine equipment.

Real-time, accurate recommendation based on large data Tencent data Platform Department Precision Recommendation Center Schoewe 2013.12 • Introduction • Data • Algorithms • Real-time precision recommendations on large data systems