Red and black with large data

The world is entering the second movement of the IT revolution and globalization-the "cloud age". Through the Internet, the huge computing and storage functions of data centers cover every corner of the world like clouds. Today, both businesses and individuals can transcend borders to facilitate and free access to high-performance cloud computing systems, and the environment for human life, work and entrepreneurship has suddenly drastically change.

-Step into the cloud era, Zhou

This is a world of peril. After the US subprime crisis of 2008, the European sovereign debt crisis followed. The United States and Europe's two 9374.html "> The world economy's leader is hovering on the brink of recession, Asia's Japan economic situation is not optimistic, terrible, people can not see the way out of the crisis." The BRICS countries, while showing a bright eye, are hardly immune from the acceleration of global integration. The world seems to be shrouded in a gloomy mood. People can't help asking, where is the hope?

In fact, every system, every mode, although it is an abstract concept, but also like the specific items, will wear out, degradation. Throughout history, these old ways of life and production, ultimately can not escape the fate of being eliminated. What really brings change is the innovation and development of science and technology. This means that when people are confronted with a crisis, they need new directions and motivations, rather than tinkering with aging parts. Just as, riding across Eurasia takes too long, if the eye is always changing a better horse, or let the existing horse run faster, after all, only the benefits of the plan. What humans really need is today's cars, high-speed trains, airplanes. After the advent of the Internet, if people just want to talk, then there is no need to cross the continent, the sea, because the network makes geographical distance completely negligible.

Today, the hottest topic is cloud computing and big data. Expectations of this change can be matched by an industrial revolution. People often feel that the technology is inscrutable, distant from their own, but in fact, the era of large data has quietly penetrated into all aspects of our lives. The area where large data is first applied may be the consumer sector, followed by telecommunications. Telecoms providers are trying to use large data to optimize the use of their capital equipment.

The application foreground of large data

Big data is already deeply rooted in the consumer sector. The field first uses large data, because the use of large data in this area is more convenient, does not need to be regulated, and consumer software is written faster than other software. For example, if you buy a book on Amazon, Amazon will recommend another book to you based on the comments of other buyers. In the past few years, it is consumers and consumer-oriented software that has led the development of large data industries, and people's own ideas have converged on data. Game companies create a variety of virtual products, using large data to analyze consumer purchases of virtual products. For example, the game company determines whether it is raining outside by using the number of virtual umbrellas that people buy. It can be seen from here that there is a very interesting connection between the virtual world and the real world.

The use of large data areas can involve all aspects of life. GE has an industry internet vision that mentions how to connect parties, how to get information from jet engines and car engines, and how to ensure that these large industrial systems are optimally run. The use of large data in the industry may be more important. At the same time, the use of this aspect really can change the nature and appearance of the product, will eventually change the world.

Typically, two aircraft engines produce 5T of data during flight. If the system can analyze this information and pass the information on to the pilot before the pilot discovers that the engine is out of control or other errors, inform him of the engine's state of operation and whether there are other problems, the flight safety can be further improved. It is very important that all the information in the voyage can be informed in due time, it can save a life, which is especially meaningful today. In addition, in the Health care field, large data can be combined with the different characteristics of each person, helping to create better medical solutions.

There's a lot of data, but it's useless. It is either worthless or directly wrong. Technologies that use large data need to address data cleanup issues. The first thing to take data is to clean up the data. Even before you take the data out of the data source and put it in storage, make sure that the data you entered is valid. Sometimes you have to filter out 5% of the data, and sometimes you even ignore 95% of the data, because the data is too complex. People should not store data you don't need, which is wasteful. Today's technology can help you break down one thing into multiple steps so that people can get rid of many of the data you don't need before they are stored and processed.

Many companies want to be among the big data changes. Many people think that what they need to do is take all the data they can get. This is actually not economical because the volume of data is too large. So you need to be more specific about your needs. Like you're baking a cake, you might want to add a variety of condiments, but you won't put chili peppers in it because it's not related to baking cakes. So, to solve a problem based on big data, you want to get rid of irrelevant data and focus on the valuable data.

There is a very interesting place about big data. The name "Big Data" comes from two aspects. On the one hand, it comes from a variety of data, which is why we call it big data. On the other hand, it originates from the disorder of the data. In the past, computers can only handle data entered in one form. When you enter the wrong data form, you have to readjust it. The essence of large data is the ability to handle data that is not necessary. Since people and businesses have begun to deal with unstructured data, they have invented new technical tools, such as distributed computing. These new technology tools enable people to store data in unstructured form.

Because of the variety of data, you can't always take a host, or browse through a supercomputer. What you have to do is resolve the big problem into a series of small problems, and then use a more efficient computing system to one by one of these small problems. This is the parallel operation. In fact, if you go to Google's data center, you can't even see a host, you see a lot of the same motherboard as your computer. The area that is being explored is the ability to merge the big issues into small problems and then combine the results.

There are a lot of ideas and big plans for using large data, but in order to do that, you first need a big operation. The crux of the matter is how to build a much more efficient computing system than a computer made in the 70 's. People use cloud computing to make big calculations. Cloud computing makes it possible to assemble infinitely large processing power, even with inexpensive components. People no longer need to buy a new motherboard because a data center or all the computers in multiple data centers can be used for me in the cloud. How much processing power you want, how much you can get, all of a sudden, you have to deal with thousands of hard drives and motherboards. When you no longer need the processing power, you put them back where they were. The center of the cloud is constantly running. It is important to ensure that the operation is smooth, and this is also the direction of research and development of new technology.

If everyone starts to rely on the system, then there is a need to ensure adequate processing capacity. Just like, in the hot summer, people need to ensure that all air-conditioning systems in the city power supply. If there is an accident, so that everyone can not use air-conditioning, it is people do not want to see results. In computer operation, utility calculation is the "supply". Public energy companies provide us with electricity, water and other energy, and cloud computing companies provide us with computing power. In the past, if a company wanted a large software, it needed to buy tons of servers. Today, people don't need to buy as many servers because they can rent or buy virtual servers from a company that operates on computing.

Everyone is worried about website hackers, fear of data leaks. Imagine a cyber hacker attacking the Beijing grid, either for mischief or for the purpose of a terrorist attack, to crash the power system in Beijing.

The field of data security, in fact, is a battlefield of smoke, but people are not necessarily clear. In this battlefield, there are good people who try to protect data security, as well as hackers and bad people who attempt to break into the data system. Villains, outsmart, this is an endless problem. Technology companies have to step forward to ensure that the technology they have is ahead of hackers and software terrorists who want to destroy data. While there are many ways to break into a computer system, people need to be aware of it when the system is really compromised. Previously the virus was the only source of such harm, but unfortunately, there are so many sources.

In general, the good has the upper hand when it comes to measuring the risk of data abuse and the usefulness of the data. All it takes is to make sure that the data is protected. E-Banking is a classic example. That's a scary thing to think about, because people can also break into your electronic bank and steal your money. But can your life now be free of electronic banking? Now it's too late for us to think about turning back. You don't want a car accident on the road, but you're less willing to give up driving. Therefore, the industry will eventually create a lot of products to ensure that the data is not violated, and ensure that all aspects of security.