With the development of science and technology, information collection becomes more and more easy. Coupled with Moore's Law, processing large amounts of data has become possible.
What is big data? Maybe you have thousands of basic information and hundreds of shopping records, but this is not big data. Big Data is at least tens of millions of data records.
What is the role of big data? In fact, data contains various rules. In the Internet age, data is not so intuitive. In addition, with the large amount of data, it is difficult for humans to find rules or associations, however, this does not mean that these laws and relationships will never be discovered. In fact, the rapid development of computers and the Development of machine learning data mining theories have brought about the possibility of mining their laws and establishing appropriate models, we can explore some of the association rules, but I believe that not all of them may have hidden deep patterns in any data. The theory is gradually improved, and technology is also developing rapidly. I believe these problems will be solved one by one in the future.
Many may not have an intuitive understanding of the role of big data. Here are some simple examples. People who have read the big data age may know this example. If you have all shopping records in supermarkets, you may find that many people buy beer when they buy diapers, you put the two together to easily increase sales. In addition, there are many similar examples. Here I will talk about the recommendation system. If you often buy books from Dangdang or Amazon, you will see some books recommended on the website. Many times, the next book you want to buy is in it. This is not accurate to the website, but is actually analyzed based on a large amount of data. For example, 10 thousand of the 1000 users who have bought machine learning introduction, which is much higher than buying other books, if you buy machine learning, the system will think that you are very likely to buy machine learning introduction. At this time, we will recommend this book to you. This is only a recommendation method based on user Purchase Behavior analysis, as well as a recommendation method for product category analysis, which may be more accurate. In fact, 1/3 of Amazon's orders come from its recommendation system.
I feel that big data will change a lot of industries, but it has actually changed many industries.
The traditional transportation industry should be transformed first. You should have noticed the traffic lights on the street. The intervals are the same every day. But in fact, the traffic flows in different ways every day are not the same. Change the red-green interval as appropriate, it may significantly reduce emissions of Vehicle Exhaust and save energy. This is not very difficult to achieve, as long as the existing traffic lights are installed with sensors to measure the traffic flow in different periods. Counting all locations prone to traffic accidents, and then taking appropriate measures in those locations may save the lives of many people. I heard that someone is already doing smart traffic. In addition, big data can also be used as the basis for infrastructure site selection, which can save a lot of costs and even plan bus routes. This is not impossible.
Currently, the data that people can collect only accounts for a very small part of all data, and the information that can be mined is also a small part. In the future, we may obtain unprecedented data with the extensive application of sensors, these data will help us live a better life, and even solve some problems that humans have not yet solved. I feel like AI and big data will be the world in the future.
Big Data I know
