Big data from no one to talk about, to the current hype, what is big data, for data analysts, what does it mean? Google search for "Big Data", you will get 19,600,000 results, and the use of the same words, two years ago you almost did not search for anything, and now big data content has been hyped, the content is more dazzling. These are mainly from IBM, McKinsey and Reilly, most of which are based on marketing purposes, are not familiar with the real situation, and some are even completely wrong. I ask myself, what does big data mean for data analysts? Progressive side of the body now, the concept of big data is transforming the culture of the internal organization, challenging the "business intelligence", and promoting the "Analysis" consciousness. Innovative technologies based on big data can be easily applied to a variety of environments like data analysis. It is worth mentioning that the enterprise organization through the application of advanced business analysis, the business will become more extensive, more complex, more valuable, and traditional website analysis of the attention will be reduced.
Definition of Big Data
What is "big data" does not have a uniform definition at the moment. Wikipedia offers a bit of a clumsy and incomplete definition: Big data refers to the magnitude of the volume of data involved that cannot be captured, managed, processed, and collated into the information that people can interpret within a reasonable amount of time through mainstream tools.
IBM offers a full, easy-to-understand overview:
Big Data has the following three features: Mass (Volume), high speed (velocity) and diversification (Variety). Large volumes of big data are bulky. The company is flooded with data, and information is reaching terabytes, even petabytes, at all levels. High-speed big data is often time-sensitive. In order to maximize its business value, big data must be used in a timely manner.
Diverse big data goes beyond structured data, including all kinds of unstructured data, such as text, audio, video, clickstream, log files, and so on, all of which can be part of big data. MSDN's Blaine Smith added 4th on IBM: Variability data can be interpreted in different ways. Different problems require different interpretations.
What does big data mean for data analysts?