learn big data from scratch

Original: http://zhuanlan.zhihu.com/donglaoshi/19962491 Fei referring to the Big data analytics platform, we have to say that Hadoop systems, Hadoop is now more than 10 years old, many things have changed, the version has evolved from 0.x to the current 2.6 version. I defined 2012 years later as the post-Hadoop platform era, not without Hadoop, but with other sele

Http://www.chinahadoop.cn/page/developerWhat is a big data developer?The system-level developers around the big data platform are familiar with the core framework of the mainstream big data platforms such as Hadoop, Spark, and Sto

Big Data is a collection of data that cannot be captured, managed, and processed by conventional software tools within a tolerable time frame. Big data in the era of Big data, written i

, and then divide them into local files.Classification: Learn from existing classifications and be able to assign to the right categories.Frequent itemsets mining: Requires a project group (the content of a shopping cart in a query session), and determines where individual items usually appear together.Using Mahout for natural language processingApache HcatalogApache Hcatalog is a data table and storage Man

Big data in the next few years development of the key direction, big Data strategy has been in the 18 session v Plenary as a key strategic direction, China in the big data is just beginning, but in the United States has produced h

airline engine flight status, can tell these airlines engine parts need overhaul or maintenance, avoid aircraft accidents, through this service general company generated $ tens of billions of of production value.Now is the best opportunity to learn big data, do not spend a penny can become big

, avoid aircraft accidents, through this service general company generated $ tens of billions of of production value.Now is the best opportunity to learn big data, do not spend a penny can become big Data master, achieve 500,000 annual salary dream.Liaoliang's first Chinese

ObjectiveThere is a big data project, you know the problem area (problem domain), you know what infrastructure to use, and maybe even decide which framework to use to process all of this data, but one decision has been delayed: which language should I choose? (or perhaps more specifically, the question is, what language should I force all my developers and

The popularity of big data makes many people want to develop in this direction and do some work such as data mining and data analysis. But where should I start? How can we quickly learn useful knowledge and skills? I think there are three entry points, which can be selected

The birth of MicroServices is not accidental, it is the product of the rapid development of the Internet, the rapid changes in technology and the traditional architecture can not adapt to fast changes, such as the impetus of the emergence of multiple factors.The birth of MicroServices is not accidental, it is the product of the rapid development of the Internet, the rapid changes in technology and the traditional architecture can not adapt to fast changes, such as the impetus of the emergence of

Kong: Big Data analysis processing and user portrait practiceLive content is as follows:Today we're going to chat about the field of data analysis I've been exposed to, because I'm a serial entrepreneur, so I focus more on problem solving and business scenarios. If I were to divide my experience in data analysis, it wa

problem tangled for a long time (MySQL data old cause program memory bloat, parallel 2 direct system is down), also went to see a lot of source code only to find the miracle is here, finally through the MySQL document confirmation, and then tested, parallel multiple, and the amount of data is more than 500W, does not cause memory bloat, the GC is all right, and the problem is finally over.After reading the

This article is the 6th in a series of Python Big Data and machine learning articles that will introduce the NumPy libraries necessary to learn Python big data and machine learning.The knowledge you will be able to learn through t

Look at the algorithm theory of business intelligence software data mining often feel some formula derivation process such as Heavenly Book general, for example, look at the mathematical proof of SVM, EM algorithm:, the sense of knowledge jumps relatively big, then the data mining system learning process is how?Ax There are a few things you should know before you

features of the input data, which can be used to represent each sample in a compact manner, resulting in a richer generalization. The source power of these algorithms is mainly from the field of artificial intelligence, the overall goal of AI is to simulate the human brain's ability to observe, analyze, learn and make decisions, especially to deal with extremely complex problems.Deep learning is primarily

First knowledge of HadoopPrefaceI had always wanted to learn big data technology in school, including Hadoop and machine learning, but ultimately it was because I was too lazy to stick with it for a long time, plus I was prepared for the offer, so the focus was on C + + (although C + + didn't learn much), Plan to have

the vegetables are finished, you can take the knife to kill the chicken. As long as everyone obeys your mother's assignment, everyone can have a pleasant cooking. You can think of the big data biosphere as a kitchen tool ecosystem. In order to do different dishes, Chinese cuisine, Japanese cuisine, French cuisine, you need a variety of different tools. And the needs of the guests are complicating, and you

developers, data scientists, and statisticians. There are many tools to assist in big data analysis, but the most popular one is Python. Why Python? Python is easy to use. This language has an intuitive syntax and is also a powerful multi-purpose language. This is important in the big

Build your own big data platform product based on Ambari Currently, there are two mainstream enterprise-level Big Data Platform products on the market: CDH launched by Cloudera and HDP launched by Hortonworks, among them, HDP uses the open-source Ambari as a management and monitoring tool. CDH corresponds to Cloudera M

About nine types of technology and their fields. Then, since there is a meal, there must be cooking. So the big data technology structure selection, must have at least three kinds of components (source, calculation, storage)The simplest data processing architecture:The least unit of data processing scheme, of course th