Big Data Skills Atlas

The following is the Big Data skill Atlas published by Stuq, which is more practical and useful for reference.

Big Data Processing Framework

Spark
-RDD
-Spark SQL
-Spark Streaming
-MLLib

Hadoop
-HDFS (Distributed File System)
-Mapreduce(computational framework)
-Yarn(Resource management platform)
-Pig(piglatin statement to MapReduce Mapping)
-Hive(Data Warehouse, SQL available)
-Mahout(MapReduce Implementation Library for machine learning algorithms)

Kafka
Storm
ELK
-ElasticSearch
-Logstash
-Kibana

Database

-SQL
-MySQL
-MongoDB
-Cassandra
-Redis
-SQLite
-BSDDB
-HBase

Programming languages

-Python
-R
-Ruby

Data analysis and mining

-MATLAB
-SPSS
-SAS

Visualization of data

-R
-D3.js
-Echarts
-Excle

Artificial intelligence

-Clustering
-Time Series
-Recommended system
-Regression analysis
-Text Mining
-Decision Tree
-Support Vector Machine
-Bayesian classification
-Neural network

Algorithm

consistency
-Paxos
-Raft
-Gossip

Data structure
-Stacks, queues, linked lists
-Hash Table
-Two fork tree, red black tree, B-Tree
-figure

Common algorithms
-Sort ( insert sort, bucket sort, heap sort, quick sort)
-Maximum sub-array
-Longest common sub-sequence
-Minimum Spanning tree
-Shortest Path
-Storage and operation of matrices

Cloud computing

-Cloud Services (SaaS, PaaS, IaaS)
-Openstack
-Docker

Big Data Skills Atlas