Course preview: Big Data real-time processing system Apache Storm

Source: Internet
Author: User


650) this.width=650; "src=" Http://storm.apache.org/images/logo.png "class=" logo "alt=" logo.png "/>

Storm provides a common set of primitives for distributed real-time computing that can be used in "streaming" to process messages and update databases in real time. This is another way to manage queues and worker clusters. Storm can also be used for "continuous computing" (continuous computation), which makes continuous queries on the data stream, and outputs the results as streams to the user at the time of calculation. It can also be used for "distributed RPC" to run expensive operations in parallel.
Storm can easily write and extend complex real-time computations in a computer cluster, and storm is used for real-time processing, as Hadoop is for batching. Storm guarantees that every message will be processed, and it will soon-in a small cluster, can process millions of messages per second. What's even better is that you can use any programming language to develop.


=====apache Storm Course Outline =====

I. Overview of the course
(*) Course overview
(*) build a Linux virtual machine environment

(*) Zookeeper Introduction and environment construction


ii. Overview of Storm
(*) What is storm and flow calculation
(*) Storm's architecture and operating mechanism
(*) installation configuration storm and common commands
(*) Demo Demo: Wordcounttopology

Three, Storm case analysis
(*) WordCount Data Flow analysis
(*) Realization of Wordcounttopology
(*) Deployment run Wordcounttopology

Iv. internal principles of storm
(*) The process of the Storm cluster task submission
(*) internal communication mechanism of storm cluster

v. Integrated Storm and Apache Kafka
(*) Apache Kafka Introduction and environment building
(*) integrated storm and Apache Kafka

VI. integrated Storm and Apache HDFS
(*) Apache Hadoop Introduction and environment building
(*) integrated storm and Apache HDFS

VII. integrated Storm and Apache HBase
(*) Apache hbase Introduction and environment building
(*) integrated storm and Apache HBase

VIII. integrated Storm and Apache Hive
(*) Apache hive Introduction and environment building
(*) integrated storm and Apache HBase

ix. integrated Storm and Redis
(*) Introduction to REDIS and environment building
(*) Integrated storm and Redis

10. Integrated Storm and JDBC
(*) Integrated storm and JDBC


This article is from my blog blog, so be sure to keep this source http://collen7788.blog.51cto.com/2788082/1903142

Course preview: Big Data real-time processing system Apache Storm

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.