A Platform Environment Introduction:1. System Information:
Project
Information
System version:
Ubuntu14.04.2 LTS \ \l
User:
*****
Password:
******
Java environment:
Openjdk-7-jre
Language:
en_US. Utf-8,en_us:en
Disk:
Each VDA is the system disk (50G) and VDB is mounted in the/storage directory for the data disk (200G).Hcloud15 the most DB, the second disk is 2000G
1.Jdkthe installationrefer to the installation of the JDK here. 2.installationZookeeperrefer to my The "Fully distributed" section of the Zookeeper installation tutorial. 3.installationKafkarefer to my The "Fully distributed Build" section of the Kafka installation tutorial. 4.installationFlumerefer to my Flume Installation Tutorial. 5.ConfigurationFlume5.1. ConfigurationKafka-s.cfg$ cd/software/flume/conf/
Zookeeper + kafka cluster Installation
Prepare three VMS. The system is RHEL64.1) the configuration of each machine is as follows:
$ Cat/etc/hosts
...# zookeeper hostnames:192.168.8.182 zk1192.168.8.183 zk2192.168.8.184 zk3
2) install jdk, zookeeper, and kafka
", " timestamp": "Timestamp at consumer startup"} example:{ "version": 1, "subscription": { "Replicatedtopic": 1 }, "pattern": "White_list", "timestamp": "1452134230082"}8. Consumer Owner/consumers/[groupid]/owners/[topic]/[partitionid]-consumeridstring + ThreadID index numberWhen consumer is started, the action that is triggered:A) First, "Consumer ID registration";b) then register a watch to listen for the " exit " and " join " of the other Consumer in the current grou
Decoration in ...KafkaNew TopicBin/kafka-topics. sh --create--zookeeper localhost:218131 --topic my-topicView a list of existing topicBin/kafka-topics. sh --list--zookeeper localhost:2181View the specified topic statusBin/kafka-topics. sh --describe--
Set jvm parameters for tomcat, zookeeper, activeMQ, and Kafka, and set zookeeperactivemq1. Set jvm parameters for tomcatSetting method:Add configuration in the tomcat bin directory:Setenv. sh
#add tomcat pidCATALINA_PID="$CATALINA_BASE/conf/tomcat.pid"#add java optsJAVA_OPTS=" -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true \ -server -Xmx1g -Xms1g -Xmn256m -XX:PermSize=128m -Xss256k -XX:+DisableEx
BAT script: Windows Next button to start Zookeeper+kafkaHere ping to control the time (first zookeeper,ping 4 times after the Kafka), you can also use choice/t 10/d y/n >nul to more precise control of time start cmd/k "D:\zookeeper-3.4.6\bin\zkS Erver.cmd "Start cmd/k" Ping 127.1-n "4" >nuld:\kafka_2.12-0.11.0.0\bin\wi
ja16-large distributed integrated project combat Spring+zookeeper+mycat+storm+kafka+nio+netty distributed storage Cloud computing Video CourseThe beginning of the new year, learning to be early, drip records, learning is progress!Do not look everywhere, seize the promotion of their own.For learning difficulties do not know how to improve themselves can be added: 1225462853 get information.ja16-large distrib
the implementation of business logic code, greatly improve their work efficiency, free of repetitive workOPEN CIOpen source Standardization Project management solution, realize the software pipelining production, guarantee the correctness, the reliabilityGuided creation, import of projects, integrated version control (GIT/SVN), project Management (trac/redmine), Code quality (Sonar), continuous integration (Jenkins)Private deployment, unified management, for developersWilling to understand the
The previous article introduced node's consumption of Kafka data, which is about the production of Kafka data.
Previous article link: http://blog.csdn.net/xiedong9857/article/details/55506266
In fact, things are very simple, I use express to build a background to accept data, and then forwarded to the zookeeper on the line, specifically not to say, a two-file
MetronicClient authentication: Jqueryvalidation Plugin.Rich Text: CkecitorFile Management: CkfinderDynamic tab: JerichotabData table: Jqgriddialog box: JQuery jboxTree structure controls: JQuery ZtreeOther components: Bootstrap 4 metronic3. SupportServer middleware: Tomcat 6, 7, Jboss 7, WebLogic 10, WebSphere 8Database support: Currently only support MySQL database, but not limited to the database, the next version of the upgrade multi-data source switching and database read and write separati
frame: jQuery1.9.CSS Framework: Bootstrap 4 MetronicClient authentication: Jqueryvalidation Plugin.Rich Text: CkecitorFile Management: CkfinderDynamic tab: JerichotabData table: Jqgriddialog box: JQuery jboxTree structure controls: JQuery ZtreeOther components: Bootstrap 4 metronic3. SupportServer middleware: Tomcat 6, 7, Jboss 7, WebLogic 10, WebSphere 8Database support: Currently only support MySQL database, but not limited to the database, the next version of the upgrade multi-data source sw
Zookeeper ConceptZookeeper is a distributed, open-source distributed Application Coordination Service that contains a simple set of primitives that can be used by distributed applications to implement synchronization services, configure maintenance and naming services, and so on. Zookeeper is a sub-project of Hadoop, and its evolution is not to be mentioned. In distributed applications, a reliable, extensib
powerful, the most popular HTML, CSS, and JS frameworks for developing responsive layouts, mobile device-first WEB projects.Designed for all developers, all application scenarios.Make front-end development faster and easier. All developers are quick to get started, all devices are adaptable, and all projects are available.Cloud ServicesSUBSYSTEM: Backend management system, RESTFU service System, Dubbo Service/control/monitoring CenterZookeeper Registration Center, Report analysis system, loggin
frame: jQuery1.9.CSS Framework: Bootstrap 4 MetronicClient authentication: Jqueryvalidation Plugin.Rich Text: CkecitorFile Management: CkfinderDynamic tab: JerichotabData table: Jqgriddialog box: JQuery jboxTree structure controls: JQuery ZtreeOther components: Bootstrap 4 metronic3. SupportServer middleware: Tomcat 6, 7, Jboss 7, WebLogic 10, WebSphere 8Database support: Currently only support MySQL database, but not limited to the database, the next version of the upgrade multi-data source sw
The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion;
products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the
content of the page makes you feel confusing, please write us an email, we will handle the problem
within 5 days after receiving your email.
If you find any instances of plagiarism from the community, please send an email to:
info-contact@alibabacloud.com
and provide relevant evidence. A staff member will contact you within 5 working days.