CDH adding Kafka

Install the Kafka component Configuration Kafka Parcel package in the Web page, host--parcel will list the current cluster to configure and assign the parcel package, currently only configured Cdh5,kafka in other parcel packages, so you need to To load parcel separately, then assign to each node within the cluster.

Cloudera Official Kafka Component Parcel Package download address is: http://archive.cloudera.com/kafka/parcels/latest/
As usual, download the Percel file as well as the SHA1 string for the file, and then rename ***.sha1 to ***.sha.
After downloading the above two files, put them into the/opt/cloudera/parcel-repo/directory of the Cm-server node.

Without restarting the server daemon, the page can be refreshed, assigned, and activated online.
Installing Kafka services in a cluster
There are 2 default configurations that need to be confirmed and modified
The replication process, which defaults to 1, modifies the number of partitions to 3 (depending on traffic) and the default number of partitions is 50, which is reserved for the moment. Delete old topic, open by default, do not change.
The business port is 9092.
Configuring the HDFS LZO compression LZO feature is also packaged in a separate parcel package, selecting the corresponding platform package.
Download Address: http://archive-primary.cloudera.com/gplextras/parcels/latest/
There is no direct provision of SHA files, so you need to view the Manifest.json file, find the corresponding parcel package hash value, manually saved to the local file.
Download the parcel package and its SHA files and store them in the/opt/cloudera/parcel-repo/directory of the Cm-server.