kafka ssl example

. Newcertpool () Cacertpool.appendcertsfrompem (caCert) Tlsconfig.rootcas = cacertpooltlsconfig.buildnametocertificate () return tlsconfig, Err}func consumerloop (consumer Sarama. Consumer, topic String) {partitions, err: = Consumer. Partitions (topic) If err! = Nil {log. Println ("Unable to fetch partition IDs for the topic", topic, err) return}//Trap SIGINT to trigger a shutdown.signals: = M Ake (Chan os. Signal, 1) Signal. Notify (Signals, OS. INTERRUPT) var wg sync. Waitgroupfor Partition: =

java.util.map;import Java.util.properties;import Java.util.concurrent.executorservice;import Java.util.concurrent.executors;import Kafka.consumer.consumer;import Kafka.consumer.consumerconfig;import Kafka.consumer.consumeriterator;import Kafka.consumer.kafkastream;import Kafka.javaapi.consumer.consumerconnector;import Kafka.message.messageandmetadata;public class Logconsumer {private Consumerconfig config; Private String topic; private int partitionsnum; Private Messageexecutor exec

Flume and Kakfa example (KAKFA as Flume sink output to Kafka topic)To prepare the work:$sudo mkdir-p/flume/web_spooldir$sudo chmod a+w-r/flumeTo edit a flume configuration file:$ cat/home/tester/flafka/spooldir_kafka.conf# Name The components in this agentAgent1.sources = WeblogsrcAgent1.sinks = Kafka-sinkAgent1.channels = Memchannel# Configure The sourceAgent1.s

In the Kafka download page, download version 0.8, unzip. 1. Modify the server.properties inside the Config directory to host.name the IP of the machine. If the deployment Kafka and the development run Kafka example for the same machine without modification, with the default localhost also line. 2. Modify the DataDir pr

Kafka Consumer API Example 1. Auto-confirm OffsetDescription Reference: http://blog.csdn.net/xianzhen376/article/details/51167333Properties Props = new properties ();/* Defines the address of the KAKFA service and does not require all brokers to be specified on */props. put ("Bootstrap.servers","localhost:9092");/* Develop consumer group */props. put ("Group.id","Test");/* Whether to automatically confirm t

(true) {String message = "message-" + ++count;//消息主题是testKeyedMessagenew KeyedMessage"test", message);//message可以带key, 根据key来将消息分配到指定区, 如果没有key则随机分配到某个区// KeyedMessageproducer.send(keyedMessage);System.out.println("send: " + message);try {Thread.sleep(1000);} catch (InterruptedException e) {e.printStackTrace();}}// producer.close();} }/*** 自定义分区类**/class MyPartition implements Partitioner {public int partition(Object key, int numPartitions) {return key.hashCode()%numPartitions;}} From fo

Decoration in ...KafkaNew TopicBin/kafka-topics. sh --create--zookeeper localhost:218131 --topic my-topicView a list of existing topicBin/kafka-topics. sh --list--zookeeper localhost:2181View the specified topic statusBin/kafka-topics. sh --describe--zookeeper localhost:2181 --topic my-topicStart consumer read message and output to standard outputBin/

("message"). ToString (). Contains ("A")) println ("Find A in message:" +map.tostring ())}}classRulefilelistenerbextendsStreaminglistener {override Def onbatchstarted (batchstarted: org.apache.spark.streaming.scheduler.StreamingListenerBatchStarted) {println ("-------------------------------------------------------------------------------------------------------------- -------------------------------") println ("Check whether the file's modified date is change, if change then reload the configu

) Conf directory, then copy zoo_sample.cfg to zoo.cfg4) Modify the Datadir=d:\zookeeper-3.3.6\zookeeper-3.3.6\data in Zoo.cfg(according to the decompression path to adjust accordingly)3. Start Zookeeper go to the bin directory and execute Zkserver.cmdOpen command Window in Bin directory: SHIFT + right mouse buttonInput: Zkserver.cmd Enter execution4 Kafka ConfigurationCompressed Package Decompression: D:\kafka_2.11-0.11.0.1Go to config directory, edit

Kafka is a message middleware for passing messages between systems, and messages can be persisted!Can be considered as a queue model, but also can be seen as a producer consumption model;The simple producer consumer client code is as follows: PackageCom.pt.util.kafka;Importjava.util.Date;Importjava.util.Properties;ImportKafka.javaapi.producer.Producer;ImportKafka.producer.KeyedMessage;ImportKafka.producer.ProducerConfig; Public classMyproducer { Publi

Storm.kafka.trident.TridentKafkaEmitter.emitNewPartitionBatCH (tridentkafkaemitter.java:79) at storm.kafka.trident.tridentkafkaemitter.access$000 (TridentKafkaEmitter.java : Storm.kafka.trident.tridentkafkaemitter$1.emitpartitionbatch (tridentkafkaemitter.java:204) at Storm.kafka.trident.tridentkafkaemitter$1.emitpartitionbatch (tridentkafkaemitter.java:194) at Storm.trident.spout.opaquepartitionedtridentspoutexecutor$emitter.emitbatch ( opaquepartitionedtridentspoutexecutor.java:127) at Storm.

= keystore.getinstance ("JKS"); Clientkeystore.load (New FileInputStream (Clientkeystorefile), Clientkeystorepwd.tochararray ()); KeyStore Clienttrustkeystore = keystore.getinstance ("JKS"); CliEnttrustkeystore.load (New FileInputStream (Clienttrustkeystorefile), Clienttrustkeystorepwd.tochararray ()); Keymanagerfactory KMF = keymanagerfactory.getinstance (Keymanagerfactory.getdefaultalgorithm ()); Kmf.init (Clientkeystore, Foxclientkeypwd.tochararray ()); Tru

In the previous "OpenSSL and keystore instruction small set," said the recent study of SSL encryption, will give a small example of Java. Copying a piece of code that can run to production is very irresponsible, but a small example can lead us to a quick glimpse of the nature of things. Rome was not built in a day.This article will give a small

Take FortiGate 60B as an example to illustrate how to configure SSL vpn! under the V3.0 system All Fortios V3.0 versions of the FortiGate firewall device (no model distinction) are applicable to this example reference. Begin: Firewall → address → new address Virtual Private network →ssl→ settings Address pool for

("TLSv1"); Sslcontext.init (NULL, TMF.GEttrustmanagers (), NULL); Sslsocketfactory socketfactory = Sslcontext.getsocketfactory (); Socket socket = Socketfactory.createsocket ("localhost", catserver.server_port); PrintWriter out = new PrintWriter (Socket.getoutputstream (), true); BufferedReader in = new BufferedReader (New InputStreamReader (Socket.getinputstream ())); Send ("Hello", out); Send ("Exit", out); Receive (in); Sock