kafka to sql server

Kafka-sql engine sharing 1. OverviewIn most cases, we use Kafka just as message processing. In some cases, we need to read the data in the Kafka cluster multiple times. Of course, we can do this by invoking the Kafka API, but for different business requirements, we need to w

log.flush.interval.ms=1000 3. Log Retention policy configurationWhen the Kafka server is written to a large number of messages, will generate a lot of data files, and take up a lot of disk space, if not cleaned up in time, may not be enough disk space,Kafka default is reserved for 7 days. Recommended configuration: # reserved for three days or

First, for the server-side construction can refer to the previous article: Kafka stand-alone version of the environment to build and testServer-Side ip:10.0.30.221The directory of the running environment is as follows:You need to change the following two properties in Server.properties under the Config folderZookeeper.connect=localhost:2181 changed into zookeeper.connect=10.0.30.221:2181And the default comm

Enter data into Kafka, throw exception org.apache.kafka.common.errors.RecordTooLargeExceptionTwo parameters of the official website are described below: Message.max.bytes The maximum size of message that the server can receive Int 1000012 [0,...] High Fetch.message.max.bytes 1024 * 1024 The number of byes of messages to attempt-t

wiseweb_crawler_website20171024where(content='% public sentiment%'or content='% Public opinion Guide%'or content='% desensitization%'or content='% data de-sensitivity%'or content='% precision Search%'or content='% Portrait%'or content='% Wind Control%'or content='% risk Control%'or content='% Content Management%'or content='% Big Data analysis%'or content='% Large Data acquisition%'or content='% Big Data mining%') and (contet='% tender notice%'or title='% tender notice%') SELECT Site_id,title,p

---- Set a non-primary key to clustered index [Step 4] to: http://king123654789.iteye.com/blog/1169191 1. View All indexes. Clustered indexes are created on the primary key by default.Sp_helpindex person 2. -- delete the primary key constraint and remove the index constraint on the primary key queried in [1], for example, PK _ person _ 117F9D94. Remove the primary key constraint from the primary key field. This field is not the primary key.Alter table person drop constraint PK _ person _ 117F9

Platform Description: Two SQL SERVER2005 servers with two identical databases installed on top of each otherRecently, because of the project needs, you need to copy the database on one of the servers on a database on another server, after a lot of Google has finally finished, here to do a detailed record, hoping to help everyone and themselves.One, the first step: SQL