metaq入門部署到實戰

標籤：tom   pop   wrapper   blog   mono   UI   download   訂閱   home   

初識metaqzookeeper部署，這裡單機zk為例。

wget http://mirror.bit.edu.cn/apache/zookeeper/zookeeper-3.4.5/zookeeper-3.4.6.tar.gztar -zxvf zookeeper-3.4.6.tar.gzcd  zookeeper-3.4.6mkdir datacp conf/zoo_sample.cfg  conf/zoo.cfg

改動zk的設定檔。將data路徑dataDir的值設定為zookeeper-3.4.6下的data

hadoop@yard02:~/bigdata/zookeeper-3.4.6$ cat conf/zoo.cfg # The number of milliseconds of each ticktickTime=2000# The number of ticks that the initial # synchronization phase can takeinitLimit=10# The number of ticks that can pass between # sending a request and getting an acknowledgementsyncLimit=5# the directory where the snapshot is stored.# do not use /tmp for storage, /tmp here is just # example sakes.dataDir=/home/hadoop/bigdata/zookeeper-3.4.6/data# the port at which the clients will connectclientPort=2181# the maximum number of client connections.# increase this if you need to handle more clients#maxClientCnxns=60## Be sure to read the maintenance section of the # administrator guide before turning on autopurge.## http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance## The number of snapshots to retain in dataDir#autopurge.snapRetainCount=3# Purge task interval in hours# Set to "0" to disable auto purge feature#autopurge.purgeInterval=1

metaq部署這裡使用單機多執行個體測試

wget http://fnil.net/downloads/metaq-server-1.4.6.2.tar.gztar -zxvf metaq-server-1.4.6.2.tar.gz cd  taobao/cp -rf  metamorphosis-server-wrapper ../metaq9123cp -rf  metamorphosis-server-wrapper ../metaq9124cp -rf  metamorphosis-server-wrapper ../metaq9125

單機多執行個體須要解決port衝突的問題1。改動JMXport，改動服務port，改動dashboardWebport,zk地址

我這裡保持metaq9123預設，改動metaq9124。metaq9125

vim metaq9124/conf/server.ini

serverPort=8124dashboardHttpPort=8121zk.zkConnect=192.168.137.2:2181

vim metaq9124/bin/env.sh

export JMX_PORT=9124

metaq9125相同，改動成不被佔用的介面即可了 啟動：

bin/metaServer.sh start

停止

bin/metaServer.sh stop

狀態

bin/metaServer.sh status

zk上節點

摘自http://udukwilliam.iteye.com/blog/1931852

1) /consumers:存放消費者列表以及消費記錄。消費者列表主要是以組的方式存在。結構主要例如以下：

       /consumers/xxGroup/ids/xxConsumerId：DATA(“：”後的DATA表示節點xxConsumerId相應的資料) 組內消費者Id;DATA為訂閱主題列表。以”,”分隔       /consumers/xxGroup/offsets/xxTopic/分區N：DATA  組內主題分區N的消費進度。DATA為topic下分區N詳細進度值       /consumers/xxGroup/owners/xxTopic/分區N：DATA 組內主題分區N的的消費者。DATA為消費者ID，表示XXTopic下分區N的資料由指定的消費者進行消費

2) /brokers/ids:存放Broker列表，假設Broker與Zookeeper失去串連，則會自己主動登出在/brokers/ids下的broker記錄。範例例如以下：

    /brokers/ids/xxBroker

3) /brokers/topics-pub：存放公布的主題列表以及相應的可發送訊息的Broker列表，範例例如以下：

    /brokers/topics-pub/xxTopic/xxBroker    /brokers/topics-pub下記錄的是可發送訊息到xxTopic的Broker列表，意味著有多少個Broker同意儲存Client發送到Topic資料

4) /brokers/topics-sub：存放訂閱的主題列表以及相應可訂閱的Broker列表。範例例如以下：

    /brokers/topics-sub/xxTopic/xxBroker    /brokers/topics-sub下記錄的可訂閱xxTopic的Broker列表，意味著有多少個Broker同意被Client訂閱topic的資料

這裡使用sohu-zookeeper-view來看了下節點資訊。當中meta-example是group

watermark/2/text/aHR0cDovL2Jsb2cuY3Nkbi5uZXQvbHV5ZWUyMDEw/font/5a6L5L2T/fontsize/400/fill/I0JBQkFCMA==/dissolve/70/gravity/SouthEast" >

WEB DASHBOARD 

metaq入門部署到實戰