1. There is a large amount of data in Hbase (row numer = 3849920), read all data from MongoDB again and below is the log:
[Email protected] ~]$ Kubectl logs histclientsdataetl-20161028141055-doize |grep@[email protected] @[email protected] Getlatestonlinetime: .-Ten- - at: -:59.815@[email protected] Get uplinedate from HBase: .-Ten- - at: -:59.815@[email protected] Getcurrentposfromdb: .-Ten- - at: -:59.815@[email protected] Start finding at time:2016-10-28 15:00:17.991, Startfinddayindex=17101@[email protected] Finding Finished at time:2016-10-28 15:00:21.551@[email protected] wrting to Hbase have been finished!@[email protected]: 3849920 , putcount:0,time:2016-10-28 15:11:48.784@[email protected] childfileName1.1.1.1-histclientsdataetl@[email protected] Change logfile name has finished: .-Ten- - the: One:48.792@[email protected] cmd:SH/home/mongo-hive-hbase/hive_histclientsinfoanalysis.SH@[email protected]: Exec has finished!@[email protected] New executing remote hive Shell has finished: .-Ten- - the: A:49.273@[email protected] Result:
MongoDB Read Test