"Go" cleans up intermediate storage data for Kylin (HDFS & HBase Tables)

http://blog.csdn.net/jiangshouzhuang/article/details/51290399

Kylin generates intermediate data on HDFS during the cube creation process. Also, when we execute purge/drop/merge on cube, some hbase tables may remain in hbase, and the tables are no longer queried, although Kylin does some automatic garbage collection, but it may not overwrite all aspects, So we need to be able to do some cleanup work for offline storage at intervals. The steps are as follows:

1. Check which resources need to be cleaned up, and this action will not delete any content:

${kylin_home}/bin/kylin.sh Org.apache.kylin.storage.hbase.util.StorageCleanupJob--delete False

2. Based on the above output, select one or two resources to see if it is no longer needed. Next, add the "–delete true" option on top of the command above to start the cleanup operation, and the intermediate HDFs and box htables tables are removed after the command execution is complete.

"Go" cleans up intermediate storage data for Kylin (HDFS & HBase Tables)