hbase architecture

HBase Write Request analysis, hbase Write Request As a distributed NoSQL database system, HBase not only supports wide lists, but also provides high performance for random read/write. HBase can maintain transaction consistency while performing high-performance random read/write transactions. Currently,

was in before the server crashed. Shows the write process: All changes are saved to the Wal before being passed to Memstore. The whole process is this: The client initiates an action to modify the data, such as put. Each modification is encapsulated in a KeyValue object instance and sent out via RPC calls. These calls are sent to the region Server that contains the matching region; When the KeyValue instance arrives, they are assigned to manage the corresponding row Hregion

operations need to be performed multiple times in the middle, but the client will cache the data.Mapreduce on hbase The most convenient and practical model for running batch processing on hbase is mapreduce, for example: The relationship between hbase table and region is similar to the relationship between HDFS file and block.

Trivial-first look at HBase, trivial-HBase Version 0.95In hbase standalone mode, all services run on one JVM, including HBase and zookeeper. The local file system is used. Logs are stored in the logs folder by default. Basic commands:Create 'table', 'cf '// create a table named after the table, and the cloumn family

machine hard drives 2, Hadoop version selection and CM5 installation 3, CDH5 cluster construction, including HBase and Zookeepe R cluster 4, HBase and Zookeeper interface Cluster management and maintenance 5, hbase architecture and how it works 6, physical Storage, htable, hregion, hfile, etc. 7,

' Student_shell ' RHBASE:hb.describe.table ("Student_rhbase") inserts a data hbase:put ' Student_shell ', ' Mary ', ' Info:age ', ' RHBASE:hb.insert ' ("Student_rhbase", List ("Mary", "Info:age", "24")))Read Data hbase:get ' Student_shell ', ' Mary ' RHBASE:hb.get (' student_rhbase ', ' Mary ') delete the table (HBase requires two commands, Rhbase is only an operation) HBASE: Disable ' Student_shell ' hbas

Tags: fault current submission Berkeley particle generation Kafka writing time1. Test MySQL Connection Bin/sqoop list-databases--connect jdbc:mysql://192.168.1.187:3306/trade_dev--username ' mysql '--password ' 111111 ' 2. Verifying SQL statements Bin/sqoop eval--connect jdbc:mysql://192.168.1.187:3306/trade_dev--username ' mysql '--password ' 111111 '--query ' SELECT * from tb_region WHERE region_id = ' 00a1719a489d4f49906a8ca9661ccbe8 ' " 3. Import hdfs3.1 Import

The document was generated with the HBase default profile and the file source is hbase-default.xml.Applied to%hbase_home%/conf/hbase-site.xml in the actual HBASE production environment.Hbase.rootdirThis directory is a shared directory of Region server and is used to persist hbase