Speed comparison between querying MYSQL and querying HBASE

Mysql, relational database, HBase, NoSql database. Which speed is quick to query Mysql and HBase? When discussing with some real experts, they say that the HBase write speed can reach 1 W per second. The ideal speed of HBase is 10 W per second. This experiment can only indicate the running status in the current environment. My lab Effect

Mysql, relational database, HBase, NoSql database. Which speed is quick to query Mysql and HBase? When discussing with some real experts, they say that the HBase write speed can reach 1 W per second. The ideal speed of HBase is 10 W per second. This experiment can only indicate the running status in the current environment. My lab Effect

Mysql, relational database;

HBase, NoSql database.

Which speed is quick to query Mysql and HBase?

When discussing with some real experts, they say that the HBase write speed can reach 1 W per second. The ideal speed of HBase is 10 W per second.

This experiment can only indicate the running status in the current environment. My experiment is still being optimized...

Environment:

There are three virtual machines running the Hadoop cluster; three virtual machines are also running HBase: master, node1, node2

The Mysql database is installed on the master.

At present, there is a need:

There are a bunch of text files, each containing logs;

Each row is a record;

Now, you need to read the record row by row and obtain the account information from HBase or Mysql based on the mac address and sn in the record.

Then, it is merged into a record and written into the "SHUJU" table of HBase.

Mysql table structure:

Id, mac, sn, addtime, account

HBase table structure:

ROWKEY is mac + sn, mac, sn, account, addtime

The test results are as follows:

Execute the count operation every minute to count the number of current data entries.

Select count (1) from SHUJU

The result is as follows:

============================================

Mysql, the first test.

Start time 11:03:15

28135 (entries)

39014

49659

264564

274379

285174 (entries)

End Time 11.26.15

285174-28135 = 257039

257039/23 = 11 175.608695652

More than 1 W...

============================================

HBase database queried

Start time 14:43:00

5622 (entries)

16671

25062

34848

46652

58001

69690

79908 (entries)

14:50:00

79908-5622 = 74 286

74286/7 = 10 612 entries per minute.

============================================

Mysql

14:58:30

19248 (entries)

26526

36389

45837

51945

62497

72319

82695 (entries)

End Time: 15: 04: 30

Interval: 7 minutes

82695-19248 = 63 447

93447/7 = 9 063.8571428571

==============================================

It can be seen that the speed in HBase is slightly faster than that in mysql.

But the overall speed still needs to be improved...

Article from :? Daniel's note

CSDN blog address: http://blog.csdn.net/weixuehao/article/details/41647185

Original article address: Query MYSQL and query HBASE speed comparison. Thank you for sharing it with the original author.