Hbase-site.xml parameter Meanings in Hbase

Source: Internet
Author: User

Hbase.client.scanner.caching

Defines the number of rows retrieved when the next method is called in the scanner. The larger the number, the fewer remote calls the client needs to make to the regionserver at the time of the scan. The larger the value, the larger the client consumes memory.


Hbase.balancer.period

The region equalizer runs periodically in HBase master. This property defines the time interval at which the equalizer runs, by default, 5 minutes, in milliseconds.


Hbase.client.write.buffer

Client Htable Instance write cache, Unit byte. The larger the RPC calls, the less memory is consumed.


Hbase.hregion.majorcompaction

The merger of the big merge periodically. Milliseconds, the default is one day. (usually not recommended)


Hbase.hregion.max

The maximum value of the underlying storage file hstorefile. The region size is defined by this parameter. If the stored file for the column family exceeds this value, region is split.


Hbase.hregion.memstore.flush.size

The maximum value of the Memstore, in bytes. When Memstore exceeds this value, it is written to disk. A periodically running thread checks the size of the Memstore, and the thread run frequency can be defined by hbase.server.thread.wakefrequency

Hbase.server.thread.wakefrequency


Hbase.hregion.memstore.mslab.enabled

Memstore-local Allocation Buffer is a feature of hbase that is used to prevent heap fragmentation when dense writes occur. Turn it on. The default is true if the garbage collection pauses too long because the heap is too large.


Hbase.hstore.blockingStoreFiles

If a column family stores more than this value in a region, the write will block out, knowing that the merge is complete or the blocking time-out. The timeout is the time using the Hbase.hstore.blockingWaitTime setting, in milliseconds.

Hbase.hstore.blockingWaitTime


Hbase.hstore.compaction.max

Configures the maximum number of files that are merged in a single small merge. The default is 7.


Hbase.hstore.compactionThreshold

When the number of storage files for a column family reaches this value, HBase executes the merge on that region. The greater the value that is set for this parameter, the lower the frequency of execution merges, but the longer it takes.


Hbase.mapreduce.hfileoutputformat.blocksize

The hfile data block size is set at each column family level of each table, which determines the granularity of the hfile index. The smaller the data block, the better the random read performance, and the more space the data block index consumes, the more memory is consumed. When you use Hfileoutputformat to write data directly to hfile in a mapreduce job, you must define the chunk size with this property.


Hbase.master.info.port

Define user access ports

Http://master:port, default is 60010


Hbase.master.port

Is the master process listening port, the default value is 60000.


Hbase.regionserver.port

Regionserver's Listening port


Hbase.regionserver.global.memstore.lowerLimithbase.regionserver.global.memstore.upperLimit

Upperlimit defines the percentage of heap that can be used in a total of Memstore on a regionserver. When encountering Upperlimit, Memstore was brushed to write the hard disk, knowing that when encountering lowerlimit stop.


Hbase.regionserver.handler.count

The number of RPC listeners that can be started on the regionserver and master processes


Hbase.regionserver.optionallogflushinterval

Regardless of how many edits are in the Hlog file, how often hlog must brush and write a file system. This is the time interval, in milliseconds, to force the brush to write. The default is 1000ms.


Hbase.regionserver.regionSplitLimit

The maximum number of region that a system has, the default is Max_int (2147483647)


Hbase.tmp.dir

Local HBase uses temp directory


Hfile.block.cache.size

The block cache can use the largest number of heaps. The data block cache algorithm is LRU.


Zookeeper.session.timeout

Both the HBase daemon and the client are zookeeper clients. This parameter is the session timeout between them and zookeeper, in milliseconds.


Zookeeper.znode.parent

In zookeeper the hbase and Znode root directories, the default value is/hbase. All HBase zookeeper files are configured to use this directory as the parent directory.


Hbase-site.xml parameter Meanings in Hbase

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.