HBase meta table fix

Source: Internet
Author: User

Meta table fix a Java code view Hbasemeta case hbase hbck 1. Re-repair hbase meta table (generate meta table based on RegionInfo file on HDFs) HBase Hbck-fixmeta 2. Heavy The new HBase meta table is assigned to Regionserver (based on the meta table, the region on the meta table is divided to regionservere) HBase hbck-fixassignments

Meta table fix Two

Java code when a vulnerability occurs in HBase Hbck-fixhdfsholes (new Region folder) HBase hbck <span style= "FONT-SIZE:13.63636302948PX; line-height:19.0909080505371px; " >-fixmeta (generate meta table based on RegionInfo) hbase hbck </span><span style= "FONT-SIZE:13.63636302948PX; line-height:19.0909080505371px; " >-fixassignments (assigning region to regionserver) </span> meta table fix three Java code missing RegionInfo hbase Hbck-fixhdfsorphans

Repeat region problem: Java code view meta in the region scan ' Hbase:meta ', {limit=>10,filter=> "prefixfilter (' Index_11 ')"} In Data migration When you encounter two duplicate region B0C8F08FFD7A96219F748EF14D7AD4F8,73AB00EAA7BAB7BC83F440549B9749A3 Delete two duplicate region delete ' HBase: Meta ', ' index_11,4380_2431,1429757926776.b0c8f08ffd7a96219f748ef14d7ad4f8 ', ' info:regioninfo ' delete ' Hbase:meta ' , ' Index_11,5479_0041431700000000040100004815e9,1429757926776.73ab00eaa7bab7bc83f440549b9749a3. ', ' info: RegionInfo ' Delete two duplicate Hdfs/hbase/data/default/index_11/b0c8f08ffd7a96219f748ef14d7ad4f8/hbase/data/default/inde X_11/73AB00EAA7BAB7BC83F440549B9749A3 corresponding restart Regionserver (just to refresh the status of RIS reported on Hmaster) will definitely lose data and lose data on the duplicate region that is not online

New HBase hbck Java code    newer hbck       new version of  hbck  can fix various errors, repair option is:     (1)-fix, backwards compatible, replaced by-fixassignments     (2)-fixassignments, used to fix region assignments errors     (3)-fixmeta, used to fix the meta-table problem, provided that the Region info information above HDFs is correct.     (4)-fixhdfsholes, fix region holes (empty, a zone without region) question     (5)-fixhdfsorphans, Fix orphan region (HDFs does not have. RegionInfo region)     (6)-fixhdfsoverlaps, repairing region  overlaps (interval overlap) issues     (7)-fixversionfile, fixing missing hbase.version files     (8)-maxmerge  <n>  (n is 5 by default), when region overlaps, you need to merge region, the maximum number of region to merge is no more than this value.     (9)-sidelinebigoverlaps  When fixing region overlaps problems, allow some region with the most overlap of other region to not participate (after repair, Can load non-participating data through bulk load to the corresponding region)     (-maxoverlapstosideline <n> ) (n default is 2), when fixed region overlaps problem, the maximum number of region in a group allowed to not participate in     because there are more options, so there are two shorthand options    (one)  -repair, equivalent to-fixassignments -fixmeta -fixhdfsholes -fixhdfsorphans  -fixHdfsOverlaps -fixVersionFile -sidelineBigOverlaps    (-repairholes), Equivalent to-fixassignments -fixmeta -fixhdfsholes -fixhdfsorphans                new version of  hbck    (1) Missing hbase.version file       Plus Options  -fixVersionFile  resolution     (2) If a region is not in the meta table and not on HDFs, But in Regionserver's Online region collection       Plus options  -fixAssignments  resolve      (3) If a region is in the meta table and is in the Online region collection of Regionserver, there is no       plus option on HDFs   -fixassignments -fixmeta  resolved, ( -fixassignments told Regionserver close region), ( - Fixmeta Delete a record of region in the meta table)     (4) If a region is not logged in the Meta table, it is not serviced by the Regionserver, but there are    on HDFs   Plus option  -fixmeta -fixassignments  resolved, ( -fixAssignments  for Assign region), ( -fixmeta to add a record for region in the meta table)      (5) If a region does not have a record in the meta table, above HDFs, it is serviced by Regionserver     Plus options  -fixMeta  resolved, Add this region's record to the meta table, first undeploy region, then assign    (6) If a region has a record in the meta table, but not on HDFs, And have not been Regionserver service     add options  -fixMeta  Resolve, delete records in meta table     (7) If a region has a record in the meta table, there is also on the HDFS, table is not disabled, but this region is not serviced     added option  -fixassignments   Resolution, assign this region    (8) If a region has a record in the meta table, it is also on HDFs, and table is disabled, But this region has been serviced by some regionserver     plus options  -fixAssignments  resolution, Undeploy this region     (9) If a region has a record in the meta table, there is also on HDFs, table is not disabled, but this region is served by multiple regionserver     plus options  -fixAssignments  Resolve, notify all regionserver close region, and then assign region    (10) If a region is in the meta table, it is also available on HDFs, but the Regio recorded in the meta-tableNserver and actual regionserver do not match     add options  -fixAssignments  resolve          (one) region holes    need to add  -fixhdfsholes  Create a new empty region to fill the void, but not assign  This  region, nor does it add information about this region in the meta table     (12

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.