Meta table fix a Java code view Hbasemeta case hbase hbck 1. Re-repair hbase meta table (generate meta table based on RegionInfo file on HDFs) HBase Hbck-fixmeta 2. Heavy The new HBase meta table is assigned to Regionserver (based on the meta table, the region on the meta table is divided to regionservere) HBase hbck-fixassignments
Meta table fix Two
Java code when a vulnerability occurs in HBase Hbck-fixhdfsholes (new Region folder) HBase hbck <span style= "FONT-SIZE:13.63636302948PX; line-height:19.0909080505371px; " >-fixmeta (generate meta table based on RegionInfo) hbase hbck </span><span style= "FONT-SIZE:13.63636302948PX; line-height:19.0909080505371px; " >-fixassignments (assigning region to regionserver) </span> meta table fix three Java code missing RegionInfo hbase Hbck-fixhdfsorphans
Repeat region problem: Java code view meta in the region scan ' Hbase:meta ', {limit=>10,filter=> "prefixfilter (' Index_11 ')"} In Data migration When you encounter two duplicate region B0C8F08FFD7A96219F748EF14D7AD4F8,73AB00EAA7BAB7BC83F440549B9749A3 Delete two duplicate region delete ' HBase: Meta ', ' index_11,4380_2431,1429757926776.b0c8f08ffd7a96219f748ef14d7ad4f8 ', ' info:regioninfo ' delete ' Hbase:meta ' , ' Index_11,5479_0041431700000000040100004815e9,1429757926776.73ab00eaa7bab7bc83f440549b9749a3. ', ' info: RegionInfo ' Delete two duplicate Hdfs/hbase/data/default/index_11/b0c8f08ffd7a96219f748ef14d7ad4f8/hbase/data/default/inde X_11/73AB00EAA7BAB7BC83F440549B9749A3 corresponding restart Regionserver (just to refresh the status of RIS reported on Hmaster) will definitely lose data and lose data on the duplicate region that is not online
New HBase hbck Java code newer hbck new version of hbck can fix various errors, repair option is: (1)-fix, backwards compatible, replaced by-fixassignments (2)-fixassignments, used to fix region assignments errors (3)-fixmeta, used to fix the meta-table problem, provided that the Region info information above HDFs is correct. (4)-fixhdfsholes, fix region holes (empty, a zone without region) question (5)-fixhdfsorphans, Fix orphan region (HDFs does not have. RegionInfo region) (6)-fixhdfsoverlaps, repairing region overlaps (interval overlap) issues (7)-fixversionfile, fixing missing hbase.version files (8)-maxmerge <n> (n is 5 by default), when region overlaps, you need to merge region, the maximum number of region to merge is no more than this value. (9)-sidelinebigoverlaps When fixing region overlaps problems, allow some region with the most overlap of other region to not participate (after repair, Can load non-participating data through bulk load to the corresponding region) (-maxoverlapstosideline <n> ) (n default is 2), when fixed region overlaps problem, the maximum number of region in a group allowed to not participate in because there are more options, so there are two shorthand options (one) -repair, equivalent to-fixassignments -fixmeta -fixhdfsholes -fixhdfsorphans -fixHdfsOverlaps -fixVersionFile -sidelineBigOverlaps (-repairholes), Equivalent to-fixassignments -fixmeta -fixhdfsholes -fixhdfsorphans new version of hbck (1) Missing hbase.version file Plus Options -fixVersionFile resolution (2) If a region is not in the meta table and not on HDFs, But in Regionserver's Online region collection Plus options -fixAssignments resolve (3) If a region is in the meta table and is in the Online region collection of Regionserver, there is no plus option on HDFs -fixassignments -fixmeta resolved, ( -fixassignments told Regionserver close region), ( - Fixmeta Delete a record of region in the meta table) (4) If a region is not logged in the Meta table, it is not serviced by the Regionserver, but there are on HDFs Plus option -fixmeta -fixassignments resolved, ( -fixAssignments for Assign region), ( -fixmeta to add a record for region in the meta table) (5) If a region does not have a record in the meta table, above HDFs, it is serviced by Regionserver Plus options -fixMeta resolved, Add this region's record to the meta table, first undeploy region, then assign (6) If a region has a record in the meta table, but not on HDFs, And have not been Regionserver service add options -fixMeta Resolve, delete records in meta table (7) If a region has a record in the meta table, there is also on the HDFS, table is not disabled, but this region is not serviced added option -fixassignments Resolution, assign this region (8) If a region has a record in the meta table, it is also on HDFs, and table is disabled, But this region has been serviced by some regionserver plus options -fixAssignments resolution, Undeploy this region (9) If a region has a record in the meta table, there is also on HDFs, table is not disabled, but this region is served by multiple regionserver plus options -fixAssignments Resolve, notify all regionserver close region, and then assign region (10) If a region is in the meta table, it is also available on HDFs, but the Regio recorded in the meta-tableNserver and actual regionserver do not match add options -fixAssignments resolve (one) region holes need to add -fixhdfsholes Create a new empty region to fill the void, but not assign This region, nor does it add information about this region in the meta table (12