1 詳細異常信息
RROR: There is a hole in the region chain between \x03\x00\x00\x00\x00\x00\x00\x00\x00 and \x05\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x08\x00\x00\x00\x00\x00\x00\x00\x00 and \x09\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:T_CHARGING_ORDER ERROR: (region WMBIGDATA:ODS_PLUS_ES_CHARGING_STATION,\x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00,1570851021283.cd3a2e47eae11e7516f40c96ef18f9e0.) First region should start with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole. ERROR: There is a hole in the region chain between \x05\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x06\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x07\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:ODS_PLUS_ES_CHARGING_STATION ERROR: (region WMBIGDATA:ODS_ES_CHARGING_EQUIPMENT_EFFECT_INDEX,\x01\x00\x00\x00\x00\x00\x00,1570863380329.262f7bf1c70f3fe0caa2df5f04184d1b.) First region should start with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole. ERROR: There is a hole in the region chain between \x02\x00\x00\x00\x00\x00\x00 and \x03\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x04\x00\x00\x00\x00\x00\x00 and \x07\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:ODS_ES_CHARGING_EQUIPMENT_EFFECT_INDEX ERROR: There is a hole in the region chain between \x01 and \x04. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x07 and \x09. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x0A and \x0B. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:WM_USER_ACCOUNT_DEPOSIT_LOG ERROR: There is a hole in the region chain between \x01\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x03\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x05\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00 and \x08\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:ODS_PLUS_ES_CHARGING_CONNECTOR ERROR: There is a hole in the region chain between \x02 and \x03. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x04 and \x05. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x08 and \x09. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:WM_TRAVEL_ORDER ERROR: There is a hole in the region chain between \x01 and \x02. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x09 and \x0A. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:WM_ORDER_ER_ORDER ERROR: There is a hole in the region chain between \x01 and \x03. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: There is a hole in the region chain between \x07 and \x08. You need to create a new .regioninfo and region dir in hdfs to plug the hole. ERROR: Last region should end with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole. ERROR: Found inconsistency in table WMBIGDATA:WM_COUPON ERROR: There is a hole in the region chain between \x02 and \x03. You need to create a new .regioninfo and region dir in hdfs to plug the hole.
2 解決心路歷程
A嘗試命令修復,不起作用
sudo -u hbase hbase hbck repair
B 嘗試重新分配,繼續修復,不起作用
sudo -u hbase hbase hbck -fixAssignments
C 刪除zookeeper的節點/hbase目錄,照樣不起作用
D 暴力刪除 hdfs dfs -rmr /hbase/WALs/ 下面的節點信息,重啟集群,也不起作用
3 最終解決
上面也是hbase RIT問題能搜索到的很多信息
參考博客: https://cloud.tencent.com/developer/article/1359221
然后增加配置hbase-site.xml
<property>
<name>hbase.regionserver.executor.openregion.threads</name>
<value>100</value>
</property>
重啟集群,服務正常。