hbase數據寫入RetriesExhaustedWithDetailsException異常


現象:表寫入異常,通過批量方式寫入,數據高峰期,幾乎每次都提交失敗。

原因:hbase拋出異常的根本原因待探索

 

處理方式:從業務角度規避了此問題,將出問題的表數據量(較大大?)備份,重建該表。

相關腳本:

disable 't1'

snapshot 't1', 't1_bak'

clone_snapshot 't1_bak', 't1_bak_new'

delete_snapshot 't1_bak'

drop 't1'

 

異常信息:

org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1883 actions: IOException: 1882 times, InterruptedIOException: 1 time,
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:247)
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$1800(AsyncProcess.java:227)
at org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(AsyncProcess.java:1758)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:240)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.mutate(BufferedMutatorImpl.java:146)
at org.apache.hadoop.hbase.client.HTable.put(HTable.java:1031)
at com.igen.parse.service.HbaseService.insertHbaseForNew(HbaseService.java:2095)
at com.igen.parse.service.HbaseService$22$1.run(HbaseService.java:1425)
at java.lang.Thread.run(Thread.java:745)
org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 2261 actions: IOException: 2261 times,
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.makeException(AsyncProcess.java:247)
at org.apache.hadoop.hbase.client.AsyncProcess$BatchErrors.access$1800(AsyncProcess.java:227)
at org.apache.hadoop.hbase.client.AsyncProcess.waitForAllPreviousOpsAndReset(AsyncProcess.java:1758)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.backgroundFlushCommits(BufferedMutatorImpl.java:240)
at org.apache.hadoop.hbase.client.BufferedMutatorImpl.flush(BufferedMutatorImpl.java:190)
at org.apache.hadoop.hbase.client.HTable.flushCommits(HTable.java:1430)
at org.apache.hadoop.hbase.client.HTable.close(HTable.java:1466)
at com.igen.parse.service.HbaseService.insertHbaseForNew(HbaseService.java:2146)
at com.igen.parse.service.HbaseService$22$1.run(HbaseService.java:1425)
at java.lang.Thread.run(Thread.java:745)


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM