hdfs無效塊修復

登錄到有無效塊的機器后操作。

hdfs fsck /       后面的路徑是指定檢查哪個目錄下有無效塊，根據丟失文件目錄可以細化，以提高檢查速度

該命令會返回

FSCK started by hdfs (auth:SIMPLE) from /xxx.xxx.xxx for path / at Fri Jul 26 14:37:29 CST 2019
....................................................................................................
....................................................................................................
....................................................................................................
....................................................................................................
................................................................................................
/.../c9ddcb18-51c0-4fa7-bdab-daa5079bc094/rdd-1061487/_partitioner: Under replicated BP-770033680-172.20.36.31-1562142528050:blk_1073943459_202678. Target Replicas is 3 but found 2 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).
.
/.../c9ddcb18-51c0-4fa7-bdab-daa5079bc094/rdd-1061487/part-00000: Under replicated BP-770033680-172.20.36.31-1562142528050:blk_1073943450_202669. Target Replicas is 3 but found 2 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).
.
/.../c9ddcb18-51c0-4fa7-bdab-daa5079bc094/rdd-1061487/part-00001: Under replicated BP-770033680-172.20.36.31-1562142528050:blk_1073943456_202675. Target Replicas is 3 but found 2 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).
.
/.../c9ddcb18-51c0-4fa7-bdab-daa5079bc094/rdd-1061487/part-00002: Under replicated BP-770033680-172.20.36.31-1562142528050:blk_1073943452_202671. Target Replicas is 3 but found 2 live replica(s), 0 decommissioned replica(s), 0 decommissioning replica(s).

 

. . .

. . . 

. . . 

Total size: 64294925737 B (Total open files size: 672396467 B)
Total dirs: 2743
Total files: 2439
Total symlinks: 0 (Files currently being written: 22)
Total blocks (validated): 2752 (avg. block size 23362981 B) (Total open file blocks (not validated): 26)
Minimally replicated blocks: 2752 (100.0 %)
Over-replicated blocks: 0 (0.0 %)
Under-replicated blocks: 22 (0.7994186 %)
Mis-replicated blocks: 0 (0.0 %)
Default replication factor: 3
Average block replication: 2.9920058
Corrupt blocks: 0
Missing replicas: 22 (0.26647288 %)
Number of data-nodes: 3
Number of racks: 1
FSCK ended at Fri Jul 26 14:37:29 CST 2019 in 48 milliseconds

 

根據打印的塊名稱，找到文件系統中存儲的塊文件和塊meta信息，將快文件和meta信息刪除掉。

hadoop debug recoverLease -path $filePath -retries 10  恢復filePath對應的文件，如：/.../c9ddcb18-51c0-4fa7-bdab-daa5079bc094/rdd-1061487/part-00000

由於恢復塊太多，使用腳本批量執行

#!/bin/bash
file_name=$1
path=$2
if [ -z "${file_name}" ];then
  echo "Pls input file path"
    exit 1
fi

cat ${file_name}| while read line
do
  if [ -z $line ]; then
    continue
  fi
  hadoop debug recoverLease -path $line -retries 10
done

 

完成恢復后需要重啟該節點后，cdh界面無效塊告警消除