HBase按照行鍵范圍刪除數據


#!/bin/bash
#TOOL_PATH=$(cd "$(dirname "$0")"; pwd)
#TOOL_PATH_TMP=$(cd "$(dirname "$0")"; pwd)
if [ $# != 3 ];then
        echo 'usage:sh byRowKeyRange.sh table startrowkey endrowkey'
        exit
fi
table=$1
srowkey=$2
erowkey=$3

echo $table
echo $srowkey
echo $erowkey

currentTime=`date +%s`

echo "scan,get rowkeys,scan: '$table',{ STARTROW => '$srowkey',ENDROW => '$erowkey',FILTER => \"FirstKeyOnlyFilter() AND KeyOnlyFilter()\" } "
#notice:[srowkey,erowkey)!!!
echo "scan '$table',{ STARTROW => '$srowkey',ENDROW => '$erowkey',FILTER => \"FirstKeyOnlyFilter() AND KeyOnlyFilter()\" }" | hbase shell > ./scanresult-$currentTime.txt

#刪除scan結果文件前面沒用的6行
sed -i '1,6d' scanresult-$currentTime.txt

#刪除最后一個空行
sed -i '$d' scanresult-$currentTime.txt

#刪除scan統計條數的行,現在位置在最后
sed -i '$d' scanresult-$currentTime.txt

#判斷下是否查詢結果,沒有則直接退出

tmpCount=$(wc -l ./scanresult-$currentTime.txt | awk '{print $1}')

if [ "$tmpCount" -eq 0 ];then
        echo "0 rows deleted"
        rm -rf ./scanresult-$currentTime.txt
        exit
fi


#生成hbase 刪除語句
cat scanresult-$currentTime.txt|awk '{print $1}' | while read rowkey
do
echo -e "deleteall '${table}','${rowkey}'" >> ./delete-$currentTime.txt
done

totalCount=$(wc -l ./delete-$currentTime.txt | awk '{print $1}')

echo "exit" >> ./delete-$currentTime.txt

#執行hbase刪除
hbase shell ./delete-$currentTime.txt

echo "$totalCount records deleted"

#rm -rf ./scanresult-$currentTime.txt
#rm -rf ./delete-$currentTime.txt

KeyOnlyFilter:只會返回每行的行鍵+列簇+列,而不返回值

FirstKeyOnlyFilter:找每一行的第一列數據,找到之后,就會停止掃描,會返回列值

參考:https://blog.csdn.net/nyistzp/article/details/76922512


免責聲明!

本站轉載的文章為個人學習借鑒使用,本站對版權不負任何法律責任。如果侵犯了您的隱私權益,請聯系本站郵箱yoyou2525@163.com刪除。



 
粵ICP備18138465號   © 2018-2025 CODEPRJ.COM