HBase shell常用命令總結
作者：尹正傑
版權聲明：原創作品，謝絕轉載！否則將追究法律責任。
一.查看hbase腳本的幫助信息
[root@hadoop101.yinzhengjie.org.cn ~]# hbase #在命令行中直接敲擊"hbase"就會彈出該腳本的幫助信息。 Usage: hbase [<options>] <command> [<args>] Options: --config DIR Configuration direction to use. Default: ./conf --hosts HOSTS Override the list in 'regionservers' file --auth-as-server Authenticate to ZooKeeper using servers configuration --internal-classpath Skip attempting to use client facing jars (WARNING: unstable results between versions) Commands: Some commands take arguments. Pass no args or -h for usage. shell Run the HBase shell hbck Run the HBase 'fsck' tool. Defaults read-only hbck1. Pass '-j /path/to/HBCK2.jar' to run hbase-2.x HBCK2. snapshot Tool for managing snapshots wal Write-ahead-log analyzer hfile Store file analyzer zkcli Run the ZooKeeper shell master Run an HBase HMaster node regionserver Run an HBase HRegionServer node zookeeper Run a ZooKeeper server rest Run an HBase REST server thrift Run the HBase Thrift server thrift2 Run the HBase Thrift2 server clean Run the HBase clean up script classpath Dump hbase CLASSPATH mapredcp Dump CLASSPATH entries required by mapreduce pe Run PerformanceEvaluation ltt Run LoadTestTool canary Run the Canary tool version Print the version completebulkload Run BulkLoadHFiles tool regionsplitter Run RegionSplitter tool rowcounter Run RowCounter tool cellcounter Run CellCounter tool pre-upgrade Run Pre-Upgrade validator tool hbtop Run HBTop tool CLASSNAME Run the class named CLASSNAME [root@hadoop101.yinzhengjie.org.cn ~]#
二.hbase shell常用命令總結
1>.進入HBase的交互式命令行
[root@hadoop101.yinzhengjie.org.cn ~]# hbase shell SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/yinzhengjie/softwares/ha/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/yinzhengjie/softwares/hbase-2.2.4/lib/client-facing-thirdparty/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] HBase Shell Use "help" to get list of supported commands. Use "exit" to quit this interactive shell. For Reference, please visit: http://hbase.apache.org/2.0/book.html#shell Version 2.2.4, r67779d1a325a4f78a468af3339e73bf075888bac, 2020年 03月 11日 星期三 12:57:39 CST Took 0.0020 seconds hbase(main):001:0>
2>.查看幫助命令
hbase(main):001:0> help HBase Shell, version 2.2.4, r67779d1a325a4f78a468af3339e73bf075888bac, 2020年 03月 11日 星期三 12:57:39 CST Type 'help "COMMAND"', (e.g. 'help "get"' -- the quotes are necessary) for help on a specific command. Commands are grouped. Type 'help "COMMAND_GROUP"', (e.g. 'help "general"') for help on a command group. COMMAND GROUPS: Group name: general Commands: processlist, status, table_help, version, whoami Group name: ddl Commands: alter, alter_async, alter_status, clone_table_schema, create, describe, disable, disable_all, drop, drop_all, enable, enable_all, exists, get_table, is_disabled, is_enabled, list, list_regions, locate_region, show_filters Group name: namespace Commands: alter_namespace, create_namespace, describe_namespace, drop_namespace, list_namespace, list_namespace_tables Group name: dml Commands: append, count, delete, deleteall, get, get_counter, get_splits, incr, put, scan, truncate, truncate_preserve Group name: tools Commands: assign, balance_switch, balancer, balancer_enabled, catalogjanitor_enabled, catalogjanitor_run, catalogjanitor_switch, cleaner_chore_enabled, cleaner_chore_run, cleaner_chore_switch, clear_block_cache, clear_compaction_queues, clear_deadservers, close_region , compact, compact_rs, compaction_state, compaction_switch, decommission_regionservers, flush, hbck_chore_run, is_in_maintenance_mode, list_deadservers, list_decommissioned_regionservers, major_compact, merge_region, move, normalize, normalizer_enabled, normalizer_switch, recommission_regionserver, regioninfo, rit, split, splitormerge_enabled, splitormerge_switch, stop_master, stop_regionserver, trace, unassign, wal_roll, zk_dump Group name: replication Commands: add_peer, append_peer_exclude_namespaces, append_peer_exclude_tableCFs, append_peer_namespaces, append_peer_tableCFs, disable_peer, disable_table_replication, enable_peer, enable_table_replication, get_peer_config, list_peer_configs, list_peers, list_replica ted_tables, remove_peer, remove_peer_exclude_namespaces, remove_peer_exclude_tableCFs, remove_peer_namespaces, remove_peer_tableCFs, set_peer_bandwidth, set_peer_exclude_namespaces, set_peer_exclude_tableCFs, set_peer_namespaces, set_peer_replicate_all, set_peer_serial, set_peer_tableCFs, show_peer_tableCFs, update_peer_config Group name: snapshots Commands: clone_snapshot, delete_all_snapshot, delete_snapshot, delete_table_snapshots, list_snapshots, list_table_snapshots, restore_snapshot, snapshot Group name: configuration Commands: update_all_config, update_config Group name: quotas Commands: disable_exceed_throttle_quota, disable_rpc_throttle, enable_exceed_throttle_quota, enable_rpc_throttle, list_quota_snapshots, list_quota_table_sizes, list_quotas, list_snapshot_sizes, set_quota Group name: security Commands: grant, list_security_capabilities, revoke, user_permission Group name: procedures Commands: list_locks, list_procedures Group name: visibility labels Commands: add_labels, clear_auths, get_auths, list_labels, set_auths, set_visibility Group name: rsgroup Commands: add_rsgroup, balance_rsgroup, get_rsgroup, get_server_rsgroup, get_table_rsgroup, list_rsgroups, move_namespaces_rsgroup, move_servers_namespaces_rsgroup, move_servers_rsgroup, move_servers_tables_rsgroup, move_tables_rsgroup, remove_rsgroup, remove_servers_ rsgroup SHELL USAGE: Quote all names in HBase Shell such as table and column names. Commas delimit command parameters. Type <RETURN> after entering a command to run it. Dictionaries of configuration used in the creation and alteration of tables are Ruby Hashes. They look like this: {'key1' => 'value1', 'key2' => 'value2', ...} and are opened and closed with curley-braces. Key/values are delimited by the '=>' character combination. Usually keys are predefined constants such as NAME, VERSIONS, COMPRESSION, etc. Constants do not need to be quoted. Type 'Object.constants' to see a (messy) list of all constants in the environment. If you are using binary keys or values and need to enter them in the shell, use double-quote'd hexadecimal representation. For example: hbase> get 't1', "key\x03\x3f\xcd" hbase> get 't1', "key\003\023\011" hbase> put 't1', "test\xef\xff", 'f1:', "\x01\x33\x40" The HBase shell is the (J)Ruby IRB with the above HBase-specific commands added. For more on the HBase Shell, see http://hbase.apache.org/book.html hbase(main):002:0>
3>.查看當前名稱空間有哪些表
hbase(main):003:0> list #對於剛剛搭建的HBase集群，默認的數據庫中是空的。 TABLE 0 row(s) Took 0.5429 seconds => [] hbase(main):004:0>
hbase(main):004:0> help "list" List all user tables in hbase. Optional regular expression parameter could be used to filter the output. Examples: hbase> list hbase> list 'abc.*' hbase> list 'ns:abc.*' hbase> list 'ns:.*' hbase(main):005:0>
4>.創建"teacher"表
hbase(main):002:0> help "create" Creates a table. Pass a table name, and a set of column family specifications (at least one), and, optionally, table configuration. Column specification can be a simple string (name), or a dictionary (dictionaries are described below in main help output), necessarily including NAME attribute. Examples: Create a table with namespace=ns1 and table qualifier=t1 hbase> create 'ns1:t1', {NAME => 'f1', VERSIONS => 5} Create a table with namespace=default and table qualifier=t1 hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} hbase> # The above in shorthand would be the following: hbase> create 't1', 'f1', 'f2', 'f3' hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true} hbase> create 't1', {NAME => 'f1', CONFIGURATION => {'hbase.hstore.blockingStoreFiles' => '10'}} hbase> create 't1', {NAME => 'f1', IS_MOB => true, MOB_THRESHOLD => 1000000, MOB_COMPACT_PARTITION_POLICY => 'weekly'} Table configuration options can be put at the end. Examples: hbase> create 'ns1:t1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS_FILE => 'splits.txt', OWNER => 'johndoe' hbase> create 't1', {NAME => 'f1', VERSIONS => 5}, METADATA => { 'mykey' => 'myvalue' } hbase> # Optionally pre-split the table into NUMREGIONS, using hbase> # SPLITALGO ("HexStringSplit", "UniformSplit" or classname) hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit'} hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit', REGION_REPLICATION => 2, CONFIGURATION => {'hbase.hregion.scan.loadColumnFamiliesOnDemand' => 'true'}} hbase> create 't1', 'f1', {SPLIT_ENABLED => false, MERGE_ENABLED => false} hbase> create 't1', {NAME => 'f1', DFS_REPLICATION => 1} You can also keep around a reference to the created table: hbase> t1 = create 't1', 'f1' Which gives you a reference to the table named 't1', on which you can then call methods. hbase(main):003:0>
hbase(main):006:0> list #對於剛剛搭建的HBase集群，默認的數據庫中是空的。 TABLE 0 row(s) Took 0.5429 seconds => [] hbase(main):007:0> create 'teacher','synopsis','professional_skill','project_experience' #創建一張"teacher"表，並指定'synopsis','professional_skill','project_experience'這3個列族。 Created table teacher Took 2.7281 seconds => Hbase::Table - teacher hbase(main):008:0> list TABLE teacher 1 row(s) Took 0.0222 seconds => ["teacher"] hbase(main):009:0>
5>.查看表結構
hbase(main):010:0> help "describe" Describe the named table. For example: hbase> describe 't1' hbase> describe 'ns1:t1' Alternatively, you can use the abbreviated 'desc' for the same thing. hbase> desc 't1' hbase> desc 'ns1:t1' hbase(main):011:0>
hbase(main):011:0> list TABLE teacher 1 row(s) Took 0.0148 seconds => ["teacher"] hbase(main):012:0> describe 'teacher' #查看"teacher"表的表結構 Table teacher is ENABLED teacher COLUMN FAMILIES DESCRIPTION {NAME => 'professional_skill', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'project_experience', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'synopsis', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMF ILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 3 row(s) QUOTAS 0 row(s) Took 0.0801 seconds hbase(main):013:0>
7>.往"teacher"表中插入數據
hbase(main):013:0> help "put" Put a cell 'value' at specified table/row/column and optionally timestamp coordinates. To put a cell value into table 'ns1:t1' or 't1' at row 'r1' under column 'c1' marked with the time 'ts1', do: hbase> put 'ns1:t1', 'r1', 'c1', 'value' hbase> put 't1', 'r1', 'c1', 'value' hbase> put 't1', 'r1', 'c1', 'value', ts1 hbase> put 't1', 'r1', 'c1', 'value', {ATTRIBUTES=>{'mykey'=>'myvalue'}} hbase> put 't1', 'r1', 'c1', 'value', ts1, {ATTRIBUTES=>{'mykey'=>'myvalue'}} hbase> put 't1', 'r1', 'c1', 'value', ts1, {VISIBILITY=>'PRIVATE|SECRET'} The same commands also can be run on a table reference. Suppose you had a reference t to table 't1', the corresponding command would be: hbase> t.put 'r1', 'c1', 'value', ts1, {ATTRIBUTES=>{'mykey'=>'myvalue'}} hbase(main):014:0>
hbase(main):014:0> put 'teacher','10001','synopsis:name','yinzhengjie' #往"teacher"表中插入一條數據,指定rowkey為"10001",指定列族為"synopsis",字段為"name"，其值為"yinzhengjie" Took 0.1176 seconds hbase(main):015:0> put 'teacher','10001','synopsis:age','18' Took 0.0105 seconds hbase(main):016:0> put 'teacher','10001','synopsis:address','beijing' Took 0.0118 seconds hbase(main):017:0> put 'teacher','10002','synopsis:name','jason yin' #需要注意的是，這里的rowkey為"10002"，和上面的"10001"並不是同一條記錄喲~ Took 0.0099 seconds hbase(main):018:0> put 'teacher','10002','synopsis:age','27' Took 0.0098 seconds hbase(main):019:0> put 'teacher','10002','synopsis:address','shijiazhuang' Took 0.0101 seconds hbase(main):020:0>
8>.查看表數據
hbase(main):019:0> help "scan" Scan a table; pass table name and optionally a dictionary of scanner specifications. Scanner specifications may include one or more of: TIMERANGE, FILTER, LIMIT, STARTROW, STOPROW, ROWPREFIXFILTER, TIMESTAMP, MAXLENGTH, COLUMNS, CACHE, RAW, VERSIONS, ALL_METRICS, METRICS, REGION_REPLICA_ID, ISOLATION_LEVEL, READ_TYPE, ALLOW_PARTIAL_RESULTS, BATCH or MAX_RESULT_SIZE If no columns are specified, all columns will be scanned. To scan all members of a column family, leave the qualifier empty as in 'col_family'. The filter can be specified in two ways: 1. Using a filterString - more information on this is available in the Filter Language document attached to the HBASE-4176 JIRA 2. Using the entire package name of the filter. If you wish to see metrics regarding the execution of the scan, the ALL_METRICS boolean should be set to true. Alternatively, if you would prefer to see only a subset of the metrics, the METRICS array can be defined to include the names of only the metrics you care about. Some examples: hbase> scan 'hbase:meta' hbase> scan 'hbase:meta', {COLUMNS => 'info:regioninfo'} hbase> scan 'ns1:t1', {COLUMNS => ['c1', 'c2'], LIMIT => 10, STARTROW => 'xyz'} hbase> scan 't1', {COLUMNS => ['c1', 'c2'], LIMIT => 10, STARTROW => 'xyz'} hbase> scan 't1', {COLUMNS => 'c1', TIMERANGE => [1303668804000, 1303668904000]} hbase> scan 't1', {REVERSED => true} hbase> scan 't1', {ALL_METRICS => true} hbase> scan 't1', {METRICS => ['RPC_RETRIES', 'ROWS_FILTERED']} hbase> scan 't1', {ROWPREFIXFILTER => 'row2', FILTER => " (QualifierFilter (>=, 'binary:xyz')) AND (TimestampsFilter ( 123, 456))"} hbase> scan 't1', {FILTER => org.apache.hadoop.hbase.filter.ColumnPaginationFilter.new(1, 0)} hbase> scan 't1', {CONSISTENCY => 'TIMELINE'} hbase> scan 't1', {ISOLATION_LEVEL => 'READ_UNCOMMITTED'} hbase> scan 't1', {MAX_RESULT_SIZE => 123456} For setting the Operation Attributes hbase> scan 't1', { COLUMNS => ['c1', 'c2'], ATTRIBUTES => {'mykey' => 'myvalue'}} hbase> scan 't1', { COLUMNS => ['c1', 'c2'], AUTHORIZATIONS => ['PRIVATE','SECRET']} For experts, there is an additional option -- CACHE_BLOCKS -- which switches block caching for the scanner on (true) or off (false). By default it is enabled. Examples: hbase> scan 't1', {COLUMNS => ['c1', 'c2'], CACHE_BLOCKS => false} Also for experts, there is an advanced option -- RAW -- which instructs the scanner to return all cells (including delete markers and uncollected deleted cells). This option cannot be combined with requesting specific COLUMNS. Disabled by default. Example: hbase> scan 't1', {RAW => true, VERSIONS => 10} There is yet another option -- READ_TYPE -- which instructs the scanner to use a specific read type. Example: hbase> scan 't1', {READ_TYPE => 'PREAD'} Besides the default 'toStringBinary' format, 'scan' supports custom formatting by column. A user can define a FORMATTER by adding it to the column name in the scan specification. The FORMATTER can be stipulated: 1. either as a org.apache.hadoop.hbase.util.Bytes method name (e.g, toInt, toString) 2. or as a custom class followed by method name: e.g. 'c(MyFormatterClass).format'. Example formatting cf:qualifier1 and cf:qualifier2 both as Integers: hbase> scan 't1', {COLUMNS => ['cf:qualifier1:toInt', 'cf:qualifier2:c(org.apache.hadoop.hbase.util.Bytes).toInt'] } Note that you can specify a FORMATTER by column only (cf:qualifier). You can set a formatter for all columns (including, all key parts) using the "FORMATTER" and "FORMATTER_CLASS" options. The default "FORMATTER_CLASS" is "org.apache.hadoop.hbase.util.Bytes". hbase> scan 't1', {FORMATTER => 'toString'} hbase> scan 't1', {FORMATTER_CLASS => 'org.apache.hadoop.hbase.util.Bytes', FORMATTER => 'toString'} Scan can also be used directly from a table, by first getting a reference to a table, like such: hbase> t = get_table 't' hbase> t.scan Note in the above situation, you can still provide all the filtering, columns, options, etc as described above. hbase(main):020:0>
hbase(main):020:0> scan 'teacher' #查看全表信息，生產環境中不推薦使用該命令，因為產線的數據是相當龐大的! ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590402865107, value=beijing 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 10002 column=synopsis:address, timestamp=1590402961446, value=shijiazhuang 10002 column=synopsis:age, timestamp=1590402919298, value=27 10002 column=synopsis:name, timestamp=1590402908251, value=jason yin 2 row(s) Took 0.1843 seconds hbase(main):021:0>
hbase(main):021:0> scan 'teacher',{STARTROW => '10001',STOPROW => '10002'} #僅查看ROWKEY為"10001"的行。注意在使用STARTEOW和STOPROW時，是左閉右開區間喲~ ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590402865107, value=beijing 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0227 seconds hbase(main):022:0>
hbase(main):022:0> scan 'teacher',{STARTROW => '10001'} #指定查看的起始點"10001"行后的所有數據。 ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590402865107, value=beijing 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 10002 column=synopsis:address, timestamp=1590402961446, value=shijiazhuang 10002 column=synopsis:age, timestamp=1590402919298, value=27 10002 column=synopsis:name, timestamp=1590402908251, value=jason yin 2 row(s) Took 0.0128 seconds hbase(main):023:0>
hbase(main):023:0> help "get" Get row or cell contents; pass table name, row, and optionally a dictionary of column(s), timestamp, timerange and versions. Examples: hbase> get 'ns1:t1', 'r1' hbase> get 't1', 'r1' hbase> get 't1', 'r1', {TIMERANGE => [ts1, ts2]} hbase> get 't1', 'r1', {COLUMN => 'c1'} hbase> get 't1', 'r1', {COLUMN => ['c1', 'c2', 'c3']} hbase> get 't1', 'r1', {COLUMN => 'c1', TIMESTAMP => ts1} hbase> get 't1', 'r1', {COLUMN => 'c1', TIMERANGE => [ts1, ts2], VERSIONS => 4} hbase> get 't1', 'r1', {COLUMN => 'c1', TIMESTAMP => ts1, VERSIONS => 4} hbase> get 't1', 'r1', {FILTER => "ValueFilter(=, 'binary:abc')"} hbase> get 't1', 'r1', 'c1' hbase> get 't1', 'r1', 'c1', 'c2' hbase> get 't1', 'r1', ['c1', 'c2'] hbase> get 't1', 'r1', {COLUMN => 'c1', ATTRIBUTES => {'mykey'=>'myvalue'}} hbase> get 't1', 'r1', {COLUMN => 'c1', AUTHORIZATIONS => ['PRIVATE','SECRET']} hbase> get 't1', 'r1', {CONSISTENCY => 'TIMELINE'} hbase> get 't1', 'r1', {CONSISTENCY => 'TIMELINE', REGION_REPLICA_ID => 1} Besides the default 'toStringBinary' format, 'get' also supports custom formatting by column. A user can define a FORMATTER by adding it to the column name in the get specification. The FORMATTER can be stipulated: 1. either as a org.apache.hadoop.hbase.util.Bytes method name (e.g, toInt, toString) 2. or as a custom class followed by method name: e.g. 'c(MyFormatterClass).format'. Example formatting cf:qualifier1 and cf:qualifier2 both as Integers: hbase> get 't1', 'r1' {COLUMN => ['cf:qualifier1:toInt', 'cf:qualifier2:c(org.apache.hadoop.hbase.util.Bytes).toInt'] } Note that you can specify a FORMATTER by column only (cf:qualifier). You can set a formatter for all columns (including, all key parts) using the "FORMATTER" and "FORMATTER_CLASS" options. The default "FORMATTER_CLASS" is "org.apache.hadoop.hbase.util.Bytes". hbase> get 't1', 'r1', {FORMATTER => 'toString'} hbase> get 't1', 'r1', {FORMATTER_CLASS => 'org.apache.hadoop.hbase.util.Bytes', FORMATTER => 'toString'} The same commands also can be run on a reference to a table (obtained via get_table or create_table). Suppose you had a reference t to table 't1', the corresponding commands would be: hbase> t.get 'r1' hbase> t.get 'r1', {TIMERANGE => [ts1, ts2]} hbase> t.get 'r1', {COLUMN => 'c1'} hbase> t.get 'r1', {COLUMN => ['c1', 'c2', 'c3']} hbase> t.get 'r1', {COLUMN => 'c1', TIMESTAMP => ts1} hbase> t.get 'r1', {COLUMN => 'c1', TIMERANGE => [ts1, ts2], VERSIONS => 4} hbase> t.get 'r1', {COLUMN => 'c1', TIMESTAMP => ts1, VERSIONS => 4} hbase> t.get 'r1', {FILTER => "ValueFilter(=, 'binary:abc')"} hbase> t.get 'r1', 'c1' hbase> t.get 'r1', 'c1', 'c2' hbase> t.get 'r1', ['c1', 'c2'] hbase> t.get 'r1', {CONSISTENCY => 'TIMELINE'} hbase> t.get 'r1', {CONSISTENCY => 'TIMELINE', REGION_REPLICA_ID => 1} hbase(main):024:0>
hbase(main):024:0> get 'teacher','10001' #查看指定(ROWKEY)行的數據 COLUMN CELL synopsis:address timestamp=1590404964908, value=AnKang synopsis:age timestamp=1590402849894, value=18 synopsis:name timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.4822 seconds hbase(main):025:0>
hbase(main):025:0> get 'teacher','10001','synopsis:name' #查看指定(ROWKEY)行的列族字段數據 COLUMN CELL synopsis:name timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0179 seconds hbase(main):026:0>
9>.更新指定字段的數據
hbase(main):026:0> scan 'teacher',{STARTROW => '10001',STOPROW => '10002'} ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590402865107, value=beijing 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0107 seconds hbase(main):027:0> put 'teacher','10001','synopsis:address','AnKang' #當插入的數據其字段不存在時新建，但插入的數據其字段已存在時會覆蓋原來的數據喲~ Took 0.0138 seconds hbase(main):028:0> scan 'teacher',{STARTROW => '10001',STOPROW => '10002'} ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0164 seconds hbase(main):029:0>
10>.統計表行數
hbase(main):030:0> count 'teacher' 2 row(s) Took 0.0777 seconds => 2 hbase(main):031:0>
11>.變更表信息
hbase(main):016:0> describe 'teacher' Table teacher is ENABLED teacher COLUMN FAMILIES DESCRIPTION {NAME => 'professional_skill', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'project_experience', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'synopsis', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMF ILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 3 row(s) QUOTAS 0 row(s) Took 0.0835 seconds hbase(main):017:0> alter 'teacher',{NAME => 'synopsis',VERSIONS => 5} #修改"teacher"表，讓其管理最近修改的版本次數為5(即會記錄最近5詞該列族的所有字段的修改)。 Updating all regions with the new schema... 1/1 regions updated. Done. Took 2.8844 seconds hbase(main):018:0> describe 'teacher' Table teacher is ENABLED teacher COLUMN FAMILIES DESCRIPTION {NAME => 'professional_skill', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'project_experience', VERSIONS => '1', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => ' 0', BLOOMFILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} {NAME => 'synopsis', VERSIONS => '5', EVICT_BLOCKS_ON_CLOSE => 'false', NEW_VERSION_BEHAVIOR => 'false', KEEP_DELETED_CELLS => 'FALSE', CACHE_DATA_ON_WRITE => 'false', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMF ILTER => 'ROW', CACHE_INDEX_ON_WRITE => 'false', IN_MEMORY => 'false', CACHE_BLOOMS_ON_WRITE => 'false', PREFETCH_BLOCKS_ON_OPEN => 'false', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 3 row(s) QUOTAS 0 row(s) Took 0.0775 seconds hbase(main):019:0>
hbase(main):027:0> scan 'teacher',{STARTROW => '10001',STOPROW => '10002'} ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590413642872, value=beijing 10001 column=synopsis:name, timestamp=1590417615037, value=yinzhengjie2020 1 row(s) Took 0.0096 seconds hbase(main):028:0> get 'teacher','10001','synopsis:name' COLUMN CELL synopsis:name timestamp=1590417615037, value=yinzhengjie2020 1 row(s) Took 0.0063 seconds hbase(main):029:0>
hbase(main):031:0> put 'teacher','10001','synopsis:name','yinzhengjie2019' #連續修改5次數據 Took 0.0064 seconds hbase(main):032:0> put 'teacher','10001','synopsis:name','yinzhengjie2018' Took 0.0063 seconds hbase(main):033:0> put 'teacher','10001','synopsis:name','yinzhengjie2017' Took 0.0094 seconds hbase(main):034:0> put 'teacher','10001','synopsis:name','yinzhengjie2016' Took 0.0080 seconds hbase(main):035:0> put 'teacher','10001','synopsis:name','yinzhengjie2015' Took 0.0141 seconds hbase(main):036:0> scan 'teacher',{STARTROW => '10001',STOPROW => '10002'} ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590413642872, value=beijing 10001 column=synopsis:name, timestamp=1590417809578, value=yinzhengjie2015 #不難發現，最新的數據保留的是最后一次修改記錄。 1 row(s) Took 0.0088 seconds hbase(main):037:0>
hbase(main):044:0> get 'teacher','10001',{COLUMN=>'synopsis:name',VERSIONS=>3} #查看"teacher"表,ROWKEY為"10001",列族為"synopsis"，字段名為"name"的最近3次修改的記錄。 COLUMN CELL synopsis:name timestamp=1590417809578, value=yinzhengjie2015 synopsis:name timestamp=1590417806829, value=yinzhengjie2016 synopsis:name timestamp=1590417803412, value=yinzhengjie2017 1 row(s) Took 0.0154 seconds hbase(main):045:0>
hbase(main):045:0> get 'teacher','10001',{COLUMN=>'synopsis:name',VERSIONS=>5} COLUMN CELL synopsis:name timestamp=1590417809578, value=yinzhengjie2015 synopsis:name timestamp=1590417806829, value=yinzhengjie2016 synopsis:name timestamp=1590417803412, value=yinzhengjie2017 synopsis:name timestamp=1590417762124, value=yinzhengjie2018 synopsis:name timestamp=1590417698039, value=yinzhengjie2019 1 row(s) Took 0.0111 seconds hbase(main):046:0>
hbase(main):046:0> get 'teacher','10001',{COLUMN=>'synopsis:name',VERSIONS=>10} #同上，查看最近10次的記錄。但是我們上面在變更表時指定"synopsis"列族僅能保存5個版本，因此查看10個版本也只會顯示最近5次修改的記錄喲~ COLUMN CELL synopsis:name timestamp=1590417809578, value=yinzhengjie2015 synopsis:name timestamp=1590417806829, value=yinzhengjie2016 synopsis:name timestamp=1590417803412, value=yinzhengjie2017 synopsis:name timestamp=1590417762124, value=yinzhengjie2018 synopsis:name timestamp=1590417698039, value=yinzhengjie2019 1 row(s) Took 0.0096 seconds hbase(main):047:0>
12>.刪除數據
hbase(main):031:0> scan 'teacher' ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 10002 column=synopsis:address, timestamp=1590402961446, value=shijiazhuang 10002 column=synopsis:age, timestamp=1590402919298, value=27 10002 column=synopsis:name, timestamp=1590402908251, value=jason yin 2 row(s) Took 0.0130 seconds hbase(main):032:0> deleteall 'teacher','10002' #刪除ROWKEY為"10002"的全部數據 Took 0.0293 seconds hbase(main):033:0> scan 'teacher' ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0276 seconds hbase(main):034:0>
hbase(main):033:0> scan 'teacher' ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:age, timestamp=1590402849894, value=18 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0276 seconds hbase(main):034:0> delete 'teacher','10001','synopsis:age' #刪除ROWKEY為"10001"，列族為"synopsis",字段為"age"的數據 Took 0.0113 seconds hbase(main):035:0> scan 'teacher' ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0083 seconds hbase(main):036:0>
hbase(main):037:0> scan 'teacher' ROW COLUMN+CELL 10001 column=synopsis:address, timestamp=1590404964908, value=AnKang 10001 column=synopsis:name, timestamp=1590402838027, value=yinzhengjie 1 row(s) Took 0.0089 seconds hbase(main):038:0> truncate 'teacher' #清空表數據,從下面的輸出可以看出,清空表的操作順序為先disable，然后再truncate。 Truncating 'teacher' table (it may take a while): Disabling table... Truncating table... Took 4.7630 seconds hbase(main):039:0> scan 'teacher' ROW COLUMN+CELL 0 row(s) Took 0.8933 seconds hbase(main):040:0>
13>.刪除表操作
hbase(main):040:0> list TABLE teacher 1 row(s) Took 0.0140 seconds => ["teacher"] hbase(main):041:0> disable 'teacher' #禁用"teacher"表 Took 0.7649 seconds hbase(main):042:0> drop 'teacher' #在執行刪除"teacher"表操作前，該表必須處於"Disable"狀態 Took 0.4524 seconds hbase(main):043:0> list TABLE 0 row(s) Took 0.0098 seconds => [] hbase(main):044:0>
14>.查看名稱空間
hbase(main):063:0> help "list_namespace" #僅查看"list_namespace"命令的幫助信息 List all namespaces in hbase. Optional regular expression parameter could be used to filter the output. Examples: hbase> list_namespace hbase> list_namespace 'abc.*' hbase(main):064:0>
hbase(main):064:0> list_namespace #很明顯，在沒有創建任何名稱空間時，默認就有2個名稱空間喲~ NAMESPACE default hbase 2 row(s) Took 0.0152 seconds hbase(main):065:0>
15>.創建名稱空間
hbase(main):067:0> help "create_namespace" #僅查看"create_namespace"命令的幫助信息 Create namespace; pass namespace name, and optionally a dictionary of namespace configuration. Examples: hbase> create_namespace 'ns1' hbase> create_namespace 'ns1', {'PROPERTY_NAME'=>'PROPERTY_VALUE'} hbase(main):068:0>
hbase(main):068:0> list_namespace NAMESPACE default hbase 2 row(s) Took 0.0304 seconds hbase(main):069:0> create_namespace 'yinzhengjie2020' #創建"yinzhengjie2020"這個名稱空間。 Took 0.2975 seconds hbase(main):070:0> list_namespace NAMESPACE default hbase yinzhengjie2020 3 row(s) Took 0.0170 seconds hbase(main):071:0>
16>.在指定名稱空間創建表
hbase(main):070:0> list_namespace NAMESPACE default hbase yinzhengjie2020 3 row(s) Took 0.0170 seconds hbase(main):071:0> create 'yinzhengjie2020:student','courses','info','detail' #新建表時指定名稱空間，就會將該表創建在相應的名稱空間喲~ Created table yinzhengjie2020:student Took 2.3499 seconds => Hbase::Table - yinzhengjie2020:student hbase(main):072:0> list TABLE teacher yinzhengjie2020:student 2 row(s) Took 0.0048 seconds => ["teacher", "yinzhengjie2020:student"] hbase(main):073:0>
17>.刪除名稱空間
hbase(main):080:0> list TABLE teacher yinzhengjie2020:student 2 row(s) Took 0.0106 seconds => ["teacher", "yinzhengjie2020:student"] hbase(main):081:0> disable "yinzhengjie2020:student" Took 0.9778 seconds hbase(main):082:0> drop "yinzhengjie2020:student" Took 0.4751 seconds hbase(main):083:0> list_namespace NAMESPACE default hbase yinzhengjie2020 3 row(s) Took 0.0194 seconds hbase(main):084:0> drop_namespace "yinzhengjie2020" #刪除名稱空間之前要確保該名稱空間沒有保存表信息(換句話說，需要手動刪除該名稱空間的所有表)。 Took 0.2688 seconds hbase(main):085:0> list_namespace NAMESPACE default hbase 2 row(s) Took 0.0205 seconds hbase(main):086:0>
三.HBase工作原理概述
博主推薦閱讀: https://www.cnblogs.com/yinzhengjie2020/p/12237264.html