【原】創建Hive表，分號分隔符“；”引起的異常

【障礙再現】

在創建支持Map數據結構的Hive表時，拋出如下異常

hive> create table tab_map(name string,info map<string,string>)
    > row format delimited
    > fields terminated by '\t'
    > collection items terminated by ';'
    > map keys terminated by ':';
MismatchedTokenException(-1!=286)
        at org.antlr.runtime.BaseRecognizer.recoverFromMismatchedToken(BaseRecognizer.java:617)
        at org.antlr.runtime.BaseRecognizer.match(BaseRecognizer.java:115)
        at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormatCollItemsIdentifier(HiveParser.java:24000)
        at org.apache.hadoop.hive.ql.parse.HiveParser.rowFormatDelimited(HiveParser.java:22887)
        at org.apache.hadoop.hive.ql.parse.HiveParser.tableRowFormat(HiveParser.java:23091)
        at org.apache.hadoop.hive.ql.parse.HiveParser.createTableStatement(HiveParser.java:4388)
        at org.apache.hadoop.hive.ql.parse.HiveParser.ddlStatement(HiveParser.java:2016)
        at org.apache.hadoop.hive.ql.parse.HiveParser.execStatement(HiveParser.java:1298)
        at org.apache.hadoop.hive.ql.parse.HiveParser.statement(HiveParser.java:938)
        at org.apache.hadoop.hive.ql.parse.ParseDriver.parse(ParseDriver.java:190)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:424)
        at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:342)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:977)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:413)
        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:781)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:675)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
FAILED: ParseException line 4:32 mismatched input '<EOF>' expecting StringLiteral near 'by' in table row format's column separator

 

【原因分析】
主要原因是 定義字段分割符的時候 用了";"作為字段分隔符，而HDFS文件的的格式就是用分號隔開的，因此，相互沖突。

 

【解決方案】
找到分號的asc碼值 ： http://blog.csdn.net/lxpbs8851/article/details/11525501
（其他字符有同樣問題 也可以這樣做） 找到的是073 那么將定義表的語句修改為：
row format delimited fields terminated by '73'。

最初的建表代碼：

create table tab_map(name string,info map<string,string>)
row format delimited
fields terminated by '\t'
collection items terminated by ';'   <---- 注意此處
map keys terminated by ':';　　

解決問題后的代碼：

create table tab_map(name string,info map<string,string>)
row format delimited
fields terminated by '\t'
collection items terminated by '73'         <------注意此處
map keys terminated by ':';