Dear All,
I am facing issue in bulk loading from csv files into Phoenix when my Phoenix
table contains '-' (hyphen) in table name.
I am using Phoenix version 4.7.0. Phoenix supports '-' (hyphen) in table name
as per naming conventions. [a-zA-Z_0-9-.]
If I try to bulk load using below command it fails and gives below error.
sudo -u hadoop
HADOOP_CLASSPATH=/usr/lib/hbase/hbase-protocol.jar:/usr/lib/hbase/conf/ hadoop
jar /usr/lib/phoenix/phoenix-client.jar
org.apache.phoenix.mapreduce.CsvBulkLoadTool -Dfs.permissions.umask-mode=000 -t
'DMG-TEST' --input "/user/test/1/DMG-TEST.csv" -d $'\t'
So ultimately it removes any single or double quotes around table name before
upserting which causes error 601.
2016-07-14 05:39:07,380 WARN [main]
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system
already initialized!
2016-07-14 05:39:08,944 INFO [main] org.apache.phoenix.util.UpsertExecutor:
Upserting SQL data with UPSERT INTO DMG-TEST ("APPLICATIONID",
"0"."PACKAGEID") VALUES (?, ?)
2016-07-14 05:39:08,945 INFO [main] org.apache.hadoop.mapred.MapTask: Starting
flush of map output
2016-07-14 05:39:08,952 INFO [main] org.apache.hadoop.io.compress.CodecPool:
Got brand-new compressor [.snappy]
2016-07-14 05:39:08,959 WARN [main] org.apache.hadoop.mapred.YarnChild:
Exception running child : java.lang.RuntimeException:
org.apache.phoenix.exception.PhoenixParserException: ERROR 601 (42P00): Syntax
error. Encountered "-" at line 1, column 17.
at
org.apache.phoenix.util.UpsertExecutor.createStatement(UpsertExecutor.java:83)
at org.apache.phoenix.util.UpsertExecutor.<init>(UpsertExecutor.java:94)
at
org.apache.phoenix.util.csv.CsvUpsertExecutor.<init>(CsvUpsertExecutor.java:63)
at
org.apache.phoenix.mapreduce.CsvToKeyValueMapper.buildUpsertExecutor(CsvToKeyValueMapper.java:85)
at
org.apache.phoenix.mapreduce.FormatToBytesWritableMapper.setup(FormatToBytesWritableMapper.java:142)
at
org.apache.phoenix.mapreduce.CsvToKeyValueMapper.setup(CsvToKeyValueMapper.java:67)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:143)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: org.apache.phoenix.exception.PhoenixParserException: ERROR 601
(42P00): Syntax error. Encountered "-" at line 1, column 17.
at
org.apache.phoenix.exception.PhoenixParserException.newException(PhoenixParserException.java:33)
at org.apache.phoenix.parse.SQLParser.parseStatement(SQLParser.java:111)
at
org.apache.phoenix.jdbc.PhoenixStatement$PhoenixStatementParser.parseStatement(PhoenixStatement.java:1185)
at
org.apache.phoenix.jdbc.PhoenixStatement.parseStatement(PhoenixStatement.java:1268)
at
org.apache.phoenix.jdbc.PhoenixPreparedStatement.<init>(PhoenixPreparedStatement.java:94)
at
org.apache.phoenix.jdbc.PhoenixConnection.prepareStatement(PhoenixConnection.java:715)
at
org.apache.phoenix.util.UpsertExecutor.createStatement(UpsertExecutor.java:81)
... 13 more
Caused by: NoViableAltException(94@[])
at
org.apache.phoenix.parse.PhoenixSQLParser.upsert_node(PhoenixSQLParser.java:4723)
at
org.apache.phoenix.parse.PhoenixSQLParser.oneStatement(PhoenixSQLParser.java:775)
at
org.apache.phoenix.parse.PhoenixSQLParser.statement(PhoenixSQLParser.java:500)
at org.apache.phoenix.parse.SQLParser.parseStatement(SQLParser.java:108)
... 18 more
Thank you!!
Regards,
:: Dharmesh Guna
:: Development | Custom Reports
:: Contact | 961.199.87.52 | Ext. | 130 3264
