[
https://issues.apache.org/jira/browse/SPARK-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Teng Qiu updated SPARK-12014:
-----------------------------
Description:
Actually it is known hive issue:
https://issues.apache.org/jira/browse/HIVE-11100
patch available: https://reviews.apache.org/r/35907/diff/1
but Spark uses its own maven dependencies for hive (org.spark-project.hive), we
can not use this patch to fix the problem, it would be better if you can fix
this in spark's hive package.
In spark's beeline, the error message will be:
{code}
0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
FORMAT DELIMITED FIELDS TERMINATED BY ';' LINES TERMINATED BY '\n';
Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
expecting StringLiteral near 'BY' in table row format's field separator; line 1
pos 87 (state=,code=0)
0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
FORMAT DELIMITED FIELDS TERMINATED BY '\;' LINES TERMINATED BY '\n';
Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
expecting StringLiteral near 'BY' in table row format's field separator; line 1
pos 88 (state=,code=0)
0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,';','=')['u2'] FROM
some_logs WHERE log_date = '20151125' limit 5;
Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
'<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 30 (state=,code=0)
0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,'\;','=')['u2'] FROM
some_logs WHERE log_date = '20151125' limit 5;
Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
'<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 31 (state=,code=0)
{code}
was:
Actually it is known hive issue:
https://issues.apache.org/jira/browse/HIVE-11100
patch available: https://reviews.apache.org/r/35907/diff/1
but Spark uses its own hive maven dependencies for hive
(org.spark-project.hive), we can not use this patch to fix the problem, it
would be better if you can fix this in spark's hive package.
In spark's beeline, the error message will be:
{code}
0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
FORMAT DELIMITED FIELDS TERMINATED BY ';' LINES TERMINATED BY '\n';
Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
expecting StringLiteral near 'BY' in table row format's field separator; line 1
pos 87 (state=,code=0)
0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
FORMAT DELIMITED FIELDS TERMINATED BY '\;' LINES TERMINATED BY '\n';
Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
expecting StringLiteral near 'BY' in table row format's field separator; line 1
pos 88 (state=,code=0)
0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,';','=')['u2'] FROM
some_logs WHERE log_date = '20151125' limit 5;
Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
'<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 30 (state=,code=0)
0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,'\;','=')['u2'] FROM
some_logs WHERE log_date = '20151125' limit 5;
Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
'<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 31 (state=,code=0)
{code}
> Spark SQL query containing semicolon is broken in Beeline (related to
> HIVE-11100)
> ---------------------------------------------------------------------------------
>
> Key: SPARK-12014
> URL: https://issues.apache.org/jira/browse/SPARK-12014
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 1.5.2
> Reporter: Teng Qiu
> Priority: Minor
>
> Actually it is known hive issue:
> https://issues.apache.org/jira/browse/HIVE-11100
> patch available: https://reviews.apache.org/r/35907/diff/1
> but Spark uses its own maven dependencies for hive (org.spark-project.hive),
> we can not use this patch to fix the problem, it would be better if you can
> fix this in spark's hive package.
> In spark's beeline, the error message will be:
> {code}
> 0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
> FORMAT DELIMITED FIELDS TERMINATED BY ';' LINES TERMINATED BY '\n';
> Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
> expecting StringLiteral near 'BY' in table row format's field separator; line
> 1 pos 87 (state=,code=0)
> 0: jdbc:hive2://host:10000/> CREATE TABLE beeline_tb (c1 int, c2 string) ROW
> FORMAT DELIMITED FIELDS TERMINATED BY '\;' LINES TERMINATED BY '\n';
> Error: org.apache.spark.sql.AnalysisException: mismatched input '<EOF>'
> expecting StringLiteral near 'BY' in table row format's field separator; line
> 1 pos 88 (state=,code=0)
> 0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,';','=')['u2'] FROM
> some_logs WHERE log_date = '20151125' limit 5;
> Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
> '<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 30 (state=,code=0)
> 0: jdbc:hive2://host:10000/> SELECT str_to_map(other_data,'\;','=')['u2']
> FROM some_logs WHERE log_date = '20151125' limit 5;
> Error: org.apache.spark.sql.AnalysisException: cannot recognize input near
> '<EOF>' '<EOF>' '<EOF>' in select expression; line 1 pos 31 (state=,code=0)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
