[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276864#comment-17276864 ] xinzhang commented on SPARK-12497: -- [~kabhwan] Sorry for the mixed up Tests. Please recheck the new test. # It's good with Spark 3.0.0 . (BTW: semicolon is good in beeline # It's still a bug with Spark 2.4.7 . [root@actuatorx-dispatcher-172-25-48-173 spark]# env|grep spark SPARK_HOME=/opt/spark/spark-bin PATH=/root/perl5/bin:/opt/scala/scala-bin//bin:/opt/spark/spark-bin/bin:172.25.52.34:/opt/hive/hive-bin/bin/:172.31.10.86:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/root/bin:/usr/local/swosbf/bin:/usr/local/swosbf/bin/system:/usr/java/jdk/bin:/usr/bin:/usr/sbin:/bin:/sbin:/usr/X11R6/bin:/root/bin PWD=/opt/spark [root@actuatorx-dispatcher-172-25-48-173 spark]# ll total 4 -rw-r--r-- 1 root root 646 Feb 1 17:44 derby.log drwxr-xr-x 5 root root 133 Feb 1 17:44 metastore_db drwxr-xr-x 14 root root 255 Sep 22 13:57 spark-2.3.0-bin-hadoop2.6 drwxr-xr-x 14 1000 1000 240 Feb 2 13:32 spark-2.4.7-bin-hadoop2.6 drwxr-xr-x 14 root root 240 Feb 2 13:26 spark-3.0.0-bin-hadoop2.7 lrwxrwxrwx 1 root root 25 Feb 1 15:42 spark-bin -> spark-2.4.7-bin-hadoop2.6 [root@actuatorx-dispatcher-172-25-48-173 spark]# jps 3348544 RunJar 3354564 Jps 3354234 RunJar 984853 JarLauncher [root@actuatorx-dispatcher-172-25-48-173 spark]# sh spark-bin/sbin/start-thriftserver.sh starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /opt/spark/spark-bin/logs/spark-root-org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1-actuatorx-dispatcher-172-25-48-173.out [root@actuatorx-dispatcher-172-25-48-173 spark]# netstat -anp|grep 3355197 tcp 0 0 172.25.48.173:21120 0.0.0.0:* LISTEN 3355197/java tcp 0 0 0.0.0.0:4040 0.0.0.0:* LISTEN 3355197/java tcp 0 0 172.25.48.173:22219 0.0.0.0:* LISTEN 3355197/java tcp 0 0 0.0.0.0:50031 0.0.0.0:* LISTEN 3355197/java tcp 0 0 172.25.48.173:51797 172.25.48.231:6033 ESTABLISHED 3355197/java tcp 0 0 172.25.48.173:51795 172.25.48.231:6033 ESTABLISHED 3355197/java tcp 0 0 172.25.48.173:51787 172.25.48.231:6033 ESTABLISHED 3355197/java tcp 0 0 172.25.48.173:51789 172.25.48.231:6033 ESTABLISHED 3355197/java unix 3 [ ] STREAM CONNECTED 534110569 3355197/java unix 3 [ ] STREAM CONNECTED 534110568 3355197/java unix 2 [ ] STREAM CONNECTED 534050562 3355197/java unix 2 [ ] STREAM CONNECTED 534110572 3355197/java [root@actuatorx-dispatcher-172-25-48-173 spark]# /opt/spark/spark-bin/bin/beeline -u jdbc:hive2://172.25.48.173:50031/tools -n tools Connecting to jdbc:hive2://172.25.48.173:50031/tools 21/02/02 13:38:57 INFO jdbc.Utils: Supplied authorities: 172.25.48.173:50031 21/02/02 13:38:57 INFO jdbc.Utils: Resolved authority: 172.25.48.173:50031 21/02/02 13:38:57 INFO jdbc.HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://172.25.48.173:50031/tools Connected to: Spark SQL (version 2.4.7) Driver: Hive JDBC (version 1.2.1.spark2) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1.spark2 by Apache Hive 0: jdbc:hive2://172.25.48.173:50031/tools> select '\;'; Error: org.apache.spark.sql.catalyst.parser.ParseException: no viable alternative at input 'select ''(line 1, pos 7) == SQL == select '\ ---^^^ (state=,code=0) 0: jdbc:hive2://172.25.48.173:50031/tools> !exit Closing: 0: jdbc:hive2://172.25.48.173:50031/tools [root@actuatorx-dispatcher-172-25-48-173 spark]# > thriftServer does not support semicolon in sql > --- > > Key: SPARK-12497 > URL: https://issues.apache.org/jira/browse/SPARK-12497 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 1.5.2 >Reporter: nilonealex >Priority: Major > > 0: jdbc:hive2://192.168.128.130:14005> SELECT ';' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 8 (state=,code=0) > 0: jdbc:hive2://192.168.128.130:14005> > 0: jdbc:hive2://192.168.128.130:14005> select '\;' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 9 (state=,code=0) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276221#comment-17276221 ] Jungtaek Lim commented on SPARK-12497: -- That is odd, see what is printed for Spark version and Hive version; Spark version 2.4.7 & Hive version 1.2.1.spark2. Please double check the directory is not mixed up with multiple version, as well as you don't run previous instance of thrift server. > thriftServer does not support semicolon in sql > --- > > Key: SPARK-12497 > URL: https://issues.apache.org/jira/browse/SPARK-12497 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 1.5.2 >Reporter: nilonealex >Priority: Major > > 0: jdbc:hive2://192.168.128.130:14005> SELECT ';' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 8 (state=,code=0) > 0: jdbc:hive2://192.168.128.130:14005> > 0: jdbc:hive2://192.168.128.130:14005> select '\;' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 9 (state=,code=0) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276207#comment-17276207 ] xinzhang commented on SPARK-12497: -- It's still a bug with spark 3.0.0 . Start spark thriftserver with default port 1, use spark's beeline connect. Setp 1: [root@172-25-48-173 spark]# sh spark-3.0.0-bin-hadoop2.7/sbin/start-thriftserver.sh ... Setp 2: [root@172-25-48-173 spark]# sh spark-3.0.0-bin-hadoop2.7/bin/beeline Beeline version 1.2.1.spark2 by Apache Hive beeline> !connect jdbc:hive2://172.25.48.173:1 Connecting to jdbc:hive2://172.25.48.173:1 Enter username for jdbc:hive2://172.25.48.173:1: Enter password for jdbc:hive2://172.25.48.173:1: log4j:WARN No appenders could be found for logger (org.apache.hive.jdbc.Utils). log4j:WARN Please initialize the log4j system properly. log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info. Connected to: Spark SQL (version 2.4.7) Driver: Hive JDBC (version 1.2.1.spark2) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://172.25.48.173:1> select '\;'; Error: org.apache.spark.sql.catalyst.parser.ParseException: no viable alternative at input 'select ''(line 1, pos 7) == SQL == select '\ ---^^^ (state=,code=0) 0: jdbc:hive2://172.25.48.173:1> Am i missing something? > thriftServer does not support semicolon in sql > --- > > Key: SPARK-12497 > URL: https://issues.apache.org/jira/browse/SPARK-12497 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 1.5.2 >Reporter: nilonealex >Priority: Major > > 0: jdbc:hive2://192.168.128.130:14005> SELECT ';' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 8 (state=,code=0) > 0: jdbc:hive2://192.168.128.130:14005> > 0: jdbc:hive2://192.168.128.130:14005> select '\;' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 9 (state=,code=0) -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-12497) thriftServer does not support semicolon in sql
[ https://issues.apache.org/jira/browse/SPARK-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097992#comment-15097992 ] Ajesh Kumar commented on SPARK-12497: - I think this should be treated as a hive issue rather than spark issue. > thriftServer does not support semicolon in sql > --- > > Key: SPARK-12497 > URL: https://issues.apache.org/jira/browse/SPARK-12497 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 1.5.2 >Reporter: nilonealex > > 0: jdbc:hive2://192.168.128.130:14005> SELECT ';' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 8 (state=,code=0) > 0: jdbc:hive2://192.168.128.130:14005> > 0: jdbc:hive2://192.168.128.130:14005> select '\;' from tx_1 limit 1 ; > Error: org.apache.spark.sql.AnalysisException: cannot recognize input near > '' '' '' in select clause; line 1 pos 9 (state=,code=0) -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org