[jira] [Updated] (DRILL-5932) HiveServer2 queries throw error with jdbc connection
[ https://issues.apache.org/jira/browse/DRILL-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tooptoop4 updated DRILL-5932: - Fix Version/s: (was: 1.12.0) > HiveServer2 queries throw error with jdbc connection > > > Key: DRILL-5932 > URL: https://issues.apache.org/jira/browse/DRILL-5932 > Project: Apache Drill > Issue Type: Bug > Components: Client - JDBC, Storage - Hive >Affects Versions: 1.11.0 > Environment: linux > 2.3 hive version >Reporter: tooptoop4 >Priority: Blocker > > Basic hive queries all throw error! > {code:sql} > copied > https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/2.3.0/hive-jdbc-2.3.0-standalone.jar > to /usr/lib/apache-drill-1.11.0/jars/3rdparty/hive-jdbc-2.3.0-standalone.jar > added this storage plugin: > { > "type": "jdbc", > "driver": "org.apache.hive.jdbc.HiveDriver", > "url": "jdbc:hive2://host:1/default", > "username": "hive", > "password": "hive1234", > "enabled": true > } > [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 > [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded > OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support > was removed in 8.0 > Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler > initialize > INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 > 01:25:26... > apache drill 1.11.0 > "this isn't your grandfather's sql" > 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; > Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the > SQL query. > sql SELECT COUNT(*) AS EXPR$0 > FROM (SELECT 0 AS $f0 > FROM.default.contact) AS t > plugin hive2 > Fragment 0:0 > [Error Id: 4b293e97-7547-49c5-91da-b9ee2f2184fc on > ip-myip.mydomain.orghere.com:31010] (state=,code=0) > 0: jdbc:drill:zk=local> ALTER SESSION SET `exec.errors.verbose` = true; > +---+---+ > | ok |summary| > +---+---+ > | true | exec.errors.verbose updated. | > +---+---+ > 1 row selected (0.351 seconds) > 0: jdbc:drill:zk=local> select * from hive2.contact; > Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the > SQL query. > sql SELECT * > FROM.default.contact > plugin hive2 > Fragment 0:0 > [Error Id: fe36b026-e8ff-4354-af6c-6073130680c9 on ip-ip.domain.org.com:31010] > (org.apache.hive.service.cli.HiveSQLException) Error while compiling > statement: FAILED: ParseException line 2:4 cannot recognize input near '.' > 'default' '.' in join source > org.apache.hive.jdbc.Utils.verifySuccess():267 > org.apache.hive.jdbc.Utils.verifySuccessWithInfo():253 > org.apache.hive.jdbc.HiveStatement.runAsyncOnServer():313 > org.apache.hive.jdbc.HiveStatement.execute():253 > org.apache.hive.jdbc.HiveStatement.executeQuery():476 > org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 > org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 > org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177 > org.apache.drill.exec.physical.impl.ScanBatch.():104 > org.apache.drill.exec.physical.impl.ScanBatch.():126 > org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40 > org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33 > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():156 > org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():136 > org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():109 > org.apache.drill.exec.physical.impl.ImplCreator.getExec():87 > org.apache.drill.exec.work.fragment.FragmentExecutor.run():207 > org.apache.drill.common.SelfCleaningRunnable.run():38 > java.util.concurrent.ThreadPoolExecutor.runWorker():1149 > java.util.concurrent.ThreadPoolExecutor$Worker.run():624 > java.lang.Thread.run():748 > Caused By (org.apache.hive.service.cli.HiveSQLException) Error while > compiling statement: FAILED: ParseException line 2:4 cannot recognize input > near '.' 'default' '.' in join source > org.apache.hive.service.cli.operation.Operation.toSQLException():380 > org.apache.hive.service.cli.operation.SQLOperation.prepare():206 > org.apache.hive.service.cli.operation.SQLOperation.runInternal():290 > org.apache.hive.service.cli.operation.Operation.run():320 > > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal():530 > > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync():517 > sun.reflect.GeneratedMethodAccessor86.invoke():-1 > s
[jira] [Updated] (DRILL-5932) HiveServer2 queries throw error with jdbc connection
[ https://issues.apache.org/jira/browse/DRILL-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tooptoop4 updated DRILL-5932: - Fix Version/s: 1.12.0 > HiveServer2 queries throw error with jdbc connection > > > Key: DRILL-5932 > URL: https://issues.apache.org/jira/browse/DRILL-5932 > Project: Apache Drill > Issue Type: Bug > Components: Client - JDBC, Storage - Hive >Affects Versions: 1.11.0 > Environment: linux > 2.3 hive version >Reporter: tooptoop4 >Priority: Blocker > Fix For: 1.12.0 > > > Basic hive queries all throw error! > {code:sql} > copied > https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/2.3.0/hive-jdbc-2.3.0-standalone.jar > to /usr/lib/apache-drill-1.11.0/jars/3rdparty/hive-jdbc-2.3.0-standalone.jar > added this storage plugin: > { > "type": "jdbc", > "driver": "org.apache.hive.jdbc.HiveDriver", > "url": "jdbc:hive2://host:1/default", > "username": "hive", > "password": "hive1234", > "enabled": true > } > [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 > [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded > OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support > was removed in 8.0 > Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler > initialize > INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 > 01:25:26... > apache drill 1.11.0 > "this isn't your grandfather's sql" > 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; > Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the > SQL query. > sql SELECT COUNT(*) AS EXPR$0 > FROM (SELECT 0 AS $f0 > FROM.default.contact) AS t > plugin hive2 > Fragment 0:0 > [Error Id: 4b293e97-7547-49c5-91da-b9ee2f2184fc on > ip-myip.mydomain.orghere.com:31010] (state=,code=0) > 0: jdbc:drill:zk=local> ALTER SESSION SET `exec.errors.verbose` = true; > +---+---+ > | ok |summary| > +---+---+ > | true | exec.errors.verbose updated. | > +---+---+ > 1 row selected (0.351 seconds) > 0: jdbc:drill:zk=local> select * from hive2.contact; > Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the > SQL query. > sql SELECT * > FROM.default.contact > plugin hive2 > Fragment 0:0 > [Error Id: fe36b026-e8ff-4354-af6c-6073130680c9 on ip-ip.domain.org.com:31010] > (org.apache.hive.service.cli.HiveSQLException) Error while compiling > statement: FAILED: ParseException line 2:4 cannot recognize input near '.' > 'default' '.' in join source > org.apache.hive.jdbc.Utils.verifySuccess():267 > org.apache.hive.jdbc.Utils.verifySuccessWithInfo():253 > org.apache.hive.jdbc.HiveStatement.runAsyncOnServer():313 > org.apache.hive.jdbc.HiveStatement.execute():253 > org.apache.hive.jdbc.HiveStatement.executeQuery():476 > org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 > org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 > org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177 > org.apache.drill.exec.physical.impl.ScanBatch.():104 > org.apache.drill.exec.physical.impl.ScanBatch.():126 > org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40 > org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33 > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():156 > org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 > org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():136 > org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 > org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():109 > org.apache.drill.exec.physical.impl.ImplCreator.getExec():87 > org.apache.drill.exec.work.fragment.FragmentExecutor.run():207 > org.apache.drill.common.SelfCleaningRunnable.run():38 > java.util.concurrent.ThreadPoolExecutor.runWorker():1149 > java.util.concurrent.ThreadPoolExecutor$Worker.run():624 > java.lang.Thread.run():748 > Caused By (org.apache.hive.service.cli.HiveSQLException) Error while > compiling statement: FAILED: ParseException line 2:4 cannot recognize input > near '.' 'default' '.' in join source > org.apache.hive.service.cli.operation.Operation.toSQLException():380 > org.apache.hive.service.cli.operation.SQLOperation.prepare():206 > org.apache.hive.service.cli.operation.SQLOperation.runInternal():290 > org.apache.hive.service.cli.operation.Operation.run():320 > > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal():530 > > org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync():517 > sun.reflect.GeneratedMethodAccessor8
[jira] [Updated] (DRILL-5932) HiveServer2 queries throw error with jdbc connection
[ https://issues.apache.org/jira/browse/DRILL-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tooptoop4 updated DRILL-5932: - Description: Basic hive queries all throw error! {code:sql} copied https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/2.3.0/hive-jdbc-2.3.0-standalone.jar to /usr/lib/apache-drill-1.11.0/jars/3rdparty/hive-jdbc-2.3.0-standalone.jar added this storage plugin: { "type": "jdbc", "driver": "org.apache.hive.jdbc.HiveDriver", "url": "jdbc:hive2://host:1/default", "username": "hive", "password": "hive1234", "enabled": true } [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler initialize INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26... apache drill 1.11.0 "this isn't your grandfather's sql" 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT COUNT(*) AS EXPR$0 FROM (SELECT 0 AS $f0 FROM.default.contact) AS t plugin hive2 Fragment 0:0 [Error Id: 4b293e97-7547-49c5-91da-b9ee2f2184fc on ip-myip.mydomain.orghere.com:31010] (state=,code=0) 0: jdbc:drill:zk=local> ALTER SESSION SET `exec.errors.verbose` = true; +---+---+ | ok |summary| +---+---+ | true | exec.errors.verbose updated. | +---+---+ 1 row selected (0.351 seconds) 0: jdbc:drill:zk=local> select * from hive2.contact; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT * FROM.default.contact plugin hive2 Fragment 0:0 [Error Id: fe36b026-e8ff-4354-af6c-6073130680c9 on ip-ip.domain.org.com:31010] (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 2:4 cannot recognize input near '.' 'default' '.' in join source org.apache.hive.jdbc.Utils.verifySuccess():267 org.apache.hive.jdbc.Utils.verifySuccessWithInfo():253 org.apache.hive.jdbc.HiveStatement.runAsyncOnServer():313 org.apache.hive.jdbc.HiveStatement.execute():253 org.apache.hive.jdbc.HiveStatement.executeQuery():476 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177 org.apache.drill.exec.physical.impl.ScanBatch.():104 org.apache.drill.exec.physical.impl.ScanBatch.():126 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():156 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():136 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():109 org.apache.drill.exec.physical.impl.ImplCreator.getExec():87 org.apache.drill.exec.work.fragment.FragmentExecutor.run():207 org.apache.drill.common.SelfCleaningRunnable.run():38 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 Caused By (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 2:4 cannot recognize input near '.' 'default' '.' in join source org.apache.hive.service.cli.operation.Operation.toSQLException():380 org.apache.hive.service.cli.operation.SQLOperation.prepare():206 org.apache.hive.service.cli.operation.SQLOperation.runInternal():290 org.apache.hive.service.cli.operation.Operation.run():320 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal():530 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync():517 sun.reflect.GeneratedMethodAccessor86.invoke():-1 sun.reflect.DelegatingMethodAccessorImpl.invoke():43 java.lang.reflect.Method.invoke():498 org.apache.hive.service.cli.session.HiveSessionProxy.invoke():78 org.apache.hive.service.cli.session.HiveSessionProxy.access$000():36 org.apache.hive.service.cli.session.HiveSessionProxy$1.run():63 java.security.AccessController.doPrivileged():-2 javax.security.auth.Subject.doAs():422 org.apache.hadoop.security.UserGroupInformation.doAs():1807 org.apache.hive.service.cli.session.HiveSessionProxy.invoke():59 com.sun.proxy.$Proxy42.executeStatementAsync():-1 org.apache.hive.service.cli.CLIService.executeStatementAsync():310
[jira] [Updated] (DRILL-5932) HiveServer2 queries throw error with jdbc connection
[ https://issues.apache.org/jira/browse/DRILL-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tooptoop4 updated DRILL-5932: - Description: Basic hive queries all throw error! {code:sql} copied https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/2.3.0/hive-jdbc-2.3.0-standalone.jar to /usr/lib/apache-drill-1.11.0/jars/3rdparty/hive-jdbc-2.3.0-standalone.jar added this storage plugin: { "type": "jdbc", "driver": "org.apache.hive.jdbc.HiveDriver", "url": "jdbc:hive2://host:1/default", "username": "hive", "password": "hive1234", "enabled": true } [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler initialize INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26... apache drill 1.11.0 "this isn't your grandfather's sql" 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT COUNT(*) AS EXPR$0 FROM (SELECT 0 AS $f0 FROM.default.contact) AS t plugin hive2 Fragment 0:0 [Error Id: 4b293e97-7547-49c5-91da-b9ee2f2184fc on ip-myip.mydomain.orghere.com:31010] (state=,code=0) 0: jdbc:drill:zk=local> ALTER SESSION SET `exec.errors.verbose` = true; +---+---+ | ok |summary| +---+---+ | true | exec.errors.verbose updated. | +---+---+ 1 row selected (0.351 seconds) 0: jdbc:drill:zk=local> select * from hive2.contact; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT * FROM.default.contact plugin hive2 Fragment 0:0 [Error Id: fe36b026-e8ff-4354-af6c-6073130680c9 on ip-10-160-153-163.syd.non.c1.macquarie.com:31010] (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 2:4 cannot recognize input near '.' 'default' '.' in join source org.apache.hive.jdbc.Utils.verifySuccess():267 org.apache.hive.jdbc.Utils.verifySuccessWithInfo():253 org.apache.hive.jdbc.HiveStatement.runAsyncOnServer():313 org.apache.hive.jdbc.HiveStatement.execute():253 org.apache.hive.jdbc.HiveStatement.executeQuery():476 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177 org.apache.drill.exec.physical.impl.ScanBatch.():104 org.apache.drill.exec.physical.impl.ScanBatch.():126 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():156 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():136 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():109 org.apache.drill.exec.physical.impl.ImplCreator.getExec():87 org.apache.drill.exec.work.fragment.FragmentExecutor.run():207 org.apache.drill.common.SelfCleaningRunnable.run():38 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 Caused By (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 2:4 cannot recognize input near '.' 'default' '.' in join source org.apache.hive.service.cli.operation.Operation.toSQLException():380 org.apache.hive.service.cli.operation.SQLOperation.prepare():206 org.apache.hive.service.cli.operation.SQLOperation.runInternal():290 org.apache.hive.service.cli.operation.Operation.run():320 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal():530 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync():517 sun.reflect.GeneratedMethodAccessor86.invoke():-1 sun.reflect.DelegatingMethodAccessorImpl.invoke():43 java.lang.reflect.Method.invoke():498 org.apache.hive.service.cli.session.HiveSessionProxy.invoke():78 org.apache.hive.service.cli.session.HiveSessionProxy.access$000():36 org.apache.hive.service.cli.session.HiveSessionProxy$1.run():63 java.security.AccessController.doPrivileged():-2 javax.security.auth.Subject.doAs():422 org.apache.hadoop.security.UserGroupInformation.doAs():1807 org.apache.hive.service.cli.session.HiveSessionProxy.invoke():59 com.sun.proxy.$Proxy42.executeStatementAsync():-1 org.apache.hive.service.cli.CLIService.execute
[jira] [Created] (DRILL-5932) HiveServer2 queries throw error with jdbc connection
tooptoop4 created DRILL-5932: Summary: HiveServer2 queries throw error with jdbc connection Key: DRILL-5932 URL: https://issues.apache.org/jira/browse/DRILL-5932 Project: Apache Drill Issue Type: Bug Components: Client - JDBC, Storage - Hive Affects Versions: 1.11.0 Environment: linux 2.3 hive version Reporter: tooptoop4 Priority: Blocker Basic hive queries all throw error! {code:sql} copied https://repo1.maven.org/maven2/org/apache/hive/hive-jdbc/2.3.0/hive-jdbc-2.3.0-standalone.jar to /usr/lib/apache-drill-1.11.0/jars/3rdparty/hive-jdbc-2.3.0-standalone.jar added this storage plugin: { "type": "jdbc", "driver": "org.apache.hive.jdbc.HiveDriver", "url": "jdbc:hive2://host:1/default", "username": "hive", "password": "hive1234", "enabled": true } [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler initialize INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26... apache drill 1.11.0 "this isn't your grandfather's sql" 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT COUNT(*) AS EXPR$0 FROM (SELECT 0 AS $f0 FROM.default.contact) AS t plugin hive2 Fragment 0:0 [Error Id: 4b293e97-7547-49c5-91da-b9ee2f2184fc on ip-myip.mydomain.orghere.com:31010] (state=,code=0) 0: jdbc:drill:zk=local> ALTER SESSION SET `exec.errors.verbose` = true; +---+---+ | ok |summary| +---+---+ | true | exec.errors.verbose updated. | +---+---+ 1 row selected (0.351 seconds) 0: jdbc:drill:zk=local> SELECT count(*) FROM hive2.`contact`; Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup the SQL query. sql SELECT COUNT(*) AS EXPR$0 FROM (SELECT 0 AS $f0 FROM.default.contact) AS t plugin hive2 Fragment 0:0 [Error Id: ac5cc8f2-69a4-455e-b1a6-5d22cde99729 on ip-myip.mydomain.orghere.com:31010] (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 1:23 missing EOF at '$' near 'EXPR' org.apache.hive.jdbc.Utils.verifySuccess():267 org.apache.hive.jdbc.Utils.verifySuccessWithInfo():253 org.apache.hive.jdbc.HiveStatement.runAsyncOnServer():313 org.apache.hive.jdbc.HiveStatement.execute():253 org.apache.hive.jdbc.HiveStatement.executeQuery():476 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.commons.dbcp.DelegatingStatement.executeQuery():208 org.apache.drill.exec.store.jdbc.JdbcRecordReader.setup():177 org.apache.drill.exec.physical.impl.ScanBatch.():104 org.apache.drill.exec.physical.impl.ScanBatch.():126 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():40 org.apache.drill.exec.store.jdbc.JdbcBatchCreator.getBatch():33 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():156 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRecordBatch():136 org.apache.drill.exec.physical.impl.ImplCreator.getChildren():179 org.apache.drill.exec.physical.impl.ImplCreator.getRootExec():109 org.apache.drill.exec.physical.impl.ImplCreator.getExec():87 org.apache.drill.exec.work.fragment.FragmentExecutor.run():207 org.apache.drill.common.SelfCleaningRunnable.run():38 java.util.concurrent.ThreadPoolExecutor.runWorker():1149 java.util.concurrent.ThreadPoolExecutor$Worker.run():624 java.lang.Thread.run():748 Caused By (org.apache.hive.service.cli.HiveSQLException) Error while compiling statement: FAILED: ParseException line 1:23 missing EOF at '$' near 'EXPR' org.apache.hive.service.cli.operation.Operation.toSQLException():380 org.apache.hive.service.cli.operation.SQLOperation.prepare():206 org.apache.hive.service.cli.operation.SQLOperation.runInternal():290 org.apache.hive.service.cli.operation.Operation.run():320 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal():530 org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync():517 sun.reflect.GeneratedMethodAccessor86.invoke():-1 sun.reflect.DelegatingMethodAccessorImpl.invoke():43 java.lang.reflect.Method.invoke():498 org.apache.hive.service.cli.session.HiveSessionProxy.invoke():78 org.apache.hive.service.cli.session.HiveSessionProxy.access$000():36 org.apache.hive.service.cli.session.HiveSessionProxy$1.run():63 java.security.AccessController.doPrivileged():-2 javax.se
[jira] [Created] (DRILL-5931) Drill queries against hive metastore tables return 0 rows rather than error
tooptoop4 created DRILL-5931: Summary: Drill queries against hive metastore tables return 0 rows rather than error Key: DRILL-5931 URL: https://issues.apache.org/jira/browse/DRILL-5931 Project: Apache Drill Issue Type: Improvement Components: Storage - Hive Affects Versions: 1.11.0 Environment: linux drill 1.11 hive 2.3.0 Reporter: tooptoop4 Priority: Critical Note that the hive user called 'hive' does not have a linux account so has no access to /home/ec2-user/warehouse/ file system. Rather than returning an error message, Drill pretends that the table is empty. {code:sql} [ec2-user@host ~]$ cd /usr/lib/apache-drill-1.11.0 [ec2-user@host apache-drill-1.11.0]$ ./bin/drill-embedded OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512M; support was removed in 8.0 Nov 01, 2017 7:53:53 AM org.glassfish.jersey.server.ApplicationHandler initialize INFO: Initiating Jersey application, version Jersey: 2.8 2014-04-29 01:25:26... apache drill 1.11.0 "this isn't your grandfather's sql" 0: jdbc:drill:zk=local> SHOW SCHEMAS; +-+ | SCHEMA_NAME | +-+ | INFORMATION_SCHEMA | | coffeemysql.COFFEEBREAK | | coffeemysql.information_schema | | coffeemysql.mysql | | coffeemysql.performance_schema | | coffeemysql.test| | coffeemysql | | cp.default | | dfs.default | | dfs.root| | dfs.tmp | | hive.default| | sys | +-+ 13 rows selected (0.317 seconds) 0: jdbc:drill:zk=local> use hive; +---+---+ | ok | summary | +---+---+ | true | Default schema changed to [hive] | +---+---+ 1 row selected (0.16 seconds) 0: jdbc:drill:zk=local> show tables; +---+-+ | TABLE_SCHEMA | TABLE_NAME | +---+-+ | hive.default | contact | | hive.default | account | +---+-+ 2 rows selected (0.958 seconds) 0: jdbc:drill:zk=local> select * from contact; +-+-++-+-+---+---++--+-+-+--+ | contact_id | first_name | last_name | address_line_1 | address_line_2 | city | postcode | email | dob | gender | marital_status | tfn | +-+-++-+-+---+---++--+-+-+--+ +-+-++-+-+---+---++--+-+-+--+ No rows selected (0.104 seconds) This is the hive plugin in the Drill browser ‘storage’ plugin { "type": "hive", "enabled": true, "configProps": { "hive.metastore.uris": "thrift://host:9083", "javax.jdo.option.ConnectionURL": "jdbc:mysql://host:3306/metastore", "javax.jdo.option.ConnectionDriverName": "com.mysql.jdbc.Driver", "javax.jdo.option.ConnectionUserName": "hive", "javax.jdo.option.ConnectionPassword": "hive1234", "hive.metastore.warehouse.dir": "file:///home/ec2-user/warehouse", "fs.default.name": "file:///" } } Below connection with beeline proves there is data in the table: Beeline version 2.3.0 by Apache Hive 0: jdbc:hive2://localhost:1/default> show create table contact; ++ | createtab_stmt | ++ | CREATE TABLE `contact`(| | `contact_id` varchar(50),| | `first_name` varchar(50),| | `last_name` varchar(50), | | `address_line_1` varchar(100), | | `address_line_2` varchar(100), | | `city` varchar(50), | | `postcode` varchar(10), | | `email` varchar(100),| | `dob` date, | | `gender` varchar(1), | | `marital_status` varchar(1), | | `tfn` varchar(20)) | | ROW FORMAT SERDE | | 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' | | STORED AS INPUTFORMAT | | 'org.apache.hadoop.mapred.TextInputFormat' | | OUTPUTF
[jira] [Commented] (DRILL-2744) Provide error message when trying to query MapR-DB or HBase tables with insufficient priviliges
[ https://issues.apache.org/jira/browse/DRILL-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234004#comment-16234004 ] tooptoop4 commented on DRILL-2744: -- anyone looking at this? > Provide error message when trying to query MapR-DB or HBase tables with > insufficient priviliges > --- > > Key: DRILL-2744 > URL: https://issues.apache.org/jira/browse/DRILL-2744 > Project: Apache Drill > Issue Type: Improvement > Components: Storage - HBase >Affects Versions: 0.8.0 >Reporter: Andries Engelbrecht >Priority: Major > Labels: security > Fix For: Future > > > When creating MapR-DB tables with different privileges Drill will return no > results for tables with insufficient privileges. Propose an error is returned > so the user is aware of the issue, instead of simply no data being returned. > This can be a serious issue with complex queries when joining data across > multiple data sources. > Creating 2 tables - one with mapr user and the other as root. > lr. 1 mapr mapr 2 Apr 9 17:51 customers -> > mapr::table::2057.45.1574734 > lr. 1 root root 2 Apr 10 00:21 test -> mapr::table::2057.48.1574740 > hbase(main):005:0> get "test", "r1" > COLUMNCELL > col1:timestamp=1428625497000, value=a > col2:timestamp=1428625506268, value=b > 2 row(s) in 0.0380 seconds > 0: jdbc:drill:zk=drilldemo:5181> show tables; > +--++ > | TABLE_SCHEMA | TABLE_NAME | > +--++ > | maprdb | test | > | maprdb | customers | > +--++ > 2 rows selected (0.098 seconds) > querying test tables simply returns no results instead of an error. > 0: jdbc:drill:zk=drilldemo:5181> select * from test; > +--+ > | | > +--+ > +--+ > No rows selected (0.059 seconds) > Customers does return data due to sufficient privileges. > 0: jdbc:drill:zk=drilldemo:5181> select * from customers limit 1; > +++++ > | row_key | address | loyalty | personal | > +++++ > | [B@6e22c013 | {"state":"InZhIg=="} | > {"agg_rev":"MTk3","membership":"InNpbHZlciI="} | > {"age":"IjE1LTIwIg==","gender":"IkZFTUFMRSI=","name":"IkNvcnJpbmUgTWVjaGFtIg=="} > | > +++++ > 1 row selected (0.236 seconds) -- This message was sent by Atlassian JIRA (v6.4.14#64029)