[jira] [Commented] (HIVE-6595) Hive 0.11.0 build failure
[ https://issues.apache.org/jira/browse/HIVE-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021965#comment-16021965 ] Shawn Lavelle commented on HIVE-6595: - For completeness, could this be accomplished by compiling with the 1.6 JDK? > Hive 0.11.0 build failure > - > > Key: HIVE-6595 > URL: https://issues.apache.org/jira/browse/HIVE-6595 > Project: Hive > Issue Type: Bug > Components: Build Infrastructure >Affects Versions: 0.11.0 > Environment: CentOS 6.5, java version "1.7.0_45", Hadoop 2.2.0 >Reporter: Amit Anand >Assignee: Szehon Ho > > I am unable to build Hive 0.11.0 from the source. I have a single node hadoop > 2.2.0, that I built from the source, running. > I followed steps given below: > svn co http://svn.apache.org/repos/asf/hive/tags/release-0.11.0/ hive-0.11.0 > cd hive-0.11.0 > ant clean > ant package > I got messages given below > compile: > [echo] Project: jdbc > [javac] Compiling 28 source files to > /opt/apache/source/hive-0.11.0/build/jdbc/classes > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveCallableStatement.java:48: > error: HiveCallableStatement is not abstract and does not override abstract > method getObject(String,Class) in CallableStatement > [javac] public class HiveCallableStatement implements > java.sql.CallableStatement { > [javac]^ > [javac] where T is a type-variable: > [javac] T extends Object declared in method > getObject(String,Class) > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveConnection.java:65: > error: HiveConnection is not abstract and does not override abstract method > getNetworkTimeout() in Connection > [javac] public class HiveConnection implements java.sql.Connection { > [javac]^ > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveDataSource.java:31: > error: HiveDataSource is not abstract and does not override abstract method > getParentLogger() in CommonDataSource > [javac] public class HiveDataSource implements DataSource { > [javac]^ > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveDatabaseMetaData.java:56: > error: HiveDatabaseMetaData is not abstract and does not override abstract > method generatedKeyAlwaysReturned() in DatabaseMetaData > [javac] public class HiveDatabaseMetaData implements DatabaseMetaData { > [javac]^ > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveDatabaseMetaData.java:707: > error: is not > abstract and does not override abstract method getObject(String,Class) > in ResultSet > [javac] , null) { > [javac] ^ > [javac] where T is a type-variable: > [javac] T extends Object declared in method > getObject(String,Class) > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveDriver.java:35: > error: HiveDriver is not abstract and does not override abstract method > getParentLogger() in Driver > [javac] public class HiveDriver implements Driver { > [javac]^ > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HivePreparedStatement.java:56: > error: HivePreparedStatement is not abstract and does not override abstract > method isCloseOnCompletion() in Statement > [javac] public class HivePreparedStatement implements PreparedStatement { > [javac]^ > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveQueryResultSet.java:48: > error: HiveQueryResultSet is not abstract and does not override abstract > method getObject(String,Class) in ResultSet > [javac] public class HiveQueryResultSet extends HiveBaseResultSet { > [javac]^ > [javac] where T is a type-variable: > [javac] T extends Object declared in method > getObject(String,Class) > [javac] > /opt/apache/source/hive-0.11.0/jdbc/src/java/org/apache/hive/jdbc/HiveStatement.java:42: > error: HiveStatement is not abstract and does not override abstract method > isCloseOnCompletion() in Statement > [javac] public class HiveStatement implements java.sql.Statement { > [javac]^ > [javac] Note: Some input files use or override a deprecated API. > [javac] Note: Recompile with -Xlint:deprecation for details. > [javac] Note: Some input files use unchecked or unsafe operations. > [javac] Note: Recompile with -Xlint:unchecked for details. > [javac] 9 errors > BUILD FAILED > /opt/apache/source/hive-0.11.0/build.xml:274: The following error occurred > while executing this line: > /opt/apache/source/hive-0.11.0/build.xml:113: The following error occurred >
[jira] [Commented] (HIVE-11555) Beeline sends password in clear text if we miss -ssl=true flag in the connect string
[ https://issues.apache.org/jira/browse/HIVE-11555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017435#comment-16017435 ] Shawn Lavelle commented on HIVE-11555: -- I think ... plaintext passwords should *never* be sent across the wire > Beeline sends password in clear text if we miss -ssl=true flag in the connect > string > > > Key: HIVE-11555 > URL: https://issues.apache.org/jira/browse/HIVE-11555 > Project: Hive > Issue Type: Bug > Components: Beeline >Affects Versions: 1.2.0 >Reporter: bharath v >Assignee: Junjie Chen > > {code} > I used tcpdump to display the network traffic: > [root@fe01 ~]# beeline > Beeline version 0.13.1-cdh5.3.2 by Apache Hive > beeline> !connect jdbc:hive2://fe01.sectest.poc:1/default > Connecting to jdbc:hive2://fe01.sectest.poc:1/default > Enter username for jdbc:hive2://fe01.sectest.poc:1/default: tdaranyi > Enter password for jdbc:hive2://fe01.sectest.poc:1/default: * > (I entered "cleartext" as the password) > The tcpdump in a different window > tdara...@fe01.sectest.poc:~$ sudo tcpdump -n -X -i lo port 1 > tcpdump: verbose output suppressed, use -v or -vv for full protocol decode > listening on lo, link-type EN10MB (Ethernet), capture size 65535 bytes > (...) > 10:25:16.329974 IP 192.168.32.102.54322 > 192.168.32.102.ndmp: Flags [P.], > seq 11:35, ack 1, win 512, options [nop,nop,TS val 2412851969 ecr > 2412851969], length 24 > 0x: 4500 004c 3dd3 4000 4006 3abc c0a8 2066 E..L=.@.@.:f > 0x0010: c0a8 2066 d432 2710 714c 0edc b45c 9268 ...f.2'.qL...\.h > 0x0020: 8018 0200 c25b 0101 080a 8fd1 3301 .[3. > 0x0030: 8fd1 3301 0500 1300 7464 6172 616e ..3...tdaran > 0x0040: 7969 0063 6c65 6172 7465 7874 yi.cleartext > (...) > {code} > We rely on the user supplied configuration to decide whether to open an SSL > socket or a Plain one. Instead we can negotiate this information from the HS2 > and connect accordingly. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Comment Edited] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474043#comment-15474043 ] Shawn Lavelle edited comment on HIVE-6852 at 9/8/16 3:03 PM: - Any thoughts on this being a known JDK issue? http://bugs.java.com/bugdatabase/view_bug.do?bug_id=8075484 (https://bugs.openjdk.java.net/browse/JDK-8049846) (https://bugs.openjdk.java.net/browse/JDK-8075484) Here's my stack trace using CUSTOM authentication on Hive 0.11: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} was (Author: azeroth2b): Any thoughts on this being a known JDK issue? https://bugs.openjdk.java.net/browse/JDK-8049846 https://bugs.openjdk.java.net/browse/JDK-8075484 Here's my stack trace using CUSTOM authentication on Hive 0.11: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that
[jira] [Comment Edited] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474043#comment-15474043 ] Shawn Lavelle edited comment on HIVE-6852 at 9/8/16 2:52 PM: - Any thoughts on this being a known JDK issue? https://bugs.openjdk.java.net/browse/JDK-8049846 https://bugs.openjdk.java.net/browse/JDK-8075484 Here's my stack trace using CUSTOM authentication on Hive 0.11: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} was (Author: azeroth2b): (Hive 0.11) Updating for CUSTOM authentication: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you
[jira] [Issue Comment Deleted] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Lavelle updated HIVE-6852: Comment: was deleted (was: Any thoughts on this being a known JDK issue? https://bugs.openjdk.java.net/browse/JDK-8049846 https://bugs.openjdk.java.net/browse/JDK-8075484) > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = > DriverManager.getConnection(this.con,"hive","password"); > "jdbc:hive2://localhost:1/default", > {noformat} > The logs get to here before the hang : > {noformat} > 0[main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 0 [main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 3[main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 3 [main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status START and payload length 5 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status START and payload length 5 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status COMPLETE and payload length 14 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status COMPLETE and payload length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 6[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > 6 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474043#comment-15474043 ] Shawn Lavelle edited comment on HIVE-6852 at 9/8/16 2:44 PM: - (SHARK 0.9.1, Hive 0.11) Updating for CUSTOM authentication: Debug Output {quote} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {quote} Partial Stack Trace {quote} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {quote} was (Author: azeroth2b): Updating for CUSTOM authentication: [code] 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message [/code] Partial Stack Trace [code] "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) [/code] > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = > DriverManager.getConnection(this.con,"hive","password"); > "jdbc:hive2://localhost:1/default", > {noformat} > The logs get to here before the
[jira] [Comment Edited] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474043#comment-15474043 ] Shawn Lavelle edited comment on HIVE-6852 at 9/8/16 2:47 PM: - (Hive 0.11) Updating for CUSTOM authentication: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} was (Author: azeroth2b): (SHARK 0.9.1, Hive 0.11) Updating for CUSTOM authentication: {code:title=Debug Output|borderStyle=solid} 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message {code} {code:title=Partial Stack Trace|borderStyle=solid} "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) {code} > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = >
[jira] [Comment Edited] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459144#comment-15459144 ] Shawn Lavelle edited comment on HIVE-6852 at 9/8/16 2:38 PM: - This workaround doesn't work with authentication set to CUSTOM. Client still hangs. was (Author: azeroth2b): This workaround doesn't seem to work with authentication set to CUSTOM. Client still hangs. > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = > DriverManager.getConnection(this.con,"hive","password"); > "jdbc:hive2://localhost:1/default", > {noformat} > The logs get to here before the hang : > {noformat} > 0[main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 0 [main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 3[main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 3 [main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status START and payload length 5 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status START and payload length 5 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status COMPLETE and payload length 14 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status COMPLETE and payload length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 6[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > 6 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15474043#comment-15474043 ] Shawn Lavelle commented on HIVE-6852: - Updating for CUSTOM authentication: [code] 16/09/08 09:36:48 DEBUG TSaslTransport: opening transport org.apache.thrift.transpor58 16/09/08 09:36:48 DEBUG TSaslClientTransport: Sending mechanism name PLAIN and initi 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status START an 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Writing message with status COMPLETE 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Start message handled 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: Main negotiation loop complete 16/09/08 09:36:48 DEBUG TSaslTransport: CLIENT: SASL Client receiving last message [/code] Partial Stack Trace [code] "main" #1 prio=5 os_prio=0 tid=0x0049f800 nid=0x409c runnable [0x0024d000] java.lang.Thread.State: RUNNABLE at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) at java.net.SocketInputStream.read(SocketInputStream.java:170) at java.net.SocketInputStream.read(SocketInputStream.java:141) at java.io.BufferedInputStream.fill(BufferedInputStream.java:246) at java.io.BufferedInputStream.read1(BufferedInputStream.java:286) at java.io.BufferedInputStream.read(BufferedInputStream.java:345) - locked <0x000716426228> (a java.io.BufferedInputStream) at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127) at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84) at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:178) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:288) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:157) [/code] > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = > DriverManager.getConnection(this.con,"hive","password"); > "jdbc:hive2://localhost:1/default", > {noformat} > The logs get to here before the hang : > {noformat} > 0[main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 0 [main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 3[main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 3 [main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status START and payload length 5 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status START and payload length 5 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status COMPLETE and payload length 14 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status COMPLETE and payload length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 6[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > 6 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-6852) JDBC client connections hang at TSaslTransport
[ https://issues.apache.org/jira/browse/HIVE-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459144#comment-15459144 ] Shawn Lavelle commented on HIVE-6852: - This workaround doesn't seem to work with authentication set to CUSTOM. Client still hangs. > JDBC client connections hang at TSaslTransport > -- > > Key: HIVE-6852 > URL: https://issues.apache.org/jira/browse/HIVE-6852 > Project: Hive > Issue Type: Bug > Components: JDBC >Reporter: jay vyas > > I've noticed that when there is an underlying issue in connecting a client to > the JDBC interface of the HiveServer2 to run queries, you get a hang after > the thrift portion, at least in certain scenarios: > Turning log4j to DEBUG, you can see the following when trying to get a > connection using: > {noformat} > Connection jdbc = > DriverManager.getConnection(this.con,"hive","password"); > "jdbc:hive2://localhost:1/default", > {noformat} > The logs get to here before the hang : > {noformat} > 0[main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 0 [main] DEBUG org.apache.thrift.transport.TSaslTransport - opening > transport org.apache.thrift.transport.TSaslClientTransport@219ba640 > 3[main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 3 [main] DEBUG org.apache.thrift.transport.TSaslClientTransport - Sending > mechanism name PLAIN and initial response of length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status START and payload length 5 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status START and payload length 5 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: > Writing message with status COMPLETE and payload length 14 > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Writing > message with status COMPLETE and payload length 14 > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Start > message handled > 5[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 5 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: Main > negotiation loop complete > 6[main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > 6 [main] DEBUG org.apache.thrift.transport.TSaslTransport - CLIENT: SASL > Client receiving last message > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-13824) NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I
[ https://issues.apache.org/jira/browse/HIVE-13824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334493#comment-15334493 ] Shawn Lavelle commented on HIVE-13824: -- It's also in Maven. http://mvnrepository.com/artifact/jline/jline > NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > -- > > Key: HIVE-13824 > URL: https://issues.apache.org/jira/browse/HIVE-13824 > Project: Hive > Issue Type: Bug > Components: Beeline, Hive > Environment: WIndows 8, HADOOP 2.7, HIVE 1.2.1, SPARK 1.6.1 >Reporter: Ekta Paliwal > > 0 > down vote > favorite > I have been trying to install hive on windows. I have 64 bit windows 8 on > which HADOOP and SPARK are running. I have > 1.HADOOP_HOME > 2.HIVE_HOME > 3.SPARK_HOME > 4.Platform > 5.PATH > all these variables set up on my system. Also, I was getting these error > before > Missing Hive Execution Jar: > C:\hadoop1\hadoop-2.7.2\apache-hive-1.2.1-bin/lib/hive-exec-*.jar > I solved these error by editing the Hive file inside bin folder of HIVE. > These errors are because of the forward slash"/" in environment variables in > HIVE file. I replace them with "\" and those errors are gone. But now I am > facing another problem. I am getting these error > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/C:/spark/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/C:/hadoop2.7/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > Beeline version 1.6.1 by Apache Hive > Exception in thread "main" java.lang.NoSuchMethodError: > org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > at > jline.WindowsTerminal.getConsoleOutputCodepage(WindowsTerminal.java:293) > at jline.WindowsTerminal.getOutputEncoding(WindowsTerminal.java:186) > at jline.console.ConsoleReader.(ConsoleReader.java:230) > at jline.console.ConsoleReader.(ConsoleReader.java:221) > at jline.console.ConsoleReader.(ConsoleReader.java:209) > at org.apache.hive.beeline.BeeLine.getConsoleReader(BeeLine.java:834) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:770) > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:484) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:467) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > I have searched alot on these. Also I have posted these question on HIVE User > mailing List but got no response. Please help me with this. Not even getting > results when google this error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (HIVE-13824) NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I
[ https://issues.apache.org/jira/browse/HIVE-13824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310613#comment-15310613 ] Shawn Lavelle edited comment on HIVE-13824 at 6/1/16 4:47 PM: -- [~epaliwal] What resolved this for me was making sure I had the right version of jline in the classpath (2.12). was (Author: azeroth2b): What resolved this for me was making sure I had the right version of jline in the classpath (2.12). > NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > -- > > Key: HIVE-13824 > URL: https://issues.apache.org/jira/browse/HIVE-13824 > Project: Hive > Issue Type: Bug > Components: Beeline, Hive > Environment: WIndows 8, HADOOP 2.7, HIVE 1.2.1, SPARK 1.6.1 >Reporter: Ekta Paliwal > > 0 > down vote > favorite > I have been trying to install hive on windows. I have 64 bit windows 8 on > which HADOOP and SPARK are running. I have > 1.HADOOP_HOME > 2.HIVE_HOME > 3.SPARK_HOME > 4.Platform > 5.PATH > all these variables set up on my system. Also, I was getting these error > before > Missing Hive Execution Jar: > C:\hadoop1\hadoop-2.7.2\apache-hive-1.2.1-bin/lib/hive-exec-*.jar > I solved these error by editing the Hive file inside bin folder of HIVE. > These errors are because of the forward slash"/" in environment variables in > HIVE file. I replace them with "\" and those errors are gone. But now I am > facing another problem. I am getting these error > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/C:/spark/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/C:/hadoop2.7/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > Beeline version 1.6.1 by Apache Hive > Exception in thread "main" java.lang.NoSuchMethodError: > org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > at > jline.WindowsTerminal.getConsoleOutputCodepage(WindowsTerminal.java:293) > at jline.WindowsTerminal.getOutputEncoding(WindowsTerminal.java:186) > at jline.console.ConsoleReader.(ConsoleReader.java:230) > at jline.console.ConsoleReader.(ConsoleReader.java:221) > at jline.console.ConsoleReader.(ConsoleReader.java:209) > at org.apache.hive.beeline.BeeLine.getConsoleReader(BeeLine.java:834) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:770) > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:484) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:467) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > I have searched alot on these. Also I have posted these question on HIVE User > mailing List but got no response. Please help me with this. Not even getting > results when google this error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-13824) NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I
[ https://issues.apache.org/jira/browse/HIVE-13824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310613#comment-15310613 ] Shawn Lavelle commented on HIVE-13824: -- What resolved this for me was making sure I had the right version of jline in the classpath (2.12). > NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > -- > > Key: HIVE-13824 > URL: https://issues.apache.org/jira/browse/HIVE-13824 > Project: Hive > Issue Type: Bug > Components: Beeline, Hive > Environment: WIndows 8, HADOOP 2.7, HIVE 1.2.1, SPARK 1.6.1 >Reporter: Ekta Paliwal > > 0 > down vote > favorite > I have been trying to install hive on windows. I have 64 bit windows 8 on > which HADOOP and SPARK are running. I have > 1.HADOOP_HOME > 2.HIVE_HOME > 3.SPARK_HOME > 4.Platform > 5.PATH > all these variables set up on my system. Also, I was getting these error > before > Missing Hive Execution Jar: > C:\hadoop1\hadoop-2.7.2\apache-hive-1.2.1-bin/lib/hive-exec-*.jar > I solved these error by editing the Hive file inside bin folder of HIVE. > These errors are because of the forward slash"/" in environment variables in > HIVE file. I replace them with "\" and those errors are gone. But now I am > facing another problem. I am getting these error > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/C:/spark/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/C:/hadoop2.7/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > Beeline version 1.6.1 by Apache Hive > Exception in thread "main" java.lang.NoSuchMethodError: > org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > at > jline.WindowsTerminal.getConsoleOutputCodepage(WindowsTerminal.java:293) > at jline.WindowsTerminal.getOutputEncoding(WindowsTerminal.java:186) > at jline.console.ConsoleReader.(ConsoleReader.java:230) > at jline.console.ConsoleReader.(ConsoleReader.java:221) > at jline.console.ConsoleReader.(ConsoleReader.java:209) > at org.apache.hive.beeline.BeeLine.getConsoleReader(BeeLine.java:834) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:770) > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:484) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:467) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > I have searched alot on these. Also I have posted these question on HIVE User > mailing List but got no response. Please help me with this. Not even getting > results when google this error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-13824) NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I
[ https://issues.apache.org/jira/browse/HIVE-13824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15308401#comment-15308401 ] Shawn Lavelle commented on HIVE-13824: -- The jansi library is dependent upon MSFT Visual C++ 2008 Runtime Executables. "Windows XP Users: The JNI library that JANSI uses depends on the "Microsoft Visual C++ 2008 SP1 Redistributable" You can get a free copy from MS at: http://www.microsoft.com/en-us/download/details.aspx?displaylang=en=5582; source: https://github.com/fusesource/jansi If this is the only thing driving the requirement of this library, perhaps a workaround should be considered. > NOSUCHMethodFound org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > -- > > Key: HIVE-13824 > URL: https://issues.apache.org/jira/browse/HIVE-13824 > Project: Hive > Issue Type: Bug > Components: Beeline, Hive > Environment: WIndows 8, HADOOP 2.7, HIVE 1.2.1, SPARK 1.6.1 >Reporter: Ekta Paliwal > > 0 > down vote > favorite > I have been trying to install hive on windows. I have 64 bit windows 8 on > which HADOOP and SPARK are running. I have > 1.HADOOP_HOME > 2.HIVE_HOME > 3.SPARK_HOME > 4.Platform > 5.PATH > all these variables set up on my system. Also, I was getting these error > before > Missing Hive Execution Jar: > C:\hadoop1\hadoop-2.7.2\apache-hive-1.2.1-bin/lib/hive-exec-*.jar > I solved these error by editing the Hive file inside bin folder of HIVE. > These errors are because of the forward slash"/" in environment variables in > HIVE file. I replace them with "\" and those errors are gone. But now I am > facing another problem. I am getting these error > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/C:/spark/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/C:/hadoop2.7/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > Beeline version 1.6.1 by Apache Hive > Exception in thread "main" java.lang.NoSuchMethodError: > org.fusesource.jansi.internal.Kernel32.GetConsoleOutputCP()I > at > jline.WindowsTerminal.getConsoleOutputCodepage(WindowsTerminal.java:293) > at jline.WindowsTerminal.getOutputEncoding(WindowsTerminal.java:186) > at jline.console.ConsoleReader.(ConsoleReader.java:230) > at jline.console.ConsoleReader.(ConsoleReader.java:221) > at jline.console.ConsoleReader.(ConsoleReader.java:209) > at org.apache.hive.beeline.BeeLine.getConsoleReader(BeeLine.java:834) > at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:770) > at > org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:484) > at org.apache.hive.beeline.BeeLine.main(BeeLine.java:467) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.run(RunJar.java:221) > at org.apache.hadoop.util.RunJar.main(RunJar.java:136) > I have searched alot on these. Also I have posted these question on HIVE User > mailing List but got no response. Please help me with this. Not even getting > results when google this error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-1955) Support non-constant expressions for array indexes.
[ https://issues.apache.org/jira/browse/HIVE-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169718#comment-15169718 ] Shawn Lavelle commented on HIVE-1955: - Was this ever addressed? > Support non-constant expressions for array indexes. > --- > > Key: HIVE-1955 > URL: https://issues.apache.org/jira/browse/HIVE-1955 > Project: Hive > Issue Type: Improvement >Reporter: Adam Kramer >Assignee: Navis > Fix For: 0.14.0 > > > FAILED: Error in semantic analysis: line 4:8 Non Constant Expressions for > Array Indexes not Supported dut > ...just wrote my own UDF to do this, and it is trivial. We should support > this natively. > Let foo have these rows: > arr i > [1,2,3] 1 > [3,4,5] 2 > [5,4,3] 2 > [0,0,1] 0 > Then, > SELECT arr[i] FROM foo > should return: > 2 > 5 > 3 > 1 > Similarly, for the same table, > SELECT 3 IN arr FROM foo > should return: > true > true > true > false > ...these use cases are needless limitations of functionality. We shouldn't > need UDFs to accomplish these goals. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10399) from_unixtime_millis() Hive UDF
[ https://issues.apache.org/jira/browse/HIVE-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155337#comment-15155337 ] Shawn Lavelle commented on HIVE-10399: -- [~aihuaxu] Ahh, sure, that'll do it. Available in Hive 1.2.0, and I'm on an older version for now. Thank you! > from_unixtime_millis() Hive UDF > --- > > Key: HIVE-10399 > URL: https://issues.apache.org/jira/browse/HIVE-10399 > Project: Hive > Issue Type: New Feature > Components: UDF > Environment: HDP 2.2 >Reporter: Hari Sekhon >Priority: Minor > > Feature request for a > {code}from_unixtime_millis(){code} > Hive UDF - from_unixtime() accepts only secs since epoch, and right now the > solution is to create a custom UDF, but this seems like quite a standard > thing to support millisecond precision dates in Hive natively. > Hari Sekhon > http://www.linkedin.com/in/harisekhon -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-10399) from_unixtime_millis() Hive UDF
[ https://issues.apache.org/jira/browse/HIVE-10399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154371#comment-15154371 ] Shawn Lavelle commented on HIVE-10399: -- [~aihuaxu] That solves [~harisekhon]'s problem, but what if you want to custom format a millisecond timestamp similarly to from_unixtime()? > from_unixtime_millis() Hive UDF > --- > > Key: HIVE-10399 > URL: https://issues.apache.org/jira/browse/HIVE-10399 > Project: Hive > Issue Type: New Feature > Components: UDF > Environment: HDP 2.2 >Reporter: Hari Sekhon >Priority: Minor > > Feature request for a > {code}from_unixtime_millis(){code} > Hive UDF - from_unixtime() accepts only secs since epoch, and right now the > solution is to create a custom UDF, but this seems like quite a standard > thing to support millisecond precision dates in Hive natively. > Hari Sekhon > http://www.linkedin.com/in/harisekhon -- This message was sent by Atlassian JIRA (v6.3.4#6332)