[jira] [Commented] (HIVE-7081) HiveServer/HiveServer2 leaks jdbc connections when network interrupt
[
https://issues.apache.org/jira/browse/HIVE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251358#comment-14251358
]
Thejas M Nair commented on HIVE-7081:
-
I don't think HIVE-5799 will help to free up this thread. HIVE-6679 (or the
upgrade to thrift 0.9.2) would be needed.
HiveServer/HiveServer2 leaks jdbc connections when network interrupt
-
Key: HIVE-7081
URL: https://issues.apache.org/jira/browse/HIVE-7081
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.12.0, 0.13.0
Environment: hadoop 1.2.1
hive 0.12.0 / hive 0.13.0
linux 2.6.32
Reporter: Wang Zhiqiang
Labels: ConnectoinLeak, HiveServer2, JDBC
HiveServer/HiveServer2 leaks jdbc connections when network between client and
server is interrupted。
I test both use DBVisualizer and write JDBC code，when the network between
client and hiveserver/hiverserver2 is interrupted，the tcp connection in the
server side will be in ESTABLISH state forever util the server is stoped。By
Using jstack to print out server's thread, I found thread is doing
socketRead0()。
{quote}
pool-1-thread-13 prio=10 tid=0x7fd00c0c6800 nid=0x5d21 runnable
[0x7fd00018]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked 0xebc24f28 (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-7081) HiveServer/HiveServer2 leaks jdbc connections when network interrupt
[
https://issues.apache.org/jira/browse/HIVE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251932#comment-14251932
]
Brock Noland commented on HIVE-7081:
We upgraded to 0.9.2 already:
https://github.com/apache/hive/blob/trunk/pom.xml#L141
HiveServer/HiveServer2 leaks jdbc connections when network interrupt
-
Key: HIVE-7081
URL: https://issues.apache.org/jira/browse/HIVE-7081
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.12.0, 0.13.0
Environment: hadoop 1.2.1
hive 0.12.0 / hive 0.13.0
linux 2.6.32
Reporter: Wang Zhiqiang
Labels: ConnectoinLeak, HiveServer2, JDBC
HiveServer/HiveServer2 leaks jdbc connections when network between client and
server is interrupted。
I test both use DBVisualizer and write JDBC code，when the network between
client and hiveserver/hiverserver2 is interrupted，the tcp connection in the
server side will be in ESTABLISH state forever util the server is stoped。By
Using jstack to print out server's thread, I found thread is doing
socketRead0()。
{quote}
pool-1-thread-13 prio=10 tid=0x7fd00c0c6800 nid=0x5d21 runnable
[0x7fd00018]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked 0xebc24f28 (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-7081) HiveServer/HiveServer2 leaks jdbc connections when network interrupt
[
https://issues.apache.org/jira/browse/HIVE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251947#comment-14251947
]
Thejas M Nair commented on HIVE-7081:
-
Yes, to be more specific - trunk has a fix, 0.14 release does not have the fix.
HiveServer/HiveServer2 leaks jdbc connections when network interrupt
-
Key: HIVE-7081
URL: https://issues.apache.org/jira/browse/HIVE-7081
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.12.0, 0.13.0
Environment: hadoop 1.2.1
hive 0.12.0 / hive 0.13.0
linux 2.6.32
Reporter: Wang Zhiqiang
Labels: ConnectoinLeak, HiveServer2, JDBC
HiveServer/HiveServer2 leaks jdbc connections when network between client and
server is interrupted。
I test both use DBVisualizer and write JDBC code，when the network between
client and hiveserver/hiverserver2 is interrupted，the tcp connection in the
server side will be in ESTABLISH state forever util the server is stoped。By
Using jstack to print out server's thread, I found thread is doing
socketRead0()。
{quote}
pool-1-thread-13 prio=10 tid=0x7fd00c0c6800 nid=0x5d21 runnable
[0x7fd00018]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked 0xebc24f28 (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-7081) HiveServer/HiveServer2 leaks jdbc connections when network interrupt
[
https://issues.apache.org/jira/browse/HIVE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217168#comment-14217168
]
Brock Noland commented on HIVE-7081:
I think that HIVE-5799 would help here?
HiveServer/HiveServer2 leaks jdbc connections when network interrupt
-
Key: HIVE-7081
URL: https://issues.apache.org/jira/browse/HIVE-7081
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.12.0, 0.13.0
Environment: hadoop 1.2.1
hive 0.12.0 / hive 0.13.0
linux 2.6.32
Reporter: Wang Zhiqiang
Labels: ConnectoinLeak, HiveServer2, JDBC
HiveServer/HiveServer2 leaks jdbc connections when network between client and
server is interrupted。
I test both use DBVisualizer and write JDBC code，when the network between
client and hiveserver/hiverserver2 is interrupted，the tcp connection in the
server side will be in ESTABLISH state forever util the server is stoped。By
Using jstack to print out server's thread, I found thread is doing
socketRead0()。
{quote}
pool-1-thread-13 prio=10 tid=0x7fd00c0c6800 nid=0x5d21 runnable
[0x7fd00018]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
- locked 0xebc24f28 (a java.io.BufferedInputStream)
at
org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
at
org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
at
org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
at
org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
