Reporting of (seemingly inconsequential) transport exception has major impact on performance --------------------------------------------------------------------------------------------
Key: HIVE-1816 URL: https://issues.apache.org/jira/browse/HIVE-1816 Project: Hive Issue Type: Improvement Components: Drivers Affects Versions: 0.5.0 Environment: Custom Java application using the Hive JDBC driver to connect to a Hive server, execute a Hive query and process the results. Reporter: Guy le Mar Priority: Minor During the process of executing a hive query and then fetching the results, the following stack track is continually output to seterr. For the query I executed, 47Mb of this text was generated. As a consequence, the performance of the application itself suffered. (Redirecting stderr to file halved the time it took my application to fetch the results - from 2 minutes down to 70 sec.) Note, this also occurs if you use an application such as SQuirrel SQL (http://www.squirrelsql.org) to execute a Hive query using the Hive JDBC driver. The stack trace that is repeatedly reported is... org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.fillTokenizer(TCTLSeparatedProtocol.java:215) at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.<init>(TCTLSeparatedProtocol.java:210) at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.internalInitialize(TCTLSeparatedProtocol.java:336) at org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.initialize(TCTLSeparatedProtocol.java:417) at org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:94) at org.apache.hadoop.hive.jdbc.HiveResultSet.initDynamicSerde(HiveResultSet.java:117) at org.apache.hadoop.hive.jdbc.HiveResultSet.<init>(HiveResultSet.java:74) at org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:178) at com.quest.orahive.HiveJdbcClient.main(HiveJdbcClient.java:117) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.