[
https://issues.apache.org/jira/browse/HIVE-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12965457#action_12965457
]
Steven Wong commented on HIVE-1816:
-----------------------------------
HiveResultSet stops using DynamicSerDe in 0.7, so this stack trace should not
be possible starting in 0.7.
> Reporting of (seemingly inconsequential) transport exception has major impact
> on performance
> --------------------------------------------------------------------------------------------
>
> Key: HIVE-1816
> URL: https://issues.apache.org/jira/browse/HIVE-1816
> Project: Hive
> Issue Type: Improvement
> Components: Drivers
> Affects Versions: 0.5.0
> Environment: Custom Java application using the Hive JDBC driver to
> connect to a Hive server, execute a Hive query and process the results.
> Reporter: Guy le Mar
> Priority: Minor
>
> During the process of executing a hive query and then fetching the results,
> the following stack track is continually output to seterr.
> For the query I executed, 47Mb of this text was generated. As a consequence,
> the performance of the application itself suffered.
> (Redirecting stderr to file halved the time it took my application to fetch
> the results - from 2 minutes down to 70 sec.)
> Note, this also occurs if you use an application such as SQuirrel SQL
> (http://www.squirrelsql.org) to execute a Hive query using the Hive JDBC
> driver.
> The stack trace that is repeatedly reported is...
> org.apache.thrift.transport.TTransportException
> at
> org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132)
> at
> org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.fillTokenizer(TCTLSeparatedProtocol.java:215)
> at
> org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol$SimpleTransportTokenizer.<init>(TCTLSeparatedProtocol.java:210)
> at
> org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.internalInitialize(TCTLSeparatedProtocol.java:336)
> at
> org.apache.hadoop.hive.serde2.thrift.TCTLSeparatedProtocol.initialize(TCTLSeparatedProtocol.java:417)
> at
> org.apache.hadoop.hive.serde2.dynamic_type.DynamicSerDe.initialize(DynamicSerDe.java:94)
> at
> org.apache.hadoop.hive.jdbc.HiveResultSet.initDynamicSerde(HiveResultSet.java:117)
> at
> org.apache.hadoop.hive.jdbc.HiveResultSet.<init>(HiveResultSet.java:74)
> at
> org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:178)
> at com.quest.orahive.HiveJdbcClient.main(HiveJdbcClient.java:117)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
