[
https://issues.apache.org/jira/browse/IMPALA-5397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710781#comment-16710781
]
Tim Armstrong commented on IMPALA-5397:
---------------------------------------
I think we should adopt a definition of "End Time" that more closely aligns to
intuition, i.e. when the "real work" of the operation has completed.
* For queries, where execution proceeds concurrently with results being
fetched, End Time should be set when admission resources are released (when the
query is cancelled, or all results are fetched).
* For other operations, End Time should be set when the operation enters the
FINISHED state.
> Set "End Time" earlier rather than on unregistration.
> -----------------------------------------------------
>
> Key: IMPALA-5397
> URL: https://issues.apache.org/jira/browse/IMPALA-5397
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.9.0
> Reporter: Mostafa Mokhtar
> Priority: Major
> Labels: query-lifecycle
>
> When queries are executed from Hue and hit the idle query timeout then the
> query duration keeps going up even though the query was cancelled and it is
> not actually doing any more work. The end time is only set when the query is
> actually unregistered.
> Queries below finished in 1s640ms while the reported time is much longer.
> |User||Default Db||Statement||Query Type||Start Time||Waiting
> Time||Duration||Scan Progress||State||Last Event||# rows fetched||Resource
> Pool||Details||Action|
> |hue/va1026.halxg.cloudera....@halxg.cloudera.com|tpcds_1000_parquet|select
> count(*) from tpcds_1000_parquet.inventory|QUERY|2017-05-31
> 09:38:20.472804000|4m27s|4m32s|261 / 261 ( 100%)|FINISHED|First row
> fetched|1|root.default|Details|Close|
> |hue/va1026.halxg.cloudera....@halxg.cloudera.com|tpcds_1000_parquet|select
> count(*) from tpcds_1000_parquet.inventory|QUERY|2017-05-31
> 08:38:52.780237000|2017-05-31 09:38:20.289582000|59m27s|261 / 261 (
> 100%)|FINISHED|1|root.default|Details|
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
