[ https://issues.apache.org/jira/browse/IMPALA-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16614054#comment-16614054 ]
ASF subversion and git services commented on IMPALA-6568: --------------------------------------------------------- Commit a0a404441141a8be4502953e0f1242678984aab6 in impala's branch refs/heads/master from [~asherman] [ https://git-wip-us.apache.org/repos/asf?p=impala.git;h=a0a4044 ] IMPALA-6568 add missing Query Compilation section to profiles. The profile command is used to display low-level information about the most recent query. When a client makes request for the Profile, it sends a GetRuntimeProfile request for the last queryId to to the server. The queryId is used to find the ClientRequestState, an object which tracks information about the execution, including Profile data which is stored in several RuntimeProfile objects. The reply to the GetRuntimeProfile message contains the Profile, pretty-printed as a string. When a query is sent to the Front End to be compiled, the TExecRequest that is returned from createExecRequest() in the JVM contains a Timeline, which is a named sequence of events with timing information. This Timeline is added to the Summary Profile in the ClientRequestState. In the following cases the Front End was not setting the Timeline in the TExecRequest: - All DDL operations - Load data statements - Set statements - Explain statements And this meant that the profile would not contain the "Query Compilation" timeline. I refactored the main createExecRequest() method to - try to make the flow clearer, - allow the timeline to be set in the TExecRequest in only one place. - to set "Planning finished" in all timelines TESTING: Add a new test to test_observability.py which checks that the "Query Compilation" and "Planning finished" timelines appear in the profile for various queries designed to exercise the new code paths in createExecRequest. Change-Id: I869eaeb4be4291b6b938f91847f624c76ec90ea5 Reviewed-on: http://gerrit.cloudera.org:8080/11387 Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com> > The profile of all statements should contain the Query Compilation timeline > --------------------------------------------------------------------------- > > Key: IMPALA-6568 > URL: https://issues.apache.org/jira/browse/IMPALA-6568 > Project: IMPALA > Issue Type: Improvement > Components: Frontend > Affects Versions: Impala 2.9.0, Impala 2.10.0, Impala 2.11.0 > Reporter: Alexander Behm > Assignee: Andrew Sherman > Priority: Major > Labels: supportability > > Some statements do not seem to include the "Query Compilation" timeline in > the query profile. > Repro: > {code} > create table t (i int); > describe t; <-- loads the table, but no FE timeline in profile > invalidate metadata t; > alter table t set tbproperties('numRows'='10'); <-- loads the table, but no > FE timeline in profile > {code} > All statements should include the planner timeline. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org For additional commands, e-mail: issues-all-h...@impala.apache.org