[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-11 Thread Ashutosh Chauhan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-23429:

Fix Version/s: 4.0.0
   Resolution: Fixed
   Status: Resolved  (was: Patch Available)

Pushed to master. Thanks, Rajesh!

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Fix For: 4.0.0
>
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Ashutosh Chauhan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-23429:

Attachment: HIVE-23429.2.patch

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Ashutosh Chauhan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-23429:

Status: Patch Available  (was: Open)

same patch reattach to retest.

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Ashutosh Chauhan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-23429:

Status: Open  (was: Patch Available)

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Attachments: HIVE-23429.1.patch, HIVE-23429.2.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-23429:

Assignee: Rajesh Balamohan
  Status: Patch Available  (was: Open)

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Assignee: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Attachments: HIVE-23429.1.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (HIVE-23429) LLAP: Optimize retrieving queryId details in LlapTaskCommunicator

2020-05-10 Thread Rajesh Balamohan (Jira)


 [ 
https://issues.apache.org/jira/browse/HIVE-23429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-23429:

Attachment: HIVE-23429.1.patch

> LLAP: Optimize retrieving queryId details in LlapTaskCommunicator
> -
>
> Key: HIVE-23429
> URL: https://issues.apache.org/jira/browse/HIVE-23429
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rajesh Balamohan
>Priority: Major
>  Labels: performance
> Attachments: HIVE-23429.1.patch
>
>
>  
> [https://github.com/apache/hive/blob/master/llap-tez/src/java/org/apache/hadoop/hive/llap/tezplugins/LlapTaskCommunicator.java#L825]
>  
> For small jobs, this becomes a bottleneck to unpack entire payload to lookup 
> HIVEQUERYID parameter. It would be good to share HIVEQUERYID in dagConf and 
> retrieve it back via DagInfo.
>  
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)