[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-03 Thread Rajesh Balamohan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-17011:

Attachment: HIVE-17011.3.patch

Thanks [~jcamachorodriguez]. Attaching .2 patch with additional method 
{{getOperatorSignature}}. This patch resets the signature on setters.

> PlanUtils.getExprList() causes memory pressure when invoked from 
> SharedWorkOptimizer on queries with lots of union operators
> 
>
> Key: HIVE-17011
> URL: https://issues.apache.org/jira/browse/HIVE-17011
> Project: Hive
>  Issue Type: Bug
>Reporter: Rajesh Balamohan
>Priority: Minor
> Attachments: CPU_usage.png, HIVE-17011.1.patch, HIVE-17011.3.patch, 
> Memory_usage.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-17011:

Priority: Minor  (was: Major)

> PlanUtils.getExprList() causes memory pressure when invoked from 
> SharedWorkOptimizer on queries with lots of union operators
> 
>
> Key: HIVE-17011
> URL: https://issues.apache.org/jira/browse/HIVE-17011
> Project: Hive
>  Issue Type: Bug
>Reporter: Rajesh Balamohan
>Priority: Minor
> Attachments: CPU_usage.png, HIVE-17011.1.patch, Memory_usage.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-17011:

Attachment: HIVE-17011.1.patch

Attaching .1 patch.

Tested on a query which had 100s of unionall on simple table. 

Without patch, SharedWorkOptimizer::transform took {{323.667 seconds}}
With Patch, SharedWorkOptimizer::transform {{116.395 seconds}}

\cc [~jcamachorodriguez]

> PlanUtils.getExprList() causes memory pressure when invoked from 
> SharedWorkOptimizer on queries with lots of union operators
> 
>
> Key: HIVE-17011
> URL: https://issues.apache.org/jira/browse/HIVE-17011
> Project: Hive
>  Issue Type: Bug
>Reporter: Rajesh Balamohan
> Attachments: CPU_usage.png, HIVE-17011.1.patch, Memory_usage.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-17011:

Status: Patch Available  (was: Open)

> PlanUtils.getExprList() causes memory pressure when invoked from 
> SharedWorkOptimizer on queries with lots of union operators
> 
>
> Key: HIVE-17011
> URL: https://issues.apache.org/jira/browse/HIVE-17011
> Project: Hive
>  Issue Type: Bug
>Reporter: Rajesh Balamohan
> Attachments: CPU_usage.png, HIVE-17011.1.patch, Memory_usage.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (HIVE-17011) PlanUtils.getExprList() causes memory pressure when invoked from SharedWorkOptimizer on queries with lots of union operators

2017-07-02 Thread Rajesh Balamohan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-17011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajesh Balamohan updated HIVE-17011:

Attachment: CPU_usage.png
Memory_usage.png

> PlanUtils.getExprList() causes memory pressure when invoked from 
> SharedWorkOptimizer on queries with lots of union operators
> 
>
> Key: HIVE-17011
> URL: https://issues.apache.org/jira/browse/HIVE-17011
> Project: Hive
>  Issue Type: Bug
>Reporter: Rajesh Balamohan
> Attachments: CPU_usage.png, Memory_usage.png
>
>




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)