[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-03 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Summary: Implement BlacklistingLlapMetricsListener  (was: Implement 
DisablingDaemonStatisticsHandler)

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-04 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.2.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-04 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.3.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.patch, HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-09 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.4.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-10 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.5.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.6.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.7.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, 
> HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: (was: HIVE-21912.7.patch)

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, 
> HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.7.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, 
> HIVE-21912.7.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.8.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, 
> HIVE-21912.7.patch, HIVE-21912.8.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-16 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.9.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.2.patch, HIVE-21912.3.patch, 
> HIVE-21912.4.patch, HIVE-21912.5.patch, HIVE-21912.6.patch, 
> HIVE-21912.7.patch, HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-17 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.10.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.10.patch, HIVE-21912.2.patch, 
> HIVE-21912.3.patch, HIVE-21912.4.patch, HIVE-21912.5.patch, 
> HIVE-21912.6.patch, HIVE-21912.7.patch, HIVE-21912.8.patch, 
> HIVE-21912.9.patch, HIVE-21912.patch, HIVE-21912.wip-2.patch, 
> HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-17 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
Attachment: HIVE-21912.11.patch

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Attachments: HIVE-21912.10.patch, HIVE-21912.11.patch, 
> HIVE-21912.2.patch, HIVE-21912.3.patch, HIVE-21912.4.patch, 
> HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.7.patch, 
> HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (HIVE-21912) Implement BlacklistingLlapMetricsListener

2019-07-18 Thread Peter Vary (JIRA)


 [ 
https://issues.apache.org/jira/browse/HIVE-21912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Peter Vary updated HIVE-21912:
--
   Resolution: Fixed
Fix Version/s: 4.0.0
   Status: Resolved  (was: Patch Available)

Pushed to master.

Thanks [~odraese] and [~szita] for the review!

> Implement BlacklistingLlapMetricsListener
> -
>
> Key: HIVE-21912
> URL: https://issues.apache.org/jira/browse/HIVE-21912
> Project: Hive
>  Issue Type: Sub-task
>  Components: llap, Tez
>Reporter: Peter Vary
>Assignee: Peter Vary
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-21912.10.patch, HIVE-21912.11.patch, 
> HIVE-21912.2.patch, HIVE-21912.3.patch, HIVE-21912.4.patch, 
> HIVE-21912.5.patch, HIVE-21912.6.patch, HIVE-21912.7.patch, 
> HIVE-21912.8.patch, HIVE-21912.9.patch, HIVE-21912.patch, 
> HIVE-21912.wip-2.patch, HIVE-21912.wip.patch
>
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> We should implement a DaemonStatisticsHandler which:
>  * If a node average response time is bigger than 150% (configurable) of the 
> other nodes
>  * If the other nodes has enough empty executors to handle the requests
> Then disables the limping node.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)