[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lefty Leverenz updated HIVE-12935: -- Labels: TODOC2.1 (was: ) > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Labels: TODOC2.1 > Fix For: 2.1.0 > > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch, HIVE-12935.5.patch, HIVE-12935.6.patch, HIVE-12935.7.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Resolution: Fixed Fix Version/s: 2.1.0 Status: Resolved (was: Patch Available) Committed patch to master. Thanks [~gopalv] and [~sseth] for the reviews! > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Fix For: 2.1.0 > > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch, HIVE-12935.5.patch, HIVE-12935.6.patch, HIVE-12935.7.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.7.patch added proper synchronization per Sid's comments. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch, HIVE-12935.5.patch, HIVE-12935.6.patch, HIVE-12935.7.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.6.patch Addressed [~sseth]'s review comments. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch, HIVE-12935.5.patch, HIVE-12935.6.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.5.patch Named notification handler threadpool, also has fix for ACL leak in zk connection. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch, HIVE-12935.5.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.4.patch Addressed [~sseth]'s review comments. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch, > HIVE-12935.4.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.3.patch Patch rebased. Also restored UUID for worker identity. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch, HIVE-12935.3.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12935: Issue Type: Improvement (was: Bug) > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-12935: Target Version/s: 2.1.0 (was: 2.0.0) > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: HIVE-12935.2.patch This patch avoids an exception when stopping the daemon's by cleaning closing the ZK objects. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Improvement >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch, HIVE-12935.2.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HIVE-12935) LLAP: Replace Yarn registry with Zookeeper registry
[ https://issues.apache.org/jira/browse/HIVE-12935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-12935: - Attachment: 12935.1.patch This is the first take on the patch. Haven't tested secure zk client-server connection yet. There could be some more cleanup on LlapTaskSchedulerService. In case if something can be cleaned up will do so in follow up patches. > LLAP: Replace Yarn registry with Zookeeper registry > --- > > Key: HIVE-12935 > URL: https://issues.apache.org/jira/browse/HIVE-12935 > Project: Hive > Issue Type: Bug >Affects Versions: 2.0.0 >Reporter: Prasanth Jayachandran >Assignee: Prasanth Jayachandran > Attachments: 12935.1.patch > > > Existing YARN registry service for cluster membership has to depend on > refresh intervals to get the list of instances/daemons that are running in > the cluster. Better approach would be replace it with zookeeper based > registry service so that custom listeners can be added to update healthiness > of daemons in the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
