[jira] [Updated] (HIVE-20547) HS2: support Tez sessions started by someone else (part 1)
[ https://issues.apache.org/jira/browse/HIVE-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-20547: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to branch. HIVE-20605 will merge this into master. > HS2: support Tez sessions started by someone else (part 1) > -- > > Key: HIVE-20547 > URL: https://issues.apache.org/jira/browse/HIVE-20547 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Fix For: master-tez092 > > Attachments: HIVE-20547.01.patch, HIVE-20547.patch > > > The registry/configs/some code is based on a private patch by [~prasanth_j]. > The patch refactors tez pool session to use composition instead of > implementation inheritance from TezSessionState, to allow for two > implementations of TezSessionState. > For now it's blocked on getClient API in Tez that will be available after > 0.9.3 release; however I commented out that path to check that refactoring > passes tests. > When 0.9.3 becomes available, we can uncomment and commit. > In part 2, we may add some tests, and also consider other changes that are > required for external sessions (e.g. KillQuery, where we cannot assume YARN > is present). > We may also consider a WM change that allows for proportional session > distribution when the number of external sessions and the number of > admin-specified sessions doesn't match, or at least some validation to see > that the external sessions are available when applying a RP. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20547) HS2: support Tez sessions started by someone else (part 1)
[ https://issues.apache.org/jira/browse/HIVE-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-20547: Fix Version/s: master-tez092 > HS2: support Tez sessions started by someone else (part 1) > -- > > Key: HIVE-20547 > URL: https://issues.apache.org/jira/browse/HIVE-20547 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Fix For: master-tez092 > > Attachments: HIVE-20547.01.patch, HIVE-20547.patch > > > The registry/configs/some code is based on a private patch by [~prasanth_j]. > The patch refactors tez pool session to use composition instead of > implementation inheritance from TezSessionState, to allow for two > implementations of TezSessionState. > For now it's blocked on getClient API in Tez that will be available after > 0.9.3 release; however I commented out that path to check that refactoring > passes tests. > When 0.9.3 becomes available, we can uncomment and commit. > In part 2, we may add some tests, and also consider other changes that are > required for external sessions (e.g. KillQuery, where we cannot assume YARN > is present). > We may also consider a WM change that allows for proportional session > distribution when the number of external sessions and the number of > admin-specified sessions doesn't match, or at least some validation to see > that the external sessions are available when applying a RP. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20547) HS2: support Tez sessions started by someone else (part 1)
[ https://issues.apache.org/jira/browse/HIVE-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-20547: Attachment: HIVE-20547.01.patch > HS2: support Tez sessions started by someone else (part 1) > -- > > Key: HIVE-20547 > URL: https://issues.apache.org/jira/browse/HIVE-20547 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-20547.01.patch, HIVE-20547.patch > > > The registry/configs/some code is based on a private patch by [~prasanth_j]. > The patch refactors tez pool session to use composition instead of > implementation inheritance from TezSessionState, to allow for two > implementations of TezSessionState. > For now it's blocked on getClient API in Tez that will be available after > 0.9.3 release; however I commented out that path to check that refactoring > passes tests. > When 0.9.3 becomes available, we can uncomment and commit. > In part 2, we may add some tests, and also consider other changes that are > required for external sessions (e.g. KillQuery, where we cannot assume YARN > is present). > We may also consider a WM change that allows for proportional session > distribution when the number of external sessions and the number of > admin-specified sessions doesn't match, or at least some validation to see > that the external sessions are available when applying a RP. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20547) HS2: support Tez sessions started by someone else (part 1)
[ https://issues.apache.org/jira/browse/HIVE-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-20547: Status: Patch Available (was: Open) > HS2: support Tez sessions started by someone else (part 1) > -- > > Key: HIVE-20547 > URL: https://issues.apache.org/jira/browse/HIVE-20547 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-20547.patch > > > The registry/configs/some code is based on a private patch by [~prasanth_j]. > The patch refactors tez pool session to use composition instead of > implementation inheritance from TezSessionState, to allow for two > implementations of TezSessionState. > For now it's blocked on getClient API in Tez that will be available after > 0.9.3 release; however I commented out that path to check that refactoring > passes tests. > When 0.9.3 becomes available, we can uncomment and commit. > In part 2, we may add some tests, and also consider other changes that are > required for external sessions (e.g. KillQuery, where we cannot assume YARN > is present). > We may also consider a WM change that allows for proportional session > distribution when the number of external sessions and the number of > admin-specified sessions doesn't match, or at least some validation to see > that the external sessions are available when applying a RP. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (HIVE-20547) HS2: support Tez sessions started by someone else (part 1)
[ https://issues.apache.org/jira/browse/HIVE-20547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-20547: Attachment: HIVE-20547.patch > HS2: support Tez sessions started by someone else (part 1) > -- > > Key: HIVE-20547 > URL: https://issues.apache.org/jira/browse/HIVE-20547 > Project: Hive > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin >Priority: Major > Attachments: HIVE-20547.patch > > > The registry/configs/some code is based on a private patch by [~prasanth_j]. > The patch refactors tez pool session to use composition instead of > implementation inheritance from TezSessionState, to allow for two > implementations of TezSessionState. > For now it's blocked on getClient API in Tez that will be available after > 0.9.3 release; however I commented out that path to check that refactoring > passes tests. > When 0.9.3 becomes available, we can uncomment and commit. > In part 2, we may add some tests, and also consider other changes that are > required for external sessions (e.g. KillQuery, where we cannot assume YARN > is present). > We may also consider a WM change that allows for proportional session > distribution when the number of external sessions and the number of > admin-specified sessions doesn't match, or at least some validation to see > that the external sessions are available when applying a RP. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
