[jira] [Updated] (AMBARI-21092) HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during EU (missing space)
[ https://issues.apache.org/jira/browse/AMBARI-21092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-21092: Attachment: AMBARI-21092.01.patch > HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during > EU (missing space) > > > Key: AMBARI-21092 > URL: https://issues.apache.org/jira/browse/AMBARI-21092 > Project: Ambari > Issue Type: Bug > Components: ambari-upgrade >Affects Versions: 2.5.1 >Reporter: Vivek Sharma >Priority: Critical > Labels: express_upgrade > Fix For: 2.5.1 > > Attachments: AMBARI-21092.01.patch > > > STR > 1. Deploy HDP-2.5 cluster with HSI enabled and Ambari-2.4.2.0 > 2. Upgrade Ambari to 2.5.1.0-140 > 3. Start EU to HDP-2.6.1.0-105 > Result > Error during HSI start > From yarn log > {code} > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon > Unrecognized VM option 'UseParallelGC-Xss512k' > Error: Could not create the Java Virtual Machine. > Error: A fatal exception has occurred. Program will exit. > {code} > Looks to be caused by https://issues.apache.org/jira/browse/AMBARI-20537 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-21092) HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during EU (missing space)
[ https://issues.apache.org/jira/browse/AMBARI-21092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-21092: Status: Patch Available (was: Open) > HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during > EU (missing space) > > > Key: AMBARI-21092 > URL: https://issues.apache.org/jira/browse/AMBARI-21092 > Project: Ambari > Issue Type: Bug > Components: ambari-upgrade >Affects Versions: 2.5.1 >Reporter: Vivek Sharma >Assignee: Siddharth Seth >Priority: Critical > Labels: express_upgrade > Fix For: 2.5.1 > > Attachments: AMBARI-21092.01.patch > > > STR > 1. Deploy HDP-2.5 cluster with HSI enabled and Ambari-2.4.2.0 > 2. Upgrade Ambari to 2.5.1.0-140 > 3. Start EU to HDP-2.6.1.0-105 > Result > Error during HSI start > From yarn log > {code} > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon > Unrecognized VM option 'UseParallelGC-Xss512k' > Error: Could not create the Java Virtual Machine. > Error: A fatal exception has occurred. Program will exit. > {code} > Looks to be caused by https://issues.apache.org/jira/browse/AMBARI-20537 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (AMBARI-21092) HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during EU (missing space)
[ https://issues.apache.org/jira/browse/AMBARI-21092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned AMBARI-21092: --- Assignee: Siddharth Seth > HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during > EU (missing space) > > > Key: AMBARI-21092 > URL: https://issues.apache.org/jira/browse/AMBARI-21092 > Project: Ambari > Issue Type: Bug > Components: ambari-upgrade >Affects Versions: 2.5.1 >Reporter: Vivek Sharma >Assignee: Siddharth Seth >Priority: Critical > Labels: express_upgrade > Fix For: 2.5.1 > > Attachments: AMBARI-21092.01.patch > > > STR > 1. Deploy HDP-2.5 cluster with HSI enabled and Ambari-2.4.2.0 > 2. Upgrade Ambari to 2.5.1.0-140 > 3. Start EU to HDP-2.6.1.0-105 > Result > Error during HSI start > From yarn log > {code} > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon > Unrecognized VM option 'UseParallelGC-Xss512k' > Error: Could not create the Java Virtual Machine. > Error: A fatal exception has occurred. Program will exit. > {code} > Looks to be caused by https://issues.apache.org/jira/browse/AMBARI-20537 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-21092) HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during EU (missing space)
[ https://issues.apache.org/jira/browse/AMBARI-21092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019957#comment-16019957 ] Siddharth Seth commented on AMBARI-21092: - cc [~sumitmohanty], [~swapanshridhar] > HSI start failed due to Unrecognized VM option 'UseParallelGC-Xss512k' during > EU (missing space) > > > Key: AMBARI-21092 > URL: https://issues.apache.org/jira/browse/AMBARI-21092 > Project: Ambari > Issue Type: Bug > Components: ambari-upgrade >Affects Versions: 2.5.1 >Reporter: Vivek Sharma >Assignee: Siddharth Seth >Priority: Critical > Labels: express_upgrade > Fix For: 2.5.1 > > Attachments: AMBARI-21092.01.patch > > > STR > 1. Deploy HDP-2.5 cluster with HSI enabled and Ambari-2.4.2.0 > 2. Upgrade Ambari to 2.5.1.0-140 > 3. Start EU to HDP-2.6.1.0-105 > Result > Error during HSI start > From yarn log > {code} > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon > Unrecognized VM option 'UseParallelGC-Xss512k' > Error: Could not create the Java Virtual Machine. > Error: A fatal exception has occurred. Program will exit. > {code} > Looks to be caused by https://issues.apache.org/jira/browse/AMBARI-20537 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-21080) Update shuffle timeout settings for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-21080: Attachment: AMBARI-21080.01.patch cc [~sumitmohanty], [~swapanshridhar] > Update shuffle timeout settings for hdp stack > - > > Key: AMBARI-21080 > URL: https://issues.apache.org/jira/browse/AMBARI-21080 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Blocker > Fix For: 2.5.1 > > Attachments: AMBARI-21080.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-21080) Update shuffle timeout settings for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-21080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-21080: Status: Patch Available (was: Open) > Update shuffle timeout settings for hdp stack > - > > Key: AMBARI-21080 > URL: https://issues.apache.org/jira/browse/AMBARI-21080 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Blocker > Fix For: 2.5.1 > > Attachments: AMBARI-21080.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-21080) Update shuffle timeout settings for hdp stack
Siddharth Seth created AMBARI-21080: --- Summary: Update shuffle timeout settings for hdp stack Key: AMBARI-21080 URL: https://issues.apache.org/jira/browse/AMBARI-21080 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Priority: Blocker Fix For: 2.5.1 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-21065) Update some YARN settings for HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-21065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-21065: Attachment: AMBARI-21065.01.patch Patch with config changes. Needs some more validations. cc [~sumitmohanty], [~swapanshridhar] > Update some YARN settings for HDP 2.6 stack > --- > > Key: AMBARI-21065 > URL: https://issues.apache.org/jira/browse/AMBARI-21065 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth > Fix For: 2.5.1 > > Attachments: AMBARI-21065.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (AMBARI-21065) Update some YARN settings for HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-21065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned AMBARI-21065: --- Assignee: (was: Siddharth Seth) > Update some YARN settings for HDP 2.6 stack > --- > > Key: AMBARI-21065 > URL: https://issues.apache.org/jira/browse/AMBARI-21065 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth > Fix For: 2.5.1 > > Attachments: AMBARI-21065.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-21065) Update some YARN settings for HDP 2.6 stack
Siddharth Seth created AMBARI-21065: --- Summary: Update some YARN settings for HDP 2.6 stack Key: AMBARI-21065 URL: https://issues.apache.org/jira/browse/AMBARI-21065 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.1 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20999) More updates to llap configs for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20999: Attachment: AMBARI-20999.addendum.patch Addendum patch to change 2 more settings. [~sumitmohanty], [~swapanshridhar] - Thanks in advance. > More updates to llap configs for hdp stack > -- > > Key: AMBARI-20999 > URL: https://issues.apache.org/jira/browse/AMBARI-20999 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Blocker > Fix For: 2.5.1 > > Attachments: AMBARI-20999.01.patch, AMBARI-20999.addendum.patch, > Screen Shot 2017-05-11 at 4.31.31 PM.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-20999) More updates to llap configs for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007694#comment-16007694 ] Siddharth Seth commented on AMBARI-20999: - Thanks [~sumitmohanty], [~swapanshridhar]. I thought I had fixed tests before submitting a patch this time. > More updates to llap configs for hdp stack > -- > > Key: AMBARI-20999 > URL: https://issues.apache.org/jira/browse/AMBARI-20999 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Blocker > Fix For: 2.5.1 > > Attachments: AMBARI-20999.01.patch, Screen Shot 2017-05-11 at 4.31.31 > PM.png > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20999) More updates to llap configs for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20999: Attachment: AMBARI-20999.01.patch [~sumitmohanty], [~swapanshridhar] - could you please take a look. Patch adds/changes a bunch of configs. Also gets rid of unnecessary changes in UpgradeCatalog250. (There's still some setting there related to hs2heapsize. Not sure why though) > More updates to llap configs for hdp stack > -- > > Key: AMBARI-20999 > URL: https://issues.apache.org/jira/browse/AMBARI-20999 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.1 > > Attachments: AMBARI-20999.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20999) More updates to llap configs for hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20999: Status: Patch Available (was: Open) > More updates to llap configs for hdp stack > -- > > Key: AMBARI-20999 > URL: https://issues.apache.org/jira/browse/AMBARI-20999 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.1 > > Attachments: AMBARI-20999.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-20999) More updates to llap configs for hdp stack
Siddharth Seth created AMBARI-20999: --- Summary: More updates to llap configs for hdp stack Key: AMBARI-20999 URL: https://issues.apache.org/jira/browse/AMBARI-20999 Project: Ambari Issue Type: Task Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.1 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20568) Update hash aggregation settings for llap in hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20568: Attachment: AMBARI-20568.01.patch cc [~sumitmohanty], [~swapanshridhar] > Update hash aggregation settings for llap in hdp stack > -- > > Key: AMBARI-20568 > URL: https://issues.apache.org/jira/browse/AMBARI-20568 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: AMBARI-20568.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20568) Update hash aggregation settings for llap in hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20568: Status: Patch Available (was: Open) > Update hash aggregation settings for llap in hdp stack > -- > > Key: AMBARI-20568 > URL: https://issues.apache.org/jira/browse/AMBARI-20568 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: AMBARI-20568.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-20568) Update hash aggregation settings for llap in hdp stack
Siddharth Seth created AMBARI-20568: --- Summary: Update hash aggregation settings for llap in hdp stack Key: AMBARI-20568 URL: https://issues.apache.org/jira/browse/AMBARI-20568 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20245) Setup tez ats related parameters
[ https://issues.apache.org/jira/browse/AMBARI-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20245: Attachment: AMBARI-20245.modified.02.patch Uploaded a copy of Sumit's previous patch with the fix. > Setup tez ats related parameters > > > Key: AMBARI-20245 > URL: https://issues.apache.org/jira/browse/AMBARI-20245 > Project: Ambari > Issue Type: Bug > Components: stacks >Affects Versions: 2.5.0 >Reporter: Siddharth Seth >Assignee: Sumit Mohanty >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-20245.modified.02.patch, > AMBARI-20245.modified.patch, AMBARI-20245.patch > > > Dags per group needs to be set to 5. > TASK_ATTEMPT events to be ignored needs to be set to > |tez-interactive-site|tez.history.logging.timeline.num-dags-per-group|5| > |tez-site|tez.history.logging.timeline-cache-plugin.old-num-dags-per-group|5| > |tez-intearactive-site|tez.history.logging.taskattempt-filters|EXECUTOR_BUSY,EXTERNAL_PREEMPTION| -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-20245) Setup tez ats related parameters
[ https://issues.apache.org/jira/browse/AMBARI-20245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15893870#comment-15893870 ] Siddharth Seth commented on AMBARI-20245: - Provided incorrect info. EXECUTOR_BUSY,EXTERNAL_PREEMPTION was supposed to be SERVICE,EXTERNAL_PREEMPTION Sorry about that. > Setup tez ats related parameters > > > Key: AMBARI-20245 > URL: https://issues.apache.org/jira/browse/AMBARI-20245 > Project: Ambari > Issue Type: Bug > Components: stacks >Affects Versions: 2.5.0 >Reporter: Siddharth Seth >Assignee: Sumit Mohanty >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-20245.modified.patch, AMBARI-20245.patch > > > Dags per group needs to be set to 5. > TASK_ATTEMPT events to be ignored needs to be set to > |tez-interactive-site|tez.history.logging.timeline.num-dags-per-group|5| > |tez-site|tez.history.logging.timeline-cache-plugin.old-num-dags-per-group|5| > |tez-intearactive-site|tez.history.logging.taskattempt-filters|EXECUTOR_BUSY,EXTERNAL_PREEMPTION| -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
[ https://issues.apache.org/jira/browse/AMBARI-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882149#comment-15882149 ] Siddharth Seth commented on AMBARI-20109: - [~swapanshridhar] - could you please revert the change. This was not ready to be committed. I had cancelled the patch. > HDP stack - enable shuffle connection keep-alive > > > Key: AMBARI-20109 > URL: https://issues.apache.org/jira/browse/AMBARI-20109 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20109.01.patch, AMBARI-20109.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-20151) add extra Tez logging configs for Hive
[ https://issues.apache.org/jira/browse/AMBARI-20151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15881438#comment-15881438 ] Siddharth Seth commented on AMBARI-20151: - We need to leave out TezMerger for now, and add it in when it has a custom logger. > add extra Tez logging configs for Hive > -- > > Key: AMBARI-20151 > URL: https://issues.apache.org/jira/browse/AMBARI-20151 > Project: Ambari > Issue Type: Bug >Reporter: Sergey Shelukhin >Assignee: Sergey Shelukhin > Fix For: 2.5.0 > > Attachments: AMBARI-20151.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
[ https://issues.apache.org/jira/browse/AMBARI-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20109: Status: Open (was: Patch Available) Cancelling the patch for now. The config changes need some more behaviour verification. > HDP stack - enable shuffle connection keep-alive > > > Key: AMBARI-20109 > URL: https://issues.apache.org/jira/browse/AMBARI-20109 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20109.01.patch, AMBARI-20109.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
[ https://issues.apache.org/jira/browse/AMBARI-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20109: Attachment: AMBARI-20109.02.patch Thanks for taking a look [~sumitmohanty], [~jonathan.hurley] Updated patch to address the review comments. Tests pass locally. Other than the fixes in the patch, I'd still like to make sure that these are the correct sections to put the configs. The configs affefct the NodeManagers, but are changed in mapred-site. After an upgrade - the configs need to be in place before the NM restarts. Since they affect the NodeManagers, I put them into a NM section. (Maybe they could have been in the RM section, or even a MapReduce section). > HDP stack - enable shuffle connection keep-alive > > > Key: AMBARI-20109 > URL: https://issues.apache.org/jira/browse/AMBARI-20109 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20109.01.patch, AMBARI-20109.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
[ https://issues.apache.org/jira/browse/AMBARI-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20109: Attachment: AMBARI-20109.01.patch cc [~sumitmohanty], [~swapanshridhar] for review. I'm not absolutely sure about the changes related to mapred-site. This change is actually read by the NodeManagers, which is why I put it into the NodeManager section. > HDP stack - enable shuffle connection keep-alive > > > Key: AMBARI-20109 > URL: https://issues.apache.org/jira/browse/AMBARI-20109 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20109.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
[ https://issues.apache.org/jira/browse/AMBARI-20109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20109: Status: Patch Available (was: Open) > HDP stack - enable shuffle connection keep-alive > > > Key: AMBARI-20109 > URL: https://issues.apache.org/jira/browse/AMBARI-20109 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20109.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-20109) HDP stack - enable shuffle connection keep-alive
Siddharth Seth created AMBARI-20109: --- Summary: HDP stack - enable shuffle connection keep-alive Key: AMBARI-20109 URL: https://issues.apache.org/jira/browse/AMBARI-20109 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20106) Additional config changes for HSI - HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20106: Attachment: AMBARI-20106.01.patch cc [~sumitmohanty], [~swapanshridhar] - please review. > Additional config changes for HSI - HDP stack > - > > Key: AMBARI-20106 > URL: https://issues.apache.org/jira/browse/AMBARI-20106 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20106.01.patch > > > Timeout changes > GC parameter changes -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20106) Additional config changes for HSI - HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20106: Description: Timeout changes GC parameter changes was: Log additions Timeout changes GC parameter changes > Additional config changes for HSI - HDP stack > - > > Key: AMBARI-20106 > URL: https://issues.apache.org/jira/browse/AMBARI-20106 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20106.01.patch > > > Timeout changes > GC parameter changes -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Assigned] (AMBARI-20106) Additional config changes for HSI - HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned AMBARI-20106: --- Assignee: Siddharth Seth > Additional config changes for HSI - HDP stack > - > > Key: AMBARI-20106 > URL: https://issues.apache.org/jira/browse/AMBARI-20106 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20106.01.patch > > > Timeout changes > GC parameter changes -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20106) Additional config changes for HSI - HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-20106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20106: Status: Patch Available (was: Open) > Additional config changes for HSI - HDP stack > - > > Key: AMBARI-20106 > URL: https://issues.apache.org/jira/browse/AMBARI-20106 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20106.01.patch > > > Timeout changes > GC parameter changes -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-20106) Additional config changes for HSI - HDP stack
Siddharth Seth created AMBARI-20106: --- Summary: Additional config changes for HSI - HDP stack Key: AMBARI-20106 URL: https://issues.apache.org/jira/browse/AMBARI-20106 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Fix For: 2.5.0 Log additions Timeout changes GC parameter changes -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20060) update the headroom for llap - hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20060: Attachment: AMBARI-20060.01.patch cc [~sumitmohanty], [~swapanshridhar] for review. > update the headroom for llap - hdp stack > > > Key: AMBARI-20060 > URL: https://issues.apache.org/jira/browse/AMBARI-20060 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20060.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-20060) update the headroom for llap - hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-20060: Status: Patch Available (was: Open) > update the headroom for llap - hdp stack > > > Key: AMBARI-20060 > URL: https://issues.apache.org/jira/browse/AMBARI-20060 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-20060.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-20060) update the headroom for llap - hdp stack
Siddharth Seth created AMBARI-20060: --- Summary: update the headroom for llap - hdp stack Key: AMBARI-20060 URL: https://issues.apache.org/jira/browse/AMBARI-20060 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19884) Set a higher value of num aggregated files per container - HDP stack, YARN
[ https://issues.apache.org/jira/browse/AMBARI-19884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19884: Attachment: AMBARI-19884.02.patch Moved to the upgrade pack instead of UpgradeCatalog50. [~afernandez] - could you please take a look at the upgrade pack changes. (Are these supposed to be under HDP/2.5/upgrades/upgrade-2.6.xml or HDP/2.6/upgrades/*) > Set a higher value of num aggregated files per container - HDP stack, YARN > -- > > Key: AMBARI-19884 > URL: https://issues.apache.org/jira/browse/AMBARI-19884 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19884.01.patch, AMBARI-19884.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Attachment: AMBARI-19886.03.patch Updated to fix the tests. > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19886.01.patch, AMBARI-19886.02.patch, > AMBARI-19886.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-19884) Set a higher value of num aggregated files per container - HDP stack, YARN
[ https://issues.apache.org/jira/browse/AMBARI-19884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15857216#comment-15857216 ] Siddharth Seth commented on AMBARI-19884: - Yes. > Set a higher value of num aggregated files per container - HDP stack, YARN > -- > > Key: AMBARI-19884 > URL: https://issues.apache.org/jira/browse/AMBARI-19884 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19884.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Comment Edited] (AMBARI-19903) Fix value for config "hive.llap.daemon.rpc.port" to be updated as "0" in UpgradeCatalog250.java
[ https://issues.apache.org/jira/browse/AMBARI-19903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856881#comment-15856881 ] Siddharth Seth edited comment on AMBARI-19903 at 2/7/17 9:57 PM: - [~sumitmohanty] - That's a good question. The second one is meant to be used with HDP-2.6. I suspect UpgradeCatalog250 is the wrong place for such changes. was (Author: sseth): [~sumitmohanty] - That's a good question. The second one is meant to be used with HDP-2.6. > Fix value for config "hive.llap.daemon.rpc.port" to be updated as "0" in > UpgradeCatalog250.java > --- > > Key: AMBARI-19903 > URL: https://issues.apache.org/jira/browse/AMBARI-19903 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.5.0 >Reporter: Swapan Shridhar >Assignee: Swapan Shridhar >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-19903.01.patch > > > From llap-daemon logs: > {code} > 2017-02-07T19:59:39,800 INFO [main ()] org.apache.hadoop.hive.conf.HiveConf: > Found configuration file > file:/grid/0/hadoop/yarn/local/usercache/hive/appcache/application_1486481006089_0004/container_e10_1486481006089_0004_01_07/app/install/conf/hive-site.xml > 2017-02-07T19:59:40,392 INFO [main ()] org.apache.hadoop.hive.llap.LlapUtil: > Using local dirs from environment: > /grid/0/hadoop/yarn/local/usercache/hive/appcache/application_1486481006089_0004 > 2017-02-07T19:59:40,394 WARN [main ()] > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Failed to start LLAP > Daemon with exception > java.lang.NumberFormatException: For input string: "only" > at > java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) > ~[?:1.7.0_67] > at java.lang.Integer.parseInt(Integer.java:492) ~[?:1.7.0_67] > at java.lang.Integer.parseInt(Integer.java:527) ~[?:1.7.0_67] > at > org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1258) > ~[hadoop-common-2.7.3.2.5.0.0-1245.jar:?] > at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:3378) > ~[hive-exec-2.1.0.2.5.0.0-1245.jar:2.1.0.2.5.0.0-1245] > at > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon.main(LlapDaemon.java:442) > [hive-llap-server-2.1.0.2.5.0.0-1245.jar:2.1.0.2.5.0.0-1245] > {code} > *Reason:* "hive.llap.daemon.rpc.port" has been updated as "only" as part of > the upgrade code as part of fix in AMBARI-19719. > *Fix:* Set the config value as "0". -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (AMBARI-19903) Fix value for config "hive.llap.daemon.rpc.port" to be updated as "0" in UpgradeCatalog250.java
[ https://issues.apache.org/jira/browse/AMBARI-19903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15856881#comment-15856881 ] Siddharth Seth commented on AMBARI-19903: - [~sumitmohanty] - That's a good question. The second one is meant to be used with HDP-2.6. > Fix value for config "hive.llap.daemon.rpc.port" to be updated as "0" in > UpgradeCatalog250.java > --- > > Key: AMBARI-19903 > URL: https://issues.apache.org/jira/browse/AMBARI-19903 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.5.0 >Reporter: Swapan Shridhar >Assignee: Swapan Shridhar >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-19903.01.patch > > > From llap-daemon logs: > {code} > 2017-02-07T19:59:39,800 INFO [main ()] org.apache.hadoop.hive.conf.HiveConf: > Found configuration file > file:/grid/0/hadoop/yarn/local/usercache/hive/appcache/application_1486481006089_0004/container_e10_1486481006089_0004_01_07/app/install/conf/hive-site.xml > 2017-02-07T19:59:40,392 INFO [main ()] org.apache.hadoop.hive.llap.LlapUtil: > Using local dirs from environment: > /grid/0/hadoop/yarn/local/usercache/hive/appcache/application_1486481006089_0004 > 2017-02-07T19:59:40,394 WARN [main ()] > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon: Failed to start LLAP > Daemon with exception > java.lang.NumberFormatException: For input string: "only" > at > java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) > ~[?:1.7.0_67] > at java.lang.Integer.parseInt(Integer.java:492) ~[?:1.7.0_67] > at java.lang.Integer.parseInt(Integer.java:527) ~[?:1.7.0_67] > at > org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1258) > ~[hadoop-common-2.7.3.2.5.0.0-1245.jar:?] > at org.apache.hadoop.hive.conf.HiveConf.getIntVar(HiveConf.java:3378) > ~[hive-exec-2.1.0.2.5.0.0-1245.jar:2.1.0.2.5.0.0-1245] > at > org.apache.hadoop.hive.llap.daemon.impl.LlapDaemon.main(LlapDaemon.java:442) > [hive-llap-server-2.1.0.2.5.0.0-1245.jar:2.1.0.2.5.0.0-1245] > {code} > *Reason:* "hive.llap.daemon.rpc.port" has been updated as "only" as part of > the upgrade code as part of fix in AMBARI-19719. > *Fix:* Set the config value as "0". -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Attachment: AMBARI-19886.02.patch Updated patch to skip setting the policy when the llap is disabled. The priority on the llap queue itself does not matter, since it is STOPPED. > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19886.01.patch, AMBARI-19886.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Attachment: AMBARI-19886.01.patch Simple patch to set a few extra cs parameters. cc [~sumitmohanty], [~swapanshridhar], [~leftnoteasy] for review. > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19886.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Component/s: stacks > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19886.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Status: Patch Available (was: Open) > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19886.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
Siddharth Seth created AMBARI-19886: --- Summary: Update ambari managed llap queue to set preemption policy Key: AMBARI-19886 URL: https://issues.apache.org/jira/browse/AMBARI-19886 Project: Ambari Issue Type: Task Reporter: Siddharth Seth Assignee: Siddharth Seth -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19886) Update ambari managed llap queue to set preemption policy
[ https://issues.apache.org/jira/browse/AMBARI-19886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19886: Fix Version/s: 2.5.0 > Update ambari managed llap queue to set preemption policy > - > > Key: AMBARI-19886 > URL: https://issues.apache.org/jira/browse/AMBARI-19886 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19884) Set a higher value of num aggregated files per container - HDP stack, YARN
[ https://issues.apache.org/jira/browse/AMBARI-19884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19884: Attachment: AMBARI-19884.01.patch cc [~sumitmohanty], [~swapanshridhar] - please review. > Set a higher value of num aggregated files per container - HDP stack, YARN > -- > > Key: AMBARI-19884 > URL: https://issues.apache.org/jira/browse/AMBARI-19884 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19884.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Updated] (AMBARI-19884) Set a higher value of num aggregated files per container - HDP stack, YARN
[ https://issues.apache.org/jira/browse/AMBARI-19884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19884: Status: Patch Available (was: Open) > Set a higher value of num aggregated files per container - HDP stack, YARN > -- > > Key: AMBARI-19884 > URL: https://issues.apache.org/jira/browse/AMBARI-19884 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19884.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (AMBARI-19884) Set a higher value of num aggregated files per container - HDP stack, YARN
Siddharth Seth created AMBARI-19884: --- Summary: Set a higher value of num aggregated files per container - HDP stack, YARN Key: AMBARI-19884 URL: https://issues.apache.org/jira/browse/AMBARI-19884 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-19719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19719: Attachment: AMBARI-19719.trunk.01.patch Patch for trunk > Update rpc port for LLAP to 0 for HDP stack > --- > > Key: AMBARI-19719 > URL: https://issues.apache.org/jira/browse/AMBARI-19719 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19719.01.patch, AMBARI-19719.trunk.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
Title: Message Title Siddharth Seth commented on AMBARI-19719  Re: Update rpc port for LLAP to 0 for HDP stack Sumit Mohanty - upgradeCatalog250 has been modified. Do I need to change something else? Add Comment  This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] [Updated] (AMBARI-19760) HSI: Fixes for smaller clusters - higher concurrency, min_node_size
[ https://issues.apache.org/jira/browse/AMBARI-19760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19760: Attachment: AMBARI-19760.01.patch Fixes minNodeCount. Fixes concurrency to go up to 4 for smaller clusters (ignoring the calculations based on queries per executor). Fixes normalizeDown to return 0 if < min_container_size cc [~swapanshridhar], [~sumitmohanty] for review. > HSI: Fixes for smaller clusters - higher concurrency, min_node_size > --- > > Key: AMBARI-19760 > URL: https://issues.apache.org/jira/browse/AMBARI-19760 > Project: Ambari > Issue Type: Bug > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-19760.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19760) HSI: Fixes for smaller clusters - higher concurrency, min_node_size
[ https://issues.apache.org/jira/browse/AMBARI-19760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19760: Status: Patch Available (was: Open) > HSI: Fixes for smaller clusters - higher concurrency, min_node_size > --- > > Key: AMBARI-19760 > URL: https://issues.apache.org/jira/browse/AMBARI-19760 > Project: Ambari > Issue Type: Bug > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-19760.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-19760) HSI: Fixes for smaller clusters - higher concurrency, min_node_size
Siddharth Seth created AMBARI-19760: --- Summary: HSI: Fixes for smaller clusters - higher concurrency, min_node_size Key: AMBARI-19760 URL: https://issues.apache.org/jira/browse/AMBARI-19760 Project: Ambari Issue Type: Bug Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Priority: Critical Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-19719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19719: Status: Patch Available (was: Open) > Update rpc port for LLAP to 0 for HDP stack > --- > > Key: AMBARI-19719 > URL: https://issues.apache.org/jira/browse/AMBARI-19719 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: AMBARI-19719.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-19719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19719: Fix Version/s: 2.5.0 > Update rpc port for LLAP to 0 for HDP stack > --- > > Key: AMBARI-19719 > URL: https://issues.apache.org/jira/browse/AMBARI-19719 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19719.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
[ https://issues.apache.org/jira/browse/AMBARI-19719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19719: Attachment: AMBARI-19719.01.patch Patch to make the change, and update catalog changes. Also converts references to "hive-interactive-string" to a constant. cc [~sumitmohanty], [~swapanshridhar] for review. > Update rpc port for LLAP to 0 for HDP stack > --- > > Key: AMBARI-19719 > URL: https://issues.apache.org/jira/browse/AMBARI-19719 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19719.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-19719) Update rpc port for LLAP to 0 for HDP stack
Siddharth Seth created AMBARI-19719: --- Summary: Update rpc port for LLAP to 0 for HDP stack Key: AMBARI-19719 URL: https://issues.apache.org/jira/browse/AMBARI-19719 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19547) HSI tez am memory set to 0, incorrect calcaultions for non llap queues
[ https://issues.apache.org/jira/browse/AMBARI-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19547: Status: Patch Available (was: Open) > HSI tez am memory set to 0, incorrect calcaultions for non llap queues > -- > > Key: AMBARI-19547 > URL: https://issues.apache.org/jira/browse/AMBARI-19547 > Project: Ambari > Issue Type: Bug >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19547.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19547) HSI tez am memory set to 0, incorrect calcaultions for non llap queues
[ https://issues.apache.org/jira/browse/AMBARI-19547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19547: Attachment: AMBARI-19547.01.patch Patch contains the following changes. - Sets the am parameter to SET_ON_FIRST_INVOCATION so that it is computed. - Modifies the way #nodes is calculated for non ambari controlled queues (BUG related to the computed size of the daemon being too large in this case) - Adds an improvement to the queue capacity determination (queue name check) - Re-adds most logging that was removed in AMBARI-19171 - Modifies the display-name and description of some config parameters. cc [~sumitmohanty], [~swapanshridhar] for review. > HSI tez am memory set to 0, incorrect calcaultions for non llap queues > -- > > Key: AMBARI-19547 > URL: https://issues.apache.org/jira/browse/AMBARI-19547 > Project: Ambari > Issue Type: Bug >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19547.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-19547) HSI tez am memory set to 0, incorrect calcaultions for non llap queues
Siddharth Seth created AMBARI-19547: --- Summary: HSI tez am memory set to 0, incorrect calcaultions for non llap queues Key: AMBARI-19547 URL: https://issues.apache.org/jira/browse/AMBARI-19547 Project: Ambari Issue Type: Bug Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-19338) AM sizing for LLAP - min container size changes
[ https://issues.apache.org/jira/browse/AMBARI-19338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15822551#comment-15822551 ] Siddharth Seth commented on AMBARI-19338: - More comments on the code review. Please don't commit yet. > AM sizing for LLAP - min container size changes > --- > > Key: AMBARI-19338 > URL: https://issues.apache.org/jira/browse/AMBARI-19338 > Project: Ambari > Issue Type: Bug > Components: stacks >Reporter: Dmytro Sen >Assignee: Sumit Mohanty >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-19338_2.patch, AMBARI-19338_3.patch > > > Currently, AMs are sized too big for LLAP (especially with small setups). > Better defaults are needed, but min container size has to change for that. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19375) Update the execution mode for hive interactive in HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-19375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19375: Fix Version/s: 2.5.0 > Update the execution mode for hive interactive in HDP 2.6 stack > --- > > Key: AMBARI-19375 > URL: https://issues.apache.org/jira/browse/AMBARI-19375 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-19375.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19375) Update the execution mode for hive interactive in HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-19375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19375: Status: Patch Available (was: Open) > Update the execution mode for hive interactive in HDP 2.6 stack > --- > > Key: AMBARI-19375 > URL: https://issues.apache.org/jira/browse/AMBARI-19375 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: AMBARI-19375.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-19375) Update the execution mode for hive interactive in HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-19375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-19375: Attachment: AMBARI-19375.01.patch The intent is to change the value to only. Also to update the value to only from the old value of 'all' in the 2.5 stack on upgrade. cc [~sumitmohanty] for review. > Update the execution mode for hive interactive in HDP 2.6 stack > --- > > Key: AMBARI-19375 > URL: https://issues.apache.org/jira/browse/AMBARI-19375 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Attachments: AMBARI-19375.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-19375) Update the execution mode for hive interactive in HDP 2.6 stack
Siddharth Seth created AMBARI-19375: --- Summary: Update the execution mode for hive interactive in HDP 2.6 stack Key: AMBARI-19375 URL: https://issues.apache.org/jira/browse/AMBARI-19375 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18901) LLAP integration enhancements
[ https://issues.apache.org/jira/browse/AMBARI-18901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15799818#comment-15799818 ] Siddharth Seth commented on AMBARI-18901: - Can this be closed? Seems like it's already committed. One question on this [~sumitmohanty], [~swapanshridhar] - why are the following lines required? {code} updateConfigurationProperties("tez-interactive-site", Collections.singletonMap("tez.runtime.io.sort.mb", "512"), true, true); updateConfigurationProperties("tez-interactive-site", Collections.singletonMap("tez.runtime.unordered.output.buffer.size-mb", "100"), true, true); {code} They will be calculated by stack-advisor; I'm not sure why this is required in the updateCatalog, and what the impact is. Will SA be applied after? > LLAP integration enhancements > - > > Key: AMBARI-18901 > URL: https://issues.apache.org/jira/browse/AMBARI-18901 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.4.2 >Reporter: Swapan Shridhar >Assignee: Swapan Shridhar >Priority: Critical > Fix For: 2.5.0 > > Attachments: AMBARI-18901-trunk.patch > > > The attached patch is a merged patch for all the changes from branch - > branch-feature-AMBARI-18901 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.06.patch Updated patch to add a few more configs related to client-am timeouts, session-timeouts, disabled blacklisting. > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch, > AMBARI-18792.05.patch, AMBARI-18792.06.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15672381#comment-15672381 ] Siddharth Seth commented on AMBARI-18792: - ping. > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch, > AMBARI-18792.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665375#comment-15665375 ] Siddharth Seth commented on AMBARI-18792: - [~sumitmohanty], [~swapanshridhar] - any idea why the precommit build is failing? Have tried this locally on trunk and branch-2.5 > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch, > AMBARI-18792.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.05.patch Re-uploading. The patch applies locally. > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch, > AMBARI-18792.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.05.patch Updated to fix the failure. > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update some configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Status: Patch Available (was: Reopened) > Update some configuration properties for hive interactive for the HDP 2.6 > stack > --- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch, AMBARI-18792.05.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652119#comment-15652119 ] Siddharth Seth commented on AMBARI-18792: - Is this good to commit? > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: trunk, 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch, AMBARI-18792.04.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15644907#comment-15644907 ] Siddharth Seth commented on AMBARI-18792: - Patch applies locally. [~sumitmohanty], [~swapanshridhar] - any ideas on what is needed to get the patch to apply in the pre-commit? > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.03.patch Added one more parameter, and changed to hive-interactive-site > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch, > AMBARI-18792.03.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15637989#comment-15637989 ] Siddharth Seth commented on AMBARI-18792: - Need input on what the correct value for the configuration file is. Should this be changed in hiveserver-site explicitly? > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.02.patch Updated to include changes to the upgrade helper. > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch, AMBARI-18792.02.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Status: Patch Available (was: Open) > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
[ https://issues.apache.org/jira/browse/AMBARI-18792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-18792: Attachment: AMBARI-18792.01.patch Changes values for locality delay, fragment timeouts, and usage of grace hash joins. cc [~sumitmohanty], [~swapanshridhar], [~gopalv] > Update som configuration properties for hive interactive for the HDP 2.6 stack > -- > > Key: AMBARI-18792 > URL: https://issues.apache.org/jira/browse/AMBARI-18792 > Project: Ambari > Issue Type: Task > Components: stacks >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.5.0 > > Attachments: AMBARI-18792.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-18792) Update som configuration properties for hive interactive for the HDP 2.6 stack
Siddharth Seth created AMBARI-18792: --- Summary: Update som configuration properties for hive interactive for the HDP 2.6 stack Key: AMBARI-18792 URL: https://issues.apache.org/jira/browse/AMBARI-18792 Project: Ambari Issue Type: Task Components: stacks Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.5.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (AMBARI-17930) Update tez-interactive for hdp stack to remove acid settings
[ https://issues.apache.org/jira/browse/AMBARI-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396222#comment-15396222 ] Siddharth Seth edited comment on AMBARI-17930 at 7/27/16 7:44 PM: -- Trivial patch to undo the acid specific changes made in AMBARI-17699. cc [~sumitmohanty], [~swapanshridhar] for review. was (Author: sseth): Trivial patch to undo the acid specific changes made in AMBARI-17699 > Update tez-interactive for hdp stack to remove acid settings > > > Key: AMBARI-17930 > URL: https://issues.apache.org/jira/browse/AMBARI-17930 > Project: Ambari > Issue Type: Task >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17930.01.patch > > > AMBARI-17699 added some settings to disable ACID by default for Hive2 LLAP, > so that the ACID transaction slider on the UI has no affect on Hive2. > That changes is not required - since ACID does work with Hive2 LLAP. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17930) Update tez-interactive for hdp stack to remove acid settings
[ https://issues.apache.org/jira/browse/AMBARI-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17930: Attachment: AMBARI-17930.01.patch Trivial patch to undo the acid specific changes made in AMBARI-17699 > Update tez-interactive for hdp stack to remove acid settings > > > Key: AMBARI-17930 > URL: https://issues.apache.org/jira/browse/AMBARI-17930 > Project: Ambari > Issue Type: Task >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17930.01.patch > > > AMBARI-17699 added some settings to disable ACID by default for Hive2 LLAP, > so that the ACID transaction slider on the UI has no affect on Hive2. > That changes is not required - since ACID does work with Hive2 LLAP. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17930) Update tez-interactive for hdp stack to remove acid settings
[ https://issues.apache.org/jira/browse/AMBARI-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17930: Status: Patch Available (was: Open) > Update tez-interactive for hdp stack to remove acid settings > > > Key: AMBARI-17930 > URL: https://issues.apache.org/jira/browse/AMBARI-17930 > Project: Ambari > Issue Type: Task >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17930.01.patch > > > AMBARI-17699 added some settings to disable ACID by default for Hive2 LLAP, > so that the ACID transaction slider on the UI has no affect on Hive2. > That changes is not required - since ACID does work with Hive2 LLAP. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-17930) Update tez-interactive for hdp stack to remove acid settings
Siddharth Seth created AMBARI-17930: --- Summary: Update tez-interactive for hdp stack to remove acid settings Key: AMBARI-17930 URL: https://issues.apache.org/jira/browse/AMBARI-17930 Project: Ambari Issue Type: Task Affects Versions: 2.4.0 Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.4.0 AMBARI-17699 added some settings to disable ACID by default for Hive2 LLAP, so that the ACID transaction slider on the UI has no affect on Hive2. That changes is not required - since ACID does work with Hive2 LLAP. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17872) Another fix to llap log4j properties for HDP 2.5 stack
[ https://issues.apache.org/jira/browse/AMBARI-17872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17872: Status: Patch Available (was: Open) > Another fix to llap log4j properties for HDP 2.5 stack > -- > > Key: AMBARI-17872 > URL: https://issues.apache.org/jira/browse/AMBARI-17872 > Project: Ambari > Issue Type: Bug > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17872.01.patch > > > llap-log4j properties changes again after HIVE-14225. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17872) Another fix to llap log4j properties for HDP 2.5 stack
[ https://issues.apache.org/jira/browse/AMBARI-17872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17872: Attachment: AMBARI-17872.01.patch Simple patch to update the file. cc [~sumitmohanty], [~swapanshridhar]. Is any XML escaping required? I looked at the diff and didn't see any requirement. > Another fix to llap log4j properties for HDP 2.5 stack > -- > > Key: AMBARI-17872 > URL: https://issues.apache.org/jira/browse/AMBARI-17872 > Project: Ambari > Issue Type: Bug > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17872.01.patch > > > llap-log4j properties changes again after HIVE-14225. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-17872) Another fix to llap log4j properties for HDP 2.5 stack
Siddharth Seth created AMBARI-17872: --- Summary: Another fix to llap log4j properties for HDP 2.5 stack Key: AMBARI-17872 URL: https://issues.apache.org/jira/browse/AMBARI-17872 Project: Ambari Issue Type: Bug Components: stacks Affects Versions: 2.4.0 Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.4.0 llap-log4j properties changes again after HIVE-14225. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-17844) Update the content of various llap log4j properties
[ https://issues.apache.org/jira/browse/AMBARI-17844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390868#comment-15390868 ] Siddharth Seth commented on AMBARI-17844: - I don't think this is committed to branch-2.4 > Update the content of various llap log4j properties > --- > > Key: AMBARI-17844 > URL: https://issues.apache.org/jira/browse/AMBARI-17844 > Project: Ambari > Issue Type: Bug > Components: ambari-server >Affects Versions: 2.4.0 >Reporter: Nahappan Somasundaram >Assignee: Nahappan Somasundaram >Priority: Blocker > Fix For: 2.4.0 > > Attachments: rb50312.patch > > > Since Hive2 has changed some logging properties - there's no logs generated > for Hive2 since the old properties file checked into the Ambari codebase is > being used. > {code} > llap-daemon-log4j2.properties file: picked up from > ambari-server/src/main/resources/stacks/HDP/2.5/services/HIVE/configuration/llap-daemon-log4j.xml > Similarly for llap-cli-log4j2.properties file: picked up from > ambari-server/src/main/resources/stacks/HDP/2.5/services/HIVE/configuration/llap-cli-log4j2.xml > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-17748) Enable yarn rolling log aggregation for 2.5 hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15380337#comment-15380337 ] Siddharth Seth commented on AMBARI-17748: - cc [~sumitmohanty] for review. > Enable yarn rolling log aggregation for 2.5 hdp stack > - > > Key: AMBARI-17748 > URL: https://issues.apache.org/jira/browse/AMBARI-17748 > Project: Ambari > Issue Type: Task > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17748.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17748) Enable yarn rolling log aggregation for 2.5 hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17748: Status: Patch Available (was: Open) > Enable yarn rolling log aggregation for 2.5 hdp stack > - > > Key: AMBARI-17748 > URL: https://issues.apache.org/jira/browse/AMBARI-17748 > Project: Ambari > Issue Type: Task > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17748.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17748) Enable yarn rolling log aggregation for 2.5 hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17748: Summary: Enable yarn rolling log aggregation for 2.5 hdp stack (was: Enable rolling log aggregation for 2.5 hdp stack) > Enable yarn rolling log aggregation for 2.5 hdp stack > - > > Key: AMBARI-17748 > URL: https://issues.apache.org/jira/browse/AMBARI-17748 > Project: Ambari > Issue Type: Task > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17748.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17748) Enable rolling log aggregation for 2.5 hdp stack
[ https://issues.apache.org/jira/browse/AMBARI-17748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17748: Attachment: AMBARI-17748.01.patch > Enable rolling log aggregation for 2.5 hdp stack > > > Key: AMBARI-17748 > URL: https://issues.apache.org/jira/browse/AMBARI-17748 > Project: Ambari > Issue Type: Task > Components: stacks >Affects Versions: 2.4.0 >Reporter: Siddharth Seth >Assignee: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17748.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-17748) Enable rolling log aggregation for 2.5 hdp stack
Siddharth Seth created AMBARI-17748: --- Summary: Enable rolling log aggregation for 2.5 hdp stack Key: AMBARI-17748 URL: https://issues.apache.org/jira/browse/AMBARI-17748 Project: Ambari Issue Type: Task Components: stacks Affects Versions: 2.4.0 Reporter: Siddharth Seth Assignee: Siddharth Seth Fix For: 2.4.0 Attachments: AMBARI-17748.01.patch -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17699) Update more configs for hive interactive in HDP 2.5 stack
[ https://issues.apache.org/jira/browse/AMBARI-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17699: Status: Patch Available (was: Open) > Update more configs for hive interactive in HDP 2.5 stack > - > > Key: AMBARI-17699 > URL: https://issues.apache.org/jira/browse/AMBARI-17699 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17699.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17699) Update more configs for hive interactive in HDP 2.5 stack
[ https://issues.apache.org/jira/browse/AMBARI-17699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17699: Attachment: AMBARI-17699.01.patch Set tez as the execution engine. Disable acid. Set AM timeout to 1 hour. > Update more configs for hive interactive in HDP 2.5 stack > - > > Key: AMBARI-17699 > URL: https://issues.apache.org/jira/browse/AMBARI-17699 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17699.01.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (AMBARI-17699) Update more configs for hive interactive in HDP 2.5 stack
Siddharth Seth created AMBARI-17699: --- Summary: Update more configs for hive interactive in HDP 2.5 stack Key: AMBARI-17699 URL: https://issues.apache.org/jira/browse/AMBARI-17699 Project: Ambari Issue Type: Task Reporter: Siddharth Seth Fix For: 2.4.0 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-17597) Disable recovery in tez configs for Hive-LLAP
[ https://issues.apache.org/jira/browse/AMBARI-17597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15365111#comment-15365111 ] Siddharth Seth commented on AMBARI-17597: - +1 (non-binding). > Disable recovery in tez configs for Hive-LLAP > -- > > Key: AMBARI-17597 > URL: https://issues.apache.org/jira/browse/AMBARI-17597 > Project: Ambari > Issue Type: Bug >Reporter: Hitesh Shah >Assignee: Hitesh Shah > Attachments: AMBARI-17597.1.patch > > > Disable recovery in tez configs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (AMBARI-17099) Update tez-site for HDP 2.5 stack version
[ https://issues.apache.org/jira/browse/AMBARI-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319295#comment-15319295 ] Siddharth Seth commented on AMBARI-17099: - cc [~swapanshridhar], [~hitesh] - could you please review. > Update tez-site for HDP 2.5 stack version > - > > Key: AMBARI-17099 > URL: https://issues.apache.org/jira/browse/AMBARI-17099 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17099.01.patch > > > This needs some additional settings. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-17099) Update tez-site for HDP 2.5 stack version
[ https://issues.apache.org/jira/browse/AMBARI-17099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated AMBARI-17099: Attachment: AMBARI-17099.01.patch > Update tez-site for HDP 2.5 stack version > - > > Key: AMBARI-17099 > URL: https://issues.apache.org/jira/browse/AMBARI-17099 > Project: Ambari > Issue Type: Task >Reporter: Siddharth Seth > Fix For: 2.4.0 > > Attachments: AMBARI-17099.01.patch > > > This needs some additional settings. -- This message was sent by Atlassian JIRA (v6.3.4#6332)