[jira] [Updated] (AMBARI-15066) Spark History server does not start after downgrade due to missing spark-events directory

2016-02-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-15066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-15066: Attachment: (was: Ambari-15066-1.patch) > Spark History server does not start after downgrade

[jira] [Updated] (AMBARI-15066) Spark History server does not start after downgrade due to missing spark-events directory

2016-02-17 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-15066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-15066: Attachment: Ambari-15066-1.patch > Spark History server does not start after downgrade due to miss

[jira] [Created] (AMBARI-15066) Spark History server does not start after downgrade due to missing spark-events directory

2016-02-16 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-15066: --- Summary: Spark History server does not start after downgrade due to missing spark-events directory Key: AMBARI-15066 URL: https://issues.apache.org/jira/browse/AMBARI-15066

[jira] [Updated] (AMBARI-14914) Update Spark to 1.6.1 in HDP 2.5

2016-02-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14914: Summary: Update Spark to 1.6.1 in HDP 2.5 (was: Update Spark to 1.6.1 in HDP 2.4) > Update Spark

[jira] [Updated] (AMBARI-14914) Update Spark to 1.6.1 in HDP 2.4

2016-02-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14914: Fix Version/s: (was: 2.2.2) > Update Spark to 1.6.1 in HDP 2.4 > -

[jira] [Created] (AMBARI-14914) Update Spark to 1.6.1 in HDP 2.4

2016-02-04 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14914: --- Summary: Update Spark to 1.6.1 in HDP 2.4 Key: AMBARI-14914 URL: https://issues.apache.org/jira/browse/AMBARI-14914 Project: Ambari Issue Type: Improvement

[jira] [Created] (AMBARI-14896) Add python as one component of Spark

2016-02-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14896: --- Summary: Add python as one component of Spark Key: AMBARI-14896 URL: https://issues.apache.org/jira/browse/AMBARI-14896 Project: Ambari Issue Type: Improvement

[jira] [Created] (AMBARI-14895) Add R as one component of Spark

2016-02-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14895: --- Summary: Add R as one component of Spark Key: AMBARI-14895 URL: https://issues.apache.org/jira/browse/AMBARI-14895 Project: Ambari Issue Type: Improvement

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: (was: AMBARI-14839-addendum-2.patch) > DEA is not enabled due to configuration con

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: AMBARI-14839-addendum-2.patch > DEA is not enabled due to configuration conflict and h

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: AMBARI-14839-addendum-2.patch > DEA is not enabled due to configuration conflict and h

[jira] [Reopened] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reopened AMBARI-14839: - > DEA is not enabled due to configuration conflict and history log directory > can not be changed >

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-29 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: AMBARI-14839-addendum.patch > DEA is not enabled due to configuration conflict and his

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: AMBARI-14839-2.patch > DEA is not enabled due to configuration conflict and history lo

[jira] [Updated] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14839: Attachment: AMBARI-14839-1.patch > DEA is not enabled due to configuration conflict and history lo

[jira] [Created] (AMBARI-14839) DEA is not enabled due to configuration conflict and history log directory can not be changed

2016-01-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14839: --- Summary: DEA is not enabled due to configuration conflict and history log directory can not be changed Key: AMBARI-14839 URL: https://issues.apache.org/jira/browse/AMBARI-14839

[jira] [Created] (AMBARI-14768) Maximum Container Size must be less than node manager memory

2016-01-21 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14768: --- Summary: Maximum Container Size must be less than node manager memory Key: AMBARI-14768 URL: https://issues.apache.org/jira/browse/AMBARI-14768 Project: Ambari

[jira] [Updated] (AMBARI-14767) SparkThriftServer may fail to start when the default memory requirement exceed yarn.scheduler.maximum-allocation-mb

2016-01-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14767: Summary: SparkThriftServer may fail to start when the default memory requirement exceed yarn.sched

[jira] [Created] (AMBARI-14767) SparkThriftServer may fails to start when the default memory requirement exceed yarn.scheduler.maximum-allocation-mb

2016-01-21 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14767: --- Summary: SparkThriftServer may fails to start when the default memory requirement exceed yarn.scheduler.maximum-allocation-mb Key: AMBARI-14767 URL: https://issues.apache.org/jira/

[jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15111590#comment-15111590 ] Jeff Zhang commented on AMBARI-14561: - Upload addendum2 patch (spark depends on hive

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-addendum-2.patch > Configuration changes of spark thrift server for Spark

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-21 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-addendum.patch Upload addendum patch (spark depends on hive now from HDP

[jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15109482#comment-15109482 ] Jeff Zhang commented on AMBARI-14561: - [~afernandez] Uploaded one patch for the miss

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-branch-2.2.patch > Configuration changes of spark thrift server for Spark

[jira] [Updated] (AMBARI-14746) Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing

2016-01-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14746: Fix Version/s: 2.2.1 > Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing > --

[jira] [Created] (AMBARI-14746) Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing

2016-01-20 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14746: --- Summary: Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing Key: AMBARI-14746 URL: https://issues.apache.org/jira/browse/AMBARI-14746 Project: Ambari

[jira] [Assigned] (AMBARI-14746) Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing

2016-01-20 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang reassigned AMBARI-14746: --- Assignee: Jeff Zhang > Upgrade of Spark from HDP 2.2 to 2.3 and 2.2 to 2.4 is missing > ---

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-15 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Description: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thr

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-13 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Description: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thr

[jira] [Created] (AMBARI-14585) Run local mode for spark thriftserver in single node

2016-01-07 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14585: --- Summary: Run local mode for spark thriftserver in single node Key: AMBARI-14585 URL: https://issues.apache.org/jira/browse/AMBARI-14585 Project: Ambari Issue T

[jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15087284#comment-15087284 ] Jeff Zhang commented on AMBARI-14561: - Attach another patch for HDP 2.4. But the wei

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-07 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-2.patch > Configuration changes of spark thrift server for Spark 1.6 > --

[jira] [Updated] (AMBARI-14557) Stack advisor recommendations for SPARK use incorrect logic

2016-01-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14557: Attachment: (was: Ambari-14557-1.patch) > Stack advisor recommendations for SPARK use incorrec

[jira] [Updated] (AMBARI-14557) Stack advisor recommendations for SPARK use incorrect logic

2016-01-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14557: Attachment: Ambari-14557-1.patch > Stack advisor recommendations for SPARK use incorrect logic > -

[jira] [Commented] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15086915#comment-15086915 ] Jeff Zhang commented on AMBARI-14561: - [~sumitmohanty] Could you help review it ? I

[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-06 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Description: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thr

[jira] [Created] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6

2016-01-06 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14561: --- Summary: Configuration changes of spark thrift server for Spark 1.6 Key: AMBARI-14561 URL: https://issues.apache.org/jira/browse/AMBARI-14561 Project: Ambari I

[jira] [Commented] (AMBARI-14459) Make the hdfs replication as 1 when it is single node cluster

2016-01-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084506#comment-15084506 ] Jeff Zhang commented on AMBARI-14459: - Yes, this may be not a problem for real produ

[jira] [Commented] (AMBARI-14459) Make the hdfs replication as 1 when it is single node cluster

2016-01-05 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15084420#comment-15084420 ] Jeff Zhang commented on AMBARI-14459: - Any reason for that ? > Make the hdfs replic

[jira] [Created] (AMBARI-14545) Add advise script for spark configuration

2016-01-04 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14545: --- Summary: Add advise script for spark configuration Key: AMBARI-14545 URL: https://issues.apache.org/jira/browse/AMBARI-14545 Project: Ambari Issue Type: Improv

[jira] [Updated] (AMBARI-14512) Add service check script for spark

2016-01-04 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14512: Attachment: Ambari-14512-1.patch > Add service check script for spark > --

[jira] [Updated] (AMBARI-14513) Bump up Spark version to 1.6 in HDP 2.4

2015-12-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14513: Attachment: AMBARI-14513-1.patch > Bump up Spark version to 1.6 in HDP 2.4 > -

[jira] [Created] (AMBARI-14513) Bump up Spark version to 1.6 in HDP 2.4

2015-12-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14513: --- Summary: Bump up Spark version to 1.6 in HDP 2.4 Key: AMBARI-14513 URL: https://issues.apache.org/jira/browse/AMBARI-14513 Project: Ambari Issue Type: Improvem

[jira] [Commented] (AMBARI-14512) Add service check script for spark

2015-12-28 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/AMBARI-14512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073588#comment-15073588 ] Jeff Zhang commented on AMBARI-14512: - I check the service check script for other co

[jira] [Created] (AMBARI-14512) Add service check script for spark

2015-12-28 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14512: --- Summary: Add service check script for spark Key: AMBARI-14512 URL: https://issues.apache.org/jira/browse/AMBARI-14512 Project: Ambari Issue Type: Improvement

[jira] [Created] (AMBARI-14500) NameNode heapsize change should also change heapsize of secondary namenode

2015-12-27 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14500: --- Summary: NameNode heapsize change should also change heapsize of secondary namenode Key: AMBARI-14500 URL: https://issues.apache.org/jira/browse/AMBARI-14500 Project:

[jira] [Created] (AMBARI-14459) Make the hdfs replication as 1 when it is single node cluster

2015-12-21 Thread Jeff Zhang (JIRA)
Jeff Zhang created AMBARI-14459: --- Summary: Make the hdfs replication as 1 when it is single node cluster Key: AMBARI-14459 URL: https://issues.apache.org/jira/browse/AMBARI-14459 Project: Ambari