[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-addendum.patch Upload addendum patch (spark depends on hive now from HDP 2.4) > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Fix For: 2.2.1 > > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch, > Ambari-14561-addendum.patch, Ambari-14561-branch-2.2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination > * Copy spark-hdp-assembly.jar to hdfs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-addendum-2.patch > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Fix For: 2.2.1 > > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch, > Ambari-14561-addendum-2.patch, Ambari-14561-addendum.patch, > Ambari-14561-branch-2.2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination > * Copy spark-hdp-assembly.jar to hdfs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-branch-2.2.patch > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Fix For: 2.2.1 > > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch, > Ambari-14561-branch-2.2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination > * Copy spark-hdp-assembly.jar to hdfs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mahadev konar updated AMBARI-14561: --- Fix Version/s: 2.2.1 > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Fix For: 2.2.1 > > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination > * Copy spark-hdp-assembly.jar to hdfs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Description: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift server * Remove advanced properties except queue name * Use yarn-client mode * Enable Dynamic Resource Allocation * Enable Fair scheduling policy * Use FileSystem as event logging destination * Copy spark-hdp-assembly.jar to hdfs was: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift server * Remove advanced properties except queue name * Use yarn-client mode * Enable Dynamic Resource Allocation * Enable Fair scheduling policy * Use FileSystem as event logging destination > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination > * Copy spark-hdp-assembly.jar to hdfs -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Description: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift server * Remove advanced properties except queue name * Use yarn-client mode * Enable Dynamic Resource Allocation * Enable Fair scheduling policy * Use FileSystem as event logging destination was: This is for HDP stack, in HDP stack, we'd like to do following changes for spark thrift server * Remove advanced properties except queue name * Use yarn-client mode * Enable Dynamic Resource Allocation * Enable Fair scheduling policy > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy > * Use FileSystem as event logging destination -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (AMBARI-14561) Configuration changes of spark thrift server for Spark 1.6
[ https://issues.apache.org/jira/browse/AMBARI-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated AMBARI-14561: Attachment: Ambari-14561-2.patch > Configuration changes of spark thrift server for Spark 1.6 > -- > > Key: AMBARI-14561 > URL: https://issues.apache.org/jira/browse/AMBARI-14561 > Project: Ambari > Issue Type: Improvement >Reporter: Jeff Zhang >Assignee: Jeff Zhang > Attachments: Ambari-14561-1.patch, Ambari-14561-2.patch > > > This is for HDP stack, in HDP stack, we'd like to do following changes for > spark thrift server > * Remove advanced properties except queue name > * Use yarn-client mode > * Enable Dynamic Resource Allocation > * Enable Fair scheduling policy -- This message was sent by Atlassian JIRA (v6.3.4#6332)
