[jira] [Updated] (SPARK-24456) Spark submit - server environment variables are overwritten by client environment variables

2018-06-03 Thread Alon Shoham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alon Shoham updated SPARK-24456: Description: When submitting a spark application in --deploy-mode cluster + spark standalone

[jira] [Updated] (SPARK-24456) Spark submit - server environment variables are overwritten by client environment variables

2018-06-03 Thread Alon Shoham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alon Shoham updated SPARK-24456: Description: When submitting a spark application in --deploy-mode cluster + spark standalone

[jira] [Updated] (SPARK-24456) Spark submit - server environment variables are overwritten by client environment variables

2018-06-03 Thread Alon Shoham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alon Shoham updated SPARK-24456: Description: When submitting a spark application in --deploy-mode cluster + spark standalone

[jira] [Created] (SPARK-24456) Spark submit - server environment variables are overwritten by client environment variable

2018-06-03 Thread Alon Shoham (JIRA)
Alon Shoham created SPARK-24456: --- Summary: Spark submit - server environment variables are overwritten by client environment variable Key: SPARK-24456 URL: https://issues.apache.org/jira/browse/SPARK-24456

[jira] [Resolved] (SPARK-23786) CSV schema validation - column names are not checked

2018-06-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23786. - Resolution: Fixed Assignee: Maxim Gekk Fix Version/s: 2.4.0 > CSV schema validation -

[jira] [Resolved] (SPARK-24369) A bug when having multiple distinct aggregations

2018-06-03 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-24369. - Resolution: Fixed Assignee: Wenchen Fan (was: Takeshi Yamamuro) Fix Version/s: 2.4.0

[jira] [Commented] (SPARK-24437) Memory leak in UnsafeHashedRelation

2018-06-03 Thread gagan taneja (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499733#comment-16499733 ] gagan taneja commented on SPARK-24437: -- I have already set the values  of

[jira] [Commented] (SPARK-20202) Remove references to org.spark-project.hive

2018-06-03 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499707#comment-16499707 ] Saisai Shao commented on SPARK-20202: - What is our plan to to fix this issue, are we going to use

[jira] [Assigned] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-24455: Assignee: xueyu > fix typo in TaskSchedulerImpl's comments >

[jira] [Resolved] (SPARK-24455) fix typo in TaskSchedulerImpl's comments

2018-06-03 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24455. -- Resolution: Fixed Fix Version/s: 2.3.2 2.4.0 Issue resolved by pull

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-03 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499612#comment-16499612 ] Shivaram Venkataraman commented on SPARK-24359: --- I think where the code sits matters if we

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

2018-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499535#comment-16499535 ] Ted Yu commented on SPARK-18057: I have created a PR, shown above. Kafka 2.0.0 is used since that would

[jira] [Assigned] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

2018-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18057: Assignee: Apache Spark > Update structured streaming kafka from 0.10.0.1 to 1.1.0 >

[jira] [Commented] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

2018-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499534#comment-16499534 ] Apache Spark commented on SPARK-18057: -- User 'tedyu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18057) Update structured streaming kafka from 0.10.0.1 to 1.1.0

2018-06-03 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18057: Assignee: (was: Apache Spark) > Update structured streaming kafka from 0.10.0.1 to

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2018-06-03 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499528#comment-16499528 ] Felix Cheung commented on SPARK-23206: -- [~irashid] sorry I thought I had replied - on our end,

[jira] [Commented] (SPARK-23904) Big execution plan cause OOM

2018-06-03 Thread Ruben Berenguel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499476#comment-16499476 ] Ruben Berenguel commented on SPARK-23904: - Yes [~igreenfi] I'm using that setting for

[jira] [Comment Edited] (SPARK-23904) Big execution plan cause OOM

2018-06-03 Thread Izek Greenfield (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499315#comment-16499315 ] Izek Greenfield edited comment on SPARK-23904 at 6/3/18 6:11 AM: -