[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

2015-09-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Assignee: Pete Robbins > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause

[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

2015-09-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't

[jira] [Updated] (SPARK-10454) Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures don't cause multiple concurrent attempts for the same map stage

2015-09-04 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-10454: -- Priority: Critical (was: Minor) > Flaky test: o.a.s.scheduler.DAGSchedulerSuite.late fetch failures

[jira] [Updated] (SPARK-10304) Partition discovery does not throw an exception if the dir structure is invalid

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10304: -- Target Version/s: (was: 1.6.0, 1.5.1) > Partition discovery does not throw an exception if

[jira] [Resolved] (SPARK-10311) In cluster mode, AppId and AttemptId should be update when ApplicationMaster is new

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10311. --- Resolution: Fixed Fix Version/s: 1.5.1 1.6.0 > In cluster mode,

[jira] [Updated] (SPARK-10311) In cluster mode, AppId and AttemptId should be update when ApplicationMaster is new

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-10311: -- Assignee: meiyoula > In cluster mode, AppId and AttemptId should be update when

[jira] [Commented] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731556#comment-14731556 ] Tathagata Das commented on SPARK-8630: -- I get your point. I guess it will be good to revert this

[jira] [Assigned] (SPARK-10013) Remove Java assert from Java unit tests

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10013: Assignee: (was: Apache Spark) > Remove Java assert from Java unit tests >

[jira] [Assigned] (SPARK-10013) Remove Java assert from Java unit tests

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10013: Assignee: Apache Spark > Remove Java assert from Java unit tests >

[jira] [Commented] (SPARK-10436) spark-submit overwrites spark.files defaults with the job script filename

2015-09-04 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731593#comment-14731593 ] holdenk commented on SPARK-10436: - I've worked on some of the older versions of the submit scripts and

[jira] [Comment Edited] (SPARK-9235) PYSPARK_DRIVER_PYTHON env variable is not set on the YARN Node manager acting as driver in yarn-cluster mode

2015-09-04 Thread bijaya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731662#comment-14731662 ] bijaya edited comment on SPARK-9235 at 9/5/15 12:41 AM:

[jira] [Commented] (SPARK-9235) PYSPARK_DRIVER_PYTHON env variable is not set on the YARN Node manager acting as driver in yarn-cluster mode

2015-09-04 Thread bijaya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731662#comment-14731662 ] bijaya commented on SPARK-9235: --- SPARK_YARN_USER_ENV="PYSPARK_PYTHON=/srv/software/anaconda/bin/python"

[jira] [Commented] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731671#comment-14731671 ] Tathagata Das commented on SPARK-8630: -- @ all in this thread: Are you having this problem with 1.4.1

[jira] [Comment Edited] (SPARK-8630) Prevent from checkpointing QueueInputDStream

2015-09-04 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731671#comment-14731671 ] Tathagata Das edited comment on SPARK-8630 at 9/5/15 12:50 AM: --- @ all in

[jira] [Assigned] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9963: --- Assignee: (was: Apache Spark) > ML RandomForest cleanup: replace predictNodeIndex with

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14731702#comment-14731702 ] Apache Spark commented on SPARK-9963: - User 'lkhamsurenl' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9963: --- Assignee: Apache Spark > ML RandomForest cleanup: replace predictNodeIndex with predictImpl

[jira] [Commented] (SPARK-4940) Support more evenly distributing cores for Mesos mode

2015-09-04 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730401#comment-14730401 ] Iulian Dragos commented on SPARK-4940: -- [~doctapp] I guess there is no perfect scheduling for every

[jira] [Commented] (SPARK-10434) Parquet compatibility with 1.4 is broken when writing arrays that may contain nulls

2015-09-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730388#comment-14730388 ] Cheng Lian commented on SPARK-10434: Another concern of mine is that, Parquet files written by a

[jira] [Created] (SPARK-10444) Remove duplication in Mesos schedulers

2015-09-04 Thread Iulian Dragos (JIRA)
Iulian Dragos created SPARK-10444: - Summary: Remove duplication in Mesos schedulers Key: SPARK-10444 URL: https://issues.apache.org/jira/browse/SPARK-10444 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-10445) Extend maven version range (enforcer)

2015-09-04 Thread JIRA
Jean-Baptiste Onofré created SPARK-10445: Summary: Extend maven version range (enforcer) Key: SPARK-10445 URL: https://issues.apache.org/jira/browse/SPARK-10445 Project: Spark Issue

[jira] [Assigned] (SPARK-10445) Extend maven version range (enforcer)

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10445: Assignee: Apache Spark > Extend maven version range (enforcer) >

[jira] [Assigned] (SPARK-10445) Extend maven version range (enforcer)

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10445: Assignee: (was: Apache Spark) > Extend maven version range (enforcer) >

[jira] [Commented] (SPARK-10445) Extend maven version range (enforcer)

2015-09-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14730524#comment-14730524 ] Apache Spark commented on SPARK-10445: -- User 'jbonofre' has created a pull request for this issue:

<    1   2