[jira] [Commented] (SPARK-1469) Scheduler mode should accept lower-case definitions and have nicer error messages

[ https://issues.apache.org/jira/browse/SPARK-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966226#comment-13966226 ] Sandeep Singh commented on SPARK-1469: -- https://github.com/apache/spark/pull/388 > S

[jira] [Comment Edited] (SPARK-1471) Worker not recognize Driver state at standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966177#comment-13966177 ] shenhong edited comment on SPARK-1471 at 4/11/14 3:34 AM: -- The re

[jira] [Commented] (SPARK-1471) Worker not recognize Driver state at standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966177#comment-13966177 ] shenhong commented on SPARK-1471: - The reason is when Worker receive DriverStateChanged, i

[jira] [Updated] (SPARK-1471) Worker not recognize Driver state at standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenhong updated SPARK-1471: Description: When I run a spark job in standalone, ./bin/spark-class org.apache.spark.deploy.Client launch

[jira] [Updated] (SPARK-1471) Worker not recognize Driver state at standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shenhong updated SPARK-1471: Description: When I run a spark job in standalone, ./bin/spark-class org.apache.spark.deploy.Client launc

[jira] [Created] (SPARK-1471) Worker not recognize Driver state at standalone mode

shenhong created SPARK-1471: --- Summary: Worker not recognize Driver state at standalone mode Key: SPARK-1471 URL: https://issues.apache.org/jira/browse/SPARK-1471 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-1469) Scheduler mode should accept lower-case definitions and have nicer error messages

[ https://issues.apache.org/jira/browse/SPARK-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1469: Assignee: Sandeep Singh > Scheduler mode should accept lower-case definitions and have nice

[jira] [Created] (SPARK-1470) Use the scala-logging wrapper instead of the directly sfl4j api

witgo created SPARK-1470: Summary: Use the scala-logging wrapper instead of the directly sfl4j api Key: SPARK-1470 URL: https://issues.apache.org/jira/browse/SPARK-1470 Project: Spark Issue Type: Ne

[jira] [Updated] (SPARK-1469) Scheduler mode should accept lower-case definitions and have nicer error messages

[ https://issues.apache.org/jira/browse/SPARK-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1469: --- Labels: starter (was: ) > Scheduler mode should accept lower-case definitions and have nicer

[jira] [Created] (SPARK-1469) Scheduler mode should accept lower-case definitions and have nicer error messages

Patrick Wendell created SPARK-1469: -- Summary: Scheduler mode should accept lower-case definitions and have nicer error messages Key: SPARK-1469 URL: https://issues.apache.org/jira/browse/SPARK-1469 P

[jira] [Updated] (SPARK-1468) The hash method used by partitionBy in Pyspark doesn't deal with None correctly.

[ https://issues.apache.org/jira/browse/SPARK-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Selin updated SPARK-1468: -- Description: In python the default hash method uses the memory address of objects. Since None is an ob

[jira] [Assigned] (SPARK-1460) Set operations on SchemaRDDs are needlessly destructive of schema information.

[ https://issues.apache.org/jira/browse/SPARK-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kan Zhang reassigned SPARK-1460: Assignee: Kan Zhang > Set operations on SchemaRDDs are needlessly destructive of schema information

[jira] [Updated] (SPARK-1468) The hash method used by partitionBy in Pyspark doesn't deal with None correctly.

[ https://issues.apache.org/jira/browse/SPARK-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Selin updated SPARK-1468: -- Description: In python the default hash method uses the memory address of objects. Since None is an obj

[jira] [Created] (SPARK-1468) Pysparks partitionBy methods default hash method causes issues for None keys.

Erik Selin created SPARK-1468: - Summary: Pysparks partitionBy methods default hash method causes issues for None keys. Key: SPARK-1468 URL: https://issues.apache.org/jira/browse/SPARK-1468 Project: Spark

[jira] [Updated] (SPARK-1468) The hash method used by partitionBy in Pyspark doesn't deal with None correctly.

[ https://issues.apache.org/jira/browse/SPARK-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Selin updated SPARK-1468: -- Component/s: PySpark Affects Version/s: 0.9.0 Summary: The hash method used by p

[jira] [Created] (SPARK-1467) Make StorageLevel.apply() factory methods experimental

Matei Zaharia created SPARK-1467: Summary: Make StorageLevel.apply() factory methods experimental Key: SPARK-1467 URL: https://issues.apache.org/jira/browse/SPARK-1467 Project: Spark Issue Ty

[jira] [Reopened] (SPARK-1433) Upgrade Mesos dependency to 0.17.0

[ https://issues.apache.org/jira/browse/SPARK-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1433: I've reverted this due to an incompatiblity with some Hadoop versions. > Upgrade Mesos depende

[jira] [Commented] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

[ https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965866#comment-13965866 ] Kay Ousterhout commented on SPARK-1466: --- https://github.com/apache/spark/pull/383 >

[jira] [Created] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

Kay Ousterhout created SPARK-1466: - Summary: Pyspark doesn't check if gateway process launches correctly Key: SPARK-1466 URL: https://issues.apache.org/jira/browse/SPARK-1466 Project: Spark

[jira] [Commented] (SPARK-1465) Spark compilation is broken with the latest hadoop-2.4.0 release

[ https://issues.apache.org/jira/browse/SPARK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965858#comment-13965858 ] Xuan Gong commented on SPARK-1465: -- I am starting to fix this. > Spark compilation is br

[jira] [Commented] (SPARK-1465) Spark compilation is broken with the latest hadoop-2.4.0 release

[ https://issues.apache.org/jira/browse/SPARK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965857#comment-13965857 ] Xuan Gong commented on SPARK-1465: -- YARN-1824 changes the APIs in Apps, which causes the

[jira] [Created] (SPARK-1465) Spark compilation is broken with the latest hadoop-2.4.0 release

Xuan Gong created SPARK-1465: Summary: Spark compilation is broken with the latest hadoop-2.4.0 release Key: SPARK-1465 URL: https://issues.apache.org/jira/browse/SPARK-1465 Project: Spark Issue

[jira] [Updated] (SPARK-1464) Update MLLib Examples to Use Breeze

[ https://issues.apache.org/jira/browse/SPARK-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1464: --- Priority: Blocker (was: Major) > Update MLLib Examples to Use Breeze > -

[jira] [Created] (SPARK-1464) Update MLLib Examples to Use Breeze

Patrick Wendell created SPARK-1464: -- Summary: Update MLLib Examples to Use Breeze Key: SPARK-1464 URL: https://issues.apache.org/jira/browse/SPARK-1464 Project: Spark Issue Type: Task

[jira] [Updated] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh updated SPARK-1462: - Description: mainly Vector, better to be Vector.dense (was: mainly Vector, better to be Vector.d

[jira] [Assigned] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh reassigned SPARK-1462: Assignee: Sandeep Singh > Examples of ML algorithms are using deprecated APIs > ---

[jira] [Commented] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965762#comment-13965762 ] Sandeep Singh commented on SPARK-1462: -- I'm working on this one > Examples of ML alg

[jira] [Updated] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Singh updated SPARK-1462: - Description: mainly Vector, better to be Vectors.dense (was: mainly Vector, better to be Vector.

[jira] [Resolved] (SPARK-1428) MLlib should convert non-float64 NumPy arrays to float64 instead of complaining

[ https://issues.apache.org/jira/browse/SPARK-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-1428. -- Resolution: Fixed Fix Version/s: 1.0.0 > MLlib should convert non-float64 NumPy arrays t

[jira] [Resolved] (SPARK-1276) Add a Simple History Server for the UI for Yarn / Mesos

[ https://issues.apache.org/jira/browse/SPARK-1276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1276. Resolution: Fixed > Add a Simple History Server for the UI for Yarn / Mesos > -

[jira] [Resolved] (SPARK-1413) Parquet messes up stdout and stdin when used in Spark REPL

[ https://issues.apache.org/jira/browse/SPARK-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1413. Resolution: Fixed Assignee: (was: Michael Armbrust) > Parquet messes up stdout an

[jira] [Created] (SPARK-1463) cleanup unnecessary dependency jars in the spark assembly jars

Jenny MA created SPARK-1463: --- Summary: cleanup unnecessary dependency jars in the spark assembly jars Key: SPARK-1463 URL: https://issues.apache.org/jira/browse/SPARK-1463 Project: Spark Issue Typ

[jira] [Updated] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1462: --- Description: mainly Vector, better to be Vector.dens > Examples of ML algorithms are using deprecated APIs >

[jira] [Updated] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nan Zhu updated SPARK-1462: --- Assignee: (was: Nan Zhu) > Examples of ML algorithms are using deprecated APIs >

[jira] [Commented] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

[ https://issues.apache.org/jira/browse/SPARK-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13965275#comment-13965275 ] Nan Zhu commented on SPARK-1462: mainly Vector, better to be Vector.dense > Examples of M

[jira] [Created] (SPARK-1462) Examples of ML algorithms are using deprecated APIs

Nan Zhu created SPARK-1462: -- Summary: Examples of ML algorithms are using deprecated APIs Key: SPARK-1462 URL: https://issues.apache.org/jira/browse/SPARK-1462 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-1446) Spark examples should not do a System.exit

[ https://issues.apache.org/jira/browse/SPARK-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1446. Resolution: Fixed > Spark examples should not do a System.exit > --