[jira] [Updated] (SPARK-3349) Incorrect partitioning after LIMIT operator

2014-09-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3349: --- Description: Reproduced by the following example: {code} import

[jira] [Updated] (SPARK-3349) Incorrect partitioning after LIMIT operator

2014-09-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3349: --- Assignee: Eric Liang Incorrect partitioning after LIMIT operator

[jira] [Resolved] (SPARK-3361) Expand PEP 8 checks to include EC2 script and Python examples

2014-09-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3361. Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.2.0 Expand PEP 8

[jira] [Resolved] (SPARK-3409) Avoid pulling in Exchange operator itself in Exchange's closures

2014-09-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3409. Resolution: Fixed Fix Version/s: 1.2.0 Avoid pulling in Exchange operator itself in

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124458#comment-14124458 ] Matthew Farrellee commented on SPARK-1701: -- slice vs partition has also come up

[jira] [Created] (SPARK-3425) OpenJDK - when run with jvm 1.8, should not set MaxPermSize

2014-09-06 Thread Matthew Farrellee (JIRA)
Matthew Farrellee created SPARK-3425: Summary: OpenJDK - when run with jvm 1.8, should not set MaxPermSize Key: SPARK-3425 URL: https://issues.apache.org/jira/browse/SPARK-3425 Project: Spark

[jira] [Commented] (SPARK-3425) OpenJDK - when run with jvm 1.8, should not set MaxPermSize

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124467#comment-14124467 ] Matthew Farrellee commented on SPARK-3425: -- this is still an issue for openjdk

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124469#comment-14124469 ] Apache Spark commented on SPARK-1701: - User 'mattf' has created a pull request for

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124510#comment-14124510 ] Matthew Farrellee commented on SPARK-1701: -- ok, and one more

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124516#comment-14124516 ] Apache Spark commented on SPARK-1701: - User 'mattf' has created a pull request for

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124517#comment-14124517 ] Apache Spark commented on SPARK-1701: - User 'mattf' has created a pull request for

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124515#comment-14124515 ] Apache Spark commented on SPARK-1701: - User 'mattf' has created a pull request for

[jira] [Commented] (SPARK-3425) OpenJDK - when run with jvm 1.8, should not set MaxPermSize

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124514#comment-14124514 ] Apache Spark commented on SPARK-3425: - User 'mattf' has created a pull request for

[jira] [Updated] (SPARK-3426) Sort-based shuffle compression behavior is inconsistent

2014-09-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3426: - Description: We have the following configs: {code} spark.shuffle.compress spark.shuffle.spill.compress

[jira] [Updated] (SPARK-3426) Sort-based shuffle compression behavior is inconsistent

2014-09-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3426: - Target Version/s: 1.1.1, 1.2.0 (was: 1.2.0) Sort-based shuffle compression behavior is inconsistent

[jira] [Created] (SPARK-3426) Sort-based shuffle compression behavior is inconsistent

2014-09-06 Thread Andrew Or (JIRA)
Andrew Or created SPARK-3426: Summary: Sort-based shuffle compression behavior is inconsistent Key: SPARK-3426 URL: https://issues.apache.org/jira/browse/SPARK-3426 Project: Spark Issue Type:

[jira] [Issue Comment Deleted] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee updated SPARK-1701: - Comment: was deleted (was: ok, i also created 2 other PRs

[jira] [Issue Comment Deleted] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee updated SPARK-1701: - Comment: was deleted (was: ok, and one more https://github.com/apache/spark/pull/2304 to

[jira] [Commented] (SPARK-1701) Inconsistent naming: slice or partition

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124590#comment-14124590 ] Apache Spark commented on SPARK-1701: - User 'mattf' has created a pull request for

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124645#comment-14124645 ] Apache Spark commented on SPARK-1981: - User 'cfregly' has created a pull request for

[jira] [Commented] (SPARK-2419) Misc updates to streaming programming guide

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124664#comment-14124664 ] Apache Spark commented on SPARK-2419: - User 'tdas' has created a pull request for this

[jira] [Resolved] (SPARK-3406) Python persist API does not have a default storage level

2014-09-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3406. --- Resolution: Fixed Fix Version/s: 1.2.0 Fixed by Holden in

[jira] [Resolved] (SPARK-3397) Bump pom.xml version number of master branch to 1.2.0-SNAPSHOT

2014-09-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3397. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2268

[jira] [Resolved] (SPARK-3301) The spark version in the welcome message of pyspark is not correct

2014-09-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3301. --- Resolution: Fixed Fix Version/s: 1.2.0 The spark version in the welcome message of pyspark is

[jira] [Resolved] (SPARK-3273) We should read the version information from the same place.

2014-09-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3273. --- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2175

[jira] [Commented] (SPARK-3321) Defining a class within python main script

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124704#comment-14124704 ] Matthew Farrellee commented on SPARK-3321: -- this has come up a few times. it's

[jira] [Commented] (SPARK-3401) Wrong usage of tee command in python/run-tests

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124705#comment-14124705 ] Matthew Farrellee commented on SPARK-3401: -- nice catch Wrong usage of tee

[jira] [Updated] (SPARK-3401) Wrong usage of tee command in python/run-tests

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee updated SPARK-3401: - Fix Version/s: 1.1.1 Wrong usage of tee command in python/run-tests

[jira] [Resolved] (SPARK-3401) Wrong usage of tee command in python/run-tests

2014-09-06 Thread Matthew Farrellee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthew Farrellee resolved SPARK-3401. -- Resolution: Fixed Wrong usage of tee command in python/run-tests

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

2014-09-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2769: --- Affects Version/s: (was: 1.0.0) 1.1.0 Ganglia Support Broken /

[jira] [Created] (SPARK-3427) Standalone version of static PageRank

2014-09-06 Thread Ankur Dave (JIRA)
Ankur Dave created SPARK-3427: - Summary: Standalone version of static PageRank Key: SPARK-3427 URL: https://issues.apache.org/jira/browse/SPARK-3427 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-3427) Avoid unnecessary active vertex tracking in static PageRank

2014-09-06 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Summary: Avoid unnecessary active vertex tracking in static PageRank (was: Standalone version of

[jira] [Updated] (SPARK-3427) Avoid active vertex tracking in static PageRank

2014-09-06 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Description: GraphX's current implementation of static (fixed iteration count) PageRank uses the

[jira] [Updated] (SPARK-3427) Avoid active vertex tracking in static PageRank

2014-09-06 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-3427: -- Summary: Avoid active vertex tracking in static PageRank (was: Avoid unnecessary active vertex

[jira] [Commented] (SPARK-3427) Avoid active vertex tracking in static PageRank

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124732#comment-14124732 ] Apache Spark commented on SPARK-3427: - User 'ankurdave' has created a pull request for

[jira] [Resolved] (SPARK-3353) Stage id monotonicity (parent stage should have lower stage id)

2014-09-06 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-3353. -- Resolution: Fixed Fix Version/s: 1.2.0 Stage id monotonicity (parent stage should have

[jira] [Commented] (SPARK-3178) setting SPARK_WORKER_MEMORY to a value without a label (m or g) sets the worker memory limit to zero

2014-09-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124744#comment-14124744 ] Apache Spark commented on SPARK-3178: - User 'bbejeck' has created a pull request for

[jira] [Created] (SPARK-3428) TaskMetrics for running tasks is missing GC time metrics

2014-09-06 Thread Andrew Ash (JIRA)
Andrew Ash created SPARK-3428: - Summary: TaskMetrics for running tasks is missing GC time metrics Key: SPARK-3428 URL: https://issues.apache.org/jira/browse/SPARK-3428 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2099) Report TaskMetrics for running tasks

2014-09-06 Thread Andrew Ash (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14124777#comment-14124777 ] Andrew Ash commented on SPARK-2099: --- Added a followon ticket for GC times as SPARK-3428