[jira] [Updated] (SPARK-944) Give example of writing to HBase from Spark Streaming

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-944: -- Reporter: Patrick Wendell (was: Patrick Cogan) Give example of writing to HBase from Spark

[jira] [Updated] (SPARK-1172) Improve naming of the BlockManager classes

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1172: --- Reporter: Patrick Wendell (was: Patrick Cogan) Improve naming of the BlockManager classes

[jira] [Updated] (SPARK-1239) Don't fetch all map outputs at each reducer during shuffles

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1239: --- Reporter: Patrick Wendell (was: Patrick Cogan) Don't fetch all map outputs at each reducer

[jira] [Updated] (SPARK-1111) URL Validation Throws Error for HDFS URL's

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-: --- Reporter: Patrick Wendell (was: Patrick Cogan) URL Validation Throws Error for HDFS URL's

[jira] [Updated] (SPARK-1269) Add Ability to Make Distribution with Tachyon

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1269: --- Reporter: Patrick Wendell (was: Patrick Cogan) Add Ability to Make Distribution with

[jira] [Updated] (SPARK-738) Spark should detect and squash nonserializable exceptions

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-738: -- Reporter: Patrick Wendell (was: Patrick Cogan) Spark should detect and squash nonserializable

[jira] [Updated] (SPARK-1322) Fix ordering of top() in Python

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1322: --- Reporter: Patrick Wendell (was: Patrick Cogan) Fix ordering of top() in Python

[jira] [Updated] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1346: --- Reporter: Patrick Wendell (was: Patrick Cogan) Backport SPARK-1210 into 0.9 branch

[jira] [Updated] (SPARK-895) Add a Ganglia sink to Spark Metrics

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-895: -- Reporter: Patrick Wendell (was: Patrick Cogan) Add a Ganglia sink to Spark Metrics

[jira] [Updated] (SPARK-1205) Clean up callSite/origin/generator

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1205: --- Reporter: Patrick Wendell (was: Patrick Cogan) Clean up callSite/origin/generator

[jira] [Updated] (SPARK-1096) Add Scalastyle Plug-in For Spaces after Comments

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1096: --- Reporter: Patrick Wendell (was: Patrick Cogan) Add Scalastyle Plug-in For Spaces after

[jira] [Updated] (SPARK-1205) Clean up callSite/origin/generator

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1205: --- Assignee: Patrick Wendell (was: Patrick Cogan) Clean up callSite/origin/generator

[jira] [Updated] (SPARK-1002) Remove binary artifacts from build

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1002: --- Reporter: Patrick Wendell (was: Patrick Cogan) Remove binary artifacts from build

[jira] [Updated] (SPARK-1244) Log an exception if map output status message exceeds frame size

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1244: --- Reporter: Patrick Wendell (was: Patrick Cogan) Log an exception if map output status

[jira] [Resolved] (SPARK-1323) Job hangs with java.io.UTFDataFormatException when reading strings 65536 bytes.

2014-03-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1323. Resolution: Fixed Job hangs with java.io.UTFDataFormatException when reading strings

[jira] [Resolved] (SPARK-833) Web UI's Application Detail UI link may use internal EC2 hostname

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-833. --- Resolution: Fixed Web UI's Application Detail UI link may use internal EC2 hostname

[jira] [Updated] (SPARK-1355) Switch website to the Apache CMS

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1355: --- Issue Type: Improvement (was: Bug) Switch website to the Apache CMS

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13954867#comment-13954867 ] Patrick Wendell commented on SPARK-1355: Another thing is that we use Jekyll to

[jira] [Updated] (SPARK-1081) Annotate Semi-private/Experimental API's [Core]

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1081: --- Summary: Annotate Semi-private/Experimental API's [Core] (was: Annotate

[jira] [Updated] (SPARK-1081) Annotate Semi-private/Experimental API's [Core]

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1081: --- Component/s: (was: Build) Spark Core Annotate

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-922: -- Priority: Blocker (was: Major) Update Spark AMI to Python 2.7 --

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2014-03-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-922: -- Fix Version/s: 1.0.0 Update Spark AMI to Python 2.7 --

[jira] [Updated] (SPARK-1154) Spark fills up disk with app-* folders

2014-04-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1154: --- Priority: Critical (was: Major) Spark fills up disk with app-* folders

[jira] [Updated] (SPARK-1154) Spark fills up disk with app-* folders

2014-04-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1154: --- Fix Version/s: 1.0.0 Spark fills up disk with app-* folders

[jira] [Updated] (SPARK-1118) Executor state shows as KILLED even the application is finished normally

2014-04-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1118: --- Assignee: Kan Zhang Executor state shows as KILLED even the application is finished

[jira] [Updated] (SPARK-1118) Executor state shows as KILLED even the application is finished normally

2014-04-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1118: --- Priority: Critical (was: Major) Executor state shows as KILLED even the application is

[jira] [Resolved] (SPARK-1212) Support sparse data in MLlib

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1212. Resolution: Fixed Support sparse data in MLlib

[jira] [Resolved] (SPARK-1398) Remove FindBugs jsr305 dependency

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1398. Resolution: Fixed Remove FindBugs jsr305 dependency -

[jira] [Reopened] (SPARK-1398) Remove FindBugs jsr305 dependency

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-1398: Remove FindBugs jsr305 dependency - Key:

[jira] [Commented] (SPARK-1411) When using spark.ui.retainedStages=n only the first n stages are kept, not the most recent.

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959494#comment-13959494 ] Patrick Wendell commented on SPARK-1411: Ah, got it SPARK-1337 When using

[jira] [Commented] (SPARK-1411) When using spark.ui.retainedStages=n only the first n stages are kept, not the most recent.

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959490#comment-13959490 ] Patrick Wendell commented on SPARK-1411: [~dgshep] is this a duplicate? What is

[jira] [Commented] (SPARK-1337) Application web UI garbage collects newest stages instead old ones

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13959547#comment-13959547 ] Patrick Wendell commented on SPARK-1337: https://github.com/apache/spark/pull/320

[jira] [Updated] (SPARK-1337) Application web UI garbage collects newest stages instead old ones

2014-04-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1337: --- Fix Version/s: 0.9.2 1.0.0 Application web UI garbage collects newest

[jira] [Resolved] (SPARK-1419) Apache parent POM to version 14

2014-04-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1419. Resolution: Fixed Fix Version/s: 1.0.0 Apache parent POM to version 14

[jira] [Updated] (SPARK-922) Update Spark AMI to Python 2.7

2014-04-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-922: -- Issue Type: Task (was: Improvement) Update Spark AMI to Python 2.7

[jira] [Resolved] (SPARK-1305) Support persisting RDD's directly to Tachyon

2014-04-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1305. Resolution: Fixed Support persisting RDD's directly to Tachyon

[jira] [Updated] (SPARK-1403) java.lang.ClassNotFoundException - spark on mesos

2014-04-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1403: --- Priority: Critical (was: Major) java.lang.ClassNotFoundException - spark on mesos

[jira] [Updated] (SPARK-1403) java.lang.ClassNotFoundException - spark on mesos

2014-04-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1403: --- Priority: Blocker (was: Critical) java.lang.ClassNotFoundException - spark on mesos

[jira] [Updated] (SPARK-1387) Update build plugins, avoid plugin version warning, centralize versions

2014-04-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1387: --- Assignee: Sean Owen Update build plugins, avoid plugin version warning, centralize

[jira] [Resolved] (SPARK-1314) sbt assembly builds hive jar

2014-04-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1314. Resolution: Fixed sbt assembly builds hive jar

[jira] [Resolved] (SPARK-1309) sbt assemble-deps no longer works

2014-04-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1309. Resolution: Fixed This is fixed by virtue of SPARK-1314 being merged. sbt assemble-deps

[jira] [Created] (SPARK-1431) Allow merging pull requests that have conflicts

2014-04-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1431: -- Summary: Allow merging pull requests that have conflicts Key: SPARK-1431 URL: https://issues.apache.org/jira/browse/SPARK-1431 Project: Spark Issue

[jira] [Resolved] (SPARK-1431) Allow merging pull requests that have conflicts

2014-04-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1431. Resolution: Fixed Allow merging pull requests that have conflicts

[jira] [Updated] (SPARK-1432) Potential memory leak in stageIdToExecutorSummaries in JobProgressTracker

2014-04-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1432: --- Assignee: Davis Shepherd Potential memory leak in stageIdToExecutorSummaries in

[jira] [Resolved] (SPARK-1432) Potential memory leak in stageIdToExecutorSummaries in JobProgressTracker

2014-04-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1432. Resolution: Fixed Fix Version/s: 0.9.2 1.0.0 Potential memory

[jira] [Updated] (SPARK-1403) Mesos on Spark does not set Thread's context class loader

2014-04-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1403: --- Summary: Mesos on Spark does not set Thread's context class loader (was:

[jira] [Updated] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2014-04-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1403: --- Summary: Spark on Mesos does not set Thread's context class loader (was: Mesos on Spark

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2014-04-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13962032#comment-13962032 ] Patrick Wendell commented on SPARK-1403: The underlying issue here is that we've

[jira] [Commented] (SPARK-1407) EventLogging to HDFS doesn't work properly on yarn

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963310#comment-13963310 ] Patrick Wendell commented on SPARK-1407: Unfortuantely I think SparkHDFSLR might

[jira] [Commented] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963468#comment-13963468 ] Patrick Wendell commented on SPARK-1348: Okay we fixed this for 1.0. The decision

[jira] [Updated] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1348: --- Assignee: Kan Zhang Spark UI's do not bind to localhost interface anymore

[jira] [Resolved] (SPARK-1348) Spark UI's do not bind to localhost interface anymore

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1348. Resolution: Fixed Spark UI's do not bind to localhost interface anymore

[jira] [Updated] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1397: --- Fix Version/s: 1.0.0 SparkListeners should be notified when stages are cancelled

[jira] [Resolved] (SPARK-1445) compute-classpath.sh should not print error if lib_managed not found

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1445. Resolution: Fixed compute-classpath.sh should not print error if lib_managed not found

[jira] [Updated] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1397: --- Priority: Critical (was: Major) SparkListeners should be notified when stages are

[jira] [Resolved] (SPARK-1397) SparkListeners should be notified when stages are cancelled

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1397. Resolution: Fixed SparkListeners should be notified when stages are cancelled

[jira] [Resolved] (SPARK-939) Allow user jars to take precedence over Spark jars, if desired

2014-04-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-939. --- Resolution: Fixed Allow user jars to take precedence over Spark jars, if desired

[jira] [Resolved] (SPARK-1390) Refactor RDD backed matrices

2014-04-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1390. Resolution: Fixed Refactor RDD backed matrices

[jira] [Resolved] (SPARK-1081) Annotate developer and experimental API's [Core]

2014-04-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1081. Resolution: Fixed Annotate developer and experimental API's [Core]

[jira] [Resolved] (SPARK-1357) [MLLIB] Annotate developer and experimental API's

2014-04-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1357. Resolution: Fixed [MLLIB] Annotate developer and experimental API's

[jira] [Created] (SPARK-1455) Determine which test suites to run based on code changes

2014-04-09 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1455: -- Summary: Determine which test suites to run based on code changes Key: SPARK-1455 URL: https://issues.apache.org/jira/browse/SPARK-1455 Project: Spark

[jira] [Created] (SPARK-1456) Clean up use of Ordered/Ordering in OrderedRDDFunctions

2014-04-09 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1456: -- Summary: Clean up use of Ordered/Ordering in OrderedRDDFunctions Key: SPARK-1456 URL: https://issues.apache.org/jira/browse/SPARK-1456 Project: Spark

[jira] [Updated] (SPARK-1464) Update MLLib Examples to Use Breeze

2014-04-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1464: --- Priority: Blocker (was: Major) Update MLLib Examples to Use Breeze

[jira] [Updated] (SPARK-1328) Current implementation of Standard Deviation in MLUtils may cause catastrophic cancellation, and loss precision.

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1328: --- Assignee: Xusen Yin Current implementation of Standard Deviation in MLUtils may cause

[jira] [Resolved] (SPARK-1328) Current implementation of Standard Deviation in MLUtils may cause catastrophic cancellation, and loss precision.

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1328. Resolution: Fixed Current implementation of Standard Deviation in MLUtils may cause

[jira] [Updated] (SPARK-1466) Pyspark doesn't check if gateway process launches correctly

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1466: --- Priority: Blocker (was: Major) Pyspark doesn't check if gateway process launches correctly

[jira] [Updated] (SPARK-1057) Remove Fastutil

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1057: --- Summary: Remove Fastutil (was: Upgrade to fastutil-6.5.x) Remove Fastutil ---

[jira] [Commented] (SPARK-1057) Remove Fastutil

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967413#comment-13967413 ] Patrick Wendell commented on SPARK-1057: I changed the title of the JIRA to

[jira] [Updated] (SPARK-1057) Remove Fastutil

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1057: --- Assignee: Sean Owen (was: Evan Chan) Remove Fastutil ---

[jira] [Updated] (SPARK-1057) Remove Fastutil

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1057: --- Priority: Major (was: Minor) Remove Fastutil --- Key:

[jira] [Resolved] (SPARK-1057) Remove Fastutil

2014-04-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1057. Resolution: Fixed Remove Fastutil --- Key: SPARK-1057

[jira] [Updated] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1480: --- Summary: Choose classloader consistently inside of Spark codebase (was: Chose classloader

[jira] [Resolved] (SPARK-1435) Don't assume context class loader is set when creating classes via reflection

2014-04-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1435. Resolution: Duplicate Don't assume context class loader is set when creating classes via

[jira] [Resolved] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2014-04-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1403. Resolution: Fixed Spark on Mesos does not set Thread's context class loader

[jira] [Updated] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

2014-04-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1403: --- Fix Version/s: 1.0.0 Spark on Mesos does not set Thread's context class loader

[jira] [Updated] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1480: --- Description: The Spark codebase is not always consistent on which class loader it uses when

[jira] [Updated] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1480: --- Description: The Spark codebase is not always consistent on which class loader it uses when

[jira] [Updated] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1480: --- Fix Version/s: (was: 1.1.0) 1.0.0 Choose classloader consistently

[jira] [Comment Edited] (SPARK-1476) 2GB limit in spark for blocks

2014-04-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967911#comment-13967911 ] Patrick Wendell edited comment on SPARK-1476 at 4/13/14 7:01 PM:

[jira] [Resolved] (SPARK-1480) Choose classloader consistently inside of Spark codebase

2014-04-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1480. Resolution: Fixed Choose classloader consistently inside of Spark codebase

[jira] [Updated] (SPARK-1465) Spark compilation is broken with the latest hadoop-2.4.0 release

2014-04-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1465: --- Fix Version/s: 1.0.0 Spark compilation is broken with the latest hadoop-2.4.0 release

[jira] [Updated] (SPARK-1465) Spark compilation is broken with the latest hadoop-2.4.0 release

2014-04-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1465: --- Priority: Blocker (was: Major) Spark compilation is broken with the latest hadoop-2.4.0

[jira] [Created] (SPARK-1496) SparkContext.jarOfClass should return Option instead of a sequence

2014-04-14 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1496: -- Summary: SparkContext.jarOfClass should return Option instead of a sequence Key: SPARK-1496 URL: https://issues.apache.org/jira/browse/SPARK-1496 Project: Spark

[jira] [Updated] (SPARK-1157) L-BFGS Optimizer

2014-04-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1157: --- Assignee: DB Tsai L-BFGS Optimizer Key: SPARK-1157

[jira] [Resolved] (SPARK-1157) L-BFGS Optimizer

2014-04-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1157. Resolution: Fixed Fix Version/s: 1.0.0 L-BFGS Optimizer

[jira] [Commented] (SPARK-1455) Determine which test suites to run based on code changes

2014-04-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13970366#comment-13970366 ] Patrick Wendell commented on SPARK-1455: This is partially dealt with in

[jira] [Resolved] (SPARK-1430) Support sparse data in Python MLlib

2014-04-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1430. Resolution: Fixed Support sparse data in Python MLlib

[jira] [Resolved] (SPARK-1277) Automatically set the UI persistence directory based on cluster settings

2014-04-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1277. Resolution: Won't Fix Subsumed by other configuration patches. Automatically set the UI

[jira] [Resolved] (SPARK-1497) Spark YARN code isn't checked with Scalastyle and has many style violations

2014-04-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1497. Resolution: Fixed Assignee: Sean Owen Spark YARN code isn't checked with Scalastyle

[jira] [Updated] (SPARK-1514) Standardize process for creating Spark packages

2014-04-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1514: --- Summary: Standardize process for creating Spark packages (was: Standardize way to create

[jira] [Created] (SPARK-1514) Standardize way to create Spark releases

2014-04-16 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1514: -- Summary: Standardize way to create Spark releases Key: SPARK-1514 URL: https://issues.apache.org/jira/browse/SPARK-1514 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1469) Scheduler mode should accept lower-case definitions and have nicer error messages

2014-04-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1469. Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.0.0

[jira] [Created] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2014-04-16 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1517: -- Summary: Publish nightly snapshots of documentation, maven artifacts, and binary builds Key: SPARK-1517 URL: https://issues.apache.org/jira/browse/SPARK-1517

[jira] [Created] (SPARK-1520) Spark assembly fails with Java 6

2014-04-17 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-1520: -- Summary: Spark assembly fails with Java 6 Key: SPARK-1520 URL: https://issues.apache.org/jira/browse/SPARK-1520 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-1520) Spark assembly fails with Java 6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Spark assembly fails with JRE6 for unknown reason

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Summary: Spark assembly fails with JRE6 for unknown reason (was: Spark assembly fails with

[jira] [Updated] (SPARK-1520) Spark assembly fails with Java 6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Description: This is a real doozie - when compiling a Spark assembly with JDK7, the produced

[jira] [Updated] (SPARK-1520) Spark assembly fails with JRE6 for unknown reason

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Component/s: MLlib Spark assembly fails with JRE6 for unknown reason

[jira] [Updated] (SPARK-1520) Spark assembly fails with JRE6 for unknown reason

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Component/s: Spark Core Spark assembly fails with JRE6 for unknown reason

[jira] [Updated] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1520: --- Summary: Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

  1   2   3   4   5   6   7   8   9   10   >