[jira] [Updated] (SPARK-2628) Mesos backend throwing unable to find LoginModule

2014-07-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2628: --- Assignee: Tim Chen Mesos backend throwing unable to find LoginModule

[jira] [Commented] (SPARK-2282) PySpark crashes if too many tasks complete quickly

2014-07-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071039#comment-14071039 ] Patrick Wendell commented on SPARK-2282: [~carlilek] I'd actually recommend just

[jira] [Commented] (SPARK-2282) PySpark crashes if too many tasks complete quickly

2014-07-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071197#comment-14071197 ] Patrick Wendell commented on SPARK-2282: Ah my b. I was confused. PySpark

[jira] [Resolved] (SPARK-2549) Functions defined inside of other functions trigger failures

2014-07-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2549. Resolution: Fixed Issue resolved by pull request 1510

[jira] [Updated] (SPARK-2316) StorageStatusListener should avoid O(blocks) operations

2014-07-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2316: --- Target Version/s: 1.1.0 (was: 1.0.2) StorageStatusListener should avoid O(blocks)

[jira] [Updated] (SPARK-2316) StorageStatusListener should avoid O(blocks) operations

2014-07-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2316: --- Priority: Critical (was: Major) StorageStatusListener should avoid O(blocks) operations

[jira] [Updated] (SPARK-2648) Randomize order of executors when fetching shuffle blocks

2014-07-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2648: --- Summary: Randomize order of executors when fetching shuffle blocks (was: through shuffling

[jira] [Updated] (SPARK-2310) Support arbitrary options on the command line with spark-submit

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2310: --- Assignee: Sandy Ryza Support arbitrary options on the command line with spark-submit

[jira] [Resolved] (SPARK-2310) Support arbitrary options on the command line with spark-submit

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2310. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1253

[jira] [Created] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

2014-07-24 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2664: -- Summary: Deal with `--conf` options in spark-submit that relate to flags Key: SPARK-2664 URL: https://issues.apache.org/jira/browse/SPARK-2664 Project: Spark

[jira] [Updated] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2664: --- Description: If someone sets a spark conf that relates to an existing flag `--master`, we

[jira] [Updated] (SPARK-2619) Configurable file-mode for spark/bin folder in the .deb package.

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2619: --- Assignee: Christian Tzolov Configurable file-mode for spark/bin folder in the .deb package.

[jira] [Resolved] (SPARK-2619) Configurable file-mode for spark/bin folder in the .deb package.

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2619. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1531

[jira] [Updated] (SPARK-2250) show stage RDDs in UI

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2250: --- Assignee: Neville Li show stage RDDs in UI - Key:

[jira] [Resolved] (SPARK-2250) show stage RDDs in UI

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2250. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1188

[jira] [Updated] (SPARK-2298) Show stage attempt in UI

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2298: --- Priority: Critical (was: Major) Show stage attempt in UI

[jira] [Commented] (SPARK-2681) With low probability, the Spark inexplicable hang

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074031#comment-14074031 ] Patrick Wendell commented on SPARK-2681: Can you do a jstack of the executor when

[jira] [Commented] (SPARK-2618) use config spark.scheduler.priority for specifying TaskSet's priority on DAGScheduler

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074045#comment-14074045 ] Patrick Wendell commented on SPARK-2618: We shouldn't should expose these types of

[jira] [Updated] (SPARK-2670) FetchFailedException should be thrown when local fetch has failed

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2670: --- Priority: Critical (was: Major) FetchFailedException should be thrown when local fetch has

[jira] [Updated] (SPARK-2670) FetchFailedException should be thrown when local fetch has failed

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2670: --- Component/s: Spark Core FetchFailedException should be thrown when local fetch has failed

[jira] [Updated] (SPARK-2670) FetchFailedException should be thrown when local fetch has failed

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2670: --- Target Version/s: 1.1.0 FetchFailedException should be thrown when local fetch has failed

[jira] [Commented] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

2014-07-24 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074108#comment-14074108 ] Patrick Wendell commented on SPARK-2664: Hey Sandy, The reason why we originally

[jira] [Updated] (SPARK-1097) ConcurrentModificationException

2014-07-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1097: --- Fix Version/s: 1.0.2 ConcurrentModificationException ---

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

2014-07-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075216#comment-14075216 ] Patrick Wendell commented on SPARK-1097: A follow up to this fix is in Spark

[jira] [Updated] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2677: --- Affects Version/s: 0.9.2 BasicBlockFetchIterator#next can wait forever

[jira] [Commented] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075672#comment-14075672 ] Patrick Wendell commented on SPARK-2677: Just as an FYI - this has been observed

[jira] [Updated] (SPARK-2677) BasicBlockFetchIterator#next can wait forever

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2677: --- Target Version/s: 1.1.0, 1.0.3 Fix Version/s: (was: 1.0.3)

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075721#comment-14075721 ] Patrick Wendell commented on SPARK-2707: What are the features we want to use here

[jira] [Commented] (SPARK-2705) Wrong stage description in Web UI

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075722#comment-14075722 ] Patrick Wendell commented on SPARK-2705: Fixed via:

[jira] [Updated] (SPARK-2705) Wrong stage description in Web UI

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2705: --- Assignee: Cheng Lian Wrong stage description in Web UI --

[jira] [Updated] (SPARK-2082) Stratified sampling implementation in PairRDDFunctions

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2082: --- Component/s: MLlib Stratified sampling implementation in PairRDDFunctions

[jira] [Updated] (SPARK-1498) Spark can hang if pyspark tasks fail

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1498: --- Component/s: PySpark Spark can hang if pyspark tasks fail

[jira] [Updated] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2703: --- Component/s: Spark Core Make Tachyon related unit tests execute without deploying a Tachyon

[jira] [Updated] (SPARK-2702) Upgrade Tachyon dependency to 0.5.0

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2702: --- Component/s: Spark Core Upgrade Tachyon dependency to 0.5.0

[jira] [Updated] (SPARK-2673) Improve Spark so that we can attach Debugger to Executors easily

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2673: --- Component/s: Spark Core Improve Spark so that we can attach Debugger to Executors easily

[jira] [Resolved] (SPARK-2410) Thrift/JDBC Server

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2410. Resolution: Fixed Issue resolved by pull request 1600

[jira] [Comment Edited] (SPARK-2420) Change Spark build to minimize library conflicts

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075758#comment-14075758 ] Patrick Wendell edited comment on SPARK-2420 at 7/27/14 9:14 PM:

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075758#comment-14075758 ] Patrick Wendell commented on SPARK-2420: I put some thought into this as well. One

[jira] [Created] (SPARK-2709) Add a tool for certifying Spark API compatiblity

2014-07-27 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2709: -- Summary: Add a tool for certifying Spark API compatiblity Key: SPARK-2709 URL: https://issues.apache.org/jira/browse/SPARK-2709 Project: Spark Issue

[jira] [Commented] (SPARK-2420) Change Spark build to minimize library conflicts

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075764#comment-14075764 ] Patrick Wendell commented on SPARK-2420: Yeah, I think users having to add guava

[jira] [Commented] (SPARK-2410) Thrift/JDBC Server

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075833#comment-14075833 ] Patrick Wendell commented on SPARK-2410: {code} [info] - test query execution

[jira] [Reopened] (SPARK-2410) Thrift/JDBC Server

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2410: Re opening this again due to test issues. Thrift/JDBC Server --

[jira] [Updated] (SPARK-2651) Add maven scalastyle plugin

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2651: --- Assignee: Rahul Singhal Add maven scalastyle plugin ---

[jira] [Updated] (SPARK-2484) Build should not run hive compatibility tests by default.

2014-07-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2484: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-2487 Build should not run

[jira] [Updated] (SPARK-2717) BasicBlockFetchIterator#next should log when it gets stuck

2014-07-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2717: --- Component/s: Spark Core BasicBlockFetchIterator#next should log when it gets stuck

[jira] [Created] (SPARK-2717) BasicBlockFetchIterator#next should log when it gets stuck

2014-07-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2717: -- Summary: BasicBlockFetchIterator#next should log when it gets stuck Key: SPARK-2717 URL: https://issues.apache.org/jira/browse/SPARK-2717 Project: Spark

[jira] [Commented] (SPARK-2723) Block Manager should catch exceptions in putValues

2014-07-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077419#comment-14077419 ] Patrick Wendell commented on SPARK-2723: I think blacklisting directories is a

[jira] [Resolved] (SPARK-2260) Spark submit standalone-cluster mode is broken

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2260. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1538

[jira] [Updated] (SPARK-2543) Allow user to set maximum Kryo buffer size

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2543: --- Summary: Allow user to set maximum Kryo buffer size (was: Resizable serialization buffers

[jira] [Resolved] (SPARK-2543) Allow user to set maximum Kryo buffer size

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2543. Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: 1.1.0 Fixed via

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080179#comment-14080179 ] Patrick Wendell commented on SPARK-2447: This is not entirely a duplicate, but

[jira] [Resolved] (SPARK-2741) Publish version of spark assembly which does not contain Hive

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2741. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1667

[jira] [Updated] (SPARK-2741) Publish version of spark assembly which does not contain Hive

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2741: --- Assignee: Brock Noland (was: Patrick Wendell) Publish version of spark assembly which does

[jira] [Resolved] (SPARK-2340) Resolve paths properly for event logging / history server

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2340. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Andrew Or Fixed by

[jira] [Updated] (SPARK-2743) Parquet has issues with capital letters and case insensitivity

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2743: --- Component/s: SQL Parquet has issues with capital letters and case insensitivity

[jira] [Resolved] (SPARK-2497) @DeveloperApi tag does not suppress MIMA warnings

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2497. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1463

[jira] [Commented] (SPARK-2546) Configuration object thread safety issue

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080531#comment-14080531 ] Patrick Wendell commented on SPARK-2546: Ideally we should merge either this or

[jira] [Updated] (SPARK-2045) Sort-based shuffle implementation

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2045: --- Fix Version/s: 1.1.0 Sort-based shuffle implementation -

[jira] [Updated] (SPARK-2546) Configuration object thread safety issue

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2546: --- Priority: Critical (was: Major) Configuration object thread safety issue

[jira] [Resolved] (SPARK-2045) Sort-based shuffle implementation

2014-07-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2045. Resolution: Fixed This was fixed by matei in this pull request:

[jira] [Updated] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2022: --- Target Version/s: 1.1.0 Spark 1.0.0 is failing if mesos.coarse set to true

[jira] [Commented] (SPARK-2712) Add a small note that mvn package must happen before test

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080579#comment-14080579 ] Patrick Wendell commented on SPARK-2712: I'm a bit confused about the doc request

[jira] [Updated] (SPARK-2712) Add a small note that mvn package must happen before test

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2712: --- Assignee: Stephen Boesch Add a small note that mvn package must happen before test

[jira] [Resolved] (SPARK-2664) Deal with `--conf` options in spark-submit that relate to flags

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2664. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1665

[jira] [Updated] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2749: --- Assignee: Sean Owen Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing

[jira] [Resolved] (SPARK-2749) Spark SQL Java tests aren't compiling in Jenkins' Maven builds; missing junit:junit dep

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2749. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1690

[jira] [Resolved] (SPARK-2646) log4j initialization not quite compatible with log4j 2.x

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2646. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1547

[jira] [Resolved] (SPARK-2766) ScalaReflectionSuite throw an llegalArgumentException in JDK 6

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2766. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1683

[jira] [Resolved] (SPARK-2702) Upgrade Tachyon dependency to 0.5.0

2014-07-31 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2702. Resolution: Fixed Issue resolved by pull request 1651

[jira] [Updated] (SPARK-2738) Remove redundant imports in BlockManagerSuite

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2738: --- Assignee: Sandy Ryza Remove redundant imports in BlockManagerSuite

[jira] [Resolved] (SPARK-2738) Remove redundant imports in BlockManagerSuite

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2738. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1642

[jira] [Resolved] (SPARK-2648) Randomize order of executors when fetching shuffle blocks

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2648. Resolution: Not a Problem It turns out we already randomized these, just in a different

[jira] [Resolved] (SPARK-2099) Report TaskMetrics for running tasks

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2099. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1056

[jira] [Resolved] (SPARK-2735) Remove deprecation in jekyll for pygment in _config.yml

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2735. Resolution: Won't Fix Since this will break compatibility for Jekyll 1.x, I'm proposing we

[jira] [Updated] (SPARK-2420) Dependency changes for compatibility with Hive

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2420: --- Summary: Dependency changes for compatibility with Hive (was: Change Spark build to

[jira] [Resolved] (SPARK-2800) Exclude scalastyle-output.xml Apache RAT checks

2014-08-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2800. Resolution: Fixed Issue resolved by pull request 1729

[jira] [Updated] (SPARK-2454) Separate driver spark home from executor spark home

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2454: --- Assignee: Andrew Or Separate driver spark home from executor spark home

[jira] [Resolved] (SPARK-2675) LiveListenerBus should set higher capacity for its event queue

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2675. Resolution: Not a Problem LiveListenerBus should set higher capacity for its event queue

[jira] [Commented] (SPARK-1812) Support cross-building with Scala 2.11

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083699#comment-14083699 ] Patrick Wendell commented on SPARK-1812: [~avati] can you create sub-tasks for the

[jira] [Updated] (SPARK-2804) Remove scalalogging dependency in Spark SQL

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2804: --- Priority: Blocker (was: Major) Remove scalalogging dependency in Spark SQL

[jira] [Resolved] (SPARK-1470) Use the scala-logging wrapper instead of the directly sfl4j api

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1470. Resolution: Won't Fix Closed in favor of SPARK-2804 Use the scala-logging wrapper

[jira] [Created] (SPARK-2804) Remove scalalogging dependency in Spark SQL

2014-08-02 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2804: -- Summary: Remove scalalogging dependency in Spark SQL Key: SPARK-2804 URL: https://issues.apache.org/jira/browse/SPARK-2804 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1842) update scala-logging-slf4j to version 2.1.2

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1842. Resolution: Won't Fix Closed in favor of SPARK-2804 update scala-logging-slf4j to

[jira] [Updated] (SPARK-2602) sbt/sbt test steals window focus on OS X

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2602: --- Assignee: Sean Owen sbt/sbt test steals window focus on OS X

[jira] [Resolved] (SPARK-2602) sbt/sbt test steals window focus on OS X

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2602. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1747

[jira] [Commented] (SPARK-2414) Remove jquery

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083867#comment-14083867 ] Patrick Wendell commented on SPARK-2414: I've merged Sean's PR to address the

[jira] [Resolved] (SPARK-2742) The variable inputFormatInfo and inputFormatMap never used

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2742. Resolution: Fixed The variable inputFormatInfo and inputFormatMap never used

[jira] [Resolved] (SPARK-2573) This file make-distribution.sh has an error, please fix it

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2573. Resolution: Fixed This file make-distribution.sh has an error, please fix it

[jira] [Resolved] (SPARK-2382) build error:

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2382. Resolution: Not a Problem Closing as per [~srowen] build error: -

[jira] [Resolved] (SPARK-2728) Integer overflow in partition index calculation RangePartitioner

2014-08-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2728. Resolution: Not a Problem Closing as per [~srowen] Integer overflow in partition index

[jira] [Resolved] (SPARK-2712) Add a small note that mvn package must happen before test

2014-08-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2712. Resolution: Fixed Issue resolved by pull request 1615

[jira] [Updated] (SPARK-2246) Add user-data option to EC2 scripts

2014-08-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2246: --- Assignee: Allan Douglas R. de Oliveira Add user-data option to EC2 scripts

[jira] [Updated] (SPARK-2810) update scala-maven-plugin to version 3.2.0

2014-08-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2810: --- Assignee: Anand Avati update scala-maven-plugin to version 3.2.0

[jira] [Resolved] (SPARK-2810) update scala-maven-plugin to version 3.2.0

2014-08-03 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2810. Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: 1.1.0 Fixed by:

[jira] [Updated] (SPARK-2803) add Kafka stream feature for fetch messages from specified starting offset position

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2803: --- Labels: (was: patch) add Kafka stream feature for fetch messages from specified starting

[jira] [Updated] (SPARK-2803) add Kafka stream feature for fetch messages from specified starting offset position

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2803: --- Component/s: (was: Input/Output) Streaming add Kafka stream feature

[jira] [Commented] (SPARK-2016) rdd in-memory storage UI becomes unresponsive when the number of RDD partitions is large

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084399#comment-14084399 ] Patrick Wendell commented on SPARK-2016: I think a major part of this was on the

[jira] [Updated] (SPARK-2815) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2815: --- Priority: Major (was: Blocker) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

[jira] [Commented] (SPARK-2815) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084407#comment-14084407 ] Patrick Wendell commented on SPARK-2815: This may just be a Won't Fix. I thin it's

[jira] [Comment Edited] (SPARK-2815) Compilation failed upon the hadoop version 2.0.0-cdh4.5.0

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084407#comment-14084407 ] Patrick Wendell edited comment on SPARK-2815 at 8/4/14 7:50 AM:

<    4   5   6   7   8   9   10   11   12   13   >