[jira] [Updated] (SPARK-2057) run-example can only be run within spark_home

[ https://issues.apache.org/jira/browse/SPARK-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2057: --- Summary: run-example can only be run within spark_home (was: run-example can only be ran

[jira] [Updated] (SPARK-2057) run-example can only be run within spark_home

[ https://issues.apache.org/jira/browse/SPARK-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2057: --- Assignee: maji2014 run-example can only be run within spark_home

[jira] [Resolved] (SPARK-2067) Spark logo in application UI uses absolute path

[ https://issues.apache.org/jira/browse/SPARK-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2067. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-2067) Spark logo in application UI uses absolute path

[ https://issues.apache.org/jira/browse/SPARK-2067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2067: --- Assignee: Neville Li Spark logo in application UI uses absolute path

[jira] [Commented] (SPARK-1944) Document --verbose in spark-shell -h

[ https://issues.apache.org/jira/browse/SPARK-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025408#comment-14025408 ] Patrick Wendell commented on SPARK-1944: Accidental edit - my bad! Document

[jira] [Updated] (SPARK-1944) Document --verbose in spark-shell -h

[ https://issues.apache.org/jira/browse/SPARK-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1944: --- Target Version/s: 1.0.1, 1.1.0 Fix Version/s: (was: 1.0.1)

[jira] [Updated] (SPARK-2075) Hadoop1 distribution of 1.0.0 does not contain classes expected by the Maven 1.0.0 artifact

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2075: --- Priority: Critical (was: Major) Hadoop1 distribution of 1.0.0 does not contain classes

[jira] [Updated] (SPARK-2075) Hadoop1 distribution of 1.0.0 does not contain classes expected by the Maven 1.0.0 artifact

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2075: --- Fix Version/s: 1.0.1 Hadoop1 distribution of 1.0.0 does not contain classes expected by the

[jira] [Updated] (SPARK-1493) Apache RAT excludes don't work with file path (instead of file name)

[ https://issues.apache.org/jira/browse/SPARK-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1493: --- Fix Version/s: (was: 1.1.0) Apache RAT excludes don't work with file path (instead of

[jira] [Commented] (SPARK-1493) Apache RAT excludes don't work with file path (instead of file name)

[ https://issues.apache.org/jira/browse/SPARK-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025954#comment-14025954 ] Patrick Wendell commented on SPARK-1493: Thanks for looking into this Erik. It

[jira] [Updated] (SPARK-2086) Improve output of toDebugString to make shuffle boundaries more clear

[ https://issues.apache.org/jira/browse/SPARK-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2086: --- Description: It would be nice if the toDebugString method of an RDD did a better job of

[jira] [Commented] (SPARK-2071) Package private classes that are deleted from an older version of Spark trigger errors

[ https://issues.apache.org/jira/browse/SPARK-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026045#comment-14026045 ] Patrick Wendell commented on SPARK-2071: Yes we could use sbt to retreive them and

[jira] [Updated] (SPARK-2088) NPE in toString when creationSiteInfo is null after deserialization

[ https://issues.apache.org/jira/browse/SPARK-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2088: --- Assignee: Doris Xin NPE in toString when creationSiteInfo is null after deserialization

[jira] [Updated] (SPARK-2088) NPE in toString when creationSiteInfo is null after deserialization

[ https://issues.apache.org/jira/browse/SPARK-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2088: --- Target Version/s: 1.0.0, 1.0.1 NPE in toString when creationSiteInfo is null after

[jira] [Updated] (SPARK-2088) NPE in toString when creationSiteInfo is null after deserialization

[ https://issues.apache.org/jira/browse/SPARK-2088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2088: --- Affects Version/s: 1.0.0 NPE in toString when creationSiteInfo is null after

[jira] [Updated] (SPARK-1902) Spark shell prints error when :4040 port already in use

[ https://issues.apache.org/jira/browse/SPARK-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1902: --- Assignee: Andrew Ash (was: Test) Spark shell prints error when :4040 port already in use

[jira] [Commented] (SPARK-2071) Package private classes that are deleted from an older version of Spark trigger errors

[ https://issues.apache.org/jira/browse/SPARK-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026195#comment-14026195 ] Patrick Wendell commented on SPARK-2071: I just meant that we could introduce a

[jira] [Comment Edited] (SPARK-2071) Package private classes that are deleted from an older version of Spark trigger errors

[ https://issues.apache.org/jira/browse/SPARK-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026195#comment-14026195 ] Patrick Wendell edited comment on SPARK-2071 at 6/10/14 7:16 AM:

[jira] [Commented] (SPARK-2101) Python unit tests fail on Python 2.6 because of lack of unittest.skipIf()

[ https://issues.apache.org/jira/browse/SPARK-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027237#comment-14027237 ] Patrick Wendell commented on SPARK-2101: That seems like a good idea! Python

[jira] [Updated] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2089: --- Target Version/s: 1.0.0, 1.0.1 With YARN, preferredNodeLocalityData isn't honored

[jira] [Updated] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2089: --- Priority: Critical (was: Major) With YARN, preferredNodeLocalityData isn't honored

[jira] [Updated] (SPARK-1998) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

[ https://issues.apache.org/jira/browse/SPARK-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1998: --- Affects Version/s: 0.9.1 1.0.0 SparkFlumeEvent with body bigger than

[jira] [Updated] (SPARK-1998) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

[ https://issues.apache.org/jira/browse/SPARK-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1998: --- Assignee: sun.sam SparkFlumeEvent with body bigger than 1020 bytes are not read properly

[jira] [Resolved] (SPARK-1998) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

[ https://issues.apache.org/jira/browse/SPARK-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1998. Resolution: Fixed Fix Version/s: 1.1.0 0.9.2

[jira] [Updated] (SPARK-2010) Support for nested data in PySpark SQL

[ https://issues.apache.org/jira/browse/SPARK-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2010: --- Target Version/s: 1.1.0 Fix Version/s: (was: 1.1.0) Support for nested data in

[jira] [Updated] (SPARK-2009) Key not found exception when slow receiver starts

[ https://issues.apache.org/jira/browse/SPARK-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2009: --- Priority: Critical (was: Major) Key not found exception when slow receiver starts

[jira] [Updated] (SPARK-2009) Key not found exception when slow receiver starts

[ https://issues.apache.org/jira/browse/SPARK-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2009: --- Assignee: Vadim Chekan Key not found exception when slow receiver starts

[jira] [Updated] (SPARK-2009) Key not found exception when slow receiver starts

[ https://issues.apache.org/jira/browse/SPARK-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2009: --- Target Version/s: 1.0.1, 1.1.0 Key not found exception when slow receiver starts

[jira] [Resolved] (SPARK-1940) Enable rolling of executor logs (stdout / stderr)

[ https://issues.apache.org/jira/browse/SPARK-1940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1940. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 895

[jira] [Created] (SPARK-2108) Mark SparkContext methods that return block information as developer API's

Patrick Wendell created SPARK-2108: -- Summary: Mark SparkContext methods that return block information as developer API's Key: SPARK-2108 URL: https://issues.apache.org/jira/browse/SPARK-2108

[jira] [Resolved] (SPARK-2070) Package private methods are not excluded correctly

[ https://issues.apache.org/jira/browse/SPARK-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2070. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/1021 Package private

[jira] [Resolved] (SPARK-2071) Package private classes that are deleted from an older version of Spark trigger errors

[ https://issues.apache.org/jira/browse/SPARK-2071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2071. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/1021 Package private

[jira] [Resolved] (SPARK-2108) Mark SparkContext methods that return block information as developer API's

[ https://issues.apache.org/jira/browse/SPARK-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2108. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Created] (SPARK-2113) awaitTermination() after stop() will hang in Spark Stremaing

Patrick Wendell created SPARK-2113: -- Summary: awaitTermination() after stop() will hang in Spark Stremaing Key: SPARK-2113 URL: https://issues.apache.org/jira/browse/SPARK-2113 Project: Spark

[jira] [Resolved] (SPARK-2113) awaitTermination() after stop() will hang in Spark Stremaing

[ https://issues.apache.org/jira/browse/SPARK-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2113. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/1001 awaitTermination()

[jira] [Updated] (SPARK-2061) Deprecate `splits` in JavaRDDLike and add `partitions`

[ https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2061: --- Assignee: Anant Daksh Asthana (was: Patrick Wendell) Deprecate `splits` in JavaRDDLike and

[jira] [Assigned] (SPARK-2061) Deprecate `splits` in JavaRDDLike and add `partitions`

[ https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-2061: -- Assignee: Patrick Wendell Deprecate `splits` in JavaRDDLike and add `partitions`

[jira] [Commented] (SPARK-2100) Allow users to disable Jetty Spark UI in local mode

[ https://issues.apache.org/jira/browse/SPARK-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028133#comment-14028133 ] Patrick Wendell commented on SPARK-2100: Could you elaborate a bit more on the

[jira] [Commented] (SPARK-2061) Deprecate `splits` in JavaRDDLike and add `partitions`

[ https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028128#comment-14028128 ] Patrick Wendell commented on SPARK-2061: Go for it! Deprecate `splits` in

[jira] [Created] (SPARK-2118) If tools jar is not present, MIMA build should exit with an exception

Patrick Wendell created SPARK-2118: -- Summary: If tools jar is not present, MIMA build should exit with an exception Key: SPARK-2118 URL: https://issues.apache.org/jira/browse/SPARK-2118 Project:

[jira] [Updated] (SPARK-2118) If tools jar is not present, MIMA build should exit with an exception

[ https://issues.apache.org/jira/browse/SPARK-2118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2118: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-2069 If tools jar is not

[jira] [Resolved] (SPARK-554) Add aggregateByKey

[ https://issues.apache.org/jira/browse/SPARK-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-554. --- Resolution: Fixed Fix Version/s: 1.1.0 Fixed in:

[jira] [Updated] (SPARK-554) Add aggregateByKey

[ https://issues.apache.org/jira/browse/SPARK-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-554: -- Summary: Add aggregateByKey (was: Add foldByKey and aggregateByKey) Add aggregateByKey

[jira] [Updated] (SPARK-554) Add aggregateByKey

[ https://issues.apache.org/jira/browse/SPARK-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-554: -- Assignee: Sandy Ryza Add aggregateByKey -- Key: SPARK-554

[jira] [Commented] (SPARK-2086) Improve output of toDebugString to make shuffle boundaries more clear

[ https://issues.apache.org/jira/browse/SPARK-2086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029610#comment-14029610 ] Patrick Wendell commented on SPARK-2086: There is an active PR for this right now:

[jira] [Resolved] (SPARK-1843) Provide a simpler alternative to assemble-deps

[ https://issues.apache.org/jira/browse/SPARK-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1843. Resolution: Fixed Issue resolved by pull request 877

[jira] [Resolved] (SPARK-1999) UI : StorageLevel in storage tab and RDD Storage Info never changes

[ https://issues.apache.org/jira/browse/SPARK-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1999. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Target

[jira] [Updated] (SPARK-1999) UI : StorageLevel in storage tab and RDD Storage Info never changes

[ https://issues.apache.org/jira/browse/SPARK-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1999: --- Assignee: Chen Chao UI : StorageLevel in storage tab and RDD Storage Info never changes

[jira] [Updated] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2148: --- Issue Type: Improvement (was: Bug) Document custom class as key needing equals() AND

[jira] [Resolved] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2148. Resolution: Fixed Fix Version/s: 1.1.0 1.0.1 Issue resolved by

[jira] [Updated] (SPARK-2148) Document custom class as key needing equals() AND hashcode()

[ https://issues.apache.org/jira/browse/SPARK-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2148: --- Assignee: Andrew Ash Document custom class as key needing equals() AND hashcode()

[jira] [Resolved] (SPARK-2039) Run hadoop output checks for all formats

[ https://issues.apache.org/jira/browse/SPARK-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2039. Resolution: Fixed Fix Version/s: 1.1.0 Fixed by:

[jira] [Resolved] (SPARK-2130) Clarify PySpark docs for RDD.getStorageLevel

[ https://issues.apache.org/jira/browse/SPARK-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2130. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1096

[jira] [Updated] (SPARK-1990) spark-ec2 should only need Python 2.6, not 2.7

[ https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1990: --- Assignee: Anant Daksh Asthana spark-ec2 should only need Python 2.6, not 2.7

[jira] [Updated] (SPARK-1990) spark-ec2 should only need Python 2.6, not 2.7

[ https://issues.apache.org/jira/browse/SPARK-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1990: --- Fix Version/s: 0.9.2 spark-ec2 should only need Python 2.6, not 2.7

[jira] [Updated] (SPARK-2035) Make a stage's call stack available on the UI

[ https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2035: --- Assignee: Daniel Darabos Make a stage's call stack available on the UI

[jira] [Resolved] (SPARK-2035) Make a stage's call stack available on the UI

[ https://issues.apache.org/jira/browse/SPARK-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2035. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 981

[jira] [Updated] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2144: --- Component/s: (was: Spark Core) SparkUI Executors tab displays incorrect RDD blocks

[jira] [Updated] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2144: --- Assignee: Andrew Or SparkUI Executors tab displays incorrect RDD blocks

[jira] [Resolved] (SPARK-2144) SparkUI Executors tab displays incorrect RDD blocks

[ https://issues.apache.org/jira/browse/SPARK-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2144. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1080

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Fix Version/s: (was: 1.1.0) Type mismatch in Spark shell when using case class defined

[jira] [Assigned] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1199: -- Assignee: Prashant Sharma Prashant said he could look into this - so I'm assigning it

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Target Version/s: 1.0.1, 1.1.0 Type mismatch in Spark shell when using case class defined

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Assignee: Jean-Martin Archer Enumerating instances to be terminated before the prompting

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Affects Version/s: 1.0.0 Enumerating instances to be terminated before the prompting the

[jira] [Updated] (SPARK-2166) Enumerating instances to be terminated before the prompting the users to continue.

[ https://issues.apache.org/jira/browse/SPARK-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2166: --- Target Version/s: 1.1.0 Enumerating instances to be terminated before the prompting the

[jira] [Resolved] (SPARK-2170) Fix for global name 'PIPE' is not defined.

[ https://issues.apache.org/jira/browse/SPARK-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2170. Resolution: Not a Problem This was fixed already in a hotfix. But thanks for submitting

[jira] [Reopened] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2038: Don't shadow conf variable in saveAsHadoop functions

[jira] [Resolved] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2038. Resolution: Won't Fix Don't shadow conf variable in saveAsHadoop functions

[jira] [Commented] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034735#comment-14034735 ] Patrick Wendell commented on SPARK-2038: Unfortunately after discussion with

[jira] [Commented] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034864#comment-14034864 ] Patrick Wendell commented on SPARK-2038: It was my fault for proposing this

[jira] [Commented] (SPARK-2171) Groovy bindings for Spark

[ https://issues.apache.org/jira/browse/SPARK-2171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034890#comment-14034890 ] Patrick Wendell commented on SPARK-2171: That's pretty cool! So if I understand

[jira] [Commented] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036801#comment-14036801 ] Patrick Wendell commented on SPARK-1112: We were able to reproduce this - thanks

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Priority: Blocker (was: Critical) When spark.akka.frameSize 10, task results bigger than

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Target Version/s: 0.9.2, 1.0.1 When spark.akka.frameSize 10, task results bigger than

[jira] [Updated] (SPARK-1112) When spark.akka.frameSize 10, task results bigger than 10MiB block execution

[ https://issues.apache.org/jira/browse/SPARK-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1112: --- Fix Version/s: (was: 0.9.2) When spark.akka.frameSize 10, task results bigger than

[jira] [Resolved] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2156. Resolution: Duplicate When the size of serialized results for one partition is slightly

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036849#comment-14036849 ] Patrick Wendell commented on SPARK-2156: Ah I see - thanks! I'm going to re-open

[jira] [Reopened] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2156: When the size of serialized results for one partition is slightly smaller than 10MB (the

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036850#comment-14036850 ] Patrick Wendell commented on SPARK-2156: [~xiaocai] Are you calling collect() on

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036866#comment-14036866 ] Patrick Wendell commented on SPARK-2156: [~xiaocai] Would you mind trying with the

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Fix Version/s: (was: 1.0.1) When the size of serialized results for one partition is

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Priority: Blocker (was: Critical) When the size of serialized results for one partition is

[jira] [Updated] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2156: --- Target Version/s: 0.9.2, 1.0.1 (was: 1.0.1) When the size of serialized results for one

[jira] [Commented] (SPARK-2156) When the size of serialized results for one partition is slightly smaller than 10MB (the default akka.frameSize), the execution blocks

[ https://issues.apache.org/jira/browse/SPARK-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036874#comment-14036874 ] Patrick Wendell commented on SPARK-2156: I closed my patch in favor of Xiangrui's.

[jira] [Commented] (SPARK-2126) Move MapOutputTracker behind ShuffleManager interface

[ https://issues.apache.org/jira/browse/SPARK-2126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037692#comment-14037692 ] Patrick Wendell commented on SPARK-2126: Hey All, This proposal is a fairly hairy

[jira] [Commented] (SPARK-2202) saveAsTextFile hangs on final 2 tasks

[ https://issues.apache.org/jira/browse/SPARK-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037698#comment-14037698 ] Patrick Wendell commented on SPARK-2202: I changed the priority because we usually

[jira] [Commented] (SPARK-2202) saveAsTextFile hangs on final 2 tasks

[ https://issues.apache.org/jira/browse/SPARK-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037696#comment-14037696 ] Patrick Wendell commented on SPARK-2202: When the tasks are hanging. Could you go

[jira] [Updated] (SPARK-2202) saveAsTextFile hangs on final 2 tasks

[ https://issues.apache.org/jira/browse/SPARK-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2202: --- Priority: Major (was: Blocker) saveAsTextFile hangs on final 2 tasks

[jira] [Commented] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037703#comment-14037703 ] Patrick Wendell commented on SPARK-2038: Hey [~CodingCat] - I realized there is

[jira] [Reopened] (SPARK-2038) Don't shadow conf variable in saveAsHadoop functions

[ https://issues.apache.org/jira/browse/SPARK-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2038: Don't shadow conf variable in saveAsHadoop functions

[jira] [Commented] (SPARK-2202) saveAsTextFile hangs on final 2 tasks

[ https://issues.apache.org/jira/browse/SPARK-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038101#comment-14038101 ] Patrick Wendell commented on SPARK-2202: Yes, please do! saveAsTextFile hangs on

[jira] [Commented] (SPARK-2192) Examples Data Not in Binary Distribution

[ https://issues.apache.org/jira/browse/SPARK-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038200#comment-14038200 ] Patrick Wendell commented on SPARK-2192: It might be good to have all the example

[jira] [Created] (SPARK-2208) local metrics tests can fail on fast machines

Patrick Wendell created SPARK-2208: -- Summary: local metrics tests can fail on fast machines Key: SPARK-2208 URL: https://issues.apache.org/jira/browse/SPARK-2208 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2208: --- Labels: starter (was: ) local metrics tests can fail on fast machines

[jira] [Commented] (SPARK-2208) local metrics tests can fail on fast machines

[ https://issues.apache.org/jira/browse/SPARK-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038414#comment-14038414 ] Patrick Wendell commented on SPARK-2208: A hotfix was merged here, but we should

[jira] [Commented] (SPARK-2114) groupByKey and joins on raw data

[ https://issues.apache.org/jira/browse/SPARK-2114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038558#comment-14038558 ] Patrick Wendell commented on SPARK-2114: Hey Sandy, One thing that would be

[jira] [Commented] (SPARK-2089) With YARN, preferredNodeLocalityData isn't honored

[ https://issues.apache.org/jira/browse/SPARK-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038569#comment-14038569 ] Patrick Wendell commented on SPARK-2089: Hey Sandy, I think I removed this from

[jira] [Resolved] (SPARK-1970) Update unit test in XORShiftRandomSuite to use ChiSquareTest from commons-math3

[ https://issues.apache.org/jira/browse/SPARK-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1970. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1073

[jira] [Resolved] (SPARK-2061) Deprecate `splits` in JavaRDDLike and add `partitions`

[ https://issues.apache.org/jira/browse/SPARK-2061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2061. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1062

<    1   2   3   4   5   6   7   8   9   10   >