[jira] [Commented] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118701#comment-14118701 ] Patrick Wendell commented on SPARK-3330: I reviewed the patch and it seemed to me

[jira] [Issue Comment Deleted] (SPARK-3330) Successive test runs with different profiles fail SparkSubmitSuite

[ https://issues.apache.org/jira/browse/SPARK-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3330: --- Comment: was deleted (was: I reviewed the patch and it seemed to me like `mvn clean` already

[jira] [Updated] (SPARK-3355) Allow running maven tests in run-tests

[ https://issues.apache.org/jira/browse/SPARK-3355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3355: --- Summary: Allow running maven tests in run-tests (was: Allow running maven tests in run-tests

[jira] [Created] (SPARK-3355) Allow running maven tests in run-tests and run-tests-jenkins

Patrick Wendell created SPARK-3355: -- Summary: Allow running maven tests in run-tests and run-tests-jenkins Key: SPARK-3355 URL: https://issues.apache.org/jira/browse/SPARK-3355 Project: Spark

[jira] [Commented] (SPARK-3350) Strange anomaly trying to write a SchemaRDD into an Avro file

[ https://issues.apache.org/jira/browse/SPARK-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119057#comment-14119057 ] Patrick Wendell commented on SPARK-3350: Can you provide the stacktrace? Strange

[jira] [Updated] (SPARK-3350) Strange anomaly trying to write a SchemaRDD into an Avro file

[ https://issues.apache.org/jira/browse/SPARK-3350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3350: --- Component/s: (was: Input/Output) SQL Strange anomaly trying to write a

[jira] [Resolved] (SPARK-3346) Error happened in using memcached

[ https://issues.apache.org/jira/browse/SPARK-3346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3346. Resolution: Invalid Would you mind reporting this to the user list? We use JIRA only for

[jira] [Updated] (SPARK-3322) ConnectionManager logs an error when the application ends

[ https://issues.apache.org/jira/browse/SPARK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3322: --- Summary: ConnectionManager logs an error when the application ends (was: Log a

[jira] [Resolved] (SPARK-3328) ./make-distribution.sh --with-tachyon build is broken

[ https://issues.apache.org/jira/browse/SPARK-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3328. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2228

[jira] [Updated] (SPARK-3328) ./make-distribution.sh --with-tachyon build is broken

[ https://issues.apache.org/jira/browse/SPARK-3328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3328: --- Assignee: prudhvi krishna ./make-distribution.sh --with-tachyon build is broken

[jira] [Commented] (SPARK-3358) PySpark worker fork()ing performance regression in m3.* / PVM instances

[ https://issues.apache.org/jira/browse/SPARK-3358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119253#comment-14119253 ] Patrick Wendell commented on SPARK-3358: There was actually a patch a couple

[jira] [Commented] (SPARK-3216) Spark-shell is broken for branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120347#comment-14120347 ] Patrick Wendell commented on SPARK-3216: [~andrewor14] for this you should Mark it

[jira] [Updated] (SPARK-3216) Spark-shell is broken for branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3216: --- Target Version/s: 1.0.3 Spark-shell is broken for branch-1.0

[jira] [Reopened] (SPARK-3216) Spark-shell is broken for branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-3216: Spark-shell is broken for branch-1.0

[jira] [Updated] (SPARK-3216) Spark-shell is broken for branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3216: --- Fix Version/s: 1.0.3 Spark-shell is broken for branch-1.0

[jira] [Resolved] (SPARK-3216) Spark-shell is broken for branch-1.0

[ https://issues.apache.org/jira/browse/SPARK-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3216. Resolution: Fixed Spark-shell is broken for branch-1.0

[jira] [Updated] (SPARK-3345) Do correct parameters for ShuffleFileGroup

[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3345: --- Affects Version/s: 1.1.0 Do correct parameters for ShuffleFileGroup

[jira] [Updated] (SPARK-3345) Do correct parameters for ShuffleFileGroup

[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3345: --- Assignee: Liang-Chi Hsieh Do correct parameters for ShuffleFileGroup

[jira] [Updated] (SPARK-3345) Do correct parameters for ShuffleFileGroup

[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3345: --- Target Version/s: 1.1.1, 1.2.0 Do correct parameters for ShuffleFileGroup

[jira] [Updated] (SPARK-3345) Do correct parameters for ShuffleFileGroup

[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3345: --- Fix Version/s: 1.2.0 Do correct parameters for ShuffleFileGroup

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3181: --- Fix Version/s: (was: 1.1.1) Add Robust Regression Algorithm with Huber Estimator

[jira] [Updated] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3181: --- Fix Version/s: (was: 1.2.0) Add Robust Regression Algorithm with Huber Estimator

[jira] [Updated] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3188: --- Fix Version/s: (was: 1.2.0) (was: 1.1.1) Add Robust Regression

[jira] [Commented] (SPARK-3188) Add Robust Regression Algorithm with Tukey bisquare weight function (Biweight Estimates)

[ https://issues.apache.org/jira/browse/SPARK-3188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120736#comment-14120736 ] Patrick Wendell commented on SPARK-3188: Hey [~fjiang6] please don't set the fix

[jira] [Commented] (SPARK-3181) Add Robust Regression Algorithm with Huber Estimator

[ https://issues.apache.org/jira/browse/SPARK-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120735#comment-14120735 ] Patrick Wendell commented on SPARK-3181: Hey [~fjiang6] please don't set the fix

[jira] [Updated] (SPARK-3061) Maven build fails in Windows OS

[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3061: --- Target Version/s: 1.1.1, 1.2.0 Maven build fails in Windows OS

[jira] [Updated] (SPARK-1919) In Windows, Spark shell cannot load classes in spark.jars (--jars)

[ https://issues.apache.org/jira/browse/SPARK-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1919: --- Target Version/s: 1.1.1, 1.2.0 (was: 1.1.1) In Windows, Spark shell cannot load classes in

[jira] [Updated] (SPARK-3280) Made sort-based shuffle the default implementation

[ https://issues.apache.org/jira/browse/SPARK-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3280: --- Component/s: Spark Core Made sort-based shuffle the default implementation

[jira] [Updated] (SPARK-3345) Do correct parameters for ShuffleFileGroup

[ https://issues.apache.org/jira/browse/SPARK-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3345: --- Component/s: Spark Core Do correct parameters for ShuffleFileGroup

[jira] [Updated] (SPARK-3349) Incorrect partitioning after LIMIT operator

[ https://issues.apache.org/jira/browse/SPARK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3349: --- Summary: Incorrect partitioning after LIMIT operator (was: [Spark SQL] Incorrect

[jira] [Updated] (SPARK-3349) [Spark SQL] Incorrect partitioning after LIMIT operator

[ https://issues.apache.org/jira/browse/SPARK-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3349: --- Component/s: SQL [Spark SQL] Incorrect partitioning after LIMIT operator

[jira] [Updated] (SPARK-3405) EC2 cluster creation on VPC

[ https://issues.apache.org/jira/browse/SPARK-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3405: --- Component/s: (was: PySpark) EC2 cluster creation on VPC ---

[jira] [Updated] (SPARK-3369) Java mapPartitions Iterator-Iterable is inconsistent with Scala's Iterator-Iterator

[ https://issues.apache.org/jira/browse/SPARK-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3369: --- Priority: Critical (was: Major) Target Version/s: 1.2.0 Java mapPartitions

[jira] [Updated] (SPARK-3174) Under YARN, add and remove executors based on load

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3174: --- Assignee: Andrew Or Under YARN, add and remove executors based on load

[jira] [Commented] (SPARK-3174) Under YARN, add and remove executors based on load

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123137#comment-14123137 ] Patrick Wendell commented on SPARK-3174: We should come up with a design doc for

[jira] [Updated] (SPARK-2769) Ganglia Support Broken / Not working

[ https://issues.apache.org/jira/browse/SPARK-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2769: --- Affects Version/s: (was: 1.0.0) 1.1.0 Ganglia Support Broken /

[jira] [Updated] (SPARK-3263) PR #720 broke GraphGenerator.logNormal

[ https://issues.apache.org/jira/browse/SPARK-3263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3263: --- Fix Version/s: (was: 1.3.0) 1.2.0 PR #720 broke

[jira] [Commented] (SPARK-3174) Under YARN, add and remove executors based on load

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125172#comment-14125172 ] Patrick Wendell commented on SPARK-3174: Hey Sandy - thanks for posting the design

[jira] [Resolved] (SPARK-938) OpenStack Swift Storage Support

[ https://issues.apache.org/jira/browse/SPARK-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-938. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2298

[jira] [Updated] (SPARK-938) OpenStack Swift Storage Support

[ https://issues.apache.org/jira/browse/SPARK-938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-938: -- Assignee: Gil Vernik OpenStack Swift Storage Support ---

[jira] [Commented] (SPARK-938) OpenStack Swift Storage Support

[ https://issues.apache.org/jira/browse/SPARK-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125195#comment-14125195 ] Patrick Wendell commented on SPARK-938: --- This was fixed by [~gvernik] with [~rxin]

[jira] [Updated] (SPARK-2425) Standalone Master is too aggressive in removing Applications

[ https://issues.apache.org/jira/browse/SPARK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2425: --- Priority: Critical (was: Major) Standalone Master is too aggressive in removing

[jira] [Updated] (SPARK-2425) Standalone Master is too aggressive in removing Applications

[ https://issues.apache.org/jira/browse/SPARK-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2425: --- Target Version/s: 1.2.0 (was: 1.0.3) Standalone Master is too aggressive in removing

[jira] [Created] (SPARK-3445) Deprecate and later remove YARN alpha support

Patrick Wendell created SPARK-3445: -- Summary: Deprecate and later remove YARN alpha support Key: SPARK-3445 URL: https://issues.apache.org/jira/browse/SPARK-3445 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3441) Explain in docs that repartitionAndSortWithinPartitions enacts Hadoop style shuffle

[ https://issues.apache.org/jira/browse/SPARK-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14126308#comment-14126308 ] Patrick Wendell commented on SPARK-3441: Hey [~sandyr] - what do you mean by

[jira] [Updated] (SPARK-3450) Enable specifiying the --jars CLI option multiple times

[ https://issues.apache.org/jira/browse/SPARK-3450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3450: --- Shepherd: (was: Marcelo Vanzin) Enable specifiying the --jars CLI option multiple times

[jira] [Updated] (SPARK-3451) spark-submit should support specifying glob wildcards in the --jars CLI option

[ https://issues.apache.org/jira/browse/SPARK-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3451: --- Shepherd: (was: Marcelo Vanzin) spark-submit should support specifying glob wildcards in

[jira] [Updated] (SPARK-2972) APPLICATION_COMPLETE not created in Python unless context explicitly stopped

[ https://issues.apache.org/jira/browse/SPARK-2972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2972: --- Priority: Major (was: Critical) APPLICATION_COMPLETE not created in Python unless context

[jira] [Updated] (SPARK-2972) APPLICATION_COMPLETE not created in Python unless context explicitly stopped

[ https://issues.apache.org/jira/browse/SPARK-2972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2972: --- Priority: Critical (was: Major) APPLICATION_COMPLETE not created in Python unless context

[jira] [Updated] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3452: --- Priority: Critical (was: Major) Maven build should skip publishing artifacts people

[jira] [Updated] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3452: --- Affects Version/s: 1.1.0 1.0.0 Maven build should skip publishing

[jira] [Created] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

Patrick Wendell created SPARK-3452: -- Summary: Maven build should skip publishing artifacts people shouldn't depend on Key: SPARK-3452 URL: https://issues.apache.org/jira/browse/SPARK-3452 Project:

[jira] [Created] (SPARK-3460) Graceful decommission of idle YARN sessions

Patrick Wendell created SPARK-3460: -- Summary: Graceful decommission of idle YARN sessions Key: SPARK-3460 URL: https://issues.apache.org/jira/browse/SPARK-3460 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-3174) Under YARN, add and remove executors based on load

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127232#comment-14127232 ] Patrick Wendell edited comment on SPARK-3174 at 9/9/14 5:08 PM:

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Component/s: Deploy Support for accessing secured HDFS in Standalone Mode

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Summary: Support for accessing secured HDFS in Standalone Mode (was: Adding support for

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Description: Secured HDFS is supported in YARN currently, but not in standalone mode. The

[jira] [Updated] (SPARK-2182) Scalastyle rule blocking unicode operators

[ https://issues.apache.org/jira/browse/SPARK-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2182: --- Assignee: Prashant Sharma Scalastyle rule blocking unicode operators

[jira] [Commented] (SPARK-2182) Scalastyle rule blocking unicode operators

[ https://issues.apache.org/jira/browse/SPARK-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14127248#comment-14127248 ] Patrick Wendell commented on SPARK-2182: [~prashant_] as our resident expert on

[jira] [Updated] (SPARK-3426) Sort-based shuffle compression behavior is inconsistent

[ https://issues.apache.org/jira/browse/SPARK-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3426: --- Priority: Blocker (was: Critical) Sort-based shuffle compression behavior is inconsistent

[jira] [Created] (SPARK-3461) Support external group-by

Patrick Wendell created SPARK-3461: -- Summary: Support external group-by Key: SPARK-3461 URL: https://issues.apache.org/jira/browse/SPARK-3461 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3461) Support external groupBy

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3461: --- Summary: Support external groupBy (was: Support external group-by) Support external groupBy

[jira] [Updated] (SPARK-3461) Support external groupBy

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3461: --- Description: Given that we have SPARK-2978, it seems like we could support an external group

[jira] [Updated] (SPARK-3461) Support external groupBy

[ https://issues.apache.org/jira/browse/SPARK-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3461: --- Component/s: Spark Core Support external groupBy

[jira] [Created] (SPARK-3511) Create a RELEASE-NOTES.txt file in the repo

Patrick Wendell created SPARK-3511: -- Summary: Create a RELEASE-NOTES.txt file in the repo Key: SPARK-3511 URL: https://issues.apache.org/jira/browse/SPARK-3511 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3500) SchemaRDD from jsonRDD() has not coalesce() method

[ https://issues.apache.org/jira/browse/SPARK-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131706#comment-14131706 ] Patrick Wendell commented on SPARK-3500: If it's just a missing feature we tend to

[jira] [Updated] (SPARK-3513) Provide a utility for running a function once on each executor

[ https://issues.apache.org/jira/browse/SPARK-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3513: --- Fix Version/s: (was: 1.2.0) Provide a utility for running a function once on each

[jira] [Updated] (SPARK-3513) Provide a utility for running a function once on each executor

[ https://issues.apache.org/jira/browse/SPARK-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3513: --- Target Version/s: 1.2.0 Provide a utility for running a function once on each executor

[jira] [Created] (SPARK-3513) Provide a utility for running a function once on each executor

Patrick Wendell created SPARK-3513: -- Summary: Provide a utility for running a function once on each executor Key: SPARK-3513 URL: https://issues.apache.org/jira/browse/SPARK-3513 Project: Spark

[jira] [Created] (SPARK-3514) Provide a utility function for returning the hosts (and number) of live executors

Patrick Wendell created SPARK-3514: -- Summary: Provide a utility function for returning the hosts (and number) of live executors Key: SPARK-3514 URL: https://issues.apache.org/jira/browse/SPARK-3514

[jira] [Updated] (SPARK-3514) Provide a utility function for returning the hosts (and number) of live executors

[ https://issues.apache.org/jira/browse/SPARK-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3514: --- Issue Type: Improvement (was: Bug) Provide a utility function for returning the hosts (and

[jira] [Updated] (SPARK-3513) Provide a utility for running a function once on each executor

[ https://issues.apache.org/jira/browse/SPARK-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3513: --- Issue Type: Improvement (was: Bug) Provide a utility for running a function once on each

[jira] [Resolved] (SPARK-3217) Shaded Guava jar doesn't play well with Maven build when SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-3217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3217. Resolution: Fixed Fix Version/s: 1.2.0 Fixed by

[jira] [Updated] (SPARK-3438) Support for accessing secured HDFS in Standalone Mode

[ https://issues.apache.org/jira/browse/SPARK-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3438: --- Description: Access to secured HDFS is currently supported in YARN using YARN's built in

[jira] [Updated] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1449: --- Affects Version/s: (was: 1.0.2) Please delete old releases from mirroring system

[jira] [Updated] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1449: --- Fix Version/s: 0.8.1 0.9.1 1.0.0

[jira] [Resolved] (SPARK-1449) Please delete old releases from mirroring system

[ https://issues.apache.org/jira/browse/SPARK-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1449. Resolution: Fixed I've left 1.0.2 and 1.1.0, since 1.1.0 is an unstable release. Please

[jira] [Updated] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3039: --- Assignee: Bertrand Bossy Spark assembly for new hadoop API (hadoop 2) contains avro-mapred

[jira] [Resolved] (SPARK-3039) Spark assembly for new hadoop API (hadoop 2) contains avro-mapred for hadoop 1 API

[ https://issues.apache.org/jira/browse/SPARK-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3039. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Target

[jira] [Resolved] (SPARK-3452) Maven build should skip publishing artifacts people shouldn't depend on

[ https://issues.apache.org/jira/browse/SPARK-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3452. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/2329 Maven build should

[jira] [Commented] (SPARK-1239) Don't fetch all map output statuses at each reducer during shuffles

[ https://issues.apache.org/jira/browse/SPARK-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134198#comment-14134198 ] Patrick Wendell commented on SPARK-1239: Yes, the current state of the art is to

[jira] [Resolved] (SPARK-3425) OpenJDK - when run with jvm 1.8, should not set MaxPermSize

[ https://issues.apache.org/jira/browse/SPARK-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3425. Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/2301 OpenJDK - when run

[jira] [Resolved] (SPARK-3518) Remove useless statement in JsonProtocol

[ https://issues.apache.org/jira/browse/SPARK-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3518. Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Assignee:

[jira] [Updated] (SPARK-2505) Weighted Regularizer

[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2505: --- Fix Version/s: (was: 1.1.0) 1.2.0 Weighted Regularizer

[jira] [Updated] (SPARK-2314) RDD actions are only overridden in Scala, not java or python

[ https://issues.apache.org/jira/browse/SPARK-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2314: --- Fix Version/s: (was: 1.1.0) 1.2.0 RDD actions are only overridden in

[jira] [Updated] (SPARK-3403) NaiveBayes crashes with blas/lapack native libraries for breeze (netlib-java)

[ https://issues.apache.org/jira/browse/SPARK-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3403: --- Fix Version/s: (was: 1.1.0) 1.2.0 NaiveBayes crashes with blas/lapack

[jira] [Updated] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2703: --- Fix Version/s: (was: 1.1.0) 1.2.0 Make Tachyon related unit tests

[jira] [Updated] (SPARK-3038) delete history server logs when there are too many logs

[ https://issues.apache.org/jira/browse/SPARK-3038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3038: --- Fix Version/s: (was: 1.1.0) 1.2.0 delete history server logs when

[jira] [Updated] (SPARK-1832) Executor UI improvement suggestions

[ https://issues.apache.org/jira/browse/SPARK-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1832: --- Fix Version/s: (was: 1.1.0) 1.2.0 Executor UI improvement suggestions

[jira] [Updated] (SPARK-2167) spark-submit should return exit code based on failure/success

[ https://issues.apache.org/jira/browse/SPARK-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2167: --- Fix Version/s: (was: 1.1.0) 1.2.0 spark-submit should return exit

[jira] [Updated] (SPARK-2754) Document standalone-cluster mode now that it's working

[ https://issues.apache.org/jira/browse/SPARK-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2754: --- Fix Version/s: (was: 1.1.0) 1.2.0 Document standalone-cluster mode

[jira] [Updated] (SPARK-2947) DAGScheduler resubmit the stage into an infinite loop

[ https://issues.apache.org/jira/browse/SPARK-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2947: --- Fix Version/s: (was: 1.1.0) 1.2.0 DAGScheduler resubmit the stage

[jira] [Updated] (SPARK-2638) Improve concurrency of fetching Map outputs

[ https://issues.apache.org/jira/browse/SPARK-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2638: --- Fix Version/s: (was: 1.1.0) 1.2.0 Improve concurrency of fetching Map

[jira] [Updated] (SPARK-1911) Warn users if their assembly jars are not built with Java 6

[ https://issues.apache.org/jira/browse/SPARK-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1911: --- Fix Version/s: (was: 1.1.0) 1.2.0 Warn users if their assembly jars

[jira] [Updated] (SPARK-2793) Correctly lock directory creation in DiskBlockManager.getFile

[ https://issues.apache.org/jira/browse/SPARK-2793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2793: --- Fix Version/s: (was: 1.1.0) 1.2.0 Correctly lock directory creation

[jira] [Updated] (SPARK-2069) MIMA false positives (umbrella)

[ https://issues.apache.org/jira/browse/SPARK-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2069: --- Fix Version/s: (was: 1.1.0) 1.2.0 MIMA false positives (umbrella)

[jira] [Updated] (SPARK-1830) Deploy failover, Make Persistence engine and LeaderAgent Pluggable.

[ https://issues.apache.org/jira/browse/SPARK-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1830: --- Fix Version/s: (was: 1.1.0) 1.2.0 Deploy failover, Make Persistence

[jira] [Updated] (SPARK-2795) Improve DiskBlockObjectWriter API

[ https://issues.apache.org/jira/browse/SPARK-2795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2795: --- Fix Version/s: (was: 1.1.0) 1.2.0 Improve DiskBlockObjectWriter API

[jira] [Updated] (SPARK-1706) Allow multiple executors per worker in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1706: --- Fix Version/s: (was: 1.1.0) 1.2.0 Allow multiple executors per worker

[jira] [Updated] (SPARK-1989) Exit executors faster if they get into a cycle of heavy GC

[ https://issues.apache.org/jira/browse/SPARK-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1989: --- Fix Version/s: (was: 1.1.0) 1.2.0 Exit executors faster if they get

<    7   8   9   10   11   12   13   14   15   16   >