[jira] [Commented] (SPARK-16859) History Server storage information is missing

[ https://issues.apache.org/jira/browse/SPARK-16859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635237#comment-16635237 ] ravi commented on SPARK-16859: -- still an issue. Storage tab on SparkUI is empty > History

[jira] [Created] (SPARK-25309) Sci-kit Learn like Auto Pipeline Parallelization in Spark

Ravi created SPARK-25309: Summary: Sci-kit Learn like Auto Pipeline Parallelization in Spark Key: SPARK-25309 URL: https://issues.apache.org/jira/browse/SPARK-25309 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-25309) Sci-kit Learn like Auto Pipeline Parallelization in Spark

[ https://issues.apache.org/jira/browse/SPARK-25309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi updated SPARK-25309: - Description: SPARK-19357 and SPARK-21911 have helped parallelize Pipelines in Spark. However, instead of setting

[jira] [Created] (SPARK-11278) PageRank fails with unified memory manager

Nishkam Ravi created SPARK-11278: Summary: PageRank fails with unified memory manager Key: SPARK-11278 URL: https://issues.apache.org/jira/browse/SPARK-11278 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972155#comment-14972155 ] Nishkam Ravi edited comment on SPARK-11278 at 10/24/15 12:05 AM: --

[jira] [Commented] (SPARK-11278) PageRank fails with unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-11278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14972155#comment-14972155 ] Nishkam Ravi commented on SPARK-11278: -- Yeah, the problem goes away with useLegacyMo

[jira] [Commented] (SPARK-6234) 10% Performance regression with Breeze upgrade

[ https://issues.apache.org/jira/browse/SPARK-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14975542#comment-14975542 ] Nishkam Ravi commented on SPARK-6234: - The regression in breeze has been fixed: https

[jira] [Created] (SPARK-11501) spark.rpc config not propagated to executors

Nishkam Ravi created SPARK-11501: Summary: spark.rpc config not propagated to executors Key: SPARK-11501 URL: https://issues.apache.org/jira/browse/SPARK-11501 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211896#comment-14211896 ] Nishkam Ravi commented on SPARK-2398: - [~srowen] yes, this has been resolved by modify

[jira] [Created] (SPARK-4484) Treat maxResultSize as unlimited when set to 0; improve error message

Nishkam Ravi created SPARK-4484: --- Summary: Treat maxResultSize as unlimited when set to 0; improve error message Key: SPARK-4484 URL: https://issues.apache.org/jira/browse/SPARK-4484 Project: Spark

[jira] [Commented] (SPARK-4484) Treat maxResultSize as unlimited when set to 0; improve error message

[ https://issues.apache.org/jira/browse/SPARK-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217577#comment-14217577 ] Nishkam Ravi commented on SPARK-4484: - PR: https://github.com/apache/spark/pull/3360/

[jira] [Commented] (SPARK-4484) Treat maxResultSize as unlimited when set to 0; improve error message

[ https://issues.apache.org/jira/browse/SPARK-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217653#comment-14217653 ] Nishkam Ravi commented on SPARK-4484: - Yeah, most workloads break with a large enough

[jira] [Updated] (SPARK-4484) [CORE] Treat maxResultSize as unlimited when set to 0; improve error message

[ https://issues.apache.org/jira/browse/SPARK-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-4484: Summary: [CORE] Treat maxResultSize as unlimited when set to 0; improve error message (was: Treat m

[jira] [Created] (SPARK-4515) OOM/GC errors with sort-based shuffle

Nishkam Ravi created SPARK-4515: --- Summary: OOM/GC errors with sort-based shuffle Key: SPARK-4515 URL: https://issues.apache.org/jira/browse/SPARK-4515 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-4515) OOM/GC errors with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-4515: Description: OOM/GC errors with sort-based shuffle that go away when shuffle.manager is set to hash

[jira] [Commented] (SPARK-4515) OOM/GC errors with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219908#comment-14219908 ] Nishkam Ravi commented on SPARK-4515: - I run a slightly modified version of PageRank,

[jira] [Commented] (SPARK-4515) OOM/GC errors with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220483#comment-14220483 ] Nishkam Ravi commented on SPARK-4515: - Looks like this issue got fixed through one of

[jira] [Commented] (SPARK-4515) OOM/GC errors with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220724#comment-14220724 ] Nishkam Ravi commented on SPARK-4515: - Yep. SPARK-4467 fixes this issue. Closing this

[jira] [Resolved] (SPARK-4515) OOM/GC errors with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi resolved SPARK-4515. - Resolution: Fixed > OOM/GC errors with sort-based shuffle > -

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220728#comment-14220728 ] Nishkam Ravi commented on SPARK-3633: - Fixed by PR for SPARK-4480. > Fetches failure

[jira] [Resolved] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi resolved SPARK-3633. - Resolution: Fixed > Fetches failure observed after SPARK-2711 > --

[jira] [Created] (SPARK-4584) 2x Performance regression for Spark-on-YARN

Nishkam Ravi created SPARK-4584: --- Summary: 2x Performance regression for Spark-on-YARN Key: SPARK-4584 URL: https://issues.apache.org/jira/browse/SPARK-4584 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223930#comment-14223930 ] Nishkam Ravi commented on SPARK-4584: - In YARN cluster mode. > 2x Performance regress

[jira] [Updated] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-4584: Description: Significant performance regression observed for Spark-on-YARN (upto 2x) after 1.2 rebas

[jira] [Issue Comment Deleted] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-4584: Comment: was deleted (was: In YARN cluster mode.) > 2x Performance regression for Spark-on-YARN > -

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225313#comment-14225313 ] Nishkam Ravi commented on SPARK-4584: - Looked into this issue a bit more. Source of th

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225321#comment-14225321 ] Nishkam Ravi commented on SPARK-4584: - Looks like java.lang.SecurityManager is a hog.

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225471#comment-14225471 ] Nishkam Ravi commented on SPARK-4584: - I don't see SecurityManager anywhere else in Sp

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225479#comment-14225479 ] Nishkam Ravi commented on SPARK-4584: - Use of SecurityManager may be suppressing a JIT

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225563#comment-14225563 ] Nishkam Ravi commented on SPARK-4584: - [~andrewor14] Just curious, why is that relevan

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225567#comment-14225567 ] Nishkam Ravi commented on SPARK-4584: - Around 2GB in the map stage and 1.5GB in the co

[jira] [Commented] (SPARK-4584) 2x Performance regression for Spark-on-YARN

[ https://issues.apache.org/jira/browse/SPARK-4584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225603#comment-14225603 ] Nishkam Ravi commented on SPARK-4584: - I would recommend working with JavaWordCount. W

[jira] [Created] (SPARK-6142) 10-12% Performance regression with "finalize"

Nishkam Ravi created SPARK-6142: --- Summary: 10-12% Performance regression with "finalize" Key: SPARK-6142 URL: https://issues.apache.org/jira/browse/SPARK-6142 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6142) 10-12% Performance regression with "finalize"

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346086#comment-14346086 ] Nishkam Ravi commented on SPARK-6142: - Fixed (master 9af001749a37a86ccbf78063ec514a218

[jira] [Resolved] (SPARK-6142) 10-12% Performance regression with "finalize"

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi resolved SPARK-6142. - Resolution: Fixed > 10-12% Performance regression with "finalize" > --

[jira] [Reopened] (SPARK-5423) ExternalAppendOnlyMap won't delete temp spilled file if some exception happens during using it

[ https://issues.apache.org/jira/browse/SPARK-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi reopened SPARK-5423: - The commit was reverted due to performance issues. Re-opening this JIRA. > ExternalAppendOnlyMap won'

[jira] [Commented] (SPARK-6142) 10-12% Performance regression with "finalize"

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349646#comment-14349646 ] Nishkam Ravi commented on SPARK-6142: - [~zsxwing]Yes, the 10-12% regression was ve

[jira] [Commented] (SPARK-6142) 10-12% Performance regression with "finalize"

[ https://issues.apache.org/jira/browse/SPARK-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350154#comment-14350154 ] Nishkam Ravi commented on SPARK-6142: - [~srowen] GC takes at least one extra cycle for

[jira] [Created] (SPARK-6234) 10% Performance regression with Breeze upgrade

Nishkam Ravi created SPARK-6234: --- Summary: 10% Performance regression with Breeze upgrade Key: SPARK-6234 URL: https://issues.apache.org/jira/browse/SPARK-6234 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6234) 10% Performance regression with Breeze upgrade

[ https://issues.apache.org/jira/browse/SPARK-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353793#comment-14353793 ] Nishkam Ravi commented on SPARK-6234: - [~mengxr] Variant of org.apache.spark.examples.

[jira] [Commented] (SPARK-6234) 10% Performance regression with Breeze upgrade

[ https://issues.apache.org/jira/browse/SPARK-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353843#comment-14353843 ] Nishkam Ravi commented on SPARK-6234: - Are we saying that Breeze's performance is unim

[jira] [Commented] (SPARK-6234) 10% Performance regression with Breeze upgrade

[ https://issues.apache.org/jira/browse/SPARK-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353877#comment-14353877 ] Nishkam Ravi commented on SPARK-6234: - Right. This particular implementation can be th

[jira] [Commented] (SPARK-6234) 10% Performance regression with Breeze upgrade

[ https://issues.apache.org/jira/browse/SPARK-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14356016#comment-14356016 ] Nishkam Ravi commented on SPARK-6234: - If Spark doesn't directly/indirectly invoke squ

[jira] [Created] (SPARK-6406) Launcher backward compatibility issues

Nishkam Ravi created SPARK-6406: --- Summary: Launcher backward compatibility issues Key: SPARK-6406 URL: https://issues.apache.org/jira/browse/SPARK-6406 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-6406) Launcher backward compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370815#comment-14370815 ] Nishkam Ravi commented on SPARK-6406: - Also, we should not look for a separate launche

[jira] [Created] (SPARK-3633) PR 1707/commit #4fde28c is problematic

Nishkam Ravi created SPARK-3633: --- Summary: PR 1707/commit #4fde28c is problematic Key: SPARK-3633 URL: https://issues.apache.org/jira/browse/SPARK-3633 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145676#comment-14145676 ] Nishkam Ravi commented on SPARK-3633: - [~pwendell] I see a large number of open files

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145713#comment-14145713 ] Nishkam Ravi commented on SPARK-3633: - Looks ok (still waiting on the run to finish/fa

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145749#comment-14145749 ] Nishkam Ravi commented on SPARK-3633: - Unsurprisingly, the run goes through. It would

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145763#comment-14145763 ] Nishkam Ravi commented on SPARK-3633: - With higher values of ulimit and timeout values

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148026#comment-14148026 ] Nishkam Ravi commented on SPARK-3633: - Increasing the value of spark.core.connection.a

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156074#comment-14156074 ] Nishkam Ravi commented on SPARK-3633: - For a different workload (variant of TeraSort),

[jira] [Commented] (SPARK-3633) Fetches failure observed after SPARK-2711

[ https://issues.apache.org/jira/browse/SPARK-3633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159059#comment-14159059 ] Nishkam Ravi commented on SPARK-3633: - Quick update: reverting 4fde28c gets rid of the

[jira] [Updated] (SPARK-7959) Uneven distribution of receivers in the cluster

[ https://issues.apache.org/jira/browse/SPARK-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-7959: Attachment: Screen Shot 2015-05-29 at 3.52.01 PM.png > Uneven distribution of receivers in the clust

[jira] [Created] (SPARK-7959) Uneven distribution of receivers in the cluster

Nishkam Ravi created SPARK-7959: --- Summary: Uneven distribution of receivers in the cluster Key: SPARK-7959 URL: https://issues.apache.org/jira/browse/SPARK-7959 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7960) Serialization problem when multiple receivers are specified in a loop

Nishkam Ravi created SPARK-7960: --- Summary: Serialization problem when multiple receivers are specified in a loop Key: SPARK-7960 URL: https://issues.apache.org/jira/browse/SPARK-7960 Project: Spark

[jira] [Commented] (SPARK-7959) Uneven distribution of receivers in the cluster

[ https://issues.apache.org/jira/browse/SPARK-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566882#comment-14566882 ] Nishkam Ravi commented on SPARK-7959: - I see. There may be some confusion with regards

[jira] [Created] (SPARK-7988) Mechanism to control receiver scheduling

Nishkam Ravi created SPARK-7988: --- Summary: Mechanism to control receiver scheduling Key: SPARK-7988 URL: https://issues.apache.org/jira/browse/SPARK-7988 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-7959) Uneven distribution of receivers in the cluster

[ https://issues.apache.org/jira/browse/SPARK-7959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566891#comment-14566891 ] Nishkam Ravi commented on SPARK-7959: - New feature JIRA: https://issues.apache.org/jir

[jira] [Commented] (SPARK-7988) Mechanism to control receiver scheduling

[ https://issues.apache.org/jira/browse/SPARK-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566896#comment-14566896 ] Nishkam Ravi commented on SPARK-7988: - Receiver.preferredLocation already helps to som

[jira] [Commented] (SPARK-7988) Mechanism to control receiver scheduling

[ https://issues.apache.org/jira/browse/SPARK-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14566898#comment-14566898 ] Nishkam Ravi commented on SPARK-7988: - Feel free to assign this JIRA to me if needed.

[jira] [Commented] (SPARK-7960) Serialization problem when multiple receivers are specified in a loop

[ https://issues.apache.org/jira/browse/SPARK-7960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14568373#comment-14568373 ] Nishkam Ravi commented on SPARK-7960: - Yep, the problem persists. > Serialization pr

[jira] [Created] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

Nishkam Ravi created SPARK-1388: --- Summary: ConcurrentModificationException in hadoop_common exposed by Spark Key: SPARK-1388 URL: https://issues.apache.org/jira/browse/SPARK-1388 Project: Spark

[jira] [Updated] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

[ https://issues.apache.org/jira/browse/SPARK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1388: Attachment: Conf_Spark.patch > ConcurrentModificationException in hadoop_common exposed by Spark >

[jira] [Updated] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

[ https://issues.apache.org/jira/browse/SPARK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1388: Attachment: nravi_Conf_Spark-1388.patch > ConcurrentModificationException in hadoop_common exposed

[jira] [Updated] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

[ https://issues.apache.org/jira/browse/SPARK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1388: Attachment: (was: Conf_Spark.patch) > ConcurrentModificationException in hadoop_common exposed

[jira] [Commented] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

[ https://issues.apache.org/jira/browse/SPARK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957231#comment-13957231 ] Nishkam Ravi commented on SPARK-1388: - Here is a simple fix for this issue (patch atta

[jira] [Updated] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1097: Attachment: nravi_Conf_Spark-1388.patch > ConcurrentModificationException > ---

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957233#comment-13957233 ] Nishkam Ravi commented on SPARK-1097: - Attached is a patch for this issue. Verified wi

[jira] [Comment Edited] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957233#comment-13957233 ] Nishkam Ravi edited comment on SPARK-1097 at 4/2/14 1:30 AM: -

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957354#comment-13957354 ] Nishkam Ravi commented on SPARK-1097: - The problem should be solved at the root. This

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957958#comment-13957958 ] Nishkam Ravi commented on SPARK-1097: - We can consider putting a workaround in Spark a

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13958248#comment-13958248 ] Nishkam Ravi commented on SPARK-1097: - Patch submitted against Hadoop-10456. > Concur

[jira] [Created] (SPARK-1573) slight modification with regards to sbt/sbt test

Nishkam Ravi created SPARK-1573: --- Summary: slight modification with regards to sbt/sbt test Key: SPARK-1573 URL: https://issues.apache.org/jira/browse/SPARK-1573 Project: Spark Issue Type: Docu

[jira] [Created] (SPARK-1575) failing tests with master branch

Nishkam Ravi created SPARK-1575: --- Summary: failing tests with master branch Key: SPARK-1575 URL: https://issues.apache.org/jira/browse/SPARK-1575 Project: Spark Issue Type: Test Re

[jira] [Created] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

Nishkam Ravi created SPARK-1576: --- Summary: Passing of JAVA_OPTS to YARN on command line Key: SPARK-1576 URL: https://issues.apache.org/jira/browse/SPARK-1576 Project: Spark Issue Type: Improvem

[jira] [Updated] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1576: Description: JAVA_OPTS can be passed by using either env variables (i.e., SPARK_JAVA_OPTS) or as co

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977472#comment-13977472 ] Nishkam Ravi commented on SPARK-1576: - Attached is a patch for this. > Passing of JA

[jira] [Updated] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1576: Attachment: SPARK-1576.patch > Passing of JAVA_OPTS to YARN on command line > -

[jira] [Comment Edited] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977472#comment-13977472 ] Nishkam Ravi edited comment on SPARK-1576 at 4/22/14 9:35 PM: --

[jira] [Comment Edited] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977472#comment-13977472 ] Nishkam Ravi edited comment on SPARK-1576 at 4/22/14 9:36 PM: --

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977906#comment-13977906 ] Nishkam Ravi commented on SPARK-1576: - Hi Sandy, I've initiated a pull request for thi

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977922#comment-13977922 ] Nishkam Ravi commented on SPARK-1576: - https://github.com/apache/spark/pull/492 > Pas

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979173#comment-13979173 ] Nishkam Ravi commented on SPARK-1576: - Bit of a race condition here it seems. Patrick

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979184#comment-13979184 ] Nishkam Ravi commented on SPARK-1576: - Thomas, --driver-java-options would not work wi

[jira] [Commented] (SPARK-1573) slight modification with regards to sbt/sbt test

[ https://issues.apache.org/jira/browse/SPARK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980015#comment-13980015 ] Nishkam Ravi commented on SPARK-1573: - In the documentation at the bottom of this page

[jira] [Commented] (SPARK-1575) failing tests with master branch

[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13980017#comment-13980017 ] Nishkam Ravi commented on SPARK-1575: - I get similar results. Tests are failing for ot

[jira] [Updated] (SPARK-1575) failing tests with master branch

[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1575: Priority: Blocker (was: Major) > failing tests with master branch > -

[jira] [Commented] (SPARK-1576) Passing of JAVA_OPTS to YARN on command line

[ https://issues.apache.org/jira/browse/SPARK-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13981473#comment-13981473 ] Nishkam Ravi commented on SPARK-1576: - We have been using SPARK_JAVA_OPTS and JAVA_OPT

[jira] [Commented] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992555#comment-13992555 ] Nishkam Ravi commented on SPARK-1758: - The prefix "file:" is missing in the string ins

[jira] [Commented] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992561#comment-13992561 ] Nishkam Ravi commented on SPARK-1758: - Pull requests: https://github.com/apache/spark

[jira] [Commented] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992556#comment-13992556 ] Nishkam Ravi commented on SPARK-1758: - Related with SPARK-1575 > failing test org.apa

[jira] [Commented] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992985#comment-13992985 ] Nishkam Ravi commented on SPARK-1758: - Keeping only pull request 692 open. > failing

[jira] [Created] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

Nishkam Ravi created SPARK-1758: --- Summary: failing test org.apache.spark.JavaAPISuite.wholeTextFiles Key: SPARK-1758 URL: https://issues.apache.org/jira/browse/SPARK-1758 Project: Spark Issue T

[jira] [Updated] (SPARK-1758) failing test org.apache.spark.JavaAPISuite.wholeTextFiles

[ https://issues.apache.org/jira/browse/SPARK-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishkam Ravi updated SPARK-1758: Attachment: SPARK-1758.patch > failing test org.apache.spark.JavaAPISuite.wholeTextFiles >

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020353#comment-14020353 ] Nishkam Ravi commented on SPARK-1097: - Have initiated a PR for a workaround in Spark a

[jira] [Created] (SPARK-2151) spark-submit issue (int format expected for memory parameter)

Nishkam Ravi created SPARK-2151: --- Summary: spark-submit issue (int format expected for memory parameter) Key: SPARK-2151 URL: https://issues.apache.org/jira/browse/SPARK-2151 Project: Spark Is

[jira] [Commented] (SPARK-2151) spark-submit issue (int format expected for memory parameter)

[ https://issues.apache.org/jira/browse/SPARK-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032133#comment-14032133 ] Nishkam Ravi commented on SPARK-2151: - PR: https://github.com/apache/spark/pull/1095/

[jira] [Created] (SPARK-2398) Trouble running Spark 1.0 on Yarn

Nishkam Ravi created SPARK-2398: --- Summary: Trouble running Spark 1.0 on Yarn Key: SPARK-2398 URL: https://issues.apache.org/jira/browse/SPARK-2398 Project: Spark Issue Type: Bug Comp

[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14055637#comment-14055637 ] Nishkam Ravi commented on SPARK-2398: - Thanks [~gq], looks related. I can see the foll

  1   2   >