[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Affects Version/s: (was: 1.4.2) (was: 1.4.1) > Fail to upload conf archive

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Fix Version/s: (was: 1.4.2) > Fail to upload conf archive to viewfs >

[jira] [Updated] (SPARK-8657) Fail to upload conf archive to viewfs

[ https://issues.apache.org/jira/browse/SPARK-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8657: - Target Version/s: 1.5.0, 1.4.2 (was: 1.4.2) > Fail to upload conf archive to viewfs > ---

[jira] [Closed] (SPARK-8019) [SparkR] Create worker R processes with a command other then Rscript

[ https://issues.apache.org/jira/browse/SPARK-8019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8019. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > [SparkR] Create worker R p

[jira] [Closed] (SPARK-8410) Hive VersionsSuite RuntimeException

[ https://issues.apache.org/jira/browse/SPARK-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8410. Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 Target Version/s: 1.5.0,

[jira] [Closed] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8475. Resolution: Fixed Fix Version/s: 1.4.2 1.5.0 > SparkSubmit with Ivy jars is very s

[jira] [Updated] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8475: - Assignee: Burak Yavuz > SparkSubmit with Ivy jars is very slow to load with no internet access > -

[jira] [Closed] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8437. Resolution: Fixed Assignee: Sean Owen Fix Version/s: 1.4.2 1.5

[jira] [Commented] (SPARK-8437) Using directory path without wildcard for filename slow for large number of files with wholeTextFiles and binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-8437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606721#comment-14606721 ] Andrew Or commented on SPARK-8437: -- The merged PR involves only documentation changes. I

[jira] [Closed] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7287. Resolution: Fixed Assignee: Yin Huai (was: Burak Yavuz) Fix Version/s: 1.5.0

[jira] [Updated] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7287: - Target Version/s: 1.5.0, 1.4.2 (was: 1.4.0) > Flaky test: o.a.s.deploy.SparkSubmitSuite --packages >

[jira] [Closed] (SPARK-8634) Fix flaky test StreamingListenerSuite "receiver info reporting"

[ https://issues.apache.org/jira/browse/SPARK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8634. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.4.2

[jira] [Closed] (SPARK-4069) [SPARK-YARN] ApplicationMaster should release all executors' containers before unregistering itself from Yarn RM

[ https://issues.apache.org/jira/browse/SPARK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-4069. Resolution: Won't Fix > [SPARK-YARN] ApplicationMaster should release all executors' containers > before un

[jira] [Commented] (SPARK-4069) [SPARK-YARN] ApplicationMaster should release all executors' containers before unregistering itself from Yarn RM

[ https://issues.apache.org/jira/browse/SPARK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606701#comment-14606701 ] Andrew Or commented on SPARK-4069: -- Fixed in YARN-3415. > [SPARK-YARN] ApplicationMaster

[jira] [Comment Edited] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606698#comment-14606698 ] Andrew Or edited comment on SPARK-8130 at 6/30/15 12:07 AM: Se

[jira] [Closed] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8130. Resolution: Won't Fix See discussion on https://github.com/apache/spark/pull/7051 > spark.files.useFetchCac

[jira] [Commented] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606693#comment-14606693 ] Andrew Or commented on SPARK-8716: -- I've updated the description. Thanks for your input [

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Description: More specifically, this is the feature that is currently flagged by `spark.files.useFetchCac

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Summary: Write tests for executor shared cache feature (was: Remove executor shared cache feature) > Wri

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Assignee: (was: Josh Rosen) > Write tests for executor shared cache feature >

[jira] [Commented] (SPARK-8716) Remove executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606682#comment-14606682 ] Andrew Or commented on SPARK-8716: -- Hm, I think you're right. Otherwise there's no way fo

[jira] [Commented] (SPARK-8716) Remove executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606657#comment-14606657 ] Andrew Or commented on SPARK-8716: -- [~vanzin] doesn't each executor container get its own

[jira] [Updated] (SPARK-8716) Remove executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8716: - Priority: Major (was: Minor) > Remove executor shared cache feature > ---

[jira] [Created] (SPARK-8716) Remove executor shared cache feature

Andrew Or created SPARK-8716: Summary: Remove executor shared cache feature Key: SPARK-8716 URL: https://issues.apache.org/jira/browse/SPARK-8716 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-8634) Fix flaky test StreamingListenerSuite "receiver info reporting"

[ https://issues.apache.org/jira/browse/SPARK-8634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8634: - Priority: Critical (was: Minor) > Fix flaky test StreamingListenerSuite "receiver info reporting" > -

[jira] [Updated] (SPARK-8130) spark.files.useFetchCache should be off by default

[ https://issues.apache.org/jira/browse/SPARK-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8130: - Affects Version/s: 1.2.0 > spark.files.useFetchCache should be off by default > --

[jira] [Commented] (SPARK-8691) Enable GZip for Web UI

[ https://issues.apache.org/jira/browse/SPARK-8691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606121#comment-14606121 ] Andrew Or commented on SPARK-8691: -- Is this the same as SPARK-7716? > Enable GZip for We

[jira] [Updated] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8705: - Target Version/s: 1.5.0, 1.4.2 > Javascript error in the web console when `totalExecutionTime` of a task i

[jira] [Updated] (SPARK-8705) Javascript error in the web console when `totalExecutionTime` of a task is 0

[ https://issues.apache.org/jira/browse/SPARK-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8705: - Affects Version/s: 1.4.0 > Javascript error in the web console when `totalExecutionTime` of a task is 0 >

[jira] [Updated] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8372: - Fix Version/s: (was: 1.4.1) (was: 1.5.0) > History server shows incorrect infor

[jira] [Commented] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605996#comment-14605996 ] Andrew Or commented on SPARK-8372: -- OK, per discussion on the #6827 I reverted this. > H

[jira] [Reopened] (SPARK-8372) History server shows incorrect information for application not started

[ https://issues.apache.org/jira/browse/SPARK-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-8372: -- Assignee: Marcelo Vanzin (was: Carson Wang) > History server shows incorrect information for applicat

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Fix Version/s: 1.4.1 > Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars > --

[jira] [Closed] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8567. Resolution: Fixed Fix Version/s: 1.5.0 > Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars > ---

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) > Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars > --

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600229#comment-14600229 ] Andrew Or commented on SPARK-7292: -- Posted a short design doc. I'm going to go ahead and

[jira] [Updated] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7292: - Attachment: SPARK-7292-design.pdf > Provide operator to truncate lineage without persisting RDD's > --

[jira] [Created] (SPARK-8584) Better exception message if invalid checkpoint dir is specified

Andrew Or created SPARK-8584: Summary: Better exception message if invalid checkpoint dir is specified Key: SPARK-8584 URL: https://issues.apache.org/jira/browse/SPARK-8584 Project: Spark Issue

[jira] [Updated] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8582: - Description: In Spark, checkpointing allows the user to truncate the lineage of his RDD and save the inte

[jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

[ https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14598692#comment-14598692 ] Andrew Or commented on SPARK-8582: -- [~tdas] also wants this. > Optimize checkpointing to

[jira] [Created] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice

Andrew Or created SPARK-8582: Summary: Optimize checkpointing to avoid computing an RDD twice Key: SPARK-8582 URL: https://issues.apache.org/jira/browse/SPARK-8582 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8581) Simplify and clean up the checkpointing code

Andrew Or created SPARK-8581: Summary: Simplify and clean up the checkpointing code Key: SPARK-8581 URL: https://issues.apache.org/jira/browse/SPARK-8581 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Component/s: Web UI > The Executors page will have negative if having resubmitted tasks >

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Assignee: Matt Cheah (was: Matthew Cheah) > Tasks that fail due to YARN preemption can cause job failure

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Assignee: Matthew Cheah > Tasks that fail due to YARN preemption can cause job failure > -

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Target Version/s: 1.4.1, 1.5.0 > The Executors page will have negative if having resubmitted tasks > -

[jira] [Updated] (SPARK-8560) The Executors page will have negative if having resubmitted tasks

[ https://issues.apache.org/jira/browse/SPARK-8560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8560: - Affects Version/s: 1.0.0 > The Executors page will have negative if having resubmitted tasks > ---

[jira] [Updated] (SPARK-8567) HiveSparkSubmitSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Priority: Critical (was: Major) > HiveSparkSubmitSuite is flaky > - > >

[jira] [Updated] (SPARK-8567) Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Summary: Flaky test: o.a.s.sql.hive.HiveSparkSubmitSuite --jars (was: HiveSparkSubmitSuite is flaky) > F

[jira] [Updated] (SPARK-8567) HiveSparkSubmitSuite is flaky

[ https://issues.apache.org/jira/browse/SPARK-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8567: - Labels: flaky-test (was: ) > HiveSparkSubmitSuite is flaky > - > >

[jira] [Updated] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7292: - Target Version/s: 1.5.0 > Provide operator to truncate lineage without persisting RDD's >

[jira] [Created] (SPARK-8496) Do not run slow tests for every PR

Andrew Or created SPARK-8496: Summary: Do not run slow tests for every PR Key: SPARK-8496 URL: https://issues.apache.org/jira/browse/SPARK-8496 Project: Spark Issue Type: Bug Components

[jira] [Comment Edited] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593954#comment-14593954 ] Andrew Or edited comment on SPARK-8470 at 6/19/15 9:19 PM: --- Clos

[jira] [Closed] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8470. Resolution: Duplicate > MissingRequirementError for ScalaReflection on user classes > --

[jira] [Reopened] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reopened SPARK-8470: -- > MissingRequirementError for ScalaReflection on user classes >

[jira] [Commented] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593954#comment-14593954 ] Andrew Or commented on SPARK-8470: -- Closing this as FIXED. We will add the regression tes

[jira] [Closed] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8470. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > MissingRequirementError for ScalaRe

[jira] [Created] (SPARK-8489) Add regression tests for SPARK-8470

Andrew Or created SPARK-8489: Summary: Add regression tests for SPARK-8470 Key: SPARK-8489 URL: https://issues.apache.org/jira/browse/SPARK-8489 Project: Spark Issue Type: Bug Component

[jira] [Commented] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593948#comment-14593948 ] Andrew Or commented on SPARK-8470: -- Update: I verified that this is actually already fixe

[jira] [Comment Edited] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593927#comment-14593927 ] Andrew Or edited comment on SPARK-8470 at 6/19/15 8:36 PM: --- FYI,

[jira] [Comment Edited] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593927#comment-14593927 ] Andrew Or edited comment on SPARK-8470 at 6/19/15 8:35 PM: --- FYI,

[jira] [Commented] (SPARK-8470) MissingRequirementError for ScalaReflection on user classes

[ https://issues.apache.org/jira/browse/SPARK-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593927#comment-14593927 ] Andrew Or commented on SPARK-8470: -- FYI, I was able to reproduce this locally. I was able

[jira] [Closed] (SPARK-5290) Executing functions in sparkSQL registered in sqlcontext gives scala.reflect.internal.MissingRequirementError: class org.apache.spark.sql.catalyst.ScalaReflection

[ https://issues.apache.org/jira/browse/SPARK-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-5290. Resolution: Duplicate > Executing functions in sparkSQL registered in sqlcontext gives > scala.reflect.inte

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Fix Version/s: 1.4.1 > SerializationDebugger does not handle classes with writeObject method > ---

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) > SerializationDebugger does not handle classes with writeObj

[jira] [Updated] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7180: - Fix Version/s: 1.4.1 > SerializationDebugger fails with ArrayOutOfBoundsException > --

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) > SerializationDebugger does not handle classes with writeRep

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Fix Version/s: 1.4.1 > SerializationDebugger does not handle classes with writeReplace correctly > ---

[jira] [Updated] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7180: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) > SerializationDebugger fails with ArrayOutOfBoundsException

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Priority: Major (was: Minor) > SerializationDebugger does not handle classes with writeReplace correctly

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593707#comment-14593707 ] Andrew Or commented on SPARK-7287: -- I'm going to keep this open for a while since we have

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593709#comment-14593709 ] Andrew Or commented on SPARK-7287: -- + and spend some time to actually rewrite it. > Flak

[jira] [Closed] (SPARK-8451) SparkSubmitSuite never checks for process exit code

[ https://issues.apache.org/jira/browse/SPARK-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8451. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 1.3.2 > SparkSubmi

[jira] [Closed] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8090. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.4.1) > Serializatio

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Target Version/s: (was: 1.4.1) > SerializationDebugger does not handle classes with writeObject method >

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Priority: Major (was: Minor) > SerializationDebugger does not handle classes with writeObject method > --

[jira] [Closed] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8091. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > SerializationDebugger does

[jira] [Closed] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7180. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > SerializationDebugger fail

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8469: - Attachment: Screen Shot 2015-06-18 at 5.51.21 PM.png > Application timeline view unreadable with many exec

[jira] [Updated] (SPARK-8469) Application timeline view unreadable with many executors

[ https://issues.apache.org/jira/browse/SPARK-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8469: - Description: This is a problem with using dynamic allocation with many executors. See screenshot. We may w

[jira] [Created] (SPARK-8469) Application timeline view unreadable with many executors

Andrew Or created SPARK-8469: Summary: Application timeline view unreadable with many executors Key: SPARK-8469 URL: https://issues.apache.org/jira/browse/SPARK-8469 Project: Spark Issue Type: Bu

[jira] [Updated] (SPARK-7968) Rename minPartitions to maxPartitions in wholeTextFiles/binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7968: - Component/s: (was: SQL) Spark Core > Rename minPartitions to maxPartitions in wholeTe

[jira] [Created] (SPARK-8451) SparkSubmitSuite never checks for process exit code

Andrew Or created SPARK-8451: Summary: SparkSubmitSuite never checks for process exit code Key: SPARK-8451 URL: https://issues.apache.org/jira/browse/SPARK-8451 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8387) [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all

[ https://issues.apache.org/jira/browse/SPARK-8387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8387: - Component/s: YARN > [SPARK][Web-UI] Only show 4096 bytes content for executor log instead all > --

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8368: - Assignee: Yin Huai > ClassNotFoundException in closure for map >

[jira] [Closed] (SPARK-8365) pyspark does not retain --packages or --jars passed on the command line as of 1.4.0

[ https://issues.apache.org/jira/browse/SPARK-8365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8365. Resolution: Duplicate This is caused by the same issue as SPARK-8368. This is because HiveContext overrides

[jira] [Updated] (SPARK-8430) ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8430: - Affects Version/s: 1.4.0 > ExternalShuffleBlockResolver should support UnsafeShuffleManager >

[jira] [Updated] (SPARK-8430) ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8430: - Priority: Critical (was: Major) > ExternalShuffleBlockResolver should support UnsafeShuffleManager >

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8447: - Priority: Critical (was: Blocker) > Test external shuffle service with all shuffle managers > ---

[jira] [Updated] (SPARK-8430) in Yarn's shuffle service ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8430: - Component/s: (was: YARN) Shuffle > in Yarn's shuffle service ExternalShuffleBlockReso

[jira] [Updated] (SPARK-8430) ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8430: - Summary: ExternalShuffleBlockResolver should support UnsafeShuffleManager (was: in Yarn's shuffle service

[jira] [Updated] (SPARK-8430) ExternalShuffleBlockResolver should support UnsafeShuffleManager

[ https://issues.apache.org/jira/browse/SPARK-8430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8430: - Assignee: Lianhui Wang > ExternalShuffleBlockResolver should support UnsafeShuffleManager > --

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8447: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) > Test external shuffle service with all shuffle managers > -

[jira] [Created] (SPARK-8447) Test external shuffle service with all shuffle managers

Andrew Or created SPARK-8447: Summary: Test external shuffle service with all shuffle managers Key: SPARK-8447 URL: https://issues.apache.org/jira/browse/SPARK-8447 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-8095) Spark package dependencies not resolved when package is in local-ivy-cache

[ https://issues.apache.org/jira/browse/SPARK-8095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8095: - Fix Version/s: 1.5.0 1.4.1 > Spark package dependencies not resolved when package is in

[jira] [Closed] (SPARK-8392) RDDOperationGraph: getting cached nodes is slow

[ https://issues.apache.org/jira/browse/SPARK-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8392. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Target Version/s: 1.4.1,

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Priority: Blocker (was: Critical) > Tasks that fail due to YARN preemption can cause job failure > --

[jira] [Updated] (SPARK-8167) Tasks that fail due to YARN preemption can cause job failure

[ https://issues.apache.org/jira/browse/SPARK-8167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8167: - Target Version/s: 1.5.0 > Tasks that fail due to YARN preemption can cause job failure > -

[jira] [Updated] (SPARK-8366) When task fails and append a new one, the ExecutorAllocationManager can't sense the new tasks

[ https://issues.apache.org/jira/browse/SPARK-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8366: - Affects Version/s: 1.4.0 > When task fails and append a new one, the ExecutorAllocationManager can't > se

[jira] [Closed] (SPARK-7913) Increase the maximum capacity of PartitionedPairBuffer, PartitionedSerializedPairBuffer and AppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7913. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Shixiong Zhu Target Version/s:

<    9   10   11   12   13   14   15   16   17   18   >