[jira] [Updated] (SPARK-6959) Support for datetime comparisions in filter for dataframes in pyspark

[ https://issues.apache.org/jira/browse/SPARK-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6959: --- Issue Type: Improvement (was: Bug) > Support for datetime comparisions in filter for datafram

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502323#comment-14502323 ] Patrick Wendell commented on SPARK-3630: [~arahuja] If you are able to upgrade th

[jira] [Updated] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6968: --- Component/s: SQL > Make maniuplating an underlying RDD of a DataFrame easier > ---

[jira] [Updated] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6968: --- Component/s: (was: Spark Core) > Make maniuplating an underlying RDD of a DataFrame easier

[jira] [Updated] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6968: --- Priority: Critical (was: Minor) > Make maniuplating an underlying RDD of a DataFrame easier >

[jira] [Updated] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6968: --- Labels: (was: DataFrame) > Make maniuplating an underlying RDD of a DataFrame easier > -

[jira] [Updated] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6968: --- Priority: Minor (was: Critical) > Make maniuplating an underlying RDD of a DataFrame easier >

[jira] [Commented] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502386#comment-14502386 ] Patrick Wendell commented on SPARK-6968: So coalesce() is added to the DataFrame d

[jira] [Comment Edited] (SPARK-6968) Make maniuplating an underlying RDD of a DataFrame easier

[ https://issues.apache.org/jira/browse/SPARK-6968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502386#comment-14502386 ] Patrick Wendell edited comment on SPARK-6968 at 4/20/15 5:56 AM: ---

[jira] [Resolved] (SPARK-2044) Pluggable interface for shuffles

[ https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2044. Resolution: Fixed Fix Version/s: 1.1.2 > Pluggable interface for shuffles > -

[jira] [Updated] (SPARK-2044) Pluggable interface for shuffles

[ https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2044: --- Fix Version/s: (was: 1.1.2) 1.1.0 > Pluggable interface for shuffles >

[jira] [Comment Edited] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504442#comment-14504442 ] Patrick Wendell edited comment on SPARK-5081 at 4/21/15 6:36 AM: ---

[jira] [Resolved] (SPARK-5081) Shuffle write increases

[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5081. Resolution: Duplicate I'm pretty sure this is fixed via SPARK-6905. Closing this and we can

[jira] [Updated] (SPARK-7027) Spark 1.2.2 Hadoop 2.4 download is missing

[ https://issues.apache.org/jira/browse/SPARK-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7027: --- Summary: Spark 1.2.2 Hadoop 2.4 download is missing (was: Spark 1.2.2 Hadoop 2.4 download doe

[jira] [Updated] (SPARK-7027) Spark 1.2.2 Hadoop 2.4 download is missing

[ https://issues.apache.org/jira/browse/SPARK-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7027: --- Priority: Critical (was: Major) > Spark 1.2.2 Hadoop 2.4 download is missing > --

[jira] [Resolved] (SPARK-7030) spark-submit in cluster mode with supervisor flag, not able to transfer application jar to driver node

[ https://issues.apache.org/jira/browse/SPARK-7030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7030. Resolution: Invalid This is filed as a bug report, but this is not currently a feature (in

[jira] [Assigned] (SPARK-7027) Spark 1.2.2 Hadoop 2.4 download is missing

[ https://issues.apache.org/jira/browse/SPARK-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-7027: -- Assignee: Patrick Wendell > Spark 1.2.2 Hadoop 2.4 download is missing > --

[jira] [Updated] (SPARK-7020) Restrict module testing based on commit contents

[ https://issues.apache.org/jira/browse/SPARK-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7020: --- Priority: Critical (was: Major) > Restrict module testing based on commit contents >

[jira] [Updated] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7016: --- Priority: Critical (was: Major) > Refactor dev/run-tests(-jenkins) from Bash to Python >

[jira] [Updated] (SPARK-6990) Add Java linting script

[ https://issues.apache.org/jira/browse/SPARK-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6990: --- Labels: starter (was: ) > Add Java linting script > --- > >

[jira] [Commented] (SPARK-6980) Akka timeout exceptions indicate which conf controls them

[ https://issues.apache.org/jira/browse/SPARK-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505404#comment-14505404 ] Patrick Wendell commented on SPARK-6980: [~harshg] I just assigned you > Akka tim

[jira] [Updated] (SPARK-6980) Akka timeout exceptions indicate which conf controls them

[ https://issues.apache.org/jira/browse/SPARK-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6980: --- Assignee: Harsh Gupta > Akka timeout exceptions indicate which conf controls them > --

[jira] [Updated] (SPARK-6958) Add Pandas style sort operator

[ https://issues.apache.org/jira/browse/SPARK-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6958: --- Summary: Add Pandas style sort operator (was: sort) > Add Pandas style sort operator > --

[jira] [Updated] (SPARK-6957) Add Pandas style group by operator

[ https://issues.apache.org/jira/browse/SPARK-6957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6957: --- Summary: Add Pandas style group by operator (was: groupby) > Add Pandas style group by operat

[jira] [Resolved] (SPARK-6995) Spark driver program throws exception cant get Master Kerberose principal for use as renewer

[ https://issues.apache.org/jira/browse/SPARK-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6995. Resolution: Invalid Can you reach out on the user list with this question? Thanks! > Spark

[jira] [Resolved] (SPARK-7027) Spark 1.2.2 Hadoop 2.4 download is missing

[ https://issues.apache.org/jira/browse/SPARK-7027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7027. Resolution: Fixed Fix Version/s: 1.2.2 It's fixed now, but will take several hours to

[jira] [Closed] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-1684. -- Resolution: Fixed Fix Version/s: 1.4.0 > Merge script should standardize SPARK-XXX prefix

[jira] [Updated] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1684: --- Assignee: Michelle Casbon (was: Patrick Wendell) > Merge script should standardize SPARK-XXX

[jira] [Commented] (SPARK-6889) Streamline contribution process with update to Contribution wiki, JIRA rules

[ https://issues.apache.org/jira/browse/SPARK-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14506195#comment-14506195 ] Patrick Wendell commented on SPARK-6889: Hey Sean - I just read over your changes

[jira] [Updated] (SPARK-7063) when lz4 compression is used, it causes core dump

[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7063: --- Environment: IBM JDK > when lz4 compression is used, it causes core dump > ---

[jira] [Resolved] (SPARK-7054) Spark jobs hang for ~15 mins when a node goes down

[ https://issues.apache.org/jira/browse/SPARK-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7054. Resolution: Invalid Hey There, Please send this to the Spark users list to get feedback and

[jira] [Resolved] (SPARK-7062) Parquet compression does not work for Spark SQL loading

[ https://issues.apache.org/jira/browse/SPARK-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7062. Resolution: Duplicate > Parquet compression does not work for Spark SQL loading > --

[jira] [Commented] (SPARK-7065) Clear the cached locations mapping after every stage to avoid inconsistent status

[ https://issues.apache.org/jira/browse/SPARK-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508433#comment-14508433 ] Patrick Wendell commented on SPARK-7065: It would be helpful to have a bit more de

[jira] [Updated] (SPARK-7065) Clear the cached locations mapping after every stage to avoid inconsistent status

[ https://issues.apache.org/jira/browse/SPARK-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7065: --- Component/s: Spark Core > Clear the cached locations mapping after every stage to avoid incons

[jira] [Updated] (SPARK-7064) Adding binary sparse vector support

[ https://issues.apache.org/jira/browse/SPARK-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7064: --- Component/s: ML > Adding binary sparse vector support > --- >

[jira] [Updated] (SPARK-6921) Spark SQL API "saveAsParquetFile" will output tachyon file with different block size

[ https://issues.apache.org/jira/browse/SPARK-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6921: --- Priority: Critical (was: Blocker) > Spark SQL API "saveAsParquetFile" will output tachyon fil

[jira] [Updated] (SPARK-6479) Create external block store API

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6479: --- Target Version/s: 1.4.0 > Create external block store API > --- >

[jira] [Updated] (SPARK-7103) SparkContext.union crashed when some RDDs have no partitioner

[ https://issues.apache.org/jira/browse/SPARK-7103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7103: --- Priority: Critical (was: Minor) > SparkContext.union crashed when some RDDs have no partition

[jira] [Updated] (SPARK-7103) SparkContext.union crashed when some RDDs have no partitioner

[ https://issues.apache.org/jira/browse/SPARK-7103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7103: --- Target Version/s: 1.3.2, 1.4.0 > SparkContext.union crashed when some RDDs have no partitioner

[jira] [Updated] (SPARK-7120) ClosureCleaner lacks documentation

[ https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7120: --- Issue Type: Improvement (was: Bug) > ClosureCleaner lacks documentation > ---

[jira] [Commented] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511687#comment-14511687 ] Patrick Wendell commented on SPARK-7108: Ping [~vanzin] who authored SPARK-4834 >

[jira] [Commented] (SPARK-7103) SparkContext.union crashed when some RDDs have no partitioner

[ https://issues.apache.org/jira/browse/SPARK-7103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511689#comment-14511689 ] Patrick Wendell commented on SPARK-7103: Escalated the priority since IMO this is

[jira] [Commented] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512272#comment-14512272 ] Patrick Wendell commented on SPARK-6961: Hey [~bogdannb] - so Spark actually uses

[jira] [Updated] (SPARK-7123) support table.star in sqlcontext

[ https://issues.apache.org/jira/browse/SPARK-7123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7123: --- Issue Type: New Feature (was: Bug) > support table.star in sqlcontext > -

[jira] [Commented] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512280#comment-14512280 ] Patrick Wendell commented on SPARK-7108: Hey I think [~joshrosen] actually miswrot

[jira] [Comment Edited] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512280#comment-14512280 ] Patrick Wendell edited comment on SPARK-7108 at 4/25/15 6:01 AM: ---

[jira] [Comment Edited] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14512280#comment-14512280 ] Patrick Wendell edited comment on SPARK-7108 at 4/25/15 6:02 AM: ---

[jira] [Updated] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7108: --- Summary: spark.local.dir is no longer honored in Standalone mode (was: Setting spark.local.di

[jira] [Reopened] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-6752: I had to revert this because it caused test failures with the Hadoop 1.0 build. To reproduce th

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514403#comment-14514403 ] Patrick Wendell commented on SPARK-7108: Hey Marcelo, Your interpretation of the

[jira] [Comment Edited] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514403#comment-14514403 ] Patrick Wendell edited comment on SPARK-7108 at 4/27/15 4:33 PM: ---

[jira] [Resolved] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4925. Resolution: Fixed Fix Version/s: 1.3.1 1.4.0 > Publish Spark SQL h

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514822#comment-14514822 ] Patrick Wendell commented on SPARK-7108: Yes - the case I'm referring to is the fo

[jira] [Comment Edited] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514822#comment-14514822 ] Patrick Wendell edited comment on SPARK-7108 at 4/27/15 7:50 PM: ---

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514862#comment-14514862 ] Patrick Wendell commented on SPARK-7108: I see - when I wrote that, I meant it to

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14514865#comment-14514865 ] Patrick Wendell commented on SPARK-7108: Actually to correct what I said - it is n

[jira] [Commented] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14516536#comment-14516536 ] Patrick Wendell commented on SPARK-7180: /cc [~rxin] > SerializationDebugger fail

[jira] [Created] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

Patrick Wendell created SPARK-7204: -- Summary: Call sites in UI are not accurate for DataFrame operations Key: SPARK-7204 URL: https://issues.apache.org/jira/browse/SPARK-7204 Project: Spark

[jira] [Resolved] (SPARK-7205) Support local ivy cache in --packages

[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7205. Resolution: Fixed Assignee: Burak Yavuz > Support local ivy cache in --packages >

[jira] [Updated] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7213: --- Component/s: YARN > Exception while copying Hadoop config files due to permission issues > ---

[jira] [Updated] (SPARK-7224) Mock repositories for testing with --packages

[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7224: --- Assignee: Burak Yavuz > Mock repositories for testing with --packages > --

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520058#comment-14520058 ] Patrick Wendell commented on SPARK-7230: I think this is a good idea. We should ex

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7237: --- Component/s: Spark Core > Many user provided closures are not actually cleaned > -

[jira] [Updated] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7233: --- Priority: Critical (was: Major) > ClosureCleaner#clean blocks concurrent job submitter thread

[jira] [Updated] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7233: --- Target Version/s: 1.4.0 > ClosureCleaner#clean blocks concurrent job submitter threads > -

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520202#comment-14520202 ] Patrick Wendell commented on SPARK-7233: Thanks this is a great find. As a simple

[jira] [Created] (SPARK-7260) Support changing Spark's log level programatically

Patrick Wendell created SPARK-7260: -- Summary: Support changing Spark's log level programatically Key: SPARK-7260 URL: https://issues.apache.org/jira/browse/SPARK-7260 Project: Spark Issue Ty

[jira] [Created] (SPARK-7261) Change default log level to WARN in the REPL

Patrick Wendell created SPARK-7261: -- Summary: Change default log level to WARN in the REPL Key: SPARK-7261 URL: https://issues.apache.org/jira/browse/SPARK-7261 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520368#comment-14520368 ] Patrick Wendell commented on SPARK-7233: I think we should just create a lazy val

[jira] [Commented] (SPARK-4399) Support multiple cloud providers

[ https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214153#comment-14214153 ] Patrick Wendell commented on SPARK-4399: I think this might actually be "out of sc

[jira] [Created] (SPARK-4445) Don't display storage level in toDebugString unless RDD is persisted

Patrick Wendell created SPARK-4445: -- Summary: Don't display storage level in toDebugString unless RDD is persisted Key: SPARK-4445 URL: https://issues.apache.org/jira/browse/SPARK-4445 Project: Spark

[jira] [Updated] (SPARK-4445) Don't display storage level in toDebugString unless RDD is persisted

[ https://issues.apache.org/jira/browse/SPARK-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4445: --- Issue Type: Bug (was: Improvement) > Don't display storage level in toDebugString unless RDD

[jira] [Updated] (SPARK-3962) Mark spark dependency as "provided" in external libraries

[ https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3962: --- Issue Type: Bug (was: Improvement) > Mark spark dependency as "provided" in external librarie

[jira] [Commented] (SPARK-3962) Mark spark dependency as "provided" in external libraries

[ https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14214480#comment-14214480 ] Patrick Wendell commented on SPARK-3962: I think this is causing the build to fail

[jira] [Resolved] (SPARK-4445) Don't display storage level in toDebugString unless RDD is persisted

[ https://issues.apache.org/jira/browse/SPARK-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4445. Resolution: Fixed Fix Version/s: 1.2.0 > Don't display storage level in toDebugString

[jira] [Updated] (SPARK-2811) update algebird to 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2811: --- Assignee: Adam Pingel > update algebird to 0.8.1 > > >

[jira] [Resolved] (SPARK-2811) update algebird to 0.8.1

[ https://issues.apache.org/jira/browse/SPARK-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2811. Resolution: Fixed Fix Version/s: 1.2.0 > update algebird to 0.8.1 > -

[jira] [Updated] (SPARK-4180) SparkContext constructor should throw exception if another SparkContext is already running

[ https://issues.apache.org/jira/browse/SPARK-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4180: --- Fix Version/s: 1.2.0 > SparkContext constructor should throw exception if another SparkContext

[jira] [Created] (SPARK-4466) Provide support for publishing Scala 2.11 artifacts to Maven

Patrick Wendell created SPARK-4466: -- Summary: Provide support for publishing Scala 2.11 artifacts to Maven Key: SPARK-4466 URL: https://issues.apache.org/jira/browse/SPARK-4466 Project: Spark

[jira] [Updated] (SPARK-4466) Provide support for publishing Scala 2.11 artifacts to Maven

[ https://issues.apache.org/jira/browse/SPARK-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4466: --- Assignee: Patrick Wendell > Provide support for publishing Scala 2.11 artifacts to Maven > ---

[jira] [Updated] (SPARK-4286) Support External Shuffle Service with Mesos integration

[ https://issues.apache.org/jira/browse/SPARK-4286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4286: --- Assignee: Timothy Chen > Support External Shuffle Service with Mesos integration > ---

[jira] [Resolved] (SPARK-4466) Provide support for publishing Scala 2.11 artifacts to Maven

[ https://issues.apache.org/jira/browse/SPARK-4466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4466. Resolution: Fixed Fix Version/s: 1.2.0 > Provide support for publishing Scala 2.11 ar

[jira] [Resolved] (SPARK-4017) Progress bar in console

[ https://issues.apache.org/jira/browse/SPARK-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4017. Resolution: Fixed Fix Version/s: 1.2.0 > Progress bar in console > --

[jira] [Updated] (SPARK-4377) ZooKeeperPersistenceEngine: java.lang.IllegalStateException: Trying to deserialize a serialized ActorRef without an ActorSystem in scope.

[ https://issues.apache.org/jira/browse/SPARK-4377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4377: --- Target Version/s: 1.2.0 > ZooKeeperPersistenceEngine: java.lang.IllegalStateException: Trying

[jira] [Resolved] (SPARK-4281) Yarn shuffle service jars need to include dependencies

[ https://issues.apache.org/jira/browse/SPARK-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4281. Resolution: Fixed Fix Version/s: 1.2.0 > Yarn shuffle service jars need to include de

[jira] [Updated] (SPARK-4452) Shuffle data structures can starve others on the same thread for memory

[ https://issues.apache.org/jira/browse/SPARK-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4452: --- Component/s: Spark Core > Shuffle data structures can starve others on the same thread for mem

[jira] [Reopened] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4404: > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process > ends > ---

[jira] [Closed] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-4404. -- Resolution: Fixed > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process

[jira] [Resolved] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4404. Resolution: Fixed > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-proc

[jira] [Closed] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-4404. -- > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process > ends > ---

[jira] [Reopened] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4404: > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process > ends > ---

[jira] [Resolved] (SPARK-4404) SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-process ends

[ https://issues.apache.org/jira/browse/SPARK-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4404. Resolution: Fixed > SparkSubmitDriverBootstrapper should stop after its SparkSubmit sub-proc

[jira] [Updated] (SPARK-3511) Create a RELEASE-NOTES.txt file in the repo

[ https://issues.apache.org/jira/browse/SPARK-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3511: --- Target Version/s: 1.3.0 (was: 1.2.0) > Create a RELEASE-NOTES.txt file in the repo >

[jira] [Resolved] (SPARK-4441) Close Tachyon client when TachyonBlockManager is shut down

[ https://issues.apache.org/jira/browse/SPARK-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4441. Resolution: Fixed Fix Version/s: 1.2.0 > Close Tachyon client when TachyonBlockManage

[jira] [Resolved] (SPARK-4432) Resource(InStream) is not closed in TachyonStore

[ https://issues.apache.org/jira/browse/SPARK-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4432. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: shimingfei > Resource(InStr

[jira] [Updated] (SPARK-4441) Close Tachyon client when TachyonBlockManager is shut down

[ https://issues.apache.org/jira/browse/SPARK-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4441: --- Assignee: shimingfei > Close Tachyon client when TachyonBlockManager is shut down > --

[jira] [Resolved] (SPARK-4455) Exclude dependency on hbase-annotations module

[ https://issues.apache.org/jira/browse/SPARK-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4455. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Ted Yu > Exclude dependency

[jira] [Commented] (SPARK-2321) Design a proper progress reporting & event listener API

[ https://issues.apache.org/jira/browse/SPARK-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218502#comment-14218502 ] Patrick Wendell commented on SPARK-2321: Currently this a programmatic API for Spa

[jira] [Resolved] (SPARK-3962) Mark spark dependency as "provided" in external libraries

[ https://issues.apache.org/jira/browse/SPARK-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3962. Resolution: Fixed Fix Version/s: 1.2.0 > Mark spark dependency as "provided" in exter

[jira] [Resolved] (SPARK-4429) Build for Scala 2.11 using sbt fails.

[ https://issues.apache.org/jira/browse/SPARK-4429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-4429. Resolution: Fixed Fix Version/s: 1.2.0 Assignee: Takuya Ueshin T

<    1   2   3   4   5   6   7   8   9   10   >