[jira] [Reopened] (SPARK-6876) DataFrame.na.replace value support for Python

[ https://issues.apache.org/jira/browse/SPARK-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-6876: DataFrame.na.replace value support for Python

[jira] [Resolved] (SPARK-7534) Fix the Stage table when a stage is missing

[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7534. Resolution: Fixed Fix the Stage table when a stage is missing

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Pending Closed Fix Version/s: 1.6.0 Issue resolved by pull request 5426

[jira] [Closed] (SPARK-7590) Test Issue to Debug JIRA Problem

[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-7590. -- Resolution: Invalid Test Issue to Debug JIRA Problem

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Fixed Issue resolved by pull request 5426 [https://github.com/apache/spark/pull

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: Test Issue to Debug JIRA Problem Key

[jira] [Reopened] (SPARK-7531) Install GPG on Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7531: Install GPG on Jenkins machines --- Key: SPARK

[jira] [Resolved] (SPARK-7276) withColumn is very slow on dataframe with large number of columns

[ https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7276. Resolution: Fixed withColumn is very slow on dataframe with large number of columns

[jira] [Reopened] (SPARK-2018) Big-Endian (IBM Power7) Spark Serialization issue

[ https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2018: Big-Endian (IBM Power7) Spark Serialization issue

[jira] [Closed] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-7552. -- Resolution: Fixed Close files correctly when iteration is finished in WAL recovery

[jira] [Reopened] (SPARK-7276) withColumn is very slow on dataframe with large number of columns

[ https://issues.apache.org/jira/browse/SPARK-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7276: withColumn is very slow on dataframe with large number of columns

[jira] [Resolved] (SPARK-2018) Big-Endian (IBM Power7) Spark Serialization issue

[ https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2018. Resolution: Fixed Big-Endian (IBM Power7) Spark Serialization issue

[jira] [Resolved] (SPARK-7487) Python API for ml.regression

[ https://issues.apache.org/jira/browse/SPARK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7487. Resolution: Fixed Python API for ml.regression

[jira] [Reopened] (SPARK-7487) Python API for ml.regression

[ https://issues.apache.org/jira/browse/SPARK-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7487: Python API for ml.regression Key: SPARK-7487

[jira] [Resolved] (SPARK-7531) Install GPG on Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7531. Resolution: Fixed Install GPG on Jenkins machines

[jira] [Resolved] (SPARK-7406) Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7406. Resolution: Fixed Add tooltips for Scheduling Delay, Processing Time and Total Delay

[jira] [Reopened] (SPARK-7406) Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7406: Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

[jira] [Reopened] (SPARK-7528) Java compatibility of RankingMetrics

[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7528: Java compatibility of RankingMetrics

[jira] [Reopened] (SPARK-7015) Multiclass to Binary Reduction

[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7015: Multiclass to Binary Reduction -- Key: SPARK

[jira] [Resolved] (SPARK-7528) Java compatibility of RankingMetrics

[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7528. Resolution: Fixed Java compatibility of RankingMetrics

[jira] [Resolved] (SPARK-7015) Multiclass to Binary Reduction

[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7015. Resolution: Fixed Multiclass to Binary Reduction

[jira] [Reopened] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7552: Close files correctly when iteration is finished in WAL recovery

[jira] [Resolved] (SPARK-7592) Resolution set to Pending Closed when using PR merge script

[ https://issues.apache.org/jira/browse/SPARK-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7592. Resolution: Fixed Fix Version/s: 1.4.0 Resolution set to Pending Closed when using

[jira] [Resolved] (SPARK-7508) JettyUtils-generated servlets to log report all errors

[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7508. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Steve Loughran JettyUtils

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539245#comment-14539245 ] Patrick Wendell commented on SPARK-7296: Actually maybe there is a chance we can

[jira] [Comment Edited] (SPARK-7296) Timeline view for Stage page

[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539240#comment-14539240 ] Patrick Wendell edited comment on SPARK-7296 at 5/12/15 4:53 AM

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.5.0 (was: 1.4.0) Timeline view for Stage page

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539240#comment-14539240 ] Patrick Wendell commented on SPARK-7296: Personally not sure I have time to review

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.4.0, 1.5.0 (was: 1.5.0) Timeline view for Stage page

[jira] [Commented] (SPARK-7531) Install GPG on Jenkins machines

[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539097#comment-14539097 ] Patrick Wendell commented on SPARK-7531: Yep - that one should work. I've actually

[jira] [Resolved] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7538. Resolution: Fixed This was a cross post from the mailing list. The poster closed the thread

[jira] [Resolved] (SPARK-7520) Install Jekyll On Jenkins Machines

[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7520. Resolution: Fixed Fix Version/s: 1.4.0 All green - awesome thanks [~shaneknapp

[jira] [Created] (SPARK-7531) Install GPG on Jenkins machines

Patrick Wendell created SPARK-7531: -- Summary: Install GPG on Jenkins machines Key: SPARK-7531 URL: https://issues.apache.org/jira/browse/SPARK-7531 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537530#comment-14537530 ] Patrick Wendell commented on SPARK-7520: Sounds good - thanks man. This build

[jira] [Created] (SPARK-7521) Allow all required release credentials to be specified with env vars

Patrick Wendell created SPARK-7521: -- Summary: Allow all required release credentials to be specified with env vars Key: SPARK-7521 URL: https://issues.apache.org/jira/browse/SPARK-7521 Project

[jira] [Comment Edited] (SPARK-7462) By default retain group by columns in aggregate

[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537494#comment-14537494 ] Patrick Wendell edited comment on SPARK-7462 at 5/11/15 2:08 AM

[jira] [Created] (SPARK-7520) Install Jekyll On Jenkins Machines

Patrick Wendell created SPARK-7520: -- Summary: Install Jekyll On Jenkins Machines Key: SPARK-7520 URL: https://issues.apache.org/jira/browse/SPARK-7520 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7462) By default retain group by columns in aggregate

[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537494#comment-14537494 ] Patrick Wendell commented on SPARK-7462: [~rxin] since this is a user facing

[jira] [Assigned] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1517: -- Assignee: Patrick Wendell Publish nightly snapshots of documentation, maven artifacts

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.4.0) Publish nightly snapshots of documentation, maven artifacts

[jira] [Updated] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7484: --- Issue Type: Improvement (was: Bug) Support passing jdbc connection properties

[jira] [Updated] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7435: --- Priority: Critical (was: Blocker) Make DataFrame.show() consistent with that of Scala

[jira] [Resolved] (SPARK-7393) How to improve Spark SQL performance?

[ https://issues.apache.org/jira/browse/SPARK-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7393. Resolution: Invalid Hi - thanks for giving feedback on your use of Spark SQL. This type

[jira] [Updated] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6961: --- Priority: Critical (was: Blocker) Cannot save data to parquet files when executing from

[jira] [Resolved] (SPARK-3454) Expose JSON representation of data shown in WebUI

[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3454. Resolution: Fixed Expose JSON representation of data shown in WebUI

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Component/s: Deploy Cannot implement nor use custom StandaloneRecoveryModeFactory

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Target Version/s: 1.3.2, 1.4.0 Cannot implement nor use custom StandaloneRecoveryModeFactory

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell commented on SPARK-4105: [~bherta] can you give a bit more

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:46 PM

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:47 PM

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529017#comment-14529017 ] Patrick Wendell commented on SPARK-7310: Ping [~andrewor14], IIRC there was a lot

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Assignee: Shixiong Zhu RpcCallContext.sender has a different name from the original sender's

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7348: --- Issue Type: Improvement (was: Bug) DAG visualization: add links to RDD page

[jira] [Updated] (SPARK-7349) DAG visualization: add legend to explain the content

[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7349: --- Issue Type: Improvement (was: Bug) DAG visualization: add legend to explain the content

[jira] [Updated] (SPARK-7347) DAG visualization: add hover to RDDs on job page

[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7347: --- Issue Type: Improvement (was: Bug) DAG visualization: add hover to RDDs on job page

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Target Version/s: 1.4.0 RpcCallContext.sender has a different name from the original

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Fix Version/s: (was: 1.3.2) (was: 1.4.0) RpcCallContext.sender

[jira] [Commented] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529011#comment-14529011 ] Patrick Wendell commented on SPARK-7332: I do not think this can affect version

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Affects Version/s: (was: 1.3.1) 1.4.0 RpcCallContext.sender has

Re: [discuss] ending support for Java 6?

If there is broad consensus here to drop Java 1.6 in Spark 1.5, should we do an ANNOUNCE to user and dev? On Mon, May 4, 2015 at 7:24 PM, shane knapp skn...@berkeley.edu wrote: sgtm On Mon, May 4, 2015 at 11:23 AM, Patrick Wendell pwend...@gmail.com wrote: If we just set JAVA_HOME in dev/run

Pull request builder errors (taking Jenkins worker 3 offline)

For unknown reasons, pull requests on Jenkins worker 3 have been failing with an exception[1]. After trying to fix this by clearing the ivy and maven caches on the node, I've given up and simply blacklisted that worker. [error] oro#oro;2.0.8!oro.jar origin location must be absolute:

[ANNOUNCE] Spark branch-1.4

Hi Devs, Just an announcement that I've cut Spark's branch 1.4 to form the basis of the 1.4 release. Other than a few stragglers, this represents the end of active feature development for Spark 1.4. Per usual, if committers are merging any features, please be in touch so I can help coordinate.

Re: [discuss] ending support for Java 6?

If we just set JAVA_HOME in dev/run-test-jenkins, I think it should work. On Mon, May 4, 2015 at 7:20 PM, shane knapp skn...@berkeley.edu wrote: ...and now the workers all have java6 installed. https://issues.apache.org/jira/browse/SPARK-1437 sadly, the built-in jenkins jdk management

[jira] [Updated] (SPARK-7286) Precedence of operator not behaving properly

[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7286: --- Priority: Critical (was: Major) Precedence of operator not behaving properly

[jira] [Updated] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7236: --- Priority: Critical (was: Trivial) AkkaUtils askWithReply sleeps indefinitely when a timeout

[jira] [Commented] (SPARK-1437) Jenkins should build with Java 6

[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526474#comment-14526474 ] Patrick Wendell commented on SPARK-1437: Hey [~shaneknapp] we had punted

[jira] [Updated] (SPARK-1437) Jenkins should build with Java 6

[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1437: --- Assignee: shane knapp Jenkins should build with Java 6

Thanking Test Partners

Hey All, Community testing during the QA window is an important part of the release cycle in Spark. It helps us deliver higher quality releases by vetting out issues not covered by our unit tests. I was thinking that from now on, it would be nice to recognize the organizations that donate time

[jira] [Resolved] (SPARK-7121) ClosureCleaner does not handle nesting properly

[ https://issues.apache.org/jira/browse/SPARK-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7121. Resolution: Fixed Fix Version/s: 1.4.0 ClosureCleaner does not handle nesting

[jira] [Resolved] (SPARK-7120) ClosureCleaner lacks documentation

[ https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7120. Resolution: Fixed Fix Version/s: 1.4.0 ClosureCleaner lacks documentation

Re: What is the location in the source code of the computation of the elements in a map transformation?

Maybe I can help a bit. What happens when you call .map(my func) is that you create a MapPartitionsRDD that has a reference to that closure in it's compute() function. When a job is run (jobs are run as the result of RDD actions):

[jira] [Updated] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7315: --- Component/s: Tests Flaky Test: WriteAheadLogBackedBlockRDDSuite

[jira] [Resolved] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3444. Resolution: Fixed Fix Version/s: 1.4.0 Provide a way to easily change the log level

[jira] [Updated] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7304: --- Assignee: Rajendra Include $@ in call to mvn in make-distribution.sh

[jira] [Resolved] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7304. Resolution: Fixed Fix Version/s: 1.4.0 Include $@ in call to mvn in make

[jira] [Resolved] (SPARK-7260) Support changing Spark's log level programatically

[ https://issues.apache.org/jira/browse/SPARK-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7260. Resolution: Duplicate Support changing Spark's log level programatically

[jira] [Resolved] (SPARK-7291) Fix a flaky test in AkkaRpcEnvSuite

[ https://issues.apache.org/jira/browse/SPARK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7291. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu Fix a flaky

[jira] [Resolved] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7287. Resolution: Fixed Fix Version/s: 1.4.0 Flaky test: o.a.s.deploy.SparkSubmitSuite

[jira] [Resolved] (SPARK-7306) SPARK-7224 broke build with jdk6

[ https://issues.apache.org/jira/browse/SPARK-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7306. Resolution: Fixed Fix Version/s: 1.4.0 Fixed by reverting SPARK-7224 SPARK-7224

[jira] [Reopened] (SPARK-7224) Mock repositories for testing with --packages

[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7224: This was reopened due to SPARK-7306 Mock repositories for testing with --packages

[jira] [Reopened] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7287: I had to reopen this due to SPARK-7306 Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[jira] [Created] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

Patrick Wendell created SPARK-7292: -- Summary: Provide operator to truncate lineage without persisting RDD's Key: SPARK-7292 URL: https://issues.apache.org/jira/browse/SPARK-7292 Project: Spark

[jira] [Created] (SPARK-7296) Timeline view for Stage page

Patrick Wendell created SPARK-7296: -- Summary: Timeline view for Stage page Key: SPARK-7296 URL: https://issues.apache.org/jira/browse/SPARK-7296 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7297) Make timeline more discoverable

Patrick Wendell created SPARK-7297: -- Summary: Make timeline more discoverable Key: SPARK-7297 URL: https://issues.apache.org/jira/browse/SPARK-7297 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7298) Harmonize style of new UI visualizations

Patrick Wendell created SPARK-7298: -- Summary: Harmonize style of new UI visualizations Key: SPARK-7298 URL: https://issues.apache.org/jira/browse/SPARK-7298 Project: Spark Issue Type: Sub

[jira] [Updated] (SPARK-3468) Provide timeline view in Job UI pages

[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3468: --- Summary: Provide timeline view in Job UI pages (was: Provide timeline view in Job and Stage

[jira] [Created] (SPARK-7293) Report memory used in aggregations and joins

Patrick Wendell created SPARK-7293: -- Summary: Report memory used in aggregations and joins Key: SPARK-7293 URL: https://issues.apache.org/jira/browse/SPARK-7293 Project: Spark Issue Type

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522919#comment-14522919 ] Patrick Wendell commented on SPARK-7292: Yes, this would mean sacrificing fault

[jira] [Updated] (SPARK-7297) Make timeline more discoverable

[ https://issues.apache.org/jira/browse/SPARK-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7297: --- Assignee: Patrick Wendell Make timeline more discoverable

[jira] [Comment Edited] (SPARK-3468) Provide timeline view in Job UI pages

[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522946#comment-14522946 ] Patrick Wendell edited comment on SPARK-3468 at 5/1/15 8:38 AM

[jira] [Resolved] (SPARK-3468) Provide timeline view in Job UI pages

[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3468. Resolution: Fixed Fix Version/s: 1.4.0 Thanks for the contribution [~sarutak

[jira] [Updated] (SPARK-7224) Mock repositories for testing with --packages

[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7224: --- Target Version/s: 1.3.2, 1.4.0 Not that I've disabled the test in master and 1.3 branches

[jira] [Resolved] (SPARK-7224) Mock repositories for testing with --packages

[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7224. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 (was: 1.3.2

[jira] [Resolved] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6971. Resolution: Fixed Fix Version/s: 1.4.0 Each Jenkins build should use a distinct

[jira] [Updated] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6971: --- Assignee: Patrick Wendell Each Jenkins build should use a distinct Zinc port

Re: [discuss] ending support for Java 6?

I'd also support this. In general, I think it's good that we try to have Spark support different versions of things (Hadoop, Hive, etc). But at some point you need to weigh the costs of doing so against the number of users affected. In the case of Java 6, we are seeing increasing cost from this.

[jira] [Commented] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522151#comment-14522151 ] Patrick Wendell commented on SPARK-6971: I took care of this for the master

[jira] [Reopened] (SPARK-4123) Show dependency changes in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4123: Hey [~boyork] and [~srowen] this has been consistently messing up and showing strange results

[jira] [Updated] (SPARK-4123) Show dependency changes in pull requests

[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Fix Version/s: (was: 1.4.0) Show dependency changes in pull requests

[jira] [Resolved] (SPARK-6479) Create external block store API

[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6479. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Zhan Zhang Create

<    1   2   3   4   5   6   7   8   9   10   >