[jira] [Reopened] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7552: > Close files correctly when iteration is finished in WAL recovery > ---

[jira] [Resolved] (SPARK-7015) Multiclass to Binary Reduction

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7015. Resolution: Fixed > Multiclass to Binary Reduction > -- > >

[jira] [Resolved] (SPARK-7528) Java compatibility of RankingMetrics

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7528. Resolution: Fixed > Java compatibility of RankingMetrics > -

[jira] [Reopened] (SPARK-7528) Java compatibility of RankingMetrics

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7528: > Java compatibility of RankingMetrics > > >

[jira] [Reopened] (SPARK-7015) Multiclass to Binary Reduction

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7015: > Multiclass to Binary Reduction > -- > > Key: SPARK

[jira] [Resolved] (SPARK-7406) Add tooltips for "Scheduling Delay", "Processing Time" and "Total Delay" in Streaming WebUI

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7406. Resolution: Fixed > Add tooltips for "Scheduling Delay", "Processing Time" and "Total Delay"

[jira] [Reopened] (SPARK-7406) Add tooltips for "Scheduling Delay", "Processing Time" and "Total Delay" in Streaming WebUI

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7406: > Add tooltips for "Scheduling Delay", "Processing Time" and "Total Delay" in > Streaming WebUI

[jira] [Created] (SPARK-7592) Resolution set to "Pending Closed" when using PR merge script

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7592: -- Summary: Resolution set to "Pending Closed" when using PR merge script Key: SPARK-7592 URL: https://issues.apache.org/jira/browse/SPARK-7592 Project: Spark

[jira] [Closed] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-7590. -- Resolution: Invalid > Test Issue to Debug JIRA Problem > > >

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: > Test Issue to Debug JIRA Problem > > > Key: S

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Fixed Issue resolved by pull request 5426 [https://github.com/apache/spark/pull/

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: > Test Issue to Debug JIRA Problem > > > Key: S

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Fixed Issue resolved by pull request 5426 [https://github.com/apache/spark/pull/

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: > Test Issue to Debug JIRA Problem > > > Key: S

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Pending Closed Issue resolved by pull request 5426 [https://github.com/apache/sp

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: > Test Issue to Debug JIRA Problem > > > Key: S

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Pending Closed Fix Version/s: 1.6.0 Issue resolved by pull request 5426 [

[jira] [Created] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7590: -- Summary: Test Issue to Debug JIRA Problem Key: SPARK-7590 URL: https://issues.apache.org/jira/browse/SPARK-7590 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7561) Install Junit Attachment Plugin on Jenkins

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7561: -- Summary: Install Junit Attachment Plugin on Jenkins Key: SPARK-7561 URL: https://issues.apache.org/jira/browse/SPARK-7561 Project: Spark Issue Type: Sub-

[jira] [Updated] (SPARK-7558) Log test name when starting and finishing each test

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7558: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7560 > Log test name when start

[jira] [Created] (SPARK-7560) Make flaky tests easier to debug

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7560: -- Summary: Make flaky tests easier to debug Key: SPARK-7560 URL: https://issues.apache.org/jira/browse/SPARK-7560 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-7558) Log test name when starting and finishing each test

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7558: -- Summary: Log test name when starting and finishing each test Key: SPARK-7558 URL: https://issues.apache.org/jira/browse/SPARK-7558 Project: Spark Issue T

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539245#comment-14539245 ] Patrick Wendell commented on SPARK-7296: Actually maybe there is a chance we can d

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.4.0, 1.5.0 (was: 1.5.0) > Timeline view for Stage page >

[jira] [Comment Edited] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539240#comment-14539240 ] Patrick Wendell edited comment on SPARK-7296 at 5/12/15 4:53 AM: ---

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.5.0 (was: 1.4.0) > Timeline view for Stage page > ---

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539240#comment-14539240 ] Patrick Wendell commented on SPARK-7296: Personally not sure I have time to review

[jira] [Commented] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539097#comment-14539097 ] Patrick Wendell commented on SPARK-7531: Yep - that one should work. I've actually

[jira] [Resolved] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7520. Resolution: Fixed Fix Version/s: 1.4.0 All green - awesome thanks [~shaneknapp]! > I

[jira] [Resolved] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7538. Resolution: Fixed This was a cross post from the mailing list. The poster closed the thread

[jira] [Resolved] (SPARK-7508) JettyUtils-generated servlets to log & report all errors

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7508. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Steve Loughran > JettyUtils

[jira] [Created] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7531: -- Summary: Install GPG on Jenkins machines Key: SPARK-7531 URL: https://issues.apache.org/jira/browse/SPARK-7531 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537530#comment-14537530 ] Patrick Wendell commented on SPARK-7520: Sounds good - thanks man. This build will

[jira] [Created] (SPARK-7521) Allow all required release credentials to be specified with env vars

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7521: -- Summary: Allow all required release credentials to be specified with env vars Key: SPARK-7521 URL: https://issues.apache.org/jira/browse/SPARK-7521 Project: Spark

[jira] [Created] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7520: -- Summary: Install Jekyll On Jenkins Machines Key: SPARK-7520 URL: https://issues.apache.org/jira/browse/SPARK-7520 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1517: -- Assignee: Patrick Wendell > Publish nightly snapshots of documentation, maven artifacts

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.4.0) > Publish nightly snapshots of documentation, maven artifacts

[jira] [Commented] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537494#comment-14537494 ] Patrick Wendell commented on SPARK-7462: [~rxin] since this is a user facing chang

[jira] [Comment Edited] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14537494#comment-14537494 ] Patrick Wendell edited comment on SPARK-7462 at 5/11/15 2:08 AM: ---

[jira] [Resolved] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3454. Resolution: Fixed > Expose JSON representation of data shown in WebUI >

[jira] [Resolved] (SPARK-7393) How to improve Spark SQL performance?

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7393. Resolution: Invalid Hi - thanks for giving feedback on your use of Spark SQL. This type of

[jira] [Updated] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7435: --- Priority: Critical (was: Blocker) > Make DataFrame.show() consistent with that of Scala and p

[jira] [Updated] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6961: --- Priority: Critical (was: Blocker) > Cannot save data to parquet files when executing from Win

[jira] [Updated] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7484: --- Issue Type: Improvement (was: Bug) > Support passing jdbc connection properties for dataframe

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:47 PM:

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532980#comment-14532980 ] Patrick Wendell commented on SPARK-4105: [~bherta] can you give a bit more informa

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:46 PM:

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Target Version/s: 1.3.2, 1.4.0 > Cannot implement nor use custom StandaloneRecoveryModeFactory

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Component/s: Deploy > Cannot implement nor use custom StandaloneRecoveryModeFactory implementa

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape & for java options and ^& won't work

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529017#comment-14529017 ] Patrick Wendell commented on SPARK-7310: Ping [~andrewor14], IIRC there was a lot

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Assignee: Shixiong Zhu > RpcCallContext.sender has a different name from the original sender's

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Affects Version/s: (was: 1.3.1) 1.4.0 > RpcCallContext.sender has a

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Target Version/s: 1.4.0 > RpcCallContext.sender has a different name from the original sender'

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Fix Version/s: (was: 1.3.2) (was: 1.4.0) > RpcCallContext.sender ha

[jira] [Commented] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14529011#comment-14529011 ] Patrick Wendell commented on SPARK-7332: I do not think this can affect version 1.

[jira] [Updated] (SPARK-7347) DAG visualization: add hover to RDDs on job page

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7347: --- Issue Type: Improvement (was: Bug) > DAG visualization: add hover to RDDs on job page > -

[jira] [Updated] (SPARK-7349) DAG visualization: add legend to explain the content

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7349: --- Issue Type: Improvement (was: Bug) > DAG visualization: add legend to explain the content > -

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7348: --- Issue Type: Improvement (was: Bug) > DAG visualization: add links to RDD page > -

[jira] [Updated] (SPARK-1437) Jenkins should build with Java 6

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1437: --- Assignee: shane knapp > Jenkins should build with Java 6 > >

[jira] [Commented] (SPARK-1437) Jenkins should build with Java 6

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526474#comment-14526474 ] Patrick Wendell commented on SPARK-1437: Hey [~shaneknapp] we had punted on this o

[jira] [Updated] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7236: --- Priority: Critical (was: Trivial) > AkkaUtils askWithReply sleeps indefinitely when a timeout

[jira] [Updated] (SPARK-7286) Precedence of operator not behaving properly

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7286: --- Priority: Critical (was: Major) > Precedence of operator not behaving properly >

[jira] [Updated] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7315: --- Component/s: Tests > Flaky Test: WriteAheadLogBackedBlockRDDSuite > --

[jira] [Resolved] (SPARK-7121) ClosureCleaner does not handle nesting properly

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7121. Resolution: Fixed Fix Version/s: 1.4.0 > ClosureCleaner does not handle nesting prope

[jira] [Resolved] (SPARK-7120) ClosureCleaner lacks documentation

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7120. Resolution: Fixed Fix Version/s: 1.4.0 > ClosureCleaner lacks documentation > ---

[jira] [Resolved] (SPARK-7260) Support changing Spark's log level programatically

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7260. Resolution: Duplicate > Support changing Spark's log level programatically > ---

[jira] [Resolved] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3444. Resolution: Fixed Fix Version/s: 1.4.0 > Provide a way to easily change the log level

[jira] [Updated] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7304: --- Assignee: Rajendra > Include $@ in call to mvn in make-distribution.sh > -

[jira] [Resolved] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7304. Resolution: Fixed Fix Version/s: 1.4.0 > Include $@ in call to mvn in make-distributi

[jira] [Reopened] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7287: I had to reopen this due to SPARK-7306 > Flaky test: o.a.s.deploy.SparkSubmitSuite --packages >

[jira] [Resolved] (SPARK-7306) SPARK-7224 broke build with jdk6

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7306. Resolution: Fixed Fix Version/s: 1.4.0 Fixed by reverting SPARK-7224 > SPARK-7224 br

[jira] [Reopened] (SPARK-7224) Mock repositories for testing with --packages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7224: This was reopened due to SPARK-7306 > Mock repositories for testing with --packages > -

[jira] [Resolved] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3468. Resolution: Fixed Fix Version/s: 1.4.0 Thanks for the contribution [~sarutak] > Prov

[jira] [Comment Edited] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522946#comment-14522946 ] Patrick Wendell edited comment on SPARK-3468 at 5/1/15 8:38 AM:

[jira] [Created] (SPARK-7298) Harmonize style of new UI visualizations

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7298: -- Summary: Harmonize style of new UI visualizations Key: SPARK-7298 URL: https://issues.apache.org/jira/browse/SPARK-7298 Project: Spark Issue Type: Sub-ta

[jira] [Updated] (SPARK-7297) Make timeline more discoverable

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7297: --- Assignee: Patrick Wendell > Make timeline more discoverable > ---

[jira] [Created] (SPARK-7297) Make timeline more discoverable

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7297: -- Summary: Make timeline more discoverable Key: SPARK-7297 URL: https://issues.apache.org/jira/browse/SPARK-7297 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7296) Timeline view for Stage page

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7296: -- Summary: Timeline view for Stage page Key: SPARK-7296 URL: https://issues.apache.org/jira/browse/SPARK-7296 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3468: --- Summary: Provide timeline view in Job UI pages (was: Provide timeline view in Job and Stage U

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522919#comment-14522919 ] Patrick Wendell commented on SPARK-7292: Yes, this would mean sacrificing fault to

[jira] [Created] (SPARK-7293) Report memory used in aggregations and joins

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7293: -- Summary: Report memory used in aggregations and joins Key: SPARK-7293 URL: https://issues.apache.org/jira/browse/SPARK-7293 Project: Spark Issue Type: Ne

[jira] [Created] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7292: -- Summary: Provide operator to truncate lineage without persisting RDD's Key: SPARK-7292 URL: https://issues.apache.org/jira/browse/SPARK-7292 Project: Spark

[jira] [Resolved] (SPARK-7291) Fix a flaky test in AkkaRpcEnvSuite

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7291. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu > Fix a flaky

[jira] [Resolved] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7287. Resolution: Fixed Fix Version/s: 1.4.0 > Flaky test: o.a.s.deploy.SparkSubmitSuite --

[jira] [Reopened] (SPARK-4123) Show dependency changes in pull requests

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4123: Hey [~boyork] and [~srowen] this has been consistently messing up and showing strange results.

[jira] [Updated] (SPARK-4123) Show dependency changes in pull requests

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Fix Version/s: (was: 1.4.0) > Show dependency changes in pull requests > -

[jira] [Resolved] (SPARK-6479) Create external block store API

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6479. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Zhan Zhang > Create externa

[jira] [Reopened] (SPARK-5213) Pluggable SQL Parser Support

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5213: I believe this introduced a build break so I reopened it https://amplab.cs.berkeley.edu/jenkins

[jira] [Reopened] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5342: I had to revert this patch because it broke old Hadoop versions https://amplab.cs.berkeley.edu/

[jira] [Resolved] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6971. Resolution: Fixed Fix Version/s: 1.4.0 > Each Jenkins build should use a distinct Zin

[jira] [Updated] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6971: --- Assignee: Patrick Wendell > Each Jenkins build should use a distinct Zinc port > -

[jira] [Commented] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14522151#comment-14522151 ] Patrick Wendell commented on SPARK-6971: I took care of this for the master and 1.

[jira] [Resolved] (SPARK-7224) Mock repositories for testing with --packages

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7224. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 (was: 1.3.2,

[jira] [Updated] (SPARK-7224) Mock repositories for testing with --packages

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7224: --- Target Version/s: 1.3.2, 1.4.0 Not that I've disabled the test in master and 1.3 branches. >

[jira] [Comment Edited] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520635#comment-14520635 ] Patrick Wendell edited comment on SPARK-7230 at 4/30/15 1:13 AM: ---

[jira] [Comment Edited] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520635#comment-14520635 ] Patrick Wendell edited comment on SPARK-7230 at 4/30/15 1:13 AM: ---

[jira] [Updated] (SPARK-7228) SparkR public API for 1.4 release

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7228: --- Priority: Blocker (was: Critical) > SparkR public API for 1.4 release > -

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520635#comment-14520635 ] Patrick Wendell commented on SPARK-7230: Yes - removing API's is really difficult

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520478#comment-14520478 ] Patrick Wendell commented on SPARK-7230: Yeah the goal is absolutely to support hi

[jira] [Commented] (SPARK-7261) Change default log level to WARN in the REPL

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520467#comment-14520467 ] Patrick Wendell commented on SPARK-7261: Yeah, but SPARK-7260 is super simple, I t

<    1   2   3   4   5   6   7   8   9   10   >