[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7820: --- Priority: Critical (was: Blocker) Java8-tests suite compile error under SBT

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557581#comment-14557581 ] Patrick Wendell commented on SPARK-7820: Since this only affects tests I'm de

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-23 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14557610#comment-14557610 ] Patrick Wendell commented on SPARK-7287: [~brkyvz] I am going to disable this test

Re: spark packages

2015-05-23 Thread Patrick Wendell
Yes - spark packages can include non ASF licenses. On Sat, May 23, 2015 at 6:16 PM, Debasish Das debasish.da...@gmail.com wrote: Hi, Is it possible to add GPL/LGPL code on spark packages or it must be licensed under Apache as well ? I want to expose Professor Tim Davis's LGPL library for

[jira] [Updated] (SPARK-7807) High-Availablity:: SparkHadoopUtil.scala should support hadoopConfiguration.addResource()

2015-05-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7807: --- Component/s: Spark Core High-Availablity:: SparkHadoopUtil.scala should support

Re: [VOTE] Release Apache Spark 1.4.0 (RC1)

2015-05-22 Thread Patrick Wendell
are not getting included. On Fri, May 22, 2015 at 2:44 PM, Andrew Psaltis psaltis.and...@gmail.com wrote: All, Should all the docs work from http://people.apache.org/~pwendell/spark-1.4.0-rc1-docs/ ? If so the R API docs 404. On Tue, May 19, 2015 at 11:10 AM, Patrick Wendell pwend

[jira] [Created] (SPARK-7805) Move SQLTestUtils.scala form src/main

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7805: -- Summary: Move SQLTestUtils.scala form src/main Key: SPARK-7805 URL: https://issues.apache.org/jira/browse/SPARK-7805 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7771) Dynamic allocation: lower timeouts further

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7771: --- Issue Type: Improvement (was: Bug) Dynamic allocation: lower timeouts further

[jira] [Updated] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7801: --- Issue Type: Improvement (was: Bug) Upgrade master versions to Spark 1.5.0

[jira] [Created] (SPARK-7803) Update MIMA for Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7803: -- Summary: Update MIMA for Spark 1.5.0 Key: SPARK-7803 URL: https://issues.apache.org/jira/browse/SPARK-7803 Project: Spark Issue Type: Sub-task

[jira] [Deleted] (SPARK-7802) Update pom versioning to 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell deleted SPARK-7802: --- Update pom versioning to 1.5.0 -- Key: SPARK

[jira] [Deleted] (SPARK-7803) Update MIMA for Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell deleted SPARK-7803: --- Update MIMA for Spark 1.5.0 --- Key: SPARK-7803

[jira] [Created] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7801: -- Summary: Upgrade master versions to Spark 1.5.0 Key: SPARK-7801 URL: https://issues.apache.org/jira/browse/SPARK-7801 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7802) Update pom versioning to 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7802: -- Summary: Update pom versioning to 1.5.0 Key: SPARK-7802 URL: https://issues.apache.org/jira/browse/SPARK-7802 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7320) Add rollup and cube support to DataFrame DSL

2015-05-20 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553073#comment-14553073 ] Patrick Wendell commented on SPARK-7320: Hey [~liancheng] and [~chenghao] - I

[jira] [Updated] (SPARK-7389) Tachyon integration improvement

2015-05-20 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7389: --- Assignee: shimingfei Tachyon integration improvement

[jira] [Resolved] (SPARK-7389) Tachyon integration improvement

2015-05-20 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7389. Resolution: Fixed Fix Version/s: 1.5.0 Tachyon integration improvement

[jira] [Updated] (SPARK-7719) Java 6 code in UnsafeShuffleWriterSuite

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7719: --- Description: This was causing a compile failure because emptyIterator() is not exposed

[jira] [Updated] (SPARK-7722) Style checks do not run for Kinesis on Jenkins

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7722: --- Component/s: Project Infra Style checks do not run for Kinesis on Jenkins

[jira] [Created] (SPARK-7719) Java 6 code in UnsafeShuffleWriterSuite

2015-05-19 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7719: -- Summary: Java 6 code in UnsafeShuffleWriterSuite Key: SPARK-7719 URL: https://issues.apache.org/jira/browse/SPARK-7719 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7722) Style checks do not run for Kinesis on Jenkins

2015-05-19 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7722: -- Summary: Style checks do not run for Kinesis on Jenkins Key: SPARK-7722 URL: https://issues.apache.org/jira/browse/SPARK-7722 Project: Spark Issue Type

[jira] [Created] (SPARK-7726) Maven Install Breaks When Upgrading Scala 2.11.2--[2.11.3 or higher]

2015-05-19 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7726: -- Summary: Maven Install Breaks When Upgrading Scala 2.11.2--[2.11.3 or higher] Key: SPARK-7726 URL: https://issues.apache.org/jira/browse/SPARK-7726 Project

[jira] [Resolved] (SPARK-7670) Failure when building with scala 2.11 (after 1.3.1

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7670. Resolution: Duplicate Fix Version/s: SPARK-7726 Failure when building with scala

[jira] [Commented] (SPARK-7092) Update spark scala version to 2.11.6

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550124#comment-14550124 ] Patrick Wendell commented on SPARK-7092: This is reopened because it caused SPARK

[jira] [Reopened] (SPARK-7092) Update spark scala version to 2.11.6

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7092: Update spark scala version to 2.11.6

Re: [VOTE] Release Apache Spark 1.4.0 (RC1)

2015-05-19 Thread Patrick Wendell
, Filter,sortByKey (word count) 2.6. Recommendation (Movielens medium dataset ~1 M ratings) OK Model evaluation/optimization (rank, numIter, lambda) with itertools OK Cheers k/ On Tue, May 19, 2015 at 9:10 AM, Patrick Wendell pwend...@gmail.com wrote: Please vote on releasing

Re: [VOTE] Release Apache Spark 1.4.0 (RC1)

2015-05-19 Thread Patrick Wendell
Huai On Tue, May 19, 2015 at 5:10 PM, Patrick Wendell pwend...@gmail.com wrote: Please vote on releasing the following candidate as Apache Spark version 1.4.0! The tag to be voted on is v1.4.0-rc1 (commit 777a081): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h

branch-1.4 merge ettiquite

2015-05-19 Thread Patrick Wendell
Hey All, Since we are now voting, please tread very carefully with branch-1.4 merges. For instances, bug fixes that don't represent regressions from 1.3.X, these probably shouldn't be merged unless they are extremely simple and well reviewed. As usual mature/core components (e.g. Spark core)

[VOTE] Release Apache Spark 1.4.0 (RC1)

2015-05-19 Thread Patrick Wendell
Please vote on releasing the following candidate as Apache Spark version 1.4.0! The tag to be voted on is v1.4.0-rc1 (commit 777a081): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=777a08166f1fb144146ba32581d4632c3466541e The release files, including signatures, digests, etc.

[jira] [Updated] (SPARK-7743) Upgrade parquet dependency

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7743: --- Component/s: SQL Upgrade parquet dependency

Re: [VOTE] Release Apache Spark 1.4.0 (RC1)

2015-05-19 Thread Patrick Wendell
AM, Patrick Wendell pwend...@gmail.com wrote: Please vote on releasing the following candidate as Apache Spark version 1.4.0! The tag to be voted on is v1.4.0-rc1 (commit 777a081): https://git-wip-us.apache.org/repos/asf?p=spark.git;a=commit;h=777a08166f1fb144146ba32581d4632c3466541e

[jira] [Updated] (SPARK-7726) Maven Install Breaks When Upgrading Scala 2.11.2--[2.11.3 or higher]

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7726: --- Assignee: Iulian Dragos Maven Install Breaks When Upgrading Scala 2.11.2--[2.11.3 or higher

[jira] [Resolved] (SPARK-7726) Maven Install Breaks When Upgrading Scala 2.11.2--[2.11.3 or higher]

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7726. Resolution: Fixed Fix Version/s: 1.4.0 Maven Install Breaks When Upgrading Scala

[jira] [Resolved] (SPARK-7092) Update spark scala version to 2.11.6

2015-05-19 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7092. Resolution: Fixed Okay this was re merged in the SPARK-7726 fix: https://github.com/apache

[jira] [Updated] (SPARK-7677) Enable Kafka In Scala 2.11 Build

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7677: --- Description: Now that we upgraded Kafka in SPARK-2808 we can enable it in the Scala 2.11

[jira] [Updated] (SPARK-7672) Number format exception with spark.kryoserializer.buffer.mb

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7672: --- Priority: Critical (was: Major) Number format exception with spark.kryoserializer.buffer.mb

[jira] [Updated] (SPARK-7672) Number format exception with spark.kryoserializer.buffer.mb

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7672: --- Component/s: Spark Core Number format exception with spark.kryoserializer.buffer.mb

[jira] [Updated] (SPARK-7284) Update streaming documentation for Spark 1.4.0 release

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7284: --- Priority: Critical (was: Blocker) Update streaming documentation for Spark 1.4.0 release

[jira] [Created] (SPARK-7677) Enable Kafka In Scala 2.11 Build

2015-05-15 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7677: -- Summary: Enable Kafka In Scala 2.11 Build Key: SPARK-7677 URL: https://issues.apache.org/jira/browse/SPARK-7677 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-6811) Building binary R packages for SparkR

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6811: --- Assignee: Shivaram Venkataraman Building binary R packages for SparkR

[jira] [Updated] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7563: --- Fix Version/s: 1.4.0 OutputCommitCoordinator.stop() should only be executed in driver

[jira] [Updated] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7563: --- Target Version/s: 1.3.2, 1.4.0 OutputCommitCoordinator.stop() should only be executed

[jira] [Resolved] (SPARK-7677) Enable Kafka In Scala 2.11 Build

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7677. Resolution: Fixed Fix Version/s: 1.4.0 Fixed by pull request: https://github.com

[jira] [Updated] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7355: --- Priority: Critical (was: Blocker) FlakyTest - o.a.s.DriverSuite

[jira] [Updated] (SPARK-7644) Ensure all scoped RDD operations are tested and cleaned

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7644: --- Priority: Critical (was: Blocker) Ensure all scoped RDD operations are tested and cleaned

[jira] [Commented] (SPARK-2883) Spark Support for ORCFile format

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546394#comment-14546394 ] Patrick Wendell commented on SPARK-2883: Since this is a feature I'm going to drop

[jira] [Updated] (SPARK-2883) Spark Support for ORCFile format

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2883: --- Priority: Critical (was: Blocker) Spark Support for ORCFile format

[jira] [Commented] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546468#comment-14546468 ] Patrick Wendell commented on SPARK-7563: I pulled the fix into 1.4.0, but not yet

[jira] [Resolved] (SPARK-5920) Use a BufferedInputStream to read local shuffle data

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5920. Resolution: Won't Fix Per the discussion on this PR I am resolving this as won't fix

[jira] [Updated] (SPARK-7532) Make StreamingContext.start() idempotent

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7532: --- Fix Version/s: 1.4.0 Make StreamingContext.start() idempotent

[jira] [Updated] (SPARK-7228) SparkR public API for 1.4 release

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7228: --- Fix Version/s: 1.4.0 SparkR public API for 1.4 release

Re: Tentative due dates for Spark 1.3.2 release

2015-05-15 Thread Patrick Wendell
Hi Niranda, Maintenance releases are not done on a predetermined schedule but instead according to which fixes show up and their severity. Since we just did a 1.3.1 release I'm not sure I see 1.3.2 on the immediate horizon. However, the maintenance releases are simply builds at the head of the

Re: Adding/Using More Resolution Types on JIRA

2015-05-15 Thread Patrick Wendell
it mean too many TODOs are filed and forgotten? That's no comment on the current state, just something to watch. So: yes I like the idea. On May 12, 2015 8:50 AM, Patrick Wendell pwend...@gmail.com wrote: In Spark we sometimes close issues as something other than Fixed

Re: Recent Spark test failures

2015-05-15 Thread Patrick Wendell
The PR builder currently builds against Hadoop 2.3. - Patrick On Fri, May 15, 2015 at 11:40 AM, Marcelo Vanzin van...@cloudera.com wrote: Funny thing, since I asked this question in a PR a few minutes ago... Ignoring the rotation suggestion for a second, can the PR builder at least cover

[jira] [Updated] (SPARK-5632) not able to resolve dot('.') in field name

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5632: --- Fix Version/s: 1.4.0 not able to resolve dot('.') in field name

Re: Recent Spark test failures

2015-05-15 Thread Patrick Wendell
, Patrick Wendell pwend...@gmail.com wrote: The PR builder currently builds against Hadoop 2.3. - Patrick On Fri, May 15, 2015 at 11:40 AM, Marcelo Vanzin van...@cloudera.com wrote: Funny thing, since I asked this question in a PR a few minutes ago... Ignoring the rotation suggestion for a second

[jira] [Updated] (SPARK-6595) DataFrame self joins with MetastoreRelations fail

2015-05-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6595: --- Fix Version/s: 1.4.0 1.3.2 DataFrame self joins with MetastoreRelations

[jira] [Commented] (SPARK-4128) Create instructions on fully building Spark in Intellij

2015-05-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544118#comment-14544118 ] Patrick Wendell commented on SPARK-4128: Thanks for bringing this back up [~srowen

Re: How to link code pull request with JIRA ID?

2015-05-14 Thread Patrick Wendell
Yeah I wrote the original script and I intentionally made it easy for other projects to use (you'll just need to tweak some variables at the top). You just need somewhere to run it... we were using a jenkins cluster to run it every 5 minutes. BTW - I looked and there is one instance where it hard

[jira] [Resolved] (SPARK-7297) Make timeline more discoverable

2015-05-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7297. Resolution: Fixed Make timeline more discoverable

[jira] [Commented] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-05-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544290#comment-14544290 ] Patrick Wendell commented on SPARK-7563: /cc [~joshrosen] I think this is caused

[jira] [Updated] (SPARK-7063) Update lz4 for Java 7 to avoid: when lz4 compression is used, it causes core dump

2015-05-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7063: --- Target Version/s: 1.5.0 (was: 2+) Update lz4 for Java 7 to avoid: when lz4 compression

[jira] [Commented] (SPARK-7063) Update lz4 for Java 7 to avoid: when lz4 compression is used, it causes core dump

2015-05-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14544359#comment-14544359 ] Patrick Wendell commented on SPARK-7063: [~srowen] so I think maybe we can pull

[jira] [Created] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7622: -- Summary: Test Jira Key: SPARK-7622 URL: https://issues.apache.org/jira/browse/SPARK-7622 Project: Spark Issue Type: Bug Reporter: Patrick

[jira] [Reopened] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7622: Test Jira - Key: SPARK-7622 URL: https

[jira] [Closed] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell closed SPARK-7622. -- Resolution: Invalid Test Jira - Key: SPARK-7622

Re: [IMPORTANT] Committers please update merge script

2015-05-13 Thread Patrick Wendell
Hi All - unfortunately the fix introduced another bug, which is that fixVersion was not updated properly. I've updated the script and had one other person test it. So committers please pull from master again thanks! - Patrick On Tue, May 12, 2015 at 6:25 PM, Patrick Wendell pwend...@gmail.com

[jira] [Resolved] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7622. Resolution: Invalid Test Jira - Key: SPARK-7622

[jira] [Reopened] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7622: Test Jira - Key: SPARK-7622 URL: https

[jira] [Updated] (SPARK-7531) Install GPG on Jenkins machines

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7531: --- Fix Version/s: 1.4.0 Install GPG on Jenkins machines

Re: Change for submitting to yarn in 1.3.1

2015-05-13 Thread Patrick Wendell
Sent from my iPad On May 12, 2015, at 20:54, Patrick Wendell pwend...@gmail.com wrote: Hey Kevin and Ron, So is the main shortcoming of the launcher library the inability to get an app ID back from YARN? Or are there other issues here that fundamentally regress things for you

[jira] [Updated] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7622: --- Fix Version/s: (was: 1.6.0) Test Jira - Key: SPARK-7622

[jira] [Reopened] (SPARK-7622) Test Jira

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7622: Test Jira - Key: SPARK-7622 URL: https

[jira] [Updated] (SPARK-6568) spark-shell.cmd --jars option does not accept the jar that has space in its path

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6568: --- Fix Version/s: 1.4.0 spark-shell.cmd --jars option does not accept the jar that has space

[jira] [Reopened] (SPARK-7561) Install Junit Attachment Plugin on Jenkins

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7561: Install Junit Attachment Plugin on Jenkins

[jira] [Updated] (SPARK-7526) Specify ip of RBackend, MonitorServer and RRDD Socket server

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7526: --- Fix Version/s: 1.4.0 Specify ip of RBackend, MonitorServer and RRDD Socket server

[jira] [Updated] (SPARK-7303) push down project if possible when the child is sort

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7303: --- Fix Version/s: 1.4.0 push down project if possible when the child is sort

[jira] [Updated] (SPARK-7601) Support Insert into JDBC Datasource

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7601: --- Fix Version/s: 1.4.0 Support Insert into JDBC Datasource

[jira] [Updated] (SPARK-7482) Rename some DataFrame API methods in SparkR to match their counterparts in Scala

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7482: --- Fix Version/s: 1.4.0 Rename some DataFrame API methods in SparkR to match their counterparts

[jira] [Updated] (SPARK-7589) Make Input Rate in the Streaming page consistent with other pages

2015-05-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7589: --- Component/s: Streaming Make Input Rate in the Streaming page consistent with other pages

[jira] [Created] (SPARK-7597) Make default doc build avoid search engine indexing

2015-05-13 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7597: -- Summary: Make default doc build avoid search engine indexing Key: SPARK-7597 URL: https://issues.apache.org/jira/browse/SPARK-7597 Project: Spark Issue

Adding/Using More Resolution Types on JIRA

2015-05-12 Thread Patrick Wendell
In Spark we sometimes close issues as something other than Fixed, and this is an important part of maintaining our JIRA. The current resolution types we use are the following: Won't Fix - bug fix or (more often) feature we don't want to add Invalid - issue is underspecified or not appropriate

[jira] [Created] (SPARK-7561) Install Junit Attachment Plugin on Jenkins

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7561: -- Summary: Install Junit Attachment Plugin on Jenkins Key: SPARK-7561 URL: https://issues.apache.org/jira/browse/SPARK-7561 Project: Spark Issue Type: Sub

[jira] [Created] (SPARK-7558) Log test name when starting and finishing each test

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7558: -- Summary: Log test name when starting and finishing each test Key: SPARK-7558 URL: https://issues.apache.org/jira/browse/SPARK-7558 Project: Spark Issue

[jira] [Created] (SPARK-7560) Make flaky tests easier to debug

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7560: -- Summary: Make flaky tests easier to debug Key: SPARK-7560 URL: https://issues.apache.org/jira/browse/SPARK-7560 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-7558) Log test name when starting and finishing each test

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7558: --- Issue Type: Sub-task (was: Improvement) Parent: SPARK-7560 Log test name when

[jira] [Created] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7590: -- Summary: Test Issue to Debug JIRA Problem Key: SPARK-7590 URL: https://issues.apache.org/jira/browse/SPARK-7590 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Fixed Issue resolved by pull request 5426 [https://github.com/apache/spark/pull

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: Test Issue to Debug JIRA Problem Key

[jira] [Created] (SPARK-7592) Resolution set to Pending Closed when using PR merge script

2015-05-12 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7592: -- Summary: Resolution set to Pending Closed when using PR merge script Key: SPARK-7592 URL: https://issues.apache.org/jira/browse/SPARK-7592 Project: Spark

[IMPORTANT] Committers please update merge script

2015-05-12 Thread Patrick Wendell
Due to an ASF infrastructure change (bug?) [1] the default JIRA resolution status has switched to Pending Closed. I've made a change to our merge script to coerce the correct status of Fixed when resolving [2]. Please upgrade the merge script to master. I've manually corrected JIRA's that were

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: Test Issue to Debug JIRA Problem Key

[jira] [Reopened] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7590: Test Issue to Debug JIRA Problem Key

[jira] [Resolved] (SPARK-7590) Test Issue to Debug JIRA Problem

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7590. Resolution: Pending Closed Issue resolved by pull request 5426 [https://github.com/apache

[jira] [Reopened] (SPARK-5182) Partitioning support for tables created by the data source API

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5182: Partitioning support for tables created by the data source API

[jira] [Resolved] (SPARK-6876) DataFrame.na.replace value support for Python

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6876. Resolution: Fixed DataFrame.na.replace value support for Python

[jira] [Reopened] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7435: Make DataFrame.show() consistent with that of Scala and pySpark

[jira] [Resolved] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7435. Resolution: Fixed Make DataFrame.show() consistent with that of Scala and pySpark

[jira] [Resolved] (SPARK-5182) Partitioning support for tables created by the data source API

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5182. Resolution: Fixed Partitioning support for tables created by the data source API

[jira] [Reopened] (SPARK-7534) Fix the Stage table when a stage is missing

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7534: Fix the Stage table when a stage is missing

<    1   2   3   4   5   6   7   8   9   10   >