[jira] [Created] (SPARK-14960) Don't perform treeAggregation in local mode

2016-04-27 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14960: -- Summary: Don't perform treeAggregation in local mode Key: SPARK-14960 URL: https://issues.apache.org/jira/browse/SPARK-14960 Project: Spark Issue Type:

[jira] [Created] (SPARK-14936) FlumePollingStreamSuite is slow

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14936: -- Summary: FlumePollingStreamSuite is slow Key: SPARK-14936 URL: https://issues.apache.org/jira/browse/SPARK-14936 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14935) DistributedSuite "local-cluster format" shouldn't actually launch clusters

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14935: -- Summary: DistributedSuite "local-cluster format" shouldn't actually launch clusters Key: SPARK-14935 URL: https://issues.apache.org/jira/browse/SPARK-14935 Project:

[jira] [Created] (SPARK-14934) Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files"

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14934: -- Summary: Slow JsonHadoopFsRelationSuite test: "SPARK-8406: Avoids name collision while writing files" Key: SPARK-14934 URL: https://issues.apache.org/jira/browse/SPARK-14934

[jira] [Resolved] (SPARK-14925) Published POMs should be flattened

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14925. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12706

[jira] [Updated] (SPARK-14511) Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14511: --- Assignee: Jakob Odersky > Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258982#comment-15258982 ] Josh Rosen commented on SPARK-14519: Given that Scala 2.12 hasn't been released yet, I think that our

[jira] [Assigned] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-13693: -- Assignee: Josh Rosen (was: Shixiong Zhu) > Flaky test: o.a.s.streaming.MapWithStateSuite >

[jira] [Created] (SPARK-14930) Race condition in CheckpointWriter.stop()

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14930: -- Summary: Race condition in CheckpointWriter.stop() Key: SPARK-14930 URL: https://issues.apache.org/jira/browse/SPARK-14930 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258867#comment-15258867 ] Josh Rosen commented on SPARK-13693: I think that I've spotted the race: If the stopping thread

[jira] [Commented] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258856#comment-15258856 ] Josh Rosen commented on SPARK-13693: Yep, there's definitely a race condition here: {code} 16/04/26

[jira] [Commented] (SPARK-13693) Flaky test: o.a.s.streaming.MapWithStateSuite

2016-04-26 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258809#comment-15258809 ] Josh Rosen commented on SPARK-13693: I was able to reproduce some of this flakiness locally and

[jira] [Created] (SPARK-14925) Published POMs should be flattened

2016-04-26 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14925: -- Summary: Published POMs should be flattened Key: SPARK-14925 URL: https://issues.apache.org/jira/browse/SPARK-14925 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-14761) PySpark DataFrame.join should reject invalid join methods even when join columns are not specified

2016-04-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255697#comment-15255697 ] Josh Rosen commented on SPARK-14761: There's already logic for handling this in the JVM Spark SQL's

[jira] [Commented] (SPARK-14708) Repl Serialization Issue

2016-04-24 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15255690#comment-15255690 ] Josh Rosen commented on SPARK-14708: [~srowen], I helped [~bill_chambers] to look into this. My best

[jira] [Resolved] (SPARK-14807) Create a compatibility module

2016-04-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14807. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12580

[jira] [Created] (SPARK-14863) Cache TreeNode's hashCode

2016-04-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14863: -- Summary: Cache TreeNode's hashCode Key: SPARK-14863 URL: https://issues.apache.org/jira/browse/SPARK-14863 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14783: -- Assignee: Josh Rosen > Log full exception stacktrace in IsolatedClientLoader >

[jira] [Resolved] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14783. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12548

[jira] [Created] (SPARK-14797) Spark SQL should not hardcode dependency on spark-sketch_2.11

2016-04-21 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14797: -- Summary: Spark SQL should not hardcode dependency on spark-sketch_2.11 Key: SPARK-14797 URL: https://issues.apache.org/jira/browse/SPARK-14797 Project: Spark

[jira] [Created] (SPARK-14786) Remove hive-cli dependency from hive subproject

2016-04-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14786: -- Summary: Remove hive-cli dependency from hive subproject Key: SPARK-14786 URL: https://issues.apache.org/jira/browse/SPARK-14786 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14783) Log full exception stacktrace in IsolatedClientLoader

2016-04-20 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14783: --- Summary: Log full exception stacktrace in IsolatedClientLoader (was: Log full stacktrace in

[jira] [Created] (SPARK-14783) Log full stacktrace in IsolatedClientLoader

2016-04-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14783: -- Summary: Log full stacktrace in IsolatedClientLoader Key: SPARK-14783 URL: https://issues.apache.org/jira/browse/SPARK-14783 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-14761) PySpark DataFrame.join should reject invalid join methods even when join columns are not specified

2016-04-20 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14761: -- Summary: PySpark DataFrame.join should reject invalid join methods even when join columns are not specified Key: SPARK-14761 URL: https://issues.apache.org/jira/browse/SPARK-14761

[jira] [Updated] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14719: --- Target Version/s: (was: 2.0.0) > WriteAheadLogBasedBlockHandler should ignore BlockManager put

[jira] [Resolved] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14719. Resolution: Won't Fix > WriteAheadLogBasedBlockHandler should ignore BlockManager put errors >

[jira] [Updated] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14719: --- Fix Version/s: (was: 2.0.0) > WriteAheadLogBasedBlockHandler should ignore BlockManager put

[jira] [Reopened] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-19 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-14719: Reverted this patch and am marking as "won't fix" for now. See discussion on PR for explanation of

[jira] [Created] (SPARK-14719) WriteAheadLogBasedBlockHandler should ignore BlockManager put errors

2016-04-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14719: -- Summary: WriteAheadLogBasedBlockHandler should ignore BlockManager put errors Key: SPARK-14719 URL: https://issues.apache.org/jira/browse/SPARK-14719 Project: Spark

[jira] [Resolved] (SPARK-14504) Enable Oracle docker integration tests

2016-04-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14504. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12270

[jira] [Updated] (SPARK-14504) Enable Oracle docker integration tests

2016-04-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14504: --- Assignee: Luciano Resende > Enable Oracle docker integration tests >

[jira] [Commented] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

2016-04-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244480#comment-15244480 ] Josh Rosen commented on SPARK-14648: I think that this should have been fixed by now. Going to mark

[jira] [Resolved] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

2016-04-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14648. Resolution: Fixed > Spark EC2 script creates cluster but spark is not installed properly. >

[jira] [Commented] (SPARK-14686) Implement a non-inheritable localProperty facility

2016-04-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244478#comment-15244478 ] Josh Rosen commented on SPARK-14686: The idea of making these properties non-inheritable has come up

[jira] [Created] (SPARK-14676) Catch, wrap, and re-throw exceptions from Await.result in order to capture full stacktrace

2016-04-15 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14676: -- Summary: Catch, wrap, and re-throw exceptions from Await.result in order to capture full stacktrace Key: SPARK-14676 URL: https://issues.apache.org/jira/browse/SPARK-14676

[jira] [Commented] (SPARK-14648) Spark EC2 script creates cluster but spark is not installed properly.

2016-04-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243275#comment-15243275 ] Josh Rosen commented on SPARK-14648: Yeah, so I've been working on this on and off and I think that

[jira] [Assigned] (SPARK-14650) Compile Spark REPL for Scala 2.12

2016-04-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14650: -- Assignee: Josh Rosen > Compile Spark REPL for Scala 2.12 > -

[jira] [Commented] (SPARK-14650) Compile Spark REPL for Scala 2.12

2016-04-15 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242529#comment-15242529 ] Josh Rosen commented on SPARK-14650: Fortunately, this is going to be really easy. It looks like the

[jira] [Created] (SPARK-14650) Compile Spark REPL for Scala 2.12

2016-04-14 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14650: -- Summary: Compile Spark REPL for Scala 2.12 Key: SPARK-14650 URL: https://issues.apache.org/jira/browse/SPARK-14650 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14280: --- Description: The following instructions will be kept quasi-up-to-date and are the best starting

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242160#comment-15242160 ] Josh Rosen commented on SPARK-14540: There's now a Scala PR to fix this:

[jira] [Updated] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14280: --- Description: The following instructions will be kept quasi-up-to-date and are the best starting

[jira] [Updated] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14280: --- Description: The following instructions will be kept quasi-up-to-date and are the best starting

[jira] [Updated] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14280: --- Description: The following instructions will be kept quasi-up-to-date and are the best starting

[jira] [Updated] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14280: --- Description: The following instructions will be kept quasi-up-to-date and are the best starting

[jira] [Commented] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242130#comment-15242130 ] Josh Rosen commented on SPARK-14519: I emailed the Kafka dev list:

[jira] [Created] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2016-04-14 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14643: -- Summary: Remove overloaded methods which become ambiguous in Scala 2.12 Key: SPARK-14643 URL: https://issues.apache.org/jira/browse/SPARK-14643 Project: Spark

[jira] [Assigned] (SPARK-14643) Remove overloaded methods which become ambiguous in Scala 2.12

2016-04-14 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14643: -- Assignee: Josh Rosen > Remove overloaded methods which become ambiguous in Scala 2.12 >

[jira] [Resolved] (SPARK-14574) Pure Java modules should not have _2.xx suffixes in their package names

2016-04-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14574. Resolution: Later Resolving as "later" since this is prohibitively costly to fix and I don't have

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2016-04-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238602#comment-15238602 ] Josh Rosen commented on SPARK-14540: I found a problem which seems to prevent the cleaning /

[jira] [Created] (SPARK-14584) Improve recognition of non-nullability in Dataset transformations

2016-04-12 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14584: -- Summary: Improve recognition of non-nullability in Dataset transformations Key: SPARK-14584 URL: https://issues.apache.org/jira/browse/SPARK-14584 Project: Spark

[jira] [Updated] (SPARK-14574) Pure Java modules should not have _2.xx suffixes in their package names

2016-04-12 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14574: --- Summary: Pure Java modules should not have _2.xx suffixes in their package names (was: Scala-free

[jira] [Created] (SPARK-14574) Scala-free modules should not have _2.xx suffixes in their package names

2016-04-12 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14574: -- Summary: Scala-free modules should not have _2.xx suffixes in their package names Key: SPARK-14574 URL: https://issues.apache.org/jira/browse/SPARK-14574 Project: Spark

[jira] [Updated] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10521: --- Assignee: Luciano Resende > Utilize Docker to test DB2 JDBC Dialect support >

[jira] [Resolved] (SPARK-10521) Utilize Docker to test DB2 JDBC Dialect support

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10521. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 9893

[jira] [Reopened] (SPARK-1844) Support maven-style dependency resolution in sbt build

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-1844: --- Assignee: Josh Rosen (was: Prashant Sharma) > Support maven-style dependency resolution in sbt

[jira] [Updated] (SPARK-14401) Switch to stock sbt-pom-reader plugin

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14401: --- Summary: Switch to stock sbt-pom-reader plugin (was: Merge our sbt-pom-reader changes upstream) >

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Priority: Blocker (was: Critical) > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Affects Version/s: 2.0.0 > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236094#comment-15236094 ] Josh Rosen commented on SPARK-14521: Downgrading to Kryo 2 is not an option so we'll have to fix

[jira] [Updated] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS Query27

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14521: --- Priority: Critical (was: Major) > StackOverflowError in Kryo when executing TPC-DS Query27 >

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235889#comment-15235889 ] Josh Rosen commented on SPARK-14540: It looks like there's a few problems here: First, the

[jira] [Updated] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14540: --- Component/s: (was: Project Infra) (was: Build) Spark Core

[jira] [Updated] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14540: --- Summary: Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner (was: Support Scala 2.12

[jira] [Created] (SPARK-14540) Support Scala 2.12 closures in ClosureCleaner

2016-04-11 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14540: -- Summary: Support Scala 2.12 closures in ClosureCleaner Key: SPARK-14540 URL: https://issues.apache.org/jira/browse/SPARK-14540 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12 or remove json4s dependency

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235742#comment-15235742 ] Josh Rosen commented on SPARK-14439: For now, I managed to hack the build to cross-publish for

[jira] [Commented] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-11 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235740#comment-15235740 ] Josh Rosen commented on SPARK-14280: I have WIP code for this at

[jira] [Created] (SPARK-14519) Cross-publish Kafka for Scala 2.12.0-M4

2016-04-10 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14519: -- Summary: Cross-publish Kafka for Scala 2.12.0-M4 Key: SPARK-14519 URL: https://issues.apache.org/jira/browse/SPARK-14519 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14511) Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version

2016-04-09 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14511: -- Summary: Publish our forked genjavadoc for 2.12.0-M4 or stop using a forked version Key: SPARK-14511 URL: https://issues.apache.org/jira/browse/SPARK-14511 Project:

[jira] [Assigned] (SPARK-14222) Cross-publish jackson-module-scala for Scala 2.12

2016-04-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14222: -- Assignee: Josh Rosen > Cross-publish jackson-module-scala for Scala 2.12 >

[jira] [Commented] (SPARK-14221) Cross-publish Chill for Scala 2.12

2016-04-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233818#comment-15233818 ] Josh Rosen commented on SPARK-14221: I have an open pull request against Chill:

[jira] [Assigned] (SPARK-14280) Update change-version.sh and pom.xml to add Scala 2.12 profiles

2016-04-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14280: -- Assignee: Josh Rosen > Update change-version.sh and pom.xml to add Scala 2.12 profiles >

[jira] [Assigned] (SPARK-14221) Cross-publish Chill for Scala 2.12

2016-04-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-14221: -- Assignee: Josh Rosen > Cross-publish Chill for Scala 2.12 >

[jira] [Commented] (SPARK-928) Add support for Unsafe-based serializer in Kryo 2.22

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233162#comment-15233162 ] Josh Rosen commented on SPARK-928: -- We've now upgraded to Kryo 3.0.0 (in SPARK-11416), so it would be

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233159#comment-15233159 ] Josh Rosen commented on SPARK-7708: --- I just upgraded to Kryo 3.0.0 in SPARK-11416, so if someone want to

[jira] [Resolved] (SPARK-11416) Upgrade kryo package to version 3.0

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-11416. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12076

[jira] [Commented] (SPARK-10793) Make spark's use/subclassing of hive more maintainable

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233108#comment-15233108 ] Josh Rosen commented on SPARK-10793: The Kryo part of this seems to be addressed by my reintroduction

[jira] [Resolved] (SPARK-14435) Shade Kryo in our custom Hive 1.2.1 fork

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14435. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12215

[jira] [Updated] (SPARK-14222) Cross-publish jackson-module-scala for Scala 2.12

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14222: --- Summary: Cross-publish jackson-module-scala for Scala 2.12 (was: Remove jackson-module-scala

[jira] [Updated] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12 or remove json4s dependency

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14439: --- Summary: Cross-publish json4s-jackson for Scala 2.12 or remove json4s dependency (was:

[jira] [Commented] (SPARK-14438) Cross-publish Breeze for Scala 2.12

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232765#comment-15232765 ] Josh Rosen commented on SPARK-14438: If we upgrade to the latest version of Breeze, this is going to

[jira] [Commented] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15232664#comment-15232664 ] Josh Rosen commented on SPARK-14401: I saw that change; it seems pretty complicated, so I think it's

[jira] [Comment Edited] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229562#comment-15229562 ] Josh Rosen edited comment on SPARK-8815 at 4/7/16 2:35 AM: --- This issue should be

[jira] [Resolved] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-8815. --- Resolution: Fixed Fix Version/s: 2.0.0 > illegal java package names in jar >

[jira] [Resolved] (SPARK-14134) SQLListenerSuite fails on maven builds

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14134. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11941

[jira] [Reopened] (SPARK-8815) illegal java package names in jar

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-8815: --- Assignee: Marcelo Vanzin This issue should be fixed by

[jira] [Updated] (SPARK-14134) SQLListenerSuite fails on maven builds

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-14134: --- Assignee: Marcelo Vanzin > SQLListenerSuite fails on maven builds >

[jira] [Commented] (SPARK-14222) Remove jackson-module-scala dependency or cross-publish Jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229512#comment-15229512 ] Josh Rosen commented on SPARK-14222: Decided to cross-publish instead since I think we want to keep

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229365#comment-15229365 ] Josh Rosen commented on SPARK-14439: Using vanilla Jackson (or Jackson Jr.) instead of json4s would

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229334#comment-15229334 ] Josh Rosen commented on SPARK-14439: How much work will it be to remove our {{json4s}} dependency? >

[jira] [Commented] (SPARK-14222) Remove jackson-module-scala dependency or cross-publish Jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228986#comment-15228986 ] Josh Rosen commented on SPARK-14222: I believe that our use of jackson-module-scala is somewhat

[jira] [Commented] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228961#comment-15228961 ] Josh Rosen commented on SPARK-14439: Filed https://github.com/json4s/json4s/issues/362 to request

[jira] [Created] (SPARK-14439) Cross-publish json4s-jackson for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14439: -- Summary: Cross-publish json4s-jackson for Scala 2.12 Key: SPARK-14439 URL: https://issues.apache.org/jira/browse/SPARK-14439 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-14438) Cross-publish Breeze for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228953#comment-15228953 ] Josh Rosen commented on SPARK-14438: I filed https://github.com/scalanlp/breeze/issues/520 to request

[jira] [Created] (SPARK-14438) Cross-publish Breeze for Scala 2.12

2016-04-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14438: -- Summary: Cross-publish Breeze for Scala 2.12 Key: SPARK-14438 URL: https://issues.apache.org/jira/browse/SPARK-14438 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-14435) Shade Kryo in our custom Hive 1.2.1 fork

2016-04-06 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14435: -- Summary: Shade Kryo in our custom Hive 1.2.1 fork Key: SPARK-14435 URL: https://issues.apache.org/jira/browse/SPARK-14435 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15225827#comment-15225827 ] Josh Rosen commented on SPARK-14401: By the way, one of my main motivators for being able to switch

[jira] [Created] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14401: -- Summary: Merge our sbt-pom-reader changes upstream Key: SPARK-14401 URL: https://issues.apache.org/jira/browse/SPARK-14401 Project: Spark Issue Type:

[jira] [Created] (SPARK-14399) Remove unnecessary excludes from POMs

2016-04-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14399: -- Summary: Remove unnecessary excludes from POMs Key: SPARK-14399 URL: https://issues.apache.org/jira/browse/SPARK-14399 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-14366) Remove SBT-Idea plugin

2016-04-04 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14366. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12151

<    5   6   7   8   9   10   11   12   13   14   >