[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416071#comment-17416071 ] Lukas Rytz commented on SPARK-33772: [~dongjoon] do you mean an example like this? {code:java} $>

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz edited comment on SPARK-33772 at 9/15/21, 7:40 AM: -- > Could you

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz edited comment on SPARK-33772 at 9/15/21, 7:40 AM: -- > Could you

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz edited comment on SPARK-33772 at 9/15/21, 7:39 AM: -- > Could you

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz edited comment on SPARK-33772 at 9/15/21, 7:39 AM: -- > Could you

[jira] [Comment Edited] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz edited comment on SPARK-33772 at 9/15/21, 7:38 AM: -- > Could you

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415357#comment-17415357 ] Lukas Rytz commented on SPARK-33772: > Could you test it with `--add-opens` please, Lukas Rytz? I

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415081#comment-17415081 ] Lukas Rytz commented on SPARK-33772: It works for me (Adoptium). Maybe it's because the option needs

[jira] [Created] (SPARK-36712) Published 2.13 POM lists `scala-parallel-collections` only in `scala-2.13` profile

Lukas Rytz created SPARK-36712: -- Summary: Published 2.13 POM lists `scala-parallel-collections` only in `scala-2.13` profile Key: SPARK-36712 URL: https://issues.apache.org/jira/browse/SPARK-36712

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411984#comment-17411984 ] Lukas Rytz commented on SPARK-33772: > Scala 2.12 doesn't seem to fit well because there are some

[jira] [Commented] (SPARK-33772) Build and Run Spark on Java 17

[ https://issues.apache.org/jira/browse/SPARK-33772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411980#comment-17411980 ] Lukas Rytz commented on SPARK-33772: > JDK8 will fail at startup if you give `--add-opens`. The

[jira] [Commented] (SPARK-25075) Build and test Spark against Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-25075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841287#comment-16841287 ] Lukas Rytz commented on SPARK-25075: In our own interest of testing Scala the 2.13 RCs, I took a

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839341#comment-16839341 ] Lukas Rytz commented on SPARK-27681: Uh, I just did "find usages" in IntelliJ for the scala.Seq type

[jira] [Commented] (SPARK-27681) Use scala.collection.Seq explicitly instead of scala.Seq alias

[ https://issues.apache.org/jira/browse/SPARK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16839280#comment-16839280 ] Lukas Rytz commented on SPARK-27681: I think the best solution for 2.13, if we forget about 2.12,

[jira] [Commented] (SPARK-27683) Remove usage of TraversableOnce

[ https://issues.apache.org/jira/browse/SPARK-27683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838548#comment-16838548 ] Lukas Rytz commented on SPARK-27683: bq. This makes it hard to create an API method that works in

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573570#comment-16573570 ] Lukas Rytz commented on SPARK-25044: This problem relates to what had to be solved for the closure

[jira] [Commented] (SPARK-25044) Address translation of LMF closure primitive args to Object in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572775#comment-16572775 ] Lukas Rytz commented on SPARK-25044: The encoding is as expected. To expand on a few details * The

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572717#comment-16572717 ] Lukas Rytz commented on SPARK-25047: Here is some older discussion:

[jira] [Commented] (SPARK-25047) Can't assign SerializedLambda to scala.Function1 in deserialization of BucketedRandomProjectionLSHModel

[ https://issues.apache.org/jira/browse/SPARK-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572713#comment-16572713 ] Lukas Rytz commented on SPARK-25047:  I don't have the full picture, or an example at hand, but I

[jira] [Commented] (SPARK-14220) Build and test Spark against Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541484#comment-16541484 ] Lukas Rytz commented on SPARK-14220: This is a limitation in overloading resolution that might be

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16515648#comment-16515648 ] Lukas Rytz commented on SPARK-14540: [~skonto] and me (both from Lightbend) are working on this

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180689#comment-16180689 ] Lukas Rytz commented on SPARK-14540: Ah, you just found a new bug in Scala 2.12! I created a ticket

[jira] [Comment Edited] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119524#comment-16119524 ] Lukas Rytz edited comment on SPARK-14540 at 8/9/17 7:37 AM: [~joshrosen] the

[jira] [Comment Edited] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119524#comment-16119524 ] Lukas Rytz edited comment on SPARK-14540 at 8/9/17 7:37 AM: [~joshrosen] the

[jira] [Comment Edited] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119524#comment-16119524 ] Lukas Rytz edited comment on SPARK-14540 at 8/9/17 7:34 AM: [~joshrosen] the

[jira] [Commented] (SPARK-14540) Support Scala 2.12 closures and Java 8 lambdas in ClosureCleaner

[ https://issues.apache.org/jira/browse/SPARK-14540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119524#comment-16119524 ] Lukas Rytz commented on SPARK-14540: [~joshrosen] the closure in your last example is serializable