[jira] [Resolved] (SPARK-28759) Upgrade scala-maven-plugin to 4.1.1

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28759. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25476

[jira] [Updated] (SPARK-28765) Dependency generation for JDK8/JDK11

[ https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28765: -- Description: SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile`

[jira] [Updated] (SPARK-28765) Dependency generation for JDK8/JDK11

[ https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28765: -- Description: SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile`

[jira] [Updated] (SPARK-28765) Dependency generation for JDK8/JDK11

[ https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28765: -- Description: SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile`

[jira] [Updated] (SPARK-28765) Dependency generation for JDK8/JDK11

[ https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28765: -- Description: SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile`

[jira] [Updated] (SPARK-28765) Dependency generation for JDK8/JDK11

[ https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28765: -- Description: SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile`

[jira] [Created] (SPARK-28765) Dependency generation for JDK8/JDK11

Dongjoon Hyun created SPARK-28765: - Summary: Dependency generation for JDK8/JDK11 Key: SPARK-28765 URL: https://issues.apache.org/jira/browse/SPARK-28765 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-27659) Allow PySpark toLocalIterator to prefetch data

[ https://issues.apache.org/jira/browse/SPARK-27659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909509#comment-16909509 ] holdenk commented on SPARK-27659: - I'm working on this. > Allow PySpark toLocalIterator to prefetch

[jira] [Assigned] (SPARK-27763) Port test cases from PostgreSQL to Spark SQL

[ https://issues.apache.org/jira/browse/SPARK-27763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27763: Assignee: Yuming Wang > Port test cases from PostgreSQL to Spark SQL >

[jira] [Commented] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909446#comment-16909446 ] Dongjoon Hyun commented on SPARK-28758: --- Thanks for the advice. Yep, this is not necessary to

[jira] [Updated] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28758: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-24417) > Upgrade

[jira] [Resolved] (SPARK-28737) Update jersey to 2.27+ (2.29)

[ https://issues.apache.org/jira/browse/SPARK-28737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28737. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25455

[jira] [Commented] (SPARK-28761) spark.driver.maxResultSize only applies to compressed data

[ https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909420#comment-16909420 ] Liang-Chi Hsieh commented on SPARK-28761: - If you do it at SparkPlan.scala#L344, isn't it just

[jira] [Commented] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing

[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909409#comment-16909409 ] Liang-Chi Hsieh commented on SPARK-28732: - As {{count}} return type is LongType, I think it is

[jira] [Comment Edited] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when st

[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909409#comment-16909409 ] Liang-Chi Hsieh edited comment on SPARK-28732 at 8/16/19 9:19 PM: -- As

[jira] [Created] (SPARK-28764) Remove unnecessary writePartitionedFile method from ExternalSorter

Matt Cheah created SPARK-28764: -- Summary: Remove unnecessary writePartitionedFile method from ExternalSorter Key: SPARK-28764 URL: https://issues.apache.org/jira/browse/SPARK-28764 Project: Spark

[jira] [Updated] (SPARK-28701) add java11 support for spark pull request builds

[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28701: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-24417 > add java11 support for

[jira] [Comment Edited] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909379#comment-16909379 ] Dongjoon Hyun edited comment on SPARK-28763 at 8/16/19 8:41 PM: Hi,

[jira] [Commented] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909379#comment-16909379 ] Dongjoon Hyun commented on SPARK-28763: --- Hi, [~yumwang] and [~smilegator]. This test suite seems

[jira] [Updated] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28763: -- Description: {code}

[jira] [Updated] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28763: -- Attachment: Screen Shot 2019-08-16 at 1.34.23 PM.png > Flaky Tests: >

[jira] [Updated] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28763: -- Description: {code}

[jira] [Created] (SPARK-28763) Flaky Test

Dongjoon Hyun created SPARK-28763: - Summary: Flaky Test Key: SPARK-28763 URL: https://issues.apache.org/jira/browse/SPARK-28763 Project: Spark Issue Type: Bug Components: SQL

[jira] [Updated] (SPARK-28763) Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get binary type

[ https://issues.apache.org/jira/browse/SPARK-28763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28763: -- Summary: Flaky Tests: SparkThriftServerProtocolVersionsSuite.HIVE_CLI_SERVICE_PROTOCOL_V1 get

[jira] [Commented] (SPARK-21097) Dynamic allocation will preserve cached data

[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909342#comment-16909342 ] Adam Kennedy commented on SPARK-21097: -- Another supporting reason for supporting transfer of memory

[jira] [Created] (SPARK-28762) Read JAR main class if JAR is not located in local file system

Ivan Gozali created SPARK-28762: --- Summary: Read JAR main class if JAR is not located in local file system Key: SPARK-28762 URL: https://issues.apache.org/jira/browse/SPARK-28762 Project: Spark

[jira] [Updated] (SPARK-28762) Read JAR main class if JAR is not located in local file system

[ https://issues.apache.org/jira/browse/SPARK-28762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Gozali updated SPARK-28762: Priority: Minor (was: Major) > Read JAR main class if JAR is not located in local file system >

[jira] [Resolved] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28758. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25474

[jira] [Resolved] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28722. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25442

[jira] [Assigned] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28722: - Assignee: Liang-Chi Hsieh > Change sequential label sorting in StringIndexer fit to parallel >

[jira] [Updated] (SPARK-28722) Change sequential label sorting in StringIndexer fit to parallel

[ https://issues.apache.org/jira/browse/SPARK-28722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-28722: -- Priority: Minor (was: Major) > Change sequential label sorting in StringIndexer fit to parallel >

[jira] [Assigned] (SPARK-28755) test_mllib_classification fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28755: - Assignee: Hyukjin Kwon > test_mllib_classification fails on JDK11 >

[jira] [Resolved] (SPARK-28755) test_mllib_classification fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28755. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25478

[jira] [Resolved] (SPARK-28756) Fix checkJavaVersion to accept JDK8+

[ https://issues.apache.org/jira/browse/SPARK-28756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28756. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25472

[jira] [Commented] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909163#comment-16909163 ] Sean Owen commented on SPARK-28758: --- It doesn't really matter, but I don't know if this is strictly

[jira] [Resolved] (SPARK-28757) File table location should include both values of option `path` and `paths`

[ https://issues.apache.org/jira/browse/SPARK-28757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28757. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25473

[jira] [Assigned] (SPARK-28757) File table location should include both values of option `path` and `paths`

[ https://issues.apache.org/jira/browse/SPARK-28757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28757: --- Assignee: Gengliang Wang > File table location should include both values of option `path`

[jira] [Updated] (SPARK-28761) spark.driver.maxResultSize only applies to compressed data

[ https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-28761: -- Description: Spark has a setting {{spark.driver.maxResultSize}}, see

[jira] [Updated] (SPARK-28761) spark.driver.maxResultSize only applies to compressed data

[ https://issues.apache.org/jira/browse/SPARK-28761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Vogelbacher updated SPARK-28761: -- Description: Spark has a setting {{spark.driver.maxResultSize}}, see

[jira] [Resolved] (SPARK-28671) [UDF] dropping permanent function when a temporary function with the same name already exists giving wrong msg on dropping it again

[ https://issues.apache.org/jira/browse/SPARK-28671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28671. -- Resolution: Fixed Assignee: pavithra ramachandran Fix Version/s: 3.0.0

[jira] [Created] (SPARK-28761) spark.driver.maxResultSize only applies to compressed data

David Vogelbacher created SPARK-28761: - Summary: spark.driver.maxResultSize only applies to compressed data Key: SPARK-28761 URL: https://issues.apache.org/jira/browse/SPARK-28761 Project: Spark

[jira] [Updated] (SPARK-28121) String Functions: decode can not accept 'escape' and 'hex' as charset

[ https://issues.apache.org/jira/browse/SPARK-28121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28121: Summary: String Functions: decode can not accept 'escape' and 'hex' as charset (was: String

[jira] [Updated] (SPARK-28121) String Functions: decode can not accept 'escape' as charset

[ https://issues.apache.org/jira/browse/SPARK-28121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28121: Description: {noformat} postgres=# select decode('1234567890','escape'); decode

[jira] [Commented] (SPARK-28742) StackOverflowError when using otherwise(col()) in a loop

[ https://issues.apache.org/jira/browse/SPARK-28742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909052#comment-16909052 ] eugen yushin commented on SPARK-28742: -- Looks like the issue is diff in logic between LocalRelation

[jira] [Commented] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908995#comment-16908995 ] Takeshi Yamamuro commented on SPARK-28587: -- oh, I see. Nice catch! Before we decide to use the

[jira] [Closed] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28748. - > 0 as decimal (n , n) in Hive tables shows as NULL in Spark >

[jira] [Resolved] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28748. --- Resolution: Duplicate Fix Version/s: (was: 3.0.0) > 0 as decimal (n , n) in Hive

[jira] [Reopened] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reopened SPARK-28748: --- > 0 as decimal (n , n) in Hive tables shows as NULL in Spark >

[jira] [Resolved] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28748. --- Resolution: Fixed Fix Version/s: 3.0.0 Thank you for reporting, [~RohitSindhu]. As

[jira] [Commented] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908973#comment-16908973 ] Dongjoon Hyun commented on SPARK-28748: --- Thanks! Then, I'll resolve this as an issue superseded by

[jira] [Commented] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908970#comment-16908970 ] Yuming Wang commented on SPARK-28748: - Yes > 0 as decimal (n , n) in Hive tables shows as NULL in

[jira] [Commented] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908969#comment-16908969 ] Dongjoon Hyun commented on SPARK-28748: --- Thank you for pinging me, [~yumwang]. So, the fix is only

[jira] [Resolved] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28735. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25475

[jira] [Resolved] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28736. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25475

[jira] [Updated] (SPARK-28756) Fix checkJavaVersion to accept JDK8+

[ https://issues.apache.org/jira/browse/SPARK-28756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28756: -- Summary: Fix checkJavaVersion to accept JDK8+ (was: checkJavaVersion fails on JDK11) > Fix

[jira] [Resolved] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28728. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25451

[jira] [Assigned] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28728: - Assignee: Fokko Driesprong > Bump Jackson Databind to 2.9.9.3 >

[jira] [Updated] (SPARK-28760) Add end-to-end Kafka delegation token test

[ https://issues.apache.org/jira/browse/SPARK-28760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28760: -- Description: At the moment no end-to-end Kafka delegation token test exists which was mainly

[jira] [Commented] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908940#comment-16908940 ] Yuming Wang commented on SPARK-28748: - cc [~dongjoon] We really hit this issue. > 0 as decimal (n ,

[jira] [Commented] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908937#comment-16908937 ] Yuming Wang commented on SPARK-28748: - We fixed it by upgrade built-in Hive to 2.3.5 and we has

[jira] [Created] (SPARK-28760) Add end-to-end Kafka delegation token test

Gabor Somogyi created SPARK-28760: - Summary: Add end-to-end Kafka delegation token test Key: SPARK-28760 URL: https://issues.apache.org/jira/browse/SPARK-28760 Project: Spark Issue Type:

[jira] [Updated] (SPARK-28748) 0 as decimal (n , n) in Hive tables shows as NULL in Spark

[ https://issues.apache.org/jira/browse/SPARK-28748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-28748: Attachment: image-2019-08-16-18-18-19-279.png > 0 as decimal (n , n) in Hive tables shows as NULL

[jira] [Assigned] (SPARK-28759) Upgrade scala-maven-plugin to 4.1.1

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28759: - Assignee: Dongjoon Hyun > Upgrade scala-maven-plugin to 4.1.1 >

[jira] [Closed] (SPARK-27704) Change default class loader to ParallelGC

[ https://issues.apache.org/jira/browse/SPARK-27704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-27704. - > Change default class loader to ParallelGC > - > >

[jira] [Assigned] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28736: Assignee: Hyukjin Kwon > pyspark.mllib.clustering fails on JDK11 >

[jira] [Created] (SPARK-28759) Upgrade scala-maven-plugin to 4.1.1

Dongjoon Hyun created SPARK-28759: - Summary: Upgrade scala-maven-plugin to 4.1.1 Key: SPARK-28759 URL: https://issues.apache.org/jira/browse/SPARK-28759 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28735: Assignee: Hyukjin Kwon >

[jira] [Closed] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-28110. - > on JDK11, IsolatedClientLoader must be able to load java.sql classes >

[jira] [Closed] (SPARK-27587) No such method error (sun.nio.ch.DirectBuffer.cleaner()) when reading big table from JDBC (with one slow query)

[ https://issues.apache.org/jira/browse/SPARK-27587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-27587. - > No such method error (sun.nio.ch.DirectBuffer.cleaner()) when reading big > table from JDBC

[jira] [Closed] (SPARK-27585) No such method error (sun.nio.ch.DirectBuffer.cleaner())

[ https://issues.apache.org/jira/browse/SPARK-27585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-27585. - > No such method error (sun.nio.ch.DirectBuffer.cleaner()) >

[jira] [Closed] (SPARK-26896) Add maven profiles for running tests with JDK 11

[ https://issues.apache.org/jira/browse/SPARK-26896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-26896. - > Add maven profiles for running tests with JDK 11 >

[jira] [Updated] (SPARK-18466) Missing withFilter method causes errors when using for comprehensions in Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-18466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-18466: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-24417) > Missing

[jira] [Updated] (SPARK-25939) Spark 'jshell' support on JDK 11

[ https://issues.apache.org/jira/browse/SPARK-25939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25939: -- Issue Type: New Feature (was: Sub-task) Parent: (was: SPARK-24417) > Spark

[jira] [Updated] (SPARK-25596) TLS1.3 support

[ https://issues.apache.org/jira/browse/SPARK-25596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25596: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-24417) > TLS1.3

[jira] [Comment Edited] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908881#comment-16908881 ] wyp edited comment on SPARK-28587 at 8/16/19 9:19 AM: -- [~maropu], Thank you for

[jira] [Commented] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908881#comment-16908881 ] wyp commented on SPARK-28587: - [~maropu], Thank you for your reply.  If the type of the TIMES field is

[jira] [Updated] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wyp updated SPARK-28587: Description: When we use JDBC data source to search data from Phoenix, and use timestamp data type column for

[jira] [Assigned] (SPARK-28737) Update jersey to 2.27+ (2.29)

[ https://issues.apache.org/jira/browse/SPARK-28737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28737: - Assignee: Sean Owen > Update jersey to 2.27+ (2.29) > - >

[jira] [Resolved] (SPARK-28750) Use `--release 8` for javac

[ https://issues.apache.org/jira/browse/SPARK-28750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28750. --- Resolution: Later > Use `--release 8` for javac > --- > >

[jira] [Updated] (SPARK-28587) JDBC data source's partition whereClause should support jdbc dialect

[ https://issues.apache.org/jira/browse/SPARK-28587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wyp updated SPARK-28587: Description: When we use JDBC data source to search data from Phoenix, and use timestamp data type column for

[jira] [Assigned] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28758: - Assignee: Dongjoon Hyun > Upgrade Janino to 3.0.15 > > >

[jira] [Updated] (SPARK-28758) Upgrade Janino to 3.0.15

[ https://issues.apache.org/jira/browse/SPARK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28758: -- Component/s: Build > Upgrade Janino to 3.0.15 > > >

[jira] [Updated] (SPARK-24417) Build and Run Spark on JDK11

[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-24417: -- Target Version/s: 3.0.0 > Build and Run Spark on JDK11 > > >

[jira] [Created] (SPARK-28758) Upgrade Janino to 3.0.15

Dongjoon Hyun created SPARK-28758: - Summary: Upgrade Janino to 3.0.15 Key: SPARK-28758 URL: https://issues.apache.org/jira/browse/SPARK-28758 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28757) File table location should include both values of option `path` and `paths`

Gengliang Wang created SPARK-28757: -- Summary: File table location should include both values of option `path` and `paths` Key: SPARK-28757 URL: https://issues.apache.org/jira/browse/SPARK-28757

[jira] [Assigned] (SPARK-28756) checkJavaVersion fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28756: - Assignee: Dongjoon Hyun > checkJavaVersion fails on JDK11 >

[jira] [Updated] (SPARK-28743) YarnShuffleService leads to NodeManager OOM because ChannelOutboundBuffer has too many entries

[ https://issues.apache.org/jira/browse/SPARK-28743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated SPARK-28743: -- Summary: YarnShuffleService leads to NodeManager OOM because ChannelOutboundBuffer has too

[jira] [Created] (SPARK-28756) checkJavaVersion fails on JDK11

Dongjoon Hyun created SPARK-28756: - Summary: checkJavaVersion fails on JDK11 Key: SPARK-28756 URL: https://issues.apache.org/jira/browse/SPARK-28756 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28755) test_mllib_classification fails on JDK11

Dongjoon Hyun created SPARK-28755: - Summary: test_mllib_classification fails on JDK11 Key: SPARK-28755 URL: https://issues.apache.org/jira/browse/SPARK-28755 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28755) test_mllib_classification fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28755: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-24417 > test_mllib_classification

[jira] [Comment Edited] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908714#comment-16908714 ] angerszhu edited comment on SPARK-28726 at 8/16/19 6:03 AM: [~hyukjin.kwon]