[jira] [Resolved] (SPARK-28695) Make Kafka source more robust with CaseInsensitiveMap

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28695. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25418 [https://gith

[jira] [Assigned] (SPARK-28695) Make Kafka source more robust with CaseInsensitiveMap

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28695: --- Assignee: Gabor Somogyi > Make Kafka source more robust with CaseInsensitiveMap > -

[jira] [Commented] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907821#comment-16907821 ] Hyukjin Kwon commented on SPARK-28735: -- Let me take a look tomorrow in KST. > Mult

[jira] [Created] (SPARK-28740) Add support for building with bloop

2019-08-14 Thread holdenk (JIRA)
holdenk created SPARK-28740: --- Summary: Add support for building with bloop Key: SPARK-28740 URL: https://issues.apache.org/jira/browse/SPARK-28740 Project: Spark Issue Type: Improvement C

[jira] [Resolved] (SPARK-28666) Support the V2SessionCatalog in saveAsTable

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28666. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25402 [https://gith

[jira] [Assigned] (SPARK-28666) Support the V2SessionCatalog in saveAsTable

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28666: --- Assignee: Burak Yavuz > Support the V2SessionCatalog in saveAsTable > -

[jira] [Assigned] (SPARK-28351) Support DELETE in DataSource V2

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-28351: --- Assignee: Xianyin Xin > Support DELETE in DataSource V2 > --- >

[jira] [Resolved] (SPARK-28351) Support DELETE in DataSource V2

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28351. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25115 [https://gith

[jira] [Resolved] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28203. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25002 [https://gi

[jira] [Assigned] (SPARK-28203) PythonRDD should respect SparkContext's conf when passing user confMap

2019-08-14 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-28203: Assignee: Xianjin YE > PythonRDD should respect SparkContext's conf when passing user con

[jira] [Created] (SPARK-28739) Add a simple cost check for Adaptive Query Execution

2019-08-14 Thread Maryann Xue (JIRA)
Maryann Xue created SPARK-28739: --- Summary: Add a simple cost check for Adaptive Query Execution Key: SPARK-28739 URL: https://issues.apache.org/jira/browse/SPARK-28739 Project: Spark Issue Type

[jira] [Updated] (SPARK-28723) Upgrade to Hive 2.3.6 for HiveMetastore Client and Hadoop-3.2 profile

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28723: -- Parent Issue: SPARK-28684 (was: SPARK-24417) > Upgrade to Hive 2.3.6 for HiveMetastore Client

[jira] [Updated] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28710: -- Description: {code} 0: jdbc:hive2://10.18.19.208:23040/default> create function addDoubles AS

[jira] [Commented] (SPARK-28710) [UDF] create or replace permanent function does not clear the jar in class path

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907681#comment-16907681 ] Dongjoon Hyun commented on SPARK-28710: --- Thank you for reporting this, [~abhishek.

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 10:43 PM: -

[jira] [Updated] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Cooper updated SPARK-28738: -- Description: It is possible to commit metadata with an offset to Kafka. Currently, the CanCom

[jira] [Resolved] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28110. --- Resolution: Duplicate > on JDK11, IsolatedClientLoader must be able to load java.sql classes

[jira] [Commented] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907671#comment-16907671 ] Dongjoon Hyun commented on SPARK-28110: --- Yes, it does. Although SPARK-28723 provid

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907654#comment-16907654 ] Dongjoon Hyun commented on SPARK-28701: --- Thanks, [~shaneknapp]! :D > add java11 s

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 9:52 PM: --

[jira] [Comment Edited] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907642#comment-16907642 ] Joseph Cooper edited comment on SPARK-28738 at 8/14/19 9:42 PM: --

[jira] [Reopened] (SPARK-23519) Create View Commands Fails with The view output (col1,col1) contains duplicate column name

2019-08-14 Thread Franck Tago (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Franck Tago reopened SPARK-23519: - Ok Spark Community  I am sorry for being a pest about this , but I re-opening this Jira because I

[jira] [Commented] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907642#comment-16907642 ] Joseph Cooper commented on SPARK-28738: --- I think I see why commitAsync might not s

[jira] [Commented] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907635#comment-16907635 ] Dongjoon Hyun commented on SPARK-28728: --- [~Fokko]. Thank you for making a JIRA and

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28728: -- Fix Version/s: (was: 2.4.4) (was: 3.0.0) > Bump Jackson Databind to

[jira] [Resolved] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Clay resolved SPARK-28721. -- Resolution: Duplicate Ah sorry I didn't search carefully enough for a duplicate > Failing to

[jira] [Created] (SPARK-28738) Add ability to include metadata in CanCommitOffsets API

2019-08-14 Thread Joseph Cooper (JIRA)
Joseph Cooper created SPARK-28738: - Summary: Add ability to include metadata in CanCommitOffsets API Key: SPARK-28738 URL: https://issues.apache.org/jira/browse/SPARK-28738 Project: Spark Iss

[jira] [Updated] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28683: -- Issue Type: Improvement (was: Sub-task) Parent: (was: SPARK-24417) > Upgrade Scal

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907619#comment-16907619 ] Dongjoon Hyun commented on SPARK-28683: --- I got it. Yes. This is a nice-to-have. I'

[jira] [Created] (SPARK-28737) Update jersey to 2.27+ (2.29)

2019-08-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-28737: - Summary: Update jersey to 2.27+ (2.29) Key: SPARK-28737 URL: https://issues.apache.org/jira/browse/SPARK-28737 Project: Spark Issue Type: Sub-task Compon

[jira] [Commented] (SPARK-28683) Upgrade Scala to 2.12.10

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907606#comment-16907606 ] Sean Owen commented on SPARK-28683: --- I think we can detach this from the JDK 11 umbrel

[jira] [Commented] (SPARK-28110) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-08-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907604#comment-16907604 ] Sean Owen commented on SPARK-28110: --- Is this one still an issue? I think this is a clo

[jira] [Updated] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28736: -- Description: Build Spark and run PySpark UT with JDK11. {code} $ build/sbt -Phadoop-3.2 test:

[jira] [Created] (SPARK-28736) pyspark.mllib.clustering fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28736: - Summary: pyspark.mllib.clustering fails on JDK11 Key: SPARK-28736 URL: https://issues.apache.org/jira/browse/SPARK-28736 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark and run PySpark UT with JDK11. The last commented `assertTrue` faile

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark with JDK11 and run `python/run-tests --testnames 'pyspark.ml.tests.t

[jira] [Updated] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28735: -- Description: Build Spark with JDK11 and run `python/run-tests --testnames 'pyspark.ml.tests.t

[jira] [Created] (SPARK-28735) MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11

2019-08-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-28735: - Summary: MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction fails on JDK11 Key: SPARK-28735 URL: https://issues.apache.org/jira/browse/SPARK-28735

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907551#comment-16907551 ] Parth Gandhi commented on SPARK-27361: -- Makes sense, thank you. > YARN support for

[jira] [Created] (SPARK-28734) Create a table of content in the left hand side bar for SQL doc.

2019-08-14 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-28734: Summary: Create a table of content in the left hand side bar for SQL doc. Key: SPARK-28734 URL: https://issues.apache.org/jira/browse/SPARK-28734 Project: Spark

[jira] [Commented] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907522#comment-16907522 ] Patrick Clay commented on SPARK-28721: -- I confirmed this affects 2.4.1, and re-conf

[jira] [Updated] (SPARK-28721) Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver and Executors

2019-08-14 Thread Patrick Clay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Clay updated SPARK-28721: - Affects Version/s: 2.4.1 > Failing to stop SparkSession in K8S cluster mode PySpark leaks Driver

[jira] [Commented] (SPARK-27931) Accept 'on' and 'off' as input for boolean data type

2019-08-14 Thread YoungGyu Chun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907514#comment-16907514 ] YoungGyu Chun commented on SPARK-27931: --- I'll be working on this > Accept 'on' an

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907431#comment-16907431 ] Thomas Graves commented on SPARK-27361: --- Since that was done prior to this feature

[jira] [Commented] (SPARK-28701) add java11 support for spark pull request builds

2019-08-14 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907394#comment-16907394 ] shane knapp commented on SPARK-28701: - [~dongjoon] whoops! i just fixed that build.

[jira] [Commented] (SPARK-27361) YARN support for GPU-aware scheduling

2019-08-14 Thread Parth Gandhi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907391#comment-16907391 ] Parth Gandhi commented on SPARK-27361: -- [~tgraves], I was just wondering whether  h

[jira] [Resolved] (SPARK-28687) Support `epoch`, `isoyear`, `milliseconds` and `microseconds` at `extract()`

2019-08-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28687. --- Resolution: Fixed Issue resolved by pull request 25408 [https://github.com/apache/spark/pull

[jira] [Resolved] (SPARK-27739) df.persist should save stats from optimized plan

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27739. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24623 [https://gith

[jira] [Created] (SPARK-28733) DataFrameReader of Spark not able to recognize the very first quote character, while custom unicode quote character is used

2019-08-14 Thread Mrinal Bhattacherjee (JIRA)
Mrinal Bhattacherjee created SPARK-28733: Summary: DataFrameReader of Spark not able to recognize the very first quote character, while custom unicode quote character is used Key: SPARK-28733 URL: https://

[jira] [Updated] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alix Métivier updated SPARK-28732: -- Description: I am using agg function on a dataset, and i want to count the number of lines up

[jira] [Updated] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-28732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alix Métivier updated SPARK-28732: -- Description: I am using agg function on a dataset, and i want to count the number of lines up

[jira] [Created] (SPARK-28732) org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing t

2019-08-14 Thread JIRA
Alix Métivier created SPARK-28732: - Summary: org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator - failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java' when storing the result of a count aggregatio

[jira] [Updated] (SPARK-28731) Support limit on recursive queries

2019-08-14 Thread Peter Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Toth updated SPARK-28731: --- Description: Recursive queries should support LIMIT and stop recursion if the required amount of row

[jira] [Created] (SPARK-28731) Support limit on recursive queries

2019-08-14 Thread Peter Toth (JIRA)
Peter Toth created SPARK-28731: -- Summary: Support limit on recursive queries Key: SPARK-28731 URL: https://issues.apache.org/jira/browse/SPARK-28731 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-28730) Configurable type coercion policy for table insertion

2019-08-14 Thread Gengliang Wang (JIRA)
Gengliang Wang created SPARK-28730: -- Summary: Configurable type coercion policy for table insertion Key: SPARK-28730 URL: https://issues.apache.org/jira/browse/SPARK-28730 Project: Spark Iss

[jira] [Assigned] (SPARK-27739) df.persist should save stats from optimized plan

2019-08-14 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27739: --- Assignee: John Zhuge > df.persist should save stats from optimized plan > -

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: (was: Due to CVE's: https://www.cvedetails.com/vulnerability-list/vendo

[jira] [Updated] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated SPARK-28728: - Description: Needs to be upgraded due to issues. > Bump Jackson Databind to 2.9.9.3 > --

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907131#comment-16907131 ] angerszhu commented on SPARK-28726: --- [~ajithshetty]   also happen when higher timeouts

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907112#comment-16907112 ] Ajith S commented on SPARK-28726: - As i see, this is driver trying to clean up RDDs, bro

[jira] [Created] (SPARK-28729) Comparison between DecimalType and StringType may lead to wrong results

2019-08-14 Thread ShuMing Li (JIRA)
ShuMing Li created SPARK-28729: -- Summary: Comparison between DecimalType and StringType may lead to wrong results Key: SPARK-28729 URL: https://issues.apache.org/jira/browse/SPARK-28729 Project: Spark

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

2019-08-14 Thread Gabor Somogyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907016#comment-16907016 ] Gabor Somogyi commented on SPARK-28367: --- It has been turned out new API from Kafka

[jira] [Created] (SPARK-28728) Bump Jackson Databind to 2.9.9.3

2019-08-14 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-28728: Summary: Bump Jackson Databind to 2.9.9.3 Key: SPARK-28728 URL: https://issues.apache.org/jira/browse/SPARK-28728 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-28727) Request for partial least square (PLS) regression model

2019-08-14 Thread Nikunj (JIRA)
Nikunj created SPARK-28727: -- Summary: Request for partial least square (PLS) regression model Key: SPARK-28727 URL: https://issues.apache.org/jira/browse/SPARK-28727 Project: Spark Issue Type: New F

[jira] [Updated] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

2019-08-14 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-28726: -- Description: When use Spark with dynamic allocation, we set idle time to 5s We always got exception a