[jira] [Resolved] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31855. - Resolution: Fixed Issue resolved by pull request 28664

[jira] [Commented] (SPARK-31333) Document Hints

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119274#comment-17119274 ] Apache Spark commented on SPARK-31333: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Commented] (SPARK-31333) Document Hints

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119273#comment-17119273 ] Apache Spark commented on SPARK-31333: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-31333) Document Hints

2020-05-28 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-31333: --- Summary: Document Hints (was: Document Join Hints) > Document Hints > -- > >

[jira] [Resolved] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31862. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28668

[jira] [Assigned] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31862: --- Assignee: Wei Xue > Remove exception wrapping in AQE > >

[jira] [Assigned] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31865: --- Assignee: Wei Xue > Fix complex AQE query stage not reused >

[jira] [Resolved] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31865. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28670

[jira] [Assigned] (SPARK-31833) Set HiveThriftServer2 with actual port while configured 0

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31833: --- Assignee: Kent Yao > Set HiveThriftServer2 with actual port while configured 0 >

[jira] [Resolved] (SPARK-31833) Set HiveThriftServer2 with actual port while configured 0

2020-05-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31833. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28651

[jira] [Commented] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-28 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119200#comment-17119200 ] Jeff Evans commented on SPARK-31779: I disagree. An entire new array has been introduced into the

[jira] [Comment Edited] (SPARK-31779) Redefining struct inside array incorrectly wraps child fields in array

2020-05-28 Thread Jeff Evans (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119200#comment-17119200 ] Jeff Evans edited comment on SPARK-31779 at 5/29/20, 1:53 AM: -- I disagree.

[jira] [Assigned] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31863: Assignee: Apache Spark > Thriftserver not setting active SparkSession, SQLConf.get not

[jira] [Assigned] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31863: Assignee: (was: Apache Spark) > Thriftserver not setting active SparkSession,

[jira] [Commented] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119149#comment-17119149 ] Apache Spark commented on SPARK-31863: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119148#comment-17119148 ] Apache Spark commented on SPARK-31863: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Assigned] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31863: Assignee: Apache Spark > Thriftserver not setting active SparkSession, SQLConf.get not

[jira] [Commented] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119150#comment-17119150 ] Apache Spark commented on SPARK-31863: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Assigned] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31861: Assignee: Apache Spark > Thriftserver collecting timestamp not using

[jira] [Assigned] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31861: Assignee: (was: Apache Spark) > Thriftserver collecting timestamp not using

[jira] [Commented] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119145#comment-17119145 ] Apache Spark commented on SPARK-31861: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119140#comment-17119140 ] Apache Spark commented on SPARK-31859: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Commented] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119141#comment-17119141 ] Apache Spark commented on SPARK-31861: -- User 'juliuszsompolski' has created a pull request for this

[jira] [Assigned] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31859: Assignee: (was: Apache Spark) > Thriftserver with

[jira] [Assigned] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31859: Assignee: Apache Spark > Thriftserver with spark.sql.datetime.java8API.enabled=true >

[jira] [Commented] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119136#comment-17119136 ] Apache Spark commented on SPARK-31865: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31865: Assignee: Apache Spark > Fix complex AQE query stage not reused >

[jira] [Assigned] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31865: Assignee: (was: Apache Spark) > Fix complex AQE query stage not reused >

[jira] [Commented] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119135#comment-17119135 ] Apache Spark commented on SPARK-31865: -- User 'maryannxue' has created a pull request for this

[jira] [Created] (SPARK-31865) Fix complex AQE query stage not reused

2020-05-28 Thread Wei Xue (Jira)
Wei Xue created SPARK-31865: --- Summary: Fix complex AQE query stage not reused Key: SPARK-31865 URL: https://issues.apache.org/jira/browse/SPARK-31865 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-31864) Adjust AQE skew join trigger condition

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31864: Assignee: (was: Apache Spark) > Adjust AQE skew join trigger condition >

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119125#comment-17119125 ] Apache Spark commented on SPARK-31864: -- User 'maryannxue' has created a pull request for this

[jira] [Commented] (SPARK-31864) Adjust AQE skew join trigger condition

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119124#comment-17119124 ] Apache Spark commented on SPARK-31864: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-31864) Adjust AQE skew join trigger condition

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31864: Assignee: Apache Spark > Adjust AQE skew join trigger condition >

[jira] [Commented] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119104#comment-17119104 ] Apache Spark commented on SPARK-31862: -- User 'maryannxue' has created a pull request for this

[jira] [Commented] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119105#comment-17119105 ] Apache Spark commented on SPARK-31862: -- User 'maryannxue' has created a pull request for this

[jira] [Assigned] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31862: Assignee: (was: Apache Spark) > Remove exception wrapping in AQE >

[jira] [Assigned] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31862: Assignee: Apache Spark > Remove exception wrapping in AQE >

[jira] [Created] (SPARK-31864) Adjust AQE skew join trigger condition

2020-05-28 Thread Wei Xue (Jira)
Wei Xue created SPARK-31864: --- Summary: Adjust AQE skew join trigger condition Key: SPARK-31864 URL: https://issues.apache.org/jira/browse/SPARK-31864 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-31863) Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31863: - Summary: Thriftserver not setting active SparkSession, SQLConf.get not getting session configs correctly Key: SPARK-31863 URL:

[jira] [Created] (SPARK-31862) Remove exception wrapping in AQE

2020-05-28 Thread Wei Xue (Jira)
Wei Xue created SPARK-31862: --- Summary: Remove exception wrapping in AQE Key: SPARK-31862 URL: https://issues.apache.org/jira/browse/SPARK-31862 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31860: Assignee: Holden Karau (was: Apache Spark) > Only push release tags on success >

[jira] [Commented] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119076#comment-17119076 ] Apache Spark commented on SPARK-31860: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31860: Assignee: Apache Spark (was: Holden Karau) > Only push release tags on success >

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2020-05-28 Thread Erik Erlandson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119054#comment-17119054 ] Erik Erlandson commented on SPARK-7768: --- Are there any issues with making this kind of change on a

[jira] [Comment Edited] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-28 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118845#comment-17118845 ] James Boylan edited comment on SPARK-31800 at 5/28/20, 7:57 PM: Ok. So

[jira] [Comment Edited] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-28 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118845#comment-17118845 ] James Boylan edited comment on SPARK-31800 at 5/28/20, 7:48 PM: Ok. So

[jira] [Comment Edited] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119029#comment-17119029 ] Maxim Gekk edited comment on SPARK-31859 at 5/28/20, 7:41 PM: --

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119029#comment-17119029 ] Maxim Gekk commented on SPARK-31859: [~juliuszsompolski] FYI

[jira] [Commented] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119002#comment-17119002 ] Juliusz Sompolski commented on SPARK-31859: --- Actually, it's already in

[jira] [Created] (SPARK-31861) Thriftserver collecting timestamp not using spark.sql.session.timeZone

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31861: - Summary: Thriftserver collecting timestamp not using spark.sql.session.timeZone Key: SPARK-31861 URL: https://issues.apache.org/jira/browse/SPARK-31861

[jira] [Created] (SPARK-31860) Only push release tags on success

2020-05-28 Thread Holden Karau (Jira)
Holden Karau created SPARK-31860: Summary: Only push release tags on success Key: SPARK-31860 URL: https://issues.apache.org/jira/browse/SPARK-31860 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juliusz Sompolski updated SPARK-31859: -- Issue Type: Bug (was: Improvement) > Thriftserver with

[jira] [Created] (SPARK-31859) Thriftserver with spark.sql.datetime.java8API.enabled=true

2020-05-28 Thread Juliusz Sompolski (Jira)
Juliusz Sompolski created SPARK-31859: - Summary: Thriftserver with spark.sql.datetime.java8API.enabled=true Key: SPARK-31859 URL: https://issues.apache.org/jira/browse/SPARK-31859 Project: Spark

[jira] [Assigned] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31858: Assignee: Apache Spark > Upgrade commons-io to 2.5 in Hadoop 3.2 profile >

[jira] [Assigned] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31858: Assignee: Apache Spark > Upgrade commons-io to 2.5 in Hadoop 3.2 profile >

[jira] [Commented] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118957#comment-17118957 ] Apache Spark commented on SPARK-31858: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118958#comment-17118958 ] Apache Spark commented on SPARK-31858: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31858: Assignee: (was: Apache Spark) > Upgrade commons-io to 2.5 in Hadoop 3.2 profile >

[jira] [Created] (SPARK-31858) Upgrade commons-io to 2.5 in Hadoop 3.2 profile

2020-05-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-31858: - Summary: Upgrade commons-io to 2.5 in Hadoop 3.2 profile Key: SPARK-31858 URL: https://issues.apache.org/jira/browse/SPARK-31858 Project: Spark Issue

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-28 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118845#comment-17118845 ] James Boylan commented on SPARK-31800: -- Ok. So further testing, this is what I have found. If I set 

[jira] [Created] (SPARK-31857) Support Azure SQLDB Kerberos login in JDBC connector

2020-05-28 Thread jobit mathew (Jira)
jobit mathew created SPARK-31857: Summary: Support Azure SQLDB Kerberos login in JDBC connector Key: SPARK-31857 URL: https://issues.apache.org/jira/browse/SPARK-31857 Project: Spark Issue

[jira] [Commented] (SPARK-31814) Null in Date conversion from yyMMddHHmmss for specific date and time

2020-05-28 Thread jobit mathew (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118783#comment-17118783 ] jobit mathew commented on SPARK-31814: -- [~sunnyjain1] can you please check in latest version I

[jira] [Created] (SPARK-31856) Handle locality wait reset better when executors added

2020-05-28 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-31856: - Summary: Handle locality wait reset better when executors added Key: SPARK-31856 URL: https://issues.apache.org/jira/browse/SPARK-31856 Project: Spark

[jira] [Resolved] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31334. -- Resolution: Duplicate > Use agg column in Having clause behave different with column type >

[jira] [Reopened] (SPARK-31334) Use agg column in Having clause behave different with column type

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-31334: -- > Use agg column in Having clause behave different with column type >

[jira] [Commented] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118529#comment-17118529 ] Apache Spark commented on SPARK-31855: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31855: Assignee: Apache Spark (was: Maxim Gekk) > Check reading date/timestamp from Avro files

[jira] [Assigned] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31855: Assignee: Maxim Gekk (was: Apache Spark) > Check reading date/timestamp from Avro files

[jira] [Commented] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118528#comment-17118528 ] Apache Spark commented on SPARK-31855: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31855: --- Description: Extend the test "SPARK-31183: compatibility with Spark 2.4 in reading

[jira] [Commented] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118468#comment-17118468 ] Maxim Gekk commented on SPARK-31855: I am working on it > Check reading date/timestamp from Avro

[jira] [Created] (SPARK-31855) Check reading date/timestamp from Avro files w/ and w/o Spark version

2020-05-28 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31855: -- Summary: Check reading date/timestamp from Avro files w/ and w/o Spark version Key: SPARK-31855 URL: https://issues.apache.org/jira/browse/SPARK-31855 Project: Spark

[jira] [Updated] (SPARK-31854) Different results of query execution with wholestage codegen on and off

2020-05-28 Thread Paul Finkelshteyn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Finkelshteyn updated SPARK-31854: -- Description: Preface: I'm creating Kotlin API for spark to take best parts from three

[jira] [Created] (SPARK-31854) Different results of query execution with wholestage codegen on and off

2020-05-28 Thread Paul Finkelshteyn (Jira)
Paul Finkelshteyn created SPARK-31854: - Summary: Different results of query execution with wholestage codegen on and off Key: SPARK-31854 URL: https://issues.apache.org/jira/browse/SPARK-31854

[jira] [Commented] (SPARK-28054) Unable to insert partitioned table dynamically when partition name is upper case

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118452#comment-17118452 ] Hyukjin Kwon commented on SPARK-28054: -- Feel free to open a PR to backport. > Unable to insert

[jira] [Commented] (SPARK-26646) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118449#comment-17118449 ] Hyukjin Kwon commented on SPARK-26646: -- Seems the cause of exception is slightly different. Could

[jira] [Assigned] (SPARK-31853) Mention removal of params mixins setter in migration guide

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31853: Assignee: (was: Apache Spark) > Mention removal of params mixins setter in migration

[jira] [Commented] (SPARK-31853) Mention removal of params mixins setter in migration guide

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118431#comment-17118431 ] Apache Spark commented on SPARK-31853: -- User 'EnricoMi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-31853) Mention removal of params mixins setter in migration guide

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31853: Assignee: Apache Spark > Mention removal of params mixins setter in migration guide >

[jira] [Updated] (SPARK-31853) Mention removal of params mixins setter in migration guide

2020-05-28 Thread Enrico Minack (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack updated SPARK-31853: -- Description: In SPARK-29093, all setters have been removed from `Params` mixins in

[jira] [Created] (SPARK-31853) Mention removal of params mixins setter in migration guide

2020-05-28 Thread Enrico Minack (Jira)
Enrico Minack created SPARK-31853: - Summary: Mention removal of params mixins setter in migration guide Key: SPARK-31853 URL: https://issues.apache.org/jira/browse/SPARK-31853 Project: Spark

[jira] [Updated] (SPARK-31851) Redesign PySpark documentation

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31851: - Description: Currently, PySpark documentation

[jira] [Updated] (SPARK-31851) Redesign PySpark documentation

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31851: - Target Version/s: 3.1.0 > Redesign PySpark documentation > -- > >

[jira] [Resolved] (SPARK-31852) Redesign PySpark documentation

2020-05-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31852. -- Resolution: Duplicate > Redesign PySpark documentation > -- > >

[jira] [Created] (SPARK-31852) Redesign PySpark documentation

2020-05-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31852: Summary: Redesign PySpark documentation Key: SPARK-31852 URL: https://issues.apache.org/jira/browse/SPARK-31852 Project: Spark Issue Type: Umbrella

[jira] [Created] (SPARK-31851) Redesign PySpark documentation

2020-05-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-31851: Summary: Redesign PySpark documentation Key: SPARK-31851 URL: https://issues.apache.org/jira/browse/SPARK-31851 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-31850) DetermineTableStats rules computes stats multiple time for same table

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31850: Assignee: Apache Spark > DetermineTableStats rules computes stats multiple time for same

[jira] [Assigned] (SPARK-31850) DetermineTableStats rules computes stats multiple time for same table

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31850: Assignee: (was: Apache Spark) > DetermineTableStats rules computes stats multiple

[jira] [Commented] (SPARK-31850) DetermineTableStats rules computes stats multiple time for same table

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118348#comment-17118348 ] Apache Spark commented on SPARK-31850: -- User 'karuppayya' has created a pull request for this

[jira] [Commented] (SPARK-31850) DetermineTableStats rules computes stats multiple time for same table

2020-05-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17118346#comment-17118346 ] Apache Spark commented on SPARK-31850: -- User 'karuppayya' has created a pull request for this

[jira] [Updated] (SPARK-31850) DetermineTableStats rules computes stats multiple time for same table

2020-05-28 Thread Karuppayya (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karuppayya updated SPARK-31850: --- Description: DetermineTableStats rules computes stats multiple time for same table. There are few