[jira] [Commented] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205990#comment-17205990 ] Apache Spark commented on SPARK-33052: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205991#comment-17205991 ] Apache Spark commented on SPARK-33052: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33052: Assignee: Apache Spark > Make database versions up-to-date for integration tests >

[jira] [Assigned] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33052: Assignee: (was: Apache Spark) > Make database versions up-to-date for integration

[jira] [Assigned] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33052: Assignee: (was: Apache Spark) > Make database versions up-to-date for integration

[jira] [Created] (SPARK-33052) Make database versions up-to-date for integration tests

2020-10-01 Thread Takeshi Yamamuro (Jira)
Takeshi Yamamuro created SPARK-33052: Summary: Make database versions up-to-date for integration tests Key: SPARK-33052 URL: https://issues.apache.org/jira/browse/SPARK-33052 Project: Spark

[jira] [Assigned] (SPARK-33051) Uses setup-r to install R in GitHub Actions build

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33051: Assignee: Apache Spark > Uses setup-r to install R in GitHub Actions build >

[jira] [Commented] (SPARK-33051) Uses setup-r to install R in GitHub Actions build

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205984#comment-17205984 ] Apache Spark commented on SPARK-33051: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-33051) Uses setup-r to install R in GitHub Actions build

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33051: Assignee: (was: Apache Spark) > Uses setup-r to install R in GitHub Actions build >

[jira] [Created] (SPARK-33051) Uses setup-r to install R in GitHub Actions build

2020-10-01 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-33051: Summary: Uses setup-r to install R in GitHub Actions build Key: SPARK-33051 URL: https://issues.apache.org/jira/browse/SPARK-33051 Project: Spark Issue

[jira] [Resolved] (SPARK-32001) Create Kerberos authentication provider API in JDBC connector

2020-10-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32001. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29024

[jira] [Assigned] (SPARK-32001) Create Kerberos authentication provider API in JDBC connector

2020-10-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-32001: Assignee: Gabor Somogyi > Create Kerberos authentication provider API in JDBC connector

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-10-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205947#comment-17205947 ] Hyukjin Kwon commented on SPARK-33044: -- Thanks [~dongjoon] for cc'ing me. Yeah, setting up a

[jira] [Updated] (SPARK-32996) Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics

2020-10-01 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32996: Fix Version/s: 3.0.2 > Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics >

[jira] [Assigned] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33050: Assignee: (was: Apache Spark) > Upgrade Apache ORC to 1.5.12 >

[jira] [Assigned] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33050: Assignee: Apache Spark > Upgrade Apache ORC to 1.5.12 > > >

[jira] [Commented] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205921#comment-17205921 ] Apache Spark commented on SPARK-33050: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-33050) Upgrade Apache ORC to 1.5.12

2020-10-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33050: - Summary: Upgrade Apache ORC to 1.5.12 Key: SPARK-33050 URL: https://issues.apache.org/jira/browse/SPARK-33050 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-32007) Spark Driver Supervise does not work reliably

2020-10-01 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205918#comment-17205918 ] Aoyuan Liao edited comment on SPARK-32007 at 10/2/20, 1:40 AM: ---

[jira] [Commented] (SPARK-32007) Spark Driver Supervise does not work reliably

2020-10-01 Thread Aoyuan Liao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205918#comment-17205918 ] Aoyuan Liao commented on SPARK-32007: - [~surajs21] Can you please post master's log for more

[jira] [Commented] (SPARK-33049) Decommission Core Integration Test is flaky.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205916#comment-17205916 ] Apache Spark commented on SPARK-33049: -- User 'holdenk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33049) Decommission Core Integration Test is flaky.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33049: Assignee: (was: Apache Spark) > Decommission Core Integration Test is flaky. >

[jira] [Assigned] (SPARK-33049) Decommission Core Integration Test is flaky.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33049: Assignee: Apache Spark > Decommission Core Integration Test is flaky. >

[jira] [Created] (SPARK-33049) Decommission Core Integration Test is flaky.

2020-10-01 Thread Holden Karau (Jira)
Holden Karau created SPARK-33049: Summary: Decommission Core Integration Test is flaky. Key: SPARK-33049 URL: https://issues.apache.org/jira/browse/SPARK-33049 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32741) Check if the same ExprId refers to the unique attribute in logical plans

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205908#comment-17205908 ] Apache Spark commented on SPARK-32741: -- User 'maropu' has created a pull request for this issue:

[jira] [Commented] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205899#comment-17205899 ] Apache Spark commented on SPARK-33048: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33048: Assignee: Kousuke Saruta (was: Apache Spark) > Fix SparkBuild.scala to recognize build

[jira] [Assigned] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33048: Assignee: Apache Spark (was: Kousuke Saruta) > Fix SparkBuild.scala to recognize build

[jira] [Commented] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205898#comment-17205898 ] Apache Spark commented on SPARK-33048: -- User 'sarutak' has created a pull request for this issue:

[jira] [Updated] (SPARK-33045) Implement built-in LIKE ANY and LIKE ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support LIKE ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement built-in LIKE ANY and LIKE ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support LIKE ANY / SOME / ALL syntax, but it will throw

[jira] [Resolved] (SPARK-32859) Introduce SQL physical plan rule to decide enable/disable bucketing

2020-10-01 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32859. -- Fix Version/s: 3.1.0 Assignee: Cheng Su Resolution: Fixed Resolved by

[jira] [Created] (SPARK-33048) Fix SparkBuild.scala to recognize build settings for Scala 2.13

2020-10-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33048: -- Summary: Fix SparkBuild.scala to recognize build settings for Scala 2.13 Key: SPARK-33048 URL: https://issues.apache.org/jira/browse/SPARK-33048 Project: Spark

[jira] [Resolved] (SPARK-33046) Update how to build doc for Scala 2.13 with sbt

2020-10-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33046. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29921

[jira] [Updated] (SPARK-33046) Update how to build doc for Scala 2.13 with sbt

2020-10-01 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33046: --- Summary: Update how to build doc for Scala 2.13 with sbt (was: How to build for Scala 2.13

[jira] [Resolved] (SPARK-32585) Support scala enumeration in ScalaReflection

2020-10-01 Thread Tathagata Das (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-32585. --- Fix Version/s: 3.1.0 Resolution: Done > Support scala enumeration in ScalaReflection

[jira] [Assigned] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33047: - Assignee: Dongjoon Hyun > Upgrade hive-storage-api to 2.7.2 >

[jira] [Commented] (SPARK-32996) Handle Option.empty v1.ExecutorSummary#peakMemoryMetrics

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205791#comment-17205791 ] Apache Spark commented on SPARK-32996: -- User 'shrutig' has created a pull request for this issue:

[jira] [Resolved] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33047. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29923

[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205772#comment-17205772 ] Apache Spark commented on SPARK-33043: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33043: Assignee: (was: Apache Spark) > RowMatrix is incompatible with

[jira] [Assigned] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33043: Assignee: Apache Spark > RowMatrix is incompatible with spark.driver.maxResultSize=0 >

[jira] [Commented] (SPARK-33043) RowMatrix is incompatible with spark.driver.maxResultSize=0

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205771#comment-17205771 ] Apache Spark commented on SPARK-33043: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-01 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205743#comment-17205743 ] BoYang commented on SPARK-33037: After discussion, we feel it is better to remove the knownManagers

[jira] [Updated] (SPARK-33037) Remove knownManagers hardcoded list

2020-10-01 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BoYang updated SPARK-33037: --- Summary: Remove knownManagers hardcoded list (was: Add "spark.shuffle.manager" value to knownManagers) >

[jira] [Commented] (SPARK-24554) Add MapType Support for Arrow in PySpark

2020-10-01 Thread Bryan Cutler (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205719#comment-17205719 ] Bryan Cutler commented on SPARK-24554: -- I started working on this, but ran into an issue at

[jira] [Commented] (SPARK-30821) Executor pods with multiple containers will not be rescheduled unless all containers fail

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205696#comment-17205696 ] Apache Spark commented on SPARK-30821: -- User 'huskysun' has created a pull request for this issue:

[jira] [Commented] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205662#comment-17205662 ] Apache Spark commented on SPARK-33047: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33047: Assignee: (was: Apache Spark) > Upgrade hive-storage-api to 2.7.2 >

[jira] [Assigned] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33047: Assignee: Apache Spark > Upgrade hive-storage-api to 2.7.2 >

[jira] [Created] (SPARK-33047) Upgrade hive-storage-api to 2.7.2

2020-10-01 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-33047: - Summary: Upgrade hive-storage-api to 2.7.2 Key: SPARK-33047 URL: https://issues.apache.org/jira/browse/SPARK-33047 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32723) Upgrade to jQuery 3.5.1

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205607#comment-17205607 ] Apache Spark commented on SPARK-32723: -- User 'n-marion' has created a pull request for this issue:

[jira] [Commented] (SPARK-30186) support Dynamic Partition Pruning in Adaptive Execution

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205606#comment-17205606 ] Yuming Wang commented on SPARK-30186: - For our internal tpcds q77, enable AQE and enable DPP cannot

[jira] [Commented] (SPARK-27318) Join operation on bucketing table fails with base adaptive enabled

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205558#comment-17205558 ] Yuming Wang commented on SPARK-27318: - Could you try Spark 3.x? > Join operation on bucketing table

[jira] [Commented] (SPARK-33046) How to build for Scala 2.13 with sbt in the doc is wrong.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205528#comment-17205528 ] Apache Spark commented on SPARK-33046: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-33046) How to build for Scala 2.13 with sbt in the doc is wrong.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205526#comment-17205526 ] Apache Spark commented on SPARK-33046: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33046) How to build for Scala 2.13 with sbt in the doc is wrong.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33046: Assignee: Apache Spark (was: Kousuke Saruta) > How to build for Scala 2.13 with sbt in

[jira] [Assigned] (SPARK-33046) How to build for Scala 2.13 with sbt in the doc is wrong.

2020-10-01 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33046: Assignee: Kousuke Saruta (was: Apache Spark) > How to build for Scala 2.13 with sbt in

[jira] [Assigned] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

2020-10-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-33024: Assignee: Yang Jie > Fix CodeGen fallback issue of UDFSuite in Scala 2.13 >

[jira] [Resolved] (SPARK-33024) Fix CodeGen fallback issue of UDFSuite in Scala 2.13

2020-10-01 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-33024. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29903

[jira] [Updated] (SPARK-33045) Implement built-in LIKE ANY and LIKE ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement built-in LIKE ANY and LIKE ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Summary: Implement built-in LIKE ANY and LIKE ALL UDF (was: Implement LIKE ANY and LIKE ALL

[jira] [Created] (SPARK-33046) How to build for Scala 2.13 with sbt in the doc is wrong.

2020-10-01 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-33046: -- Summary: How to build for Scala 2.13 with sbt in the doc is wrong. Key: SPARK-33046 URL: https://issues.apache.org/jira/browse/SPARK-33046 Project: Spark

[jira] [Updated] (SPARK-33045) Implement LIKE ANY and LIKE ALL built-in UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement LIKE ANY and LIKE ALL built-in UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Summary: Implement LIKE ANY and LIKE ALL built-in UDF (was: Implement LIKE ANY and LIKE ALL UDF)

[jira] [Updated] (SPARK-33045) Implement LIKE ANY and LIKE ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Summary: Implement LIKE ANY and LIKE ALL UDF (was: Implement LIKE ANY/SOME/ALL UDF) > Implement

[jira] [Reopened] (SPARK-32965) pyspark reading csv files with utf_16le encoding

2020-10-01 Thread Punit Shah (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Punit Shah reopened SPARK-32965: The linked duplicate issue won't be fixed because the issue was mixed with a multiline feature

[jira] [Updated] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw

[jira] [Updated] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw {{StackOverflowError}}

[jira] [Updated] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33045: Description: We already support ANY / SOME / ALL syntax, but it will throw {{StackOverflowError}}

[jira] [Created] (SPARK-33045) Implement LIKE ANY/SOME/ALL UDF

2020-10-01 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33045: --- Summary: Implement LIKE ANY/SOME/ALL UDF Key: SPARK-33045 URL: https://issues.apache.org/jira/browse/SPARK-33045 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-33025) Empty file for the first partition

2020-10-01 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33025. -- Resolution: Won't Fix > Empty file for the first partition >

[jira] [Commented] (SPARK-33025) Empty file for the first partition

2020-10-01 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205328#comment-17205328 ] Takeshi Yamamuro commented on SPARK-33025: -- This is not a bug but an expected behaviour and

[jira] [Updated] (SPARK-33042) Add a test case to ensure changes to spark.sql.optimizer.maxIterations take effect at runtime

2020-10-01 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-33042: - Component/s: (was: Optimizer) SQL > Add a test case to ensure

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-10-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205290#comment-17205290 ] Dongjoon Hyun commented on SPARK-33044: --- cc [~srowen] and [~hyukjin.kwon] > Add a Jenkins build

[jira] [Commented] (SPARK-33044) Add a Jenkins build and test job for Scala 2.13

2020-10-01 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205289#comment-17205289 ] Dongjoon Hyun commented on SPARK-33044: --- Thank you, [~LuciferYang]. Could you add a new Jenkins