[jira] [Created] (SPARK-42211) Python UDFs with inconsistent client and server versions

2023-01-27 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-42211: Summary: Python UDFs with inconsistent client and server versions Key: SPARK-42211 URL: https://issues.apache.org/jira/browse/SPARK-42211 Project: Spark Issu

[jira] [Updated] (SPARK-41661) Support for User-defined Functions in Python

2023-01-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-41661: - Summary: Support for User-defined Functions in Python (was: Support for Python UDFs) > Support

[jira] [Commented] (SPARK-41661) Support for User-defined Functions in Python

2023-01-27 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681221#comment-17681221 ] Xinrong Meng commented on SPARK-41661: -- Hi [~grundprinzip-db], I renamed the ticket

[jira] [Commented] (SPARK-42190) Support `local[*]` in `spark-submit` in K8s environment

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681234#comment-17681234 ] Apache Spark commented on SPARK-42190: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-42206) Omit "Task Executor Metrics" field in JsonProtocol output if values are all zero

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681238#comment-17681238 ] Apache Spark commented on SPARK-42206: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-42206) Omit "Task Executor Metrics" field in JsonProtocol output if values are all zero

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681240#comment-17681240 ] Apache Spark commented on SPARK-42206: -- User 'JoshRosen' has created a pull request

[jira] [Created] (SPARK-42212) Skip `Python/R/SQL` doc generation if unchanged

2023-01-27 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42212: - Summary: Skip `Python/R/SQL` doc generation if unchanged Key: SPARK-42212 URL: https://issues.apache.org/jira/browse/SPARK-42212 Project: Spark Issue Type:

[jira] [Created] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42213: Summary: Failed to test ClientE2ETestSuite with maven Key: SPARK-42213 URL: https://issues.apache.org/jira/browse/SPARK-42213 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42213: - Description: run the following commands {code:java} build/mvn clean build/mvn clean install -pl connecto

[jira] [Assigned] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42213: Assignee: Apache Spark > Failed to test ClientE2ETestSuite with maven > -

[jira] [Commented] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681344#comment-17681344 ] Apache Spark commented on SPARK-42213: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681346#comment-17681346 ] Apache Spark commented on SPARK-42213: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42213: Assignee: (was: Apache Spark) > Failed to test ClientE2ETestSuite with maven > --

[jira] [Created] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42214: Summary: Branch-3.4 daily test failed Key: SPARK-42214 URL: https://issues.apache.org/jira/browse/SPARK-42214 Project: Spark Issue Type: Bug Components: Pr

[jira] [Updated] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42214: - Description: https://github.com/apache/spark/actions/runs/4023012095/jobs/6913400923 > Branch-3.4 daily

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681359#comment-17681359 ] Yang Jie commented on SPARK-42214: -- It seems that the environment of the daily test is

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681370#comment-17681370 ] Yang Jie commented on SPARK-42214: -- {code:java} WARNING: You are using pip version 22.0

[jira] [Assigned] (SPARK-41931) Improve UNSUPPORTED_DATA_TYPE message for complex types

2023-01-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41931: Assignee: Max Gekk > Improve UNSUPPORTED_DATA_TYPE message for complex types > --

[jira] [Resolved] (SPARK-41931) Improve UNSUPPORTED_DATA_TYPE message for complex types

2023-01-27 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41931. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39711 [https://github.com

[jira] [Created] (SPARK-42215) Better Scala Client Integration test

2023-01-27 Thread Zhen Li (Jira)
Zhen Li created SPARK-42215: --- Summary: Better Scala Client Integration test Key: SPARK-42215 URL: https://issues.apache.org/jira/browse/SPARK-42215 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42215) Better Scala Client Integration test

2023-01-27 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42215: Description: The current Scala client has a few integration tests that requires a build first before runn

[jira] [Commented] (SPARK-42215) Better Scala Client Integration test

2023-01-27 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681401#comment-17681401 ] Zhen Li commented on SPARK-42215: - Marking the tests as ITs in maven may cause the tests

[jira] [Created] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42216: Summary: Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite Key: SPARK-42216 URL: https://issues.apache.org/jira/browse/SPARK-42216 Project

[jira] [Commented] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681406#comment-17681406 ] Apache Spark commented on SPARK-42216: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42216: Assignee: Apache Spark > Use `immutable.Map` by default and fix two check conditions in

[jira] [Assigned] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42216: Assignee: (was: Apache Spark) > Use `immutable.Map` by default and fix two check cond

[jira] [Commented] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681407#comment-17681407 ] Apache Spark commented on SPARK-42216: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42213: - Assignee: Yang Jie > Failed to test ClientE2ETestSuite with maven > ---

[jira] [Resolved] (SPARK-42213) Failed to test ClientE2ETestSuite with maven

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42213. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39771 [https://

[jira] [Updated] (SPARK-38230) InsertIntoHadoopFsRelationCommand unnecessarily fetches details of partitions in most cases

2023-01-27 Thread Gabor Roczei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Roczei updated SPARK-38230: - Affects Version/s: 3.3.0 3.4.0 3.5.0 > InsertIntoH

[jira] [Created] (SPARK-42217) Support lateral column alias in queries with Window

2023-01-27 Thread Xinyi Yu (Jira)
Xinyi Yu created SPARK-42217: Summary: Support lateral column alias in queries with Window Key: SPARK-42217 URL: https://issues.apache.org/jira/browse/SPARK-42217 Project: Spark Issue Type: Sub-t

[jira] [Assigned] (SPARK-42217) Support lateral column alias in queries with Window

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42217: Assignee: Apache Spark > Support lateral column alias in queries with Window > --

[jira] [Commented] (SPARK-42217) Support lateral column alias in queries with Window

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681440#comment-17681440 ] Apache Spark commented on SPARK-42217: -- User 'anchovYu' has created a pull request

[jira] [Assigned] (SPARK-42217) Support lateral column alias in queries with Window

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42217: Assignee: (was: Apache Spark) > Support lateral column alias in queries with Window >

[jira] [Commented] (SPARK-42217) Support lateral column alias in queries with Window

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681441#comment-17681441 ] Apache Spark commented on SPARK-42217: -- User 'anchovYu' has created a pull request

[jira] [Created] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Jira
Bjørn Jørgensen created SPARK-42218: --- Summary: Upgrade netty to version 4.1.87.Final Key: SPARK-42218 URL: https://issues.apache.org/jira/browse/SPARK-42218 Project: Spark Issue Type: Impro

[jira] [Assigned] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42218: Assignee: Apache Spark > Upgrade netty to version 4.1.87.Final >

[jira] [Assigned] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42218: Assignee: (was: Apache Spark) > Upgrade netty to version 4.1.87.Final > -

[jira] [Commented] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681450#comment-17681450 ] Apache Spark commented on SPARK-42218: -- User 'bjornjorgensen' has created a pull re

[jira] [Commented] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681451#comment-17681451 ] Apache Spark commented on SPARK-42218: -- User 'bjornjorgensen' has created a pull re

[jira] [Created] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Attila Zsolt Piros (Jira)
Attila Zsolt Piros created SPARK-42219: -- Summary: Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable Key: SPARK-42219 URL: https://issues.apache.org/jira/browse/SPARK-42219

[jira] [Assigned] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros reassigned SPARK-42219: -- Assignee: Attila Zsolt Piros > Make "SPARK-34674: Close SparkContext after th

[jira] [Updated] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-42219: --- Description: We run into an error after an upgrade from Spark 3.1 to Spark 3.2 cased

[jira] [Commented] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681454#comment-17681454 ] Attila Zsolt Piros commented on SPARK-42219: I will open a PR regarding this

[jira] [Updated] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-42219: --- Description: We run into an error after an upgrade from Spark 3.1 to Spark 3.2 cased

[jira] [Commented] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681463#comment-17681463 ] Apache Spark commented on SPARK-42219: -- User 'attilapiros' has created a pull reque

[jira] [Assigned] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42219: Assignee: Attila Zsolt Piros (was: Apache Spark) > Make "SPARK-34674: Close SparkContext

[jira] [Assigned] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42219: Assignee: Apache Spark (was: Attila Zsolt Piros) > Make "SPARK-34674: Close SparkContext

[jira] [Commented] (SPARK-42219) Make "SPARK-34674: Close SparkContext after the Main method has finished" configurable

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681465#comment-17681465 ] Apache Spark commented on SPARK-42219: -- User 'attilapiros' has created a pull reque

[jira] [Created] (SPARK-42220) Upgrade buf from 1.12.0 to 1.13.1

2023-01-27 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-42220: --- Summary: Upgrade buf from 1.12.0 to 1.13.1 Key: SPARK-42220 URL: https://issues.apache.org/jira/browse/SPARK-42220 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42220) Upgrade buf from 1.12.0 to 1.13.1

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681499#comment-17681499 ] Apache Spark commented on SPARK-42220: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-42220) Upgrade buf from 1.12.0 to 1.13.1

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42220: Assignee: Apache Spark > Upgrade buf from 1.12.0 to 1.13.1 >

[jira] [Assigned] (SPARK-42220) Upgrade buf from 1.12.0 to 1.13.1

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42220: Assignee: (was: Apache Spark) > Upgrade buf from 1.12.0 to 1.13.1 > -

[jira] [Resolved] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42216. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 39772 [https://

[jira] [Assigned] (SPARK-42216) Use `immutable.Map` by default and fix two check conditions in util.JsonProtocolSuite

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42216: - Assignee: Yang Jie > Use `immutable.Map` by default and fix two check conditions in >

[jira] [Assigned] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42218: - Assignee: Bjørn Jørgensen > Upgrade netty to version 4.1.87.Final > ---

[jira] [Resolved] (SPARK-42218) Upgrade netty to version 4.1.87.Final

2023-01-27 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42218. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39774 [https://

[jira] [Created] (SPARK-42221) Introduce a new conf for TimestampNTZ schema inference in JSON/CSV

2023-01-27 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42221: -- Summary: Introduce a new conf for TimestampNTZ schema inference in JSON/CSV Key: SPARK-42221 URL: https://issues.apache.org/jira/browse/SPARK-42221 Project: Spark

[jira] [Assigned] (SPARK-42221) Introduce a new conf for TimestampNTZ schema inference in JSON/CSV

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42221: Assignee: Gengliang Wang (was: Apache Spark) > Introduce a new conf for TimestampNTZ sch

[jira] [Assigned] (SPARK-42221) Introduce a new conf for TimestampNTZ schema inference in JSON/CSV

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42221: Assignee: Apache Spark (was: Gengliang Wang) > Introduce a new conf for TimestampNTZ sch

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681522#comment-17681522 ] Yang Jie commented on SPARK-42214: -- [~gurwls223] [~yikun]  branch-3.4 daily build has s

[jira] [Resolved] (SPARK-41897) Parity in Error types between pyspark and connect functions

2023-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41897. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39450 [https://gi

[jira] [Assigned] (SPARK-41897) Parity in Error types between pyspark and connect functions

2023-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41897: Assignee: Sandeep Singh > Parity in Error types between pyspark and connect functions > -

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681524#comment-17681524 ] Hyukjin Kwon commented on SPARK-42214: -- cc [~itholic]and [~XinrongM] FYI > Branch-

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681526#comment-17681526 ] Yikun Jiang commented on SPARK-42214: - https://github.com/apache/spark/blob/c8b1e526

[jira] [Assigned] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42214: Assignee: Apache Spark > Branch-3.4 daily test failed > > >

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681527#comment-17681527 ] Apache Spark commented on SPARK-42214: -- User 'Yikun' has created a pull request for

[jira] [Assigned] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42214: Assignee: (was: Apache Spark) > Branch-3.4 daily test failed > --

[jira] [Commented] (SPARK-42214) Branch-3.4 daily test failed

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681528#comment-17681528 ] Apache Spark commented on SPARK-42214: -- User 'Yikun' has created a pull request for

[jira] [Created] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Kevin Cheung (Jira)
Kevin Cheung created SPARK-4: Summary: Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error Key: SPARK-4 URL: https://issues.apache.org/jira/browse/SPARK-4 Project:

[jira] [Updated] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Kevin Cheung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Cheung updated SPARK-4: - Description: The underlying error message is thrown away, leading to a misleading/non-user frie

[jira] [Updated] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Kevin Cheung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Cheung updated SPARK-4: - Description: The underlying error message is thrown away, leading to a misleading/non-user frie

[jira] [Commented] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Kevin Cheung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681531#comment-17681531 ] Kevin Cheung commented on SPARK-4: -- Added link to backport https://github.com/

[jira] [Commented] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Kevin Cheung (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681532#comment-17681532 ] Kevin Cheung commented on SPARK-4: -- [~gurwls223] do you think you can review th

[jira] [Assigned] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: (was: Apache Spark) > Spark 3.3 Backport: SPARK-41344 Reading V2 datasource

[jira] [Assigned] (SPARK-42222) Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks underlying error

2023-01-27 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-4: Assignee: Apache Spark > Spark 3.3 Backport: SPARK-41344 Reading V2 datasource masks unde