[jira] [Resolved] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38926. -- Fix Version/s: (was: 3.3.0) Resolution: Fixed Issue resolved by pull request 36233 [https:/

[jira] [Assigned] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38929: Assignee: (was: Apache Spark) > Improve error messages for cast failures in ANSI > --

[jira] [Assigned] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38929: Assignee: Apache Spark > Improve error messages for cast failures in ANSI > -

[jira] [Commented] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523515#comment-17523515 ] Apache Spark commented on SPARK-38929: -- User 'anchovYu' has created a pull request

[jira] [Commented] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523512#comment-17523512 ] Apache Spark commented on SPARK-37787: -- User 'huangzhir' has created a pull request

[jira] [Commented] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523511#comment-17523511 ] Apache Spark commented on SPARK-37787: -- User 'huangzhir' has created a pull request

[jira] [Updated] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38929: - Description: Improve several error messages for cast failures in ANSI. h2. Cast to numeric types {code:j

[jira] [Updated] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38929: - Description: Improve several error messages for cast failures in ANSI. h2. Cast to numeric types {code:j

[jira] [Updated] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38929: - Description: Improve several error messages for cast failures in ANSI. h3. Cast to numeric types {code:j

[jira] [Updated] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38929: - Description: Improve several error messages for cast failures in ANSI. h3. Cast to numeric types {code:j

[jira] [Updated] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinyi Yu updated SPARK-38929: - Description: Improve several error messages for cast failures in ANSI. h3. Cast to numeric types {code:j

[jira] [Created] (SPARK-38929) Improve error messages for cast failures in ANSI

2022-04-17 Thread Xinyi Yu (Jira)
Xinyi Yu created SPARK-38929: Summary: Improve error messages for cast failures in ANSI Key: SPARK-38929 URL: https://issues.apache.org/jira/browse/SPARK-38929 Project: Spark Issue Type: Improvem

[jira] [Commented] (SPARK-38720) Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523498#comment-17523498 ] Apache Spark commented on SPARK-38720: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-38720) Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38720: Assignee: Apache Spark > Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION >

[jira] [Assigned] (SPARK-38720) Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38720: Assignee: (was: Apache Spark) > Test the error class: CANNOT_CHANGE_DECIMAL_PRECISION

[jira] [Commented] (SPARK-38916) Tasks not killed caused by race conditions between killTask() and launchTask()

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523493#comment-17523493 ] Apache Spark commented on SPARK-38916: -- User 'maryannxue' has created a pull reques

[jira] [Assigned] (SPARK-38916) Tasks not killed caused by race conditions between killTask() and launchTask()

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38916: Assignee: Apache Spark > Tasks not killed caused by race conditions between killTask() an

[jira] [Assigned] (SPARK-38916) Tasks not killed caused by race conditions between killTask() and launchTask()

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38916: Assignee: (was: Apache Spark) > Tasks not killed caused by race conditions between ki

[jira] [Commented] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523487#comment-17523487 ] Apache Spark commented on SPARK-38896: -- User 'LuciferYang' has created a pull reque

[jira] [Resolved] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38928. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36236 [https://

[jira] [Assigned] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38928: - Assignee: William Hyun > Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not a

[jira] [Resolved] (SPARK-38707) Allow user to insert into only certain columns of a table

2022-04-17 Thread morvenhuang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] morvenhuang resolved SPARK-38707. - Resolution: Duplicate Fixed by SPARK-38795. > Allow user to insert into only certain columns of

[jira] [Updated] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38896: - Description: Use `Utils.tryWithResource` to recycling all  `KVStoreIterator` opened by RocksDB/LevelDB 

[jira] [Updated] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38896: - Summary: Use tryWithResource to recycling KVStoreIterator (was: Use tryWithResource to recycling KVStor

[jira] [Commented] (SPARK-38812) when i clean data ,I hope one rdd spill two rdd according clean data rule

2022-04-17 Thread gaokui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523476#comment-17523476 ] gaokui commented on SPARK-38812: I see  SPARK-2373, SPARK-6664 actually i can get more

[jira] [Commented] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523475#comment-17523475 ] Apache Spark commented on SPARK-38928: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38928: Assignee: (was: Apache Spark) > Skip Pandas UDF test in `QueryCompilationErrorsSuite`

[jira] [Assigned] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38928: Assignee: Apache Spark > Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not ava

[jira] [Updated] (SPARK-38868) `assert_true` fails unconditionnaly after `left_outer` joins

2022-04-17 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-38868: -- Affects Version/s: 3.3.0 3.4.0 > `assert_true` fails unconditionnaly af

[jira] [Created] (SPARK-38928) Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available

2022-04-17 Thread William Hyun (Jira)
William Hyun created SPARK-38928: Summary: Skip Pandas UDF test in `QueryCompilationErrorsSuite` if not available Key: SPARK-38928 URL: https://issues.apache.org/jira/browse/SPARK-38928 Project: Spark

[jira] [Updated] (SPARK-38812) when i clean data ,I hope one rdd spill two rdd according clean data rule

2022-04-17 Thread gaokui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gaokui updated SPARK-38812: --- Description: when id do clean data,one rdd according one value(>or <) filter data, and then generate two di

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523470#comment-17523470 ] Hyukjin Kwon commented on SPARK-38810: -- We can pin the version of {{click}} in dev/

[jira] [Commented] (SPARK-38904) Low cost DataFrame schema swap util

2022-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523469#comment-17523469 ] Hyukjin Kwon commented on SPARK-38904: -- It would be great to have such API actually

[jira] [Updated] (SPARK-38917) StreamingQuery.processAllAvailable() blocks forever on queries containing mapGroupsWithState(GroupStateTimeout.ProcessingTimeTimeout())

2022-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38917: - Priority: Major (was: Critical) > StreamingQuery.processAllAvailable() blocks forever on querie

[jira] [Resolved] (SPARK-38816) Wrong comment in random matrix generator in spark-als algorithm

2022-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38816. -- Fix Version/s: 3.3.0 3.2.2 3.1.3 Resolution: Fixed

[jira] [Assigned] (SPARK-38816) Wrong comment in random matrix generator in spark-als algorithm

2022-04-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38816: Assignee: Sean R. Owen > Wrong comment in random matrix generator in spark-als algorithm

[jira] [Updated] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38927: -- Affects Version/s: 3.3.0 3.2.2 > Skip NumPy/Pandas tests in `test_rdd.p

[jira] [Assigned] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38927: - Assignee: William Hyun > Skip NumPy/Pandas tests in `test_rdd.py` if not available > --

[jira] [Resolved] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38927. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pul

[jira] [Commented] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523431#comment-17523431 ] Apache Spark commented on SPARK-38927: -- User 'williamhyun' has created a pull reque

[jira] [Assigned] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38927: Assignee: Apache Spark > Skip NumPy/Pandas tests in `test_rdd.py` if not available >

[jira] [Assigned] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38927: Assignee: (was: Apache Spark) > Skip NumPy/Pandas tests in `test_rdd.py` if not avail

[jira] [Created] (SPARK-38927) Skip NumPy/Pandas tests in `test_rdd.py` if not available

2022-04-17 Thread William Hyun (Jira)
William Hyun created SPARK-38927: Summary: Skip NumPy/Pandas tests in `test_rdd.py` if not available Key: SPARK-38927 URL: https://issues.apache.org/jira/browse/SPARK-38927 Project: Spark Iss

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:34 PM:

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:27 PM:

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523427#comment-17523427 ] Bjørn Jørgensen commented on SPARK-38810: - You are right Sean it not a Spark bug

[jira] [Assigned] (SPARK-38924) Update dataTables to 1.10.25 for security issue

2022-04-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-38924: -- Assignee: Sean R. Owen > Update dataTables to 1.10.25 for security issue > --

[jira] [Resolved] (SPARK-38924) Update dataTables to 1.10.25 for security issue

2022-04-17 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-38924. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36226 [https:

[jira] [Updated] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bjørn Jørgensen updated SPARK-38810: Issue Type: Improvement (was: Bug) > Upgrade Python black in /dev/reformat-python > -

[jira] [Comment Edited] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523425#comment-17523425 ] Bjørn Jørgensen edited comment on SPARK-38810 at 4/17/22 6:21 PM:

[jira] [Commented] (SPARK-38810) Upgrade Python black in /dev/reformat-python

2022-04-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-38810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523425#comment-17523425 ] Bjørn Jørgensen commented on SPARK-38810: - [~srowen] Yes, I think so. Black is u

[jira] [Commented] (SPARK-38409) PrometheusServlet exports gauges with null values

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523401#comment-17523401 ] Apache Spark commented on SPARK-38409: -- User 'jkylling' has created a pull request

[jira] [Assigned] (SPARK-38409) PrometheusServlet exports gauges with null values

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38409: Assignee: (was: Apache Spark) > PrometheusServlet exports gauges with null values > -

[jira] [Commented] (SPARK-38409) PrometheusServlet exports gauges with null values

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523400#comment-17523400 ] Apache Spark commented on SPARK-38409: -- User 'jkylling' has created a pull request

[jira] [Assigned] (SPARK-38409) PrometheusServlet exports gauges with null values

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38409: Assignee: Apache Spark > PrometheusServlet exports gauges with null values >

[jira] [Resolved] (SPARK-38913) Output identifiers in error messages in SQL style

2022-04-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38913. -- Fix Version/s: (was: 3.3.0) Resolution: Fixed Issue resolved by pull request 36210 [https:/

[jira] [Commented] (SPARK-38485) Non-deterministic UDF executed multiple times when combined with withField

2022-04-17 Thread Tanel Kiis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523363#comment-17523363 ] Tanel Kiis commented on SPARK-38485: Is there then even any point in having non-dete

[jira] [Assigned] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

2022-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38826: Assignee: morvenhuang > dropFieldIfAllNull option does not work for empty JSON struct > -

[jira] [Resolved] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

2022-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38826. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36111 [https://gi

[jira] [Commented] (SPARK-38826) dropFieldIfAllNull option does not work for empty JSON struct

2022-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523358#comment-17523358 ] Sean R. Owen commented on SPARK-38826: -- Yeah I guess we can at least update the doc

[jira] [Resolved] (SPARK-38640) NPE with unpersisting memory-only RDD with RDD fetching from shuffle service enabled

2022-04-17 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38640. -- Fix Version/s: 3.3.0 Assignee: Adam Binford Resolution: Fixed Resolved by http

[jira] [Commented] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523305#comment-17523305 ] Apache Spark commented on SPARK-38926: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38926: Assignee: Apache Spark (was: Max Gekk) > Output types in error messages in SQL style > -

[jira] [Commented] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523304#comment-17523304 ] Apache Spark commented on SPARK-38926: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38926: Assignee: Max Gekk (was: Apache Spark) > Output types in error messages in SQL style > -

[jira] [Updated] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38926: - Description: All types should be printed in SQL style in error messages. For example, the type DateType

[jira] [Created] (SPARK-38926) Output types in error messages in SQL style

2022-04-17 Thread Max Gekk (Jira)
Max Gekk created SPARK-38926: Summary: Output types in error messages in SQL style Key: SPARK-38926 URL: https://issues.apache.org/jira/browse/SPARK-38926 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-38492) Improve the test coverage for PySpark

2022-04-17 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523293#comment-17523293 ] pralabhkumar commented on SPARK-38492: -- on it . Thx > Improve the test coverage fo