[jira] [Resolved] (SPARK-33474) Incorrect value when inserting into date type partition table with date type value

[ https://issues.apache.org/jira/browse/SPARK-33474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33474. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved by

[jira] [Comment Edited] (SPARK-21564) TaskDescription decoding failure should fail the task

[ https://issues.apache.org/jira/browse/SPARK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294347#comment-17294347 ] Sandeep Katta edited comment on SPARK-21564 at 3/3/21, 7:47 AM: --

[jira] [Updated] (SPARK-21564) TaskDescription decoding failure should fail the task

[ https://issues.apache.org/jira/browse/SPARK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-21564: -- Affects Version/s: 2.4.7 3.1.1 > TaskDescription decoding failure shoul

[jira] [Commented] (SPARK-21564) TaskDescription decoding failure should fail the task

[ https://issues.apache.org/jira/browse/SPARK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294347#comment-17294347 ] Sandeep Katta commented on SPARK-21564: --- Recently I have hit with decode error, ir

[jira] [Updated] (SPARK-21564) TaskDescription decoding failure should fail the task

[ https://issues.apache.org/jira/browse/SPARK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-21564: -- Attachment: image-2021-03-03-13-02-31-744.png > TaskDescription decoding failure should fail t

[jira] [Updated] (SPARK-21564) TaskDescription decoding failure should fail the task

[ https://issues.apache.org/jira/browse/SPARK-21564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Katta updated SPARK-21564: -- Attachment: image-2021-03-03-13-02-06-669.png > TaskDescription decoding failure should fail t

[jira] [Commented] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

[ https://issues.apache.org/jira/browse/SPARK-34604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294339#comment-17294339 ] Apache Spark commented on SPARK-34604: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

[ https://issues.apache.org/jira/browse/SPARK-34604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34604: Assignee: Apache Spark (was: Hyukjin Kwon) > Flaky test: > TaskContextTestsWithWorkerRe

[jira] [Commented] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

[ https://issues.apache.org/jira/browse/SPARK-34604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294338#comment-17294338 ] Apache Spark commented on SPARK-34604: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

[ https://issues.apache.org/jira/browse/SPARK-34604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34604: Assignee: Hyukjin Kwon (was: Apache Spark) > Flaky test: > TaskContextTestsWithWorkerRe

[jira] [Created] (SPARK-34604) Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse

Hyukjin Kwon created SPARK-34604: Summary: Flaky test: TaskContextTestsWithWorkerReuse.test_task_context_correct_with_python_worker_reuse Key: SPARK-34604 URL: https://issues.apache.org/jira/browse/SPARK-34604

[jira] [Resolved] (SPARK-30476) NullPointerException when Insert data to hive mongo external table by spark-sql

[ https://issues.apache.org/jira/browse/SPARK-30476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiongCheng resolved SPARK-30476. Resolution: Not A Problem > NullPointerException when Insert data to hive mongo external table by

[jira] [Commented] (SPARK-34595) DPP support RLIKE

[ https://issues.apache.org/jira/browse/SPARK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294327#comment-17294327 ] Apache Spark commented on SPARK-34595: -- User 'chaojun-zhang' has created a pull req

[jira] [Commented] (SPARK-34595) DPP support RLIKE

[ https://issues.apache.org/jira/browse/SPARK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294326#comment-17294326 ] Apache Spark commented on SPARK-34595: -- User 'chaojun-zhang' has created a pull req

[jira] [Assigned] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34603: Assignee: Apache Spark (was: Kousuke Saruta) > Support ADD ARCHIVE and LIST ARCHIVE comm

[jira] [Assigned] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34603: Assignee: Kousuke Saruta (was: Apache Spark) > Support ADD ARCHIVE and LIST ARCHIVE comm

[jira] [Commented] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294325#comment-17294325 ] Apache Spark commented on SPARK-34603: -- User 'sarutak' has created a pull request f

[jira] [Created] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

Kousuke Saruta created SPARK-34603: -- Summary: Support ADD ARCHIVE and LIST ARCHIVE command Key: SPARK-34603 URL: https://issues.apache.org/jira/browse/SPARK-34603 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34603) Support ADD ARCHIVE and LIST ARCHIVE command

[ https://issues.apache.org/jira/browse/SPARK-34603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34603: --- Description: SPARK-33530 added addArchive and listArchives to SparkContext but it's not supp

[jira] [Commented] (SPARK-34602) Improve PlanStabilitySuite to output # of operators information

[ https://issues.apache.org/jira/browse/SPARK-34602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294321#comment-17294321 ] Cheng Su commented on SPARK-34602: -- Will submit a PR shortly. > Improve PlanStabilityS

[jira] [Created] (SPARK-34602) Improve PlanStabilitySuite to output # of operators information

Cheng Su created SPARK-34602: Summary: Improve PlanStabilitySuite to output # of operators information Key: SPARK-34602 URL: https://issues.apache.org/jira/browse/SPARK-34602 Project: Spark Issu

[jira] [Commented] (SPARK-34595) DPP support RLIKE

[ https://issues.apache.org/jira/browse/SPARK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294309#comment-17294309 ] Apache Spark commented on SPARK-34595: -- User 'chaojun-zhang' has created a pull req

[jira] [Commented] (SPARK-34595) DPP support RLIKE

[ https://issues.apache.org/jira/browse/SPARK-34595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294308#comment-17294308 ] Apache Spark commented on SPARK-34595: -- User 'chaojun-zhang' has created a pull req

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is n

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is n

[jira] [Assigned] (SPARK-34222) Enhance Boolean Simplification Rule

[ https://issues.apache.org/jira/browse/SPARK-34222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34222: --- Assignee: Swinky Mann > Enhance Boolean Simplification Rule > -

[jira] [Resolved] (SPARK-34222) Enhance Boolean Simplification Rule

[ https://issues.apache.org/jira/browse/SPARK-34222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34222. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31318 [https://gith

[jira] [Commented] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

[ https://issues.apache.org/jira/browse/SPARK-34361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294284#comment-17294284 ] Apache Spark commented on SPARK-34361: -- User 'attilapiros' has created a pull reque

[jira] [Commented] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

[ https://issues.apache.org/jira/browse/SPARK-34361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294283#comment-17294283 ] Apache Spark commented on SPARK-34361: -- User 'attilapiros' has created a pull reque

[jira] [Resolved] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-27793. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31614 [https://gith

[jira] [Assigned] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-27793: --- Assignee: Maxim Gekk > Add ANSI SQL day-time and year-month interval types > --

[jira] [Assigned] (SPARK-34593) Preserve broadcast nested loop join output partitioning and ordering

[ https://issues.apache.org/jira/browse/SPARK-34593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34593: --- Assignee: Cheng Su > Preserve broadcast nested loop join output partitioning and ordering >

[jira] [Resolved] (SPARK-34593) Preserve broadcast nested loop join output partitioning and ordering

[ https://issues.apache.org/jira/browse/SPARK-34593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34593. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31708 [https://gith

[jira] [Commented] (SPARK-34225) Jars or file paths which contain spaces are generating FileNotFoundException exception

[ https://issues.apache.org/jira/browse/SPARK-34225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294270#comment-17294270 ] Apache Spark commented on SPARK-34225: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34225) Jars or file paths which contain spaces are generating FileNotFoundException exception

[ https://issues.apache.org/jira/browse/SPARK-34225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34225: Assignee: (was: Apache Spark) > Jars or file paths which contain spaces are generatin

[jira] [Commented] (SPARK-34594) OrcColumnarBatchReader uncaught exception

[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294269#comment-17294269 ] Zhang Jianguo commented on SPARK-34594: --- [~dongjoon] This issue occured with "spa

[jira] [Assigned] (SPARK-34225) Jars or file paths which contain spaces are generating FileNotFoundException exception

[ https://issues.apache.org/jira/browse/SPARK-34225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34225: Assignee: Apache Spark > Jars or file paths which contain spaces are generating FileNotFo

[jira] [Resolved] (SPARK-34534) New protocol FetchShuffleBlocks in OneForOneBlockFetcher lead to data loss or correctness

[ https://issues.apache.org/jira/browse/SPARK-34534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34534. - Fix Version/s: 3.1.2 3.0.3 3.2.0 Resolution: Fixed

[jira] [Resolved] (SPARK-34596) NewInstance.doGenCode should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34596. -- Resolution: Fixed Fixed in https://github.com/apache/spark/pull/31709 > NewInstance.doGenCode

[jira] [Updated] (SPARK-34596) NewInstance.doGenCode should not throw malformed class name error

[ https://issues.apache.org/jira/browse/SPARK-34596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34596: - Fix Version/s: 3.0.3 3.1.2 3.2.0 > NewInstance.doGenCode s

[jira] [Resolved] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34556. -- Fix Version/s: 3.1.2 3.0.3 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34556: Assignee: Shixiong Zhu > Checking duplicate static partition columns doesn't respect case

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Description: In the current master, if we want to debug using JDWP for tests, we need to man

[jira] [Updated] (SPARK-34590) Allow JDWP debug for tests

[ https://issues.apache.org/jira/browse/SPARK-34590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-34590: --- Summary: Allow JDWP debug for tests (was: Allow JDWP debug for tests with sbt) > Allow JDW

[jira] [Commented] (SPARK-34594) OrcColumnarBatchReader uncaught exception

[ https://issues.apache.org/jira/browse/SPARK-34594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294223#comment-17294223 ] Dongjoon Hyun commented on SPARK-34594: --- Could you try to use `spark.sql.files.ign

[jira] [Commented] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294221#comment-17294221 ] Apache Spark commented on SPARK-34548: -- User 'viirya' has created a pull request fo

[jira] [Resolved] (SPARK-34579) Fix wrong test in SQLQuerySuite

[ https://issues.apache.org/jira/browse/SPARK-34579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34579. --- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Thank you, [~maro

[jira] [Resolved] (SPARK-34548) Remove unnecessary children from Union under Distince and Deduplicate

[ https://issues.apache.org/jira/browse/SPARK-34548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-34548. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31656 [https://gith

[jira] [Assigned] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34601: Assignee: (was: Apache Spark) > Do not delete shuffle file on executor lost event whe

[jira] [Commented] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294197#comment-17294197 ] Apache Spark commented on SPARK-34601: -- User 'hiboyang' has created a pull request

[jira] [Assigned] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34601: Assignee: Apache Spark > Do not delete shuffle file on executor lost event when using rem

[jira] [Commented] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294196#comment-17294196 ] Apache Spark commented on SPARK-34601: -- User 'hiboyang' has created a pull request

[jira] [Commented] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294194#comment-17294194 ] Apache Spark commented on SPARK-34556: -- User 'zsxwing' has created a pull request f

[jira] [Commented] (SPARK-34556) Checking duplicate static partition columns doesn't respect case sensitive conf

[ https://issues.apache.org/jira/browse/SPARK-34556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294193#comment-17294193 ] Apache Spark commented on SPARK-34556: -- User 'zsxwing' has created a pull request f

[jira] [Resolved] (SPARK-34361) Dynamic allocation on K8s kills executors with running tasks

[ https://issues.apache.org/jira/browse/SPARK-34361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-34361. -- Fix Version/s: 3.1.2 3.2.0 Assignee: Attila Zsolt Piros Reso

[jira] [Commented] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

[ https://issues.apache.org/jira/browse/SPARK-34601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294062#comment-17294062 ] BoYang commented on SPARK-34601: I will add a PR for this soon. > Do not delete shuffle

[jira] [Created] (SPARK-34601) Do not delete shuffle file on executor lost event when using remote shuffle service

BoYang created SPARK-34601: -- Summary: Do not delete shuffle file on executor lost event when using remote shuffle service Key: SPARK-34601 URL: https://issues.apache.org/jira/browse/SPARK-34601 Project: Spar

[jira] [Assigned] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

[ https://issues.apache.org/jira/browse/SPARK-34599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34599: Assignee: (was: Apache Spark) > INSERT INTO OVERWRITE doesn't support partition colum

[jira] [Commented] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

[ https://issues.apache.org/jira/browse/SPARK-34599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17294055#comment-17294055 ] Apache Spark commented on SPARK-34599: -- User 'zsxwing' has created a pull request f

[jira] [Assigned] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

[ https://issues.apache.org/jira/browse/SPARK-34599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34599: Assignee: Apache Spark > INSERT INTO OVERWRITE doesn't support partition columns containi

[jira] [Updated] (SPARK-34600) Support user defined types in Pandas UDF

[ https://issues.apache.org/jira/browse/SPARK-34600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated SPARK-34600: -- Description: Because Pandas UDF uses pyarrow to passing data, it does not currently support U

[jira] [Created] (SPARK-34600) Support user defined types in Pandas UDF

Lei (Eddy) Xu created SPARK-34600: - Summary: Support user defined types in Pandas UDF Key: SPARK-34600 URL: https://issues.apache.org/jira/browse/SPARK-34600 Project: Spark Issue Type: New Fe

[jira] [Created] (SPARK-34599) INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2

Shixiong Zhu created SPARK-34599: Summary: INSERT INTO OVERWRITE doesn't support partition columns containing dot for DSv2 Key: SPARK-34599 URL: https://issues.apache.org/jira/browse/SPARK-34599 Proje

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293975#comment-17293975 ] Dmitry Kravchuk commented on SPARK-34588: - [~emkornfield] [~gurwls223] looks lik

[jira] [Commented] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

[ https://issues.apache.org/jira/browse/SPARK-34598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293938#comment-17293938 ] Apache Spark commented on SPARK-34598: -- User 'Swinky' has created a pull request fo

[jira] [Assigned] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

[ https://issues.apache.org/jira/browse/SPARK-34598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34598: Assignee: (was: Apache Spark) > RewritePredicateSubquery Rule must not update Filters

[jira] [Commented] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

[ https://issues.apache.org/jira/browse/SPARK-34598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293937#comment-17293937 ] Apache Spark commented on SPARK-34598: -- User 'Swinky' has created a pull request fo

[jira] [Assigned] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

[ https://issues.apache.org/jira/browse/SPARK-34598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34598: Assignee: Apache Spark > RewritePredicateSubquery Rule must not update Filters without su

[jira] [Commented] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

[ https://issues.apache.org/jira/browse/SPARK-34598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293930#comment-17293930 ] Swinky Mann commented on SPARK-34598: - I am working on this, shall submit a PR. > R

[jira] [Created] (SPARK-34598) RewritePredicateSubquery Rule must not update Filters without subqueries

Swinky Mann created SPARK-34598: --- Summary: RewritePredicateSubquery Rule must not update Filters without subqueries Key: SPARK-34598 URL: https://issues.apache.org/jira/browse/SPARK-34598 Project: Spark

[jira] [Commented] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293918#comment-17293918 ] David Li commented on SPARK-34463: -- I've been a bit backlogged but I'll try to get docs

[jira] [Comment Edited] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293893#comment-17293893 ] Bryan Cutler edited comment on SPARK-34463 at 3/2/21, 6:11 PM: ---

[jira] [Commented] (SPARK-34463) toPandas failed with error: buffer source array is read-only when Arrow with self-destruct is enabled

[ https://issues.apache.org/jira/browse/SPARK-34463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293893#comment-17293893 ] Bryan Cutler commented on SPARK-34463: -- As David said, it depends on what is done i

[jira] [Commented] (SPARK-34380) Support ifExists for ALTER TABLE ... UNSET TBLPROPERTIES

[ https://issues.apache.org/jira/browse/SPARK-34380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293854#comment-17293854 ] Terry Kim commented on SPARK-34380: --- [~angerszhuuu] This PR was reverted, thus I think

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293817#comment-17293817 ] Micah Kornfield commented on SPARK-34588: - It looks like 3.1.0 should have the c

[jira] [Assigned] (SPARK-34558) warehouse path should be resolved ahead of populating and use

[ https://issues.apache.org/jira/browse/SPARK-34558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34558: --- Assignee: Kent Yao > warehouse path should be resolved ahead of populating and use > --

[jira] [Resolved] (SPARK-34558) warehouse path should be resolved ahead of populating and use

[ https://issues.apache.org/jira/browse/SPARK-34558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34558. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31671 [https://gith

[jira] [Assigned] (SPARK-34432) add a java implementation for the simple writable data source

[ https://issues.apache.org/jira/browse/SPARK-34432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34432: --- Assignee: Kevin Pis > add a java implementation for the simple writable data source > -

[jira] [Assigned] (SPARK-34498) fix the remaining problems in SPARK-34432

[ https://issues.apache.org/jira/browse/SPARK-34498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34498: --- Assignee: Kevin Pis > fix the remaining problems in SPARK-34432 > -

[jira] [Resolved] (SPARK-34498) fix the remaining problems in SPARK-34432

[ https://issues.apache.org/jira/browse/SPARK-34498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34498. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31621 [https://gith

[jira] [Commented] (SPARK-34597) Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter`

[ https://issues.apache.org/jira/browse/SPARK-34597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293726#comment-17293726 ] Apache Spark commented on SPARK-34597: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-34597) Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter`

[ https://issues.apache.org/jira/browse/SPARK-34597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34597: Assignee: Apache Spark > Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.

[jira] [Assigned] (SPARK-34597) Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter`

[ https://issues.apache.org/jira/browse/SPARK-34597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34597: Assignee: (was: Apache Spark) > Replaces `ParquetFileReader.readFooter` with `Parquet

[jira] [Created] (SPARK-34597) Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter`

Yang Jie created SPARK-34597: Summary: Replaces `ParquetFileReader.readFooter` with `ParquetFileReader.open and getFooter` Key: SPARK-34597 URL: https://issues.apache.org/jira/browse/SPARK-34597 Project:

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293713#comment-17293713 ] Dmitry Kravchuk commented on SPARK-34588: - [~hyukjin.kwon] I've searched though

[jira] [Assigned] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27793: Assignee: (was: Apache Spark) > Add ANSI SQL day-time and year-month interval types >

[jira] [Assigned] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27793: Assignee: Apache Spark > Add ANSI SQL day-time and year-month interval types > --

[jira] [Commented] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293710#comment-17293710 ] Apache Spark commented on SPARK-27793: -- User 'MaxGekk' has created a pull request f

[jira] [Updated] (SPARK-27793) Add ANSI SQL day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Summary: Add ANSI SQL day-time and year-month interval types (was: Add day-time and year-month inte

[jira] [Commented] (SPARK-34588) Support int64 buffer lengths in Java for pyspark Pandas UDF as buffer expanding

[ https://issues.apache.org/jira/browse/SPARK-34588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293695#comment-17293695 ] Dmitry Kravchuk commented on SPARK-34588: - [~hyukjin.kwon] as you can see here

[jira] [Updated] (SPARK-27791) Support SQL year-month INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27791: --- Parent: (was: SPARK-27790) Issue Type: Improvement (was: Sub-task) > Support SQL year-m

[jira] [Resolved] (SPARK-27791) Support SQL year-month INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-27791. Resolution: Won't Fix > Support SQL year-month INTERVAL type > ---

[jira] [Updated] (SPARK-27793) Add day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Description: Extend Catalyst's type system by two new types that conform to the SQL standard (see S

[jira] [Updated] (SPARK-27793) Add day-time and year-month interval types

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Summary: Add day-time and year-month interval types (was: Support SQL day-time INTERVAL type) > Ad

[jira] [Updated] (SPARK-27793) Support SQL day-time INTERVAL type

[ https://issues.apache.org/jira/browse/SPARK-27793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27793: --- Affects Version/s: (was: 2.4.3) 3.2.0 > Support SQL day-time INTERVAL typ

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is n

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Description: Spark has an INTERVAL data type, but it is “broken”: # It cannot be persisted # It is n

[jira] [Issue Comment Deleted] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Comment: was deleted (was: I am working on it.) > Support ANSI SQL INTERVAL types > ---

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Issue Type: Improvement (was: New Feature) > Support ANSI SQL INTERVAL types >

[jira] [Updated] (SPARK-27790) Support ANSI SQL INTERVAL types

[ https://issues.apache.org/jira/browse/SPARK-27790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-27790: --- Summary: Support ANSI SQL INTERVAL types (was: Support SQL INTERVAL types) > Support ANSI SQL INTER

  1   2   >