[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472521#comment-17472521 ] Jinpeng Chi commented on SPARK-37840: - [~hyukjin.kwon] But the loading is still from the previous

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472519#comment-17472519 ] Jinpeng Chi commented on SPARK-37840: - Spark does not currently support delete jar > Dynamically

[jira] [Commented] (SPARK-37863) Add submitTime for Spark Application

[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472507#comment-17472507 ] Apache Spark commented on SPARK-37863: -- User 'zhouyifan279' has created a pull request for this

[jira] [Assigned] (SPARK-37863) Add submitTime for Spark Application

[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37863: Assignee: Apache Spark > Add submitTime for Spark Application >

[jira] [Assigned] (SPARK-37863) Add submitTime for Spark Application

[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37863: Assignee: (was: Apache Spark) > Add submitTime for Spark Application >

[jira] [Assigned] (SPARK-37862) RecordBinaryComparator should fast skip the check of aligning with unaligned platform

[ https://issues.apache.org/jira/browse/SPARK-37862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37862: Assignee: (was: Apache Spark) > RecordBinaryComparator should fast skip the check of

[jira] [Assigned] (SPARK-37862) RecordBinaryComparator should fast skip the check of aligning with unaligned platform

[ https://issues.apache.org/jira/browse/SPARK-37862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37862: Assignee: Apache Spark > RecordBinaryComparator should fast skip the check of aligning

[jira] [Commented] (SPARK-37862) RecordBinaryComparator should fast skip the check of aligning with unaligned platform

[ https://issues.apache.org/jira/browse/SPARK-37862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472493#comment-17472493 ] Apache Spark commented on SPARK-37862: -- User 'ulysses-you' has created a pull request for this

[jira] [Updated] (SPARK-37863) Add submitTime for Spark Application

[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhou Yifan updated SPARK-37863: --- Description: Spark Driver may take a long time to startup when running with cluster mode, if YARN

[jira] [Created] (SPARK-37863) Add submitTime for Spark Application

Zhou Yifan created SPARK-37863: -- Summary: Add submitTime for Spark Application Key: SPARK-37863 URL: https://issues.apache.org/jira/browse/SPARK-37863 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-37862) RecordBinaryComparator should fast skip the check of aligning with unaligned platform

XiDuo You created SPARK-37862: - Summary: RecordBinaryComparator should fast skip the check of aligning with unaligned platform Key: SPARK-37862 URL: https://issues.apache.org/jira/browse/SPARK-37862

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472488#comment-17472488 ] Hyukjin Kwon commented on SPARK-37840: -- ADD FILE|JAR|ARCHIVE tracks timestamps IIRC, and they can

[jira] [Commented] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472487#comment-17472487 ] Kousuke Saruta commented on SPARK-37860: Note: If the vote of Spark 3.2.1 RC1 passes, replace

[jira] [Resolved] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-37860. Fix Version/s: 3.1.3 3.0.4 3.2.1

[jira] [Commented] (SPARK-37840) Dynamically update the loaded Hive UDF JAR

[ https://issues.apache.org/jira/browse/SPARK-37840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472471#comment-17472471 ] Jinpeng Chi commented on SPARK-37840: - [~hyukjin.kwon] No > Dynamically update the loaded Hive UDF

[jira] [Created] (SPARK-37861) How to reload udf jar class without restart driver and executor

Jinpeng Chi created SPARK-37861: --- Summary: How to reload udf jar class without restart driver and executor Key: SPARK-37861 URL: https://issues.apache.org/jira/browse/SPARK-37861 Project: Spark

[jira] [Assigned] (SPARK-37847) PushBlockStreamCallback should check isTooLate first to avoid NPE

[ https://issues.apache.org/jira/browse/SPARK-37847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-37847: --- Assignee: Cheng Pan > PushBlockStreamCallback should check isTooLate first

[jira] [Resolved] (SPARK-37847) PushBlockStreamCallback should check isTooLate first to avoid NPE

[ https://issues.apache.org/jira/browse/SPARK-37847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-37847. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Commented] (SPARK-37159) Change HiveExternalCatalogVersionsSuite to be able to test with Java 17

[ https://issues.apache.org/jira/browse/SPARK-37159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472434#comment-17472434 ] Kousuke Saruta commented on SPARK-37159: All right. Thank you [~dongjoon]! > Change

[jira] [Commented] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472421#comment-17472421 ] Apache Spark commented on SPARK-37860: -- User 'stczwd' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37860: Assignee: Apache Spark > [BUG] Revert: Fix taskid in the stage page task event timeline

[jira] [Assigned] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37860: Assignee: (was: Apache Spark) > [BUG] Revert: Fix taskid in the stage page task

[jira] [Commented] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

[ https://issues.apache.org/jira/browse/SPARK-37860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472420#comment-17472420 ] Apache Spark commented on SPARK-37860: -- User 'stczwd' has created a pull request for this issue:

[jira] [Updated] (SPARK-37159) Change HiveExternalCatalogVersionsSuite to be able to test with Java 17

[ https://issues.apache.org/jira/browse/SPARK-37159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37159: -- Parent: SPARK-33772 Issue Type: Sub-task (was: Bug) > Change

[jira] [Commented] (SPARK-37159) Change HiveExternalCatalogVersionsSuite to be able to test with Java 17

[ https://issues.apache.org/jira/browse/SPARK-37159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472409#comment-17472409 ] Dongjoon Hyun commented on SPARK-37159: --- I'll collect this to a subtask of SPARK-33772,

[jira] [Commented] (SPARK-35746) Task id in the Stage page timeline is incorrect

[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472389#comment-17472389 ] Apache Spark commented on SPARK-35746: -- User 'stczwd' has created a pull request for this issue:

[jira] [Created] (SPARK-37860) [BUG] Revert: Fix taskid in the stage page task event timeline

Jackey Lee created SPARK-37860: -- Summary: [BUG] Revert: Fix taskid in the stage page task event timeline Key: SPARK-37860 URL: https://issues.apache.org/jira/browse/SPARK-37860 Project: Spark

[jira] [Updated] (SPARK-36717) Wrong order of variable initialization may lead to incorrect behavior

[ https://issues.apache.org/jira/browse/SPARK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36717: --- Fix Version/s: (was: 3.2.0) > Wrong order of variable initialization may lead to incorrect

[jira] [Updated] (SPARK-37790) Upgrade SLF4J to 1.7.32

[ https://issues.apache.org/jira/browse/SPARK-37790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37790: -- Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Upgrade SLF4J to

[jira] [Updated] (SPARK-36717) Wrong order of variable initialization may lead to incorrect behavior

[ https://issues.apache.org/jira/browse/SPARK-36717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36717: --- Fix Version/s: 3.2.1 > Wrong order of variable initialization may lead to incorrect behavior >

[jira] [Updated] (SPARK-36979) Add RewriteLateralSubquery rule into nonExcludableRules

[ https://issues.apache.org/jira/browse/SPARK-36979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36979: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Add RewriteLateralSubquery rule into

[jira] [Updated] (SPARK-37843) Suppress NoSuchFieldError at setMDCForTask

[ https://issues.apache.org/jira/browse/SPARK-37843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37843: -- Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > Suppress NoSuchFieldError at

[jira] [Updated] (SPARK-37844) Remove slf4j-log4j12 dependency from hadoop-minikdc

[ https://issues.apache.org/jira/browse/SPARK-37844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37844: -- Parent: SPARK-37814 Issue Type: Sub-task (was: Bug) > Remove slf4j-log4j12

[jira] [Updated] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37853: -- Parent: SPARK-37814 Issue Type: Sub-task (was: Improvement) > Clean up deprecation

[jira] [Updated] (SPARK-33277) Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.

[ https://issues.apache.org/jira/browse/SPARK-33277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-33277: --- Fix Version/s: 3.2.1 > Python/Pandas UDF right after off-heap vectorized reader could cause

[jira] [Updated] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36464: --- Fix Version/s: 3.2.0 > Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream

[jira] [Updated] (SPARK-36464) Fix Underlying Size Variable Initialization in ChunkedByteBufferOutputStream for Writing Over 2GB Data

[ https://issues.apache.org/jira/browse/SPARK-36464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-36464: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Fix Underlying Size Variable

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30789: --- Fix Version/s: (was: 3.2.0) > Support (IGNORE | RESPECT) NULLS for

[jira] [Updated] (SPARK-34399) Add file commit time to metrics and shown in SQL Tab UI

[ https://issues.apache.org/jira/browse/SPARK-34399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-34399: --- Fix Version/s: 3.2.1 (was: 3.2.0) > Add file commit time to metrics and

[jira] [Resolved] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37853. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35153

[jira] [Assigned] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37853: - Assignee: Yang Jie > Clean up deprecation compilation warning related to log4j2 >

[jira] [Updated] (SPARK-35714) Bug fix for deadlock during the executor shutdown

[ https://issues.apache.org/jira/browse/SPARK-35714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-35714: --- Fix Version/s: 3.2.1 > Bug fix for deadlock during the executor shutdown >

[jira] [Updated] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE

[ https://issues.apache.org/jira/browse/SPARK-30789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-30789: --- Fix Version/s: 3.2.1 > Support (IGNORE | RESPECT) NULLS for

[jira] [Resolved] (SPARK-37851) Mark org.apache.spark.sql.hive.execution as slow tests

[ https://issues.apache.org/jira/browse/SPARK-37851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37851. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35151

[jira] [Assigned] (SPARK-37851) Mark org.apache.spark.sql.hive.execution as slow tests

[ https://issues.apache.org/jira/browse/SPARK-37851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37851: - Assignee: Hyukjin Kwon > Mark org.apache.spark.sql.hive.execution as slow tests >

[jira] [Commented] (SPARK-37859) SQL tables created with JDBC with Spark 3.1 are not readable with 3.2

[ https://issues.apache.org/jira/browse/SPARK-37859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472351#comment-17472351 ] Apache Spark commented on SPARK-37859: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37859) SQL tables created with JDBC with Spark 3.1 are not readable with 3.2

[ https://issues.apache.org/jira/browse/SPARK-37859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37859: Assignee: (was: Apache Spark) > SQL tables created with JDBC with Spark 3.1 are not

[jira] [Assigned] (SPARK-37859) SQL tables created with JDBC with Spark 3.1 are not readable with 3.2

[ https://issues.apache.org/jira/browse/SPARK-37859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37859: Assignee: Apache Spark > SQL tables created with JDBC with Spark 3.1 are not readable

[jira] [Commented] (SPARK-37859) SQL tables created with JDBC with Spark 3.1 are not readable with 3.2

[ https://issues.apache.org/jira/browse/SPARK-37859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472350#comment-17472350 ] Apache Spark commented on SPARK-37859: -- User 'karenfeng' has created a pull request for this issue:

[jira] [Created] (SPARK-37859) SQL tables created with JDBC with Spark 3.1 are not readable with 3.2

Karen Feng created SPARK-37859: -- Summary: SQL tables created with JDBC with Spark 3.1 are not readable with 3.2 Key: SPARK-37859 URL: https://issues.apache.org/jira/browse/SPARK-37859 Project: Spark

[jira] [Resolved] (SPARK-37852) Enable flake's E741 rule in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37852. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37852) Enable flake's E741 rule in PySpark

[ https://issues.apache.org/jira/browse/SPARK-37852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37852: -- Assignee: Hyukjin Kwon > Enable flake's E741 rule in PySpark >

[jira] [Assigned] (SPARK-37858) Throw Spark exceptions from AES functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37858: Assignee: Max Gekk (was: Apache Spark) > Throw Spark exceptions from AES functions >

[jira] [Assigned] (SPARK-37858) Throw Spark exceptions from AES functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37858: Assignee: Apache Spark (was: Max Gekk) > Throw Spark exceptions from AES functions >

[jira] [Commented] (SPARK-37858) Throw Spark exceptions from AES functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472294#comment-17472294 ] Apache Spark commented on SPARK-37858: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-37858) Throw Spark exceptions from AES functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37858: - Summary: Throw Spark exceptions from AES functions (was: Wrap Java exceptions from aes functions) >

[jira] [Updated] (SPARK-36782) Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster upon migrating shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-36782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau updated SPARK-36782: - Fix Version/s: 3.1.3 > Deadlock between map-output-dispatcher and dispatcher-BlockManagerMaster

[jira] [Commented] (SPARK-36644) Push down boolean column filter

[ https://issues.apache.org/jira/browse/SPARK-36644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472269#comment-17472269 ] Apache Spark commented on SPARK-36644: -- User 'kazuyukitanimura' has created a pull request for this

[jira] [Updated] (SPARK-37858) Wrap Java exceptions from aes functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-37858: - Issue Type: Improvement (was: Bug) > Wrap Java exceptions from aes functions >

[jira] [Created] (SPARK-37858) Wrap Java exceptions from aes functions

Max Gekk created SPARK-37858: Summary: Wrap Java exceptions from aes functions Key: SPARK-37858 URL: https://issues.apache.org/jira/browse/SPARK-37858 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-35262) Memory leak when dataset is being persisted

[ https://issues.apache.org/jira/browse/SPARK-35262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472248#comment-17472248 ] Denis Krivenko commented on SPARK-35262: [~iamelin] Could you please check/confirm the issue

[jira] [Created] (SPARK-37857) Any depth search not working in get_json_object ($..foo)

Venkata Subramaniam created SPARK-37857: --- Summary: Any depth search not working in get_json_object ($..foo) Key: SPARK-37857 URL: https://issues.apache.org/jira/browse/SPARK-37857 Project: Spark

[jira] [Updated] (SPARK-37856) Executor pods keep existing if driver container was restarted

[ https://issues.apache.org/jira/browse/SPARK-37856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Denis Krivenko updated SPARK-37856: --- Environment: Kubernetes 1.20 | Spark 3.1.2 | Hadoop 3.2.0 | Java 11 | Scala 2.12

[jira] [Created] (SPARK-37856) Executor pods keep existing if driver container was restarted

Denis Krivenko created SPARK-37856: -- Summary: Executor pods keep existing if driver container was restarted Key: SPARK-37856 URL: https://issues.apache.org/jira/browse/SPARK-37856 Project: Spark

[jira] [Commented] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472183#comment-17472183 ] Huaxin Gao commented on SPARK-37818: [~Gengliang.Wang] version 3.2.2 doesn't exist yet. I will just

[jira] [Updated] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37818: --- Fix Version/s: (was: 3.2.1) > Add option for show create table command >

[jira] [Commented] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472181#comment-17472181 ] Huaxin Gao commented on SPARK-37818: [~Gengliang.Wang] I am drafting the 3.2.1 voting email now. I

[jira] [Created] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

G Muciaccia created SPARK-37855: --- Summary: IllegalStateException when transforming an array inside a nested struct Key: SPARK-37855 URL: https://issues.apache.org/jira/browse/SPARK-37855 Project: Spark

[jira] [Updated] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

[ https://issues.apache.org/jira/browse/SPARK-37854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37854: - Priority: Trivial (was: Major) > Use type match to simplify TestUtils#withHttpConnection >

[jira] [Commented] (SPARK-37491) Fix Series.asof when values of the series is not sorted

[ https://issues.apache.org/jira/browse/SPARK-37491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472056#comment-17472056 ] pralabhkumar commented on SPARK-37491: -- Lets take example of  pser = pd.Series([2, 1, np.nan, 4],

[jira] [Commented] (SPARK-35746) Task id in the Stage page timeline is incorrect

[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471981#comment-17471981 ] Apache Spark commented on SPARK-35746: -- User 'stczwd' has created a pull request for this issue:

[jira] [Commented] (SPARK-35746) Task id in the Stage page timeline is incorrect

[ https://issues.apache.org/jira/browse/SPARK-35746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471982#comment-17471982 ] Apache Spark commented on SPARK-35746: -- User 'stczwd' has created a pull request for this issue:

[jira] [Resolved] (SPARK-35442) Support propagate empty relation through aggregate

[ https://issues.apache.org/jira/browse/SPARK-35442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35442. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35149

[jira] [Commented] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471925#comment-17471925 ] Gengliang Wang commented on SPARK-37818: [~huaxingao] FYI I set the fixed version as 3.2.1. I

[jira] [Resolved] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-37818. Fix Version/s: 3.2.1 Resolution: Fixed Issue resolved by pull request 35107

[jira] [Assigned] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-37818: -- Assignee: PengLei > Add option for show create table command >

[jira] [Updated] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

[ https://issues.apache.org/jira/browse/SPARK-37854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37854: - Description: {code:java} if (connection.isInstanceOf[HttpsURLConnection]) {            

[jira] [Assigned] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

[ https://issues.apache.org/jira/browse/SPARK-37854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37854: Assignee: Apache Spark > Use type match to simplify TestUtils#withHttpConnection >

[jira] [Commented] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

[ https://issues.apache.org/jira/browse/SPARK-37854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471799#comment-17471799 ] Apache Spark commented on SPARK-37854: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

[ https://issues.apache.org/jira/browse/SPARK-37854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37854: Assignee: (was: Apache Spark) > Use type match to simplify

[jira] [Created] (SPARK-37854) Use type match to simplify TestUtils#withHttpConnection

Yang Jie created SPARK-37854: Summary: Use type match to simplify TestUtils#withHttpConnection Key: SPARK-37854 URL: https://issues.apache.org/jira/browse/SPARK-37854 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471786#comment-17471786 ] Apache Spark commented on SPARK-37853: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37853: Assignee: (was: Apache Spark) > Clean up deprecation compilation warning related to

[jira] [Assigned] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37853: Assignee: Apache Spark > Clean up deprecation compilation warning related to log4j2 >

[jira] [Commented] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471785#comment-17471785 ] Apache Spark commented on SPARK-37853: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-37851) Mark org.apache.spark.sql.hive.execution as slow tests

[ https://issues.apache.org/jira/browse/SPARK-37851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37851: - Summary: Mark org.apache.spark.sql.hive.execution as slow tests (was: Mark TPCDS*Suite,

[jira] [Updated] (SPARK-37851) Mark org.apache.spark.sql.hive.execution as slow tests

[ https://issues.apache.org/jira/browse/SPARK-37851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37851: - Description: Related to SPARK-33171 and SPARK-32884. We should rebalance both: "hive -slow

[jira] [Created] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

Yang Jie created SPARK-37853: Summary: Clean up deprecation compilation warning related to log4j2 Key: SPARK-37853 URL: https://issues.apache.org/jira/browse/SPARK-37853 Project: Spark Issue

[jira] [Updated] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37802: --- Fix Version/s: 3.2.1 (was: 3.2.0) > composite field name like `field name`