[jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475156#comment-17475156 ] dch nguyen commented on SPARK-37479: [~imback82] I'm working on this now. I'll create PR soon. Thank

[jira] [Comment Edited] (SPARK-35715) Option "--files" with local:// prefix is not honoured for Spark on kubernetes

[ https://issues.apache.org/jira/browse/SPARK-35715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475135#comment-17475135 ] jingxiong zhong edited comment on SPARK-35715 at 1/13/22, 7:00 AM: --- It

[jira] [Commented] (SPARK-35715) Option "--files" with local:// prefix is not honoured for Spark on kubernetes

[ https://issues.apache.org/jira/browse/SPARK-35715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475135#comment-17475135 ] jingxiong zhong commented on SPARK-35715: - t seems that spark 3 does not support the schema

[jira] [Updated] (SPARK-37892) Spark streaming task failure with ClassCastException [C cannot be cast to [J, at org.apache.spark.unsafe.memory.HeapMemoryAllocator.allocate

[ https://issues.apache.org/jira/browse/SPARK-37892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Benoy V updated SPARK-37892: - Priority: Major (was: Minor) > Spark streaming task failure with ClassCastException [C cannot

[jira] [Created] (SPARK-37892) Spark streaming task failure with ClassCastException [C cannot be cast to [J, at org.apache.spark.unsafe.memory.HeapMemoryAllocator.allocate

Arun Benoy V created SPARK-37892: Summary: Spark streaming task failure with ClassCastException [C cannot be cast to [J, at org.apache.spark.unsafe.memory.HeapMemoryAllocator.allocate Key: SPARK-37892 URL:

[jira] [Assigned] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37891: Assignee: (was: Apache Spark) > Add scalastyle check to disable >

[jira] [Assigned] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37891: Assignee: Apache Spark > Add scalastyle check to disable >

[jira] [Commented] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475109#comment-17475109 ] Apache Spark commented on SPARK-37891: -- User 'tianhanhu' has created a pull request for this issue:

[jira] [Commented] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

[ https://issues.apache.org/jira/browse/SPARK-37891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475108#comment-17475108 ] Apache Spark commented on SPARK-37891: -- User 'tianhanhu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

[ https://issues.apache.org/jira/browse/SPARK-37885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37885. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35184

[jira] [Assigned] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

[ https://issues.apache.org/jira/browse/SPARK-37885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37885: Assignee: Takuya Ueshin > Allow pandas_udf to take type annotations with future

[jira] [Created] (SPARK-37891) Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global

Tianhan Hu created SPARK-37891: -- Summary: Add scalastyle check to disable scala.concurrent.ExecutionContext.Implicits.global Key: SPARK-37891 URL: https://issues.apache.org/jira/browse/SPARK-37891

[jira] [Commented] (SPARK-37890) Migrate DESCRIBE TABLE to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475089#comment-17475089 ] Terry Kim commented on SPARK-37890: --- Working on this. > Migrate DESCRIBE TABLE to use V2 command by

[jira] [Updated] (SPARK-37890) Migrate DESCRIBE TABLE to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim updated SPARK-37890: -- Description: Migrate DESCRIBE TABLE to use V2 command by default. (was: Migrate DESCRIBE NAMESPACE

[jira] [Created] (SPARK-37890) Migrate DESCRIBE TABLE to use V2 command by default

Terry Kim created SPARK-37890: - Summary: Migrate DESCRIBE TABLE to use V2 command by default Key: SPARK-37890 URL: https://issues.apache.org/jira/browse/SPARK-37890 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-37888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475087#comment-17475087 ] Terry Kim commented on SPARK-37888: --- Yes, will work on this first. > Unify v1 and v2 DESCRIBE TABLE

[jira] [Commented] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

[ https://issues.apache.org/jira/browse/SPARK-37889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475085#comment-17475085 ] Apache Spark commented on SPARK-37889: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Commented] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

[ https://issues.apache.org/jira/browse/SPARK-37889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475084#comment-17475084 ] Apache Spark commented on SPARK-37889: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

[ https://issues.apache.org/jira/browse/SPARK-37889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37889: Assignee: (was: Apache Spark) > Log4j2 MarkerFilter can not filter unnecessary

[jira] [Assigned] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

[ https://issues.apache.org/jira/browse/SPARK-37889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37889: Assignee: Apache Spark > Log4j2 MarkerFilter can not filter unnecessary thrift errors >

[jira] [Created] (SPARK-37889) Log4j2 MarkerFilter can not filter unnecessary thrift errors

Kent Yao created SPARK-37889: Summary: Log4j2 MarkerFilter can not filter unnecessary thrift errors Key: SPARK-37889 URL: https://issues.apache.org/jira/browse/SPARK-37889 Project: Spark Issue

[jira] [Commented] (SPARK-37479) Migrate DROP NAMESPACE to use V2 command by default

[ https://issues.apache.org/jira/browse/SPARK-37479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475077#comment-17475077 ] Terry Kim commented on SPARK-37479: --- [~dchvn] Are you still working on this? If not, I will take this?

[jira] [Commented] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-37888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475075#comment-17475075 ] Wenchen Fan commented on SPARK-37888: - Hi [~imback82] , do you have time to work on it? DESCRIBE

[jira] [Created] (SPARK-37888) Unify v1 and v2 DESCRIBE TABLE tests

Wenchen Fan created SPARK-37888: --- Summary: Unify v1 and v2 DESCRIBE TABLE tests Key: SPARK-37888 URL: https://issues.apache.org/jira/browse/SPARK-37888 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37381. - Resolution: Fixed Issue resolved by pull request 34719

[jira] [Assigned] (SPARK-37381) Unify v1 and v2 SHOW CREATE TABLE tests

[ https://issues.apache.org/jira/browse/SPARK-37381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37381: --- Assignee: PengLei > Unify v1 and v2 SHOW CREATE TABLE tests >

[jira] [Assigned] (SPARK-37831) Add task partition id in metrics

[ https://issues.apache.org/jira/browse/SPARK-37831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37831: Assignee: Apache Spark > Add task partition id in metrics >

[jira] [Assigned] (SPARK-37831) Add task partition id in metrics

[ https://issues.apache.org/jira/browse/SPARK-37831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37831: Assignee: (was: Apache Spark) > Add task partition id in metrics >

[jira] [Commented] (SPARK-37831) Add task partition id in metrics

[ https://issues.apache.org/jira/browse/SPARK-37831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475071#comment-17475071 ] Apache Spark commented on SPARK-37831: -- User 'stczwd' has created a pull request for this issue:

[jira] [Commented] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

[ https://issues.apache.org/jira/browse/SPARK-37885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475055#comment-17475055 ] Apache Spark commented on SPARK-37885: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

[ https://issues.apache.org/jira/browse/SPARK-37885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37885: Assignee: Apache Spark > Allow pandas_udf to take type annotations with future

[jira] [Assigned] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

[ https://issues.apache.org/jira/browse/SPARK-37885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37885: Assignee: (was: Apache Spark) > Allow pandas_udf to take type annotations with

[jira] [Commented] (SPARK-37887) PySpark shell sets log level to INFO by default

[ https://issues.apache.org/jira/browse/SPARK-37887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475049#comment-17475049 ] L. C. Hsieh commented on SPARK-37887: - Got it. I will take a look. Thanks. > PySpark shell sets log

[jira] [Commented] (SPARK-37887) PySpark shell sets log level to INFO by default

[ https://issues.apache.org/jira/browse/SPARK-37887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475044#comment-17475044 ] Hyukjin Kwon commented on SPARK-37887: -- cc [~viirya] and [~sarutak] FYI > PySpark shell sets log

[jira] [Commented] (SPARK-37887) PySpark shell sets log level to INFO by default

[ https://issues.apache.org/jira/browse/SPARK-37887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475043#comment-17475043 ] Hyukjin Kwon commented on SPARK-37887: -- SparkR shell also has the same issue. > PySpark shell sets

[jira] [Created] (SPARK-37887) PySpark shell sets log level to INFO by default

Hyukjin Kwon created SPARK-37887: Summary: PySpark shell sets log level to INFO by default Key: SPARK-37887 URL: https://issues.apache.org/jira/browse/SPARK-37887 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475038#comment-17475038 ] Apache Spark commented on SPARK-37886: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37886: Assignee: (was: Apache Spark) > Use ComparisonTestBase to reduce redundant test code

[jira] [Assigned] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37886: Assignee: Apache Spark > Use ComparisonTestBase to reduce redundant test code >

[jira] [Commented] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17475037#comment-17475037 ] Apache Spark commented on SPARK-37886: -- User 'Yikun' has created a pull request for this issue:

[jira] [Updated] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37886: Environment: (was: We have many testcase are using same logic to covert pdf to psdf, we can

[jira] [Updated] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

[ https://issues.apache.org/jira/browse/SPARK-37886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37886: Description: We have many testcase are using same logic to covert pdf to psdf, we can use

[jira] [Created] (SPARK-37886) Use ComparisonTestBase to reduce redundant test code

Yikun Jiang created SPARK-37886: --- Summary: Use ComparisonTestBase to reduce redundant test code Key: SPARK-37886 URL: https://issues.apache.org/jira/browse/SPARK-37886 Project: Spark Issue

[jira] [Created] (SPARK-37885) Allow pandas_udf to take type annotations with future annotations enabled

Takuya Ueshin created SPARK-37885: - Summary: Allow pandas_udf to take type annotations with future annotations enabled Key: SPARK-37885 URL: https://issues.apache.org/jira/browse/SPARK-37885 Project:

[jira] [Assigned] (SPARK-37805) Refactor TestUtils#configTestLog4j method to use log4j2 api

[ https://issues.apache.org/jira/browse/SPARK-37805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37805: Assignee: Yang Jie > Refactor TestUtils#configTestLog4j method to use log4j2 api >

[jira] [Resolved] (SPARK-37805) Refactor TestUtils#configTestLog4j method to use log4j2 api

[ https://issues.apache.org/jira/browse/SPARK-37805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37805. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35095

[jira] [Resolved] (SPARK-37418) Inline type hints for python/pyspark/ml/param/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-37418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37418. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37418) Inline type hints for python/pyspark/ml/param/__init__.py

[ https://issues.apache.org/jira/browse/SPARK-37418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37418: -- Assignee: Maciej Szymkiewicz > Inline type hints for

[jira] [Resolved] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37884. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35182

[jira] [Assigned] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37884: - Assignee: Dongjoon Hyun > Upgrade kubernetes-client to 5.10.2 >

[jira] [Updated] (SPARK-37818) Add option for show create table command

[ https://issues.apache.org/jira/browse/SPARK-37818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao updated SPARK-37818: --- Fix Version/s: 3.2.1 > Add option for show create table command >

[jira] [Resolved] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-37855. - Resolution: Fixed > IllegalStateException when transforming an array inside a nested struct >

[jira] [Updated] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-37855: Fix Version/s: 3.2.1 3.3.0 > IllegalStateException when transforming an array

[jira] [Assigned] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37855: --- Assignee: XiDuo You (was: L. C. Hsieh) > IllegalStateException when transforming an array

[jira] [Assigned] (SPARK-37855) IllegalStateException when transforming an array inside a nested struct

[ https://issues.apache.org/jira/browse/SPARK-37855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-37855: --- Assignee: L. C. Hsieh > IllegalStateException when transforming an array inside a nested

[jira] [Updated] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Affects Version/s: 3.2.0 (was: 3.1.1) > Instrument Python UDF

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474905#comment-17474905 ] L. C. Hsieh commented on SPARK-37814: - Feel free to add the issues that should be listed here you

[jira] [Updated] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Description: This proposes to add SQLMetrics instrumentation for Python UDF. This is aimed at

[jira] [Updated] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Attachment: (was: Python_UDF_instrumentation_lite_BatchEvalPython.png) > Instrument Python

[jira] [Updated] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Attachment: (was: Python_UDF_instrumentation_lite_ArrowEvalPython.png) > Instrument Python

[jira] [Updated] (SPARK-34265) Instrument Python UDF execution using SQL Metrics

[ https://issues.apache.org/jira/browse/SPARK-34265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luca Canali updated SPARK-34265: Attachment: PandasUDF_ArrowEvalPython_Metrics.png > Instrument Python UDF execution using SQL

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474877#comment-17474877 ] Dongjoon Hyun commented on SPARK-37814: --- You can re-arrange the issues like that if needed,

[jira] [Commented] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474874#comment-17474874 ] Apache Spark commented on SPARK-37884: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37884: Assignee: Apache Spark > Upgrade kubernetes-client to 5.10.2 >

[jira] [Assigned] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37884: Assignee: (was: Apache Spark) > Upgrade kubernetes-client to 5.10.2 >

[jira] [Commented] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

[ https://issues.apache.org/jira/browse/SPARK-37884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474873#comment-17474873 ] Apache Spark commented on SPARK-37884: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-37884) Upgrade kubernetes-client to 5.10.2

Dongjoon Hyun created SPARK-37884: - Summary: Upgrade kubernetes-client to 5.10.2 Key: SPARK-37884 URL: https://issues.apache.org/jira/browse/SPARK-37884 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-37875) Support ARM64 in Java 17 docker image

[ https://issues.apache.org/jira/browse/SPARK-37875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37875. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35176

[jira] [Assigned] (SPARK-37875) Support ARM64 in Java 17 docker image

[ https://issues.apache.org/jira/browse/SPARK-37875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37875: - Assignee: Dongjoon Hyun > Support ARM64 in Java 17 docker image >

[jira] [Resolved] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37879. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35179

[jira] [Assigned] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37879: - Assignee: Hyukjin Kwon > Show test report in GitHub Actions builds from PRs >

[jira] [Created] (SPARK-37883) log4j update to 2.17.1 in spark-core 3.2

Setu Agrawal created SPARK-37883: Summary: log4j update to 2.17.1 in spark-core 3.2 Key: SPARK-37883 URL: https://issues.apache.org/jira/browse/SPARK-37883 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37814) Migrating from log4j 1 to log4j 2

[ https://issues.apache.org/jira/browse/SPARK-37814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474615#comment-17474615 ] Yang Jie commented on SPARK-37814: -- Maybe SPARK-37693 should also be archived here. The fix is also

[jira] [Assigned] (SPARK-37880) Upgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-37880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37880: Assignee: (was: Apache Spark) > Upgrade Scala to 2.13.8 > --- >

[jira] [Commented] (SPARK-37880) Upgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-37880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474601#comment-17474601 ] Apache Spark commented on SPARK-37880: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37880) Upgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-37880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37880: Assignee: Apache Spark > Upgrade Scala to 2.13.8 > --- > >

[jira] [Updated] (SPARK-37880) Upgrade Scala to 2.13.8

[ https://issues.apache.org/jira/browse/SPARK-37880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-37880: - Description: Scala 2.13.8 already tags: [https://github.com/scala/scala/releases/tag/v2.13.8]  

[jira] [Assigned] (SPARK-37881) Cleanup ShuffleBlockResolver from polluted methods to create a developer API

[ https://issues.apache.org/jira/browse/SPARK-37881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37881: Assignee: Attila Zsolt Piros (was: Apache Spark) > Cleanup ShuffleBlockResolver from

[jira] [Assigned] (SPARK-37881) Cleanup ShuffleBlockResolver from polluted methods to create a developer API

[ https://issues.apache.org/jira/browse/SPARK-37881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37881: Assignee: Apache Spark (was: Attila Zsolt Piros) > Cleanup ShuffleBlockResolver from

[jira] [Commented] (SPARK-37881) Cleanup ShuffleBlockResolver from polluted methods to create a developer API

[ https://issues.apache.org/jira/browse/SPARK-37881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474593#comment-17474593 ] Apache Spark commented on SPARK-37881: -- User 'attilapiros' has created a pull request for this

[jira] [Created] (SPARK-37882) pyarrow.lib.ArrowInvalid: Can only convert 1-dimensional array values

Matthieu Vanhoutte created SPARK-37882: -- Summary: pyarrow.lib.ArrowInvalid: Can only convert 1-dimensional array values Key: SPARK-37882 URL: https://issues.apache.org/jira/browse/SPARK-37882

[jira] [Resolved] (SPARK-37858) Throw Spark exceptions from AES functions

[ https://issues.apache.org/jira/browse/SPARK-37858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37858. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35157

[jira] [Created] (SPARK-37881) Cleanup ShuffleBlockResolver from polluted methods to create a developer API

Attila Zsolt Piros created SPARK-37881: -- Summary: Cleanup ShuffleBlockResolver from polluted methods to create a developer API Key: SPARK-37881 URL: https://issues.apache.org/jira/browse/SPARK-37881

[jira] [Created] (SPARK-37880) Upgrade Scala to 2.13.8

Yang Jie created SPARK-37880: Summary: Upgrade Scala to 2.13.8 Key: SPARK-37880 URL: https://issues.apache.org/jira/browse/SPARK-37880 Project: Spark Issue Type: Sub-task Components:

[jira] [Resolved] (SPARK-37827) Put the some built-in table properties into V1Table.propertie to adapt to V2 command

[ https://issues.apache.org/jira/browse/SPARK-37827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37827. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35131

[jira] [Assigned] (SPARK-37827) Put the some built-in table properties into V1Table.propertie to adapt to V2 command

[ https://issues.apache.org/jira/browse/SPARK-37827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37827: --- Assignee: PengLei > Put the some built-in table properties into V1Table.propertie to adapt

[jira] [Assigned] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37879: Assignee: (was: Apache Spark) > Show test report in GitHub Actions builds from PRs >

[jira] [Commented] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474513#comment-17474513 ] Apache Spark commented on SPARK-37879: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37879: Assignee: Apache Spark > Show test report in GitHub Actions builds from PRs >

[jira] [Commented] (SPARK-37879) Show test report in GitHub Actions builds from PRs

[ https://issues.apache.org/jira/browse/SPARK-37879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474512#comment-17474512 ] Apache Spark commented on SPARK-37879: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-37879) Show test report in GitHub Actions builds from PRs

Hyukjin Kwon created SPARK-37879: Summary: Show test report in GitHub Actions builds from PRs Key: SPARK-37879 URL: https://issues.apache.org/jira/browse/SPARK-37879 Project: Spark Issue

[jira] [Created] (SPARK-37878) Migrate SHOW CREATE TABLE to use v2 command by default

PengLei created SPARK-37878: --- Summary: Migrate SHOW CREATE TABLE to use v2 command by default Key: SPARK-37878 URL: https://issues.apache.org/jira/browse/SPARK-37878 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37877) Support clear shuffle dependencies eagerly for thrift server

[ https://issues.apache.org/jira/browse/SPARK-37877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37877: Assignee: (was: Apache Spark) > Support clear shuffle dependencies eagerly for

[jira] [Commented] (SPARK-37877) Support clear shuffle dependencies eagerly for thrift server

[ https://issues.apache.org/jira/browse/SPARK-37877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474440#comment-17474440 ] Apache Spark commented on SPARK-37877: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37877) Support clear shuffle dependencies eagerly for thrift server

[ https://issues.apache.org/jira/browse/SPARK-37877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37877: Assignee: Apache Spark > Support clear shuffle dependencies eagerly for thrift server >

[jira] [Created] (SPARK-37877) Support clear shuffle dependencies eagerly for thrift server

Kent Yao created SPARK-37877: Summary: Support clear shuffle dependencies eagerly for thrift server Key: SPARK-37877 URL: https://issues.apache.org/jira/browse/SPARK-37877 Project: Spark Issue

[jira] [Assigned] (SPARK-37876) Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

[ https://issues.apache.org/jira/browse/SPARK-37876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37876: Assignee: (was: Apache Spark) > Move SpecificParquetRecordReaderBase.listDirectory

[jira] [Commented] (SPARK-37876) Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

[ https://issues.apache.org/jira/browse/SPARK-37876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17474392#comment-17474392 ] Apache Spark commented on SPARK-37876: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-37876) Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

[ https://issues.apache.org/jira/browse/SPARK-37876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37876: Assignee: Apache Spark > Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

[jira] [Created] (SPARK-37876) Move SpecificParquetRecordReaderBase.listDirectory to TestUtils

Yang Jie created SPARK-37876: Summary: Move SpecificParquetRecordReaderBase.listDirectory to TestUtils Key: SPARK-37876 URL: https://issues.apache.org/jira/browse/SPARK-37876 Project: Spark

  1   2   >