[jira] [Updated] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala/ThriftServerQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37835: Description: Currently, the comments on `SQLQueryTestSuite.scala` says: {code:java} * To

[jira] [Updated] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala/ThriftServerQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37835: Description: Currently, the comments on `SQLQueryTestSuite.scala` says: {code:java} * To

[jira] [Updated] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala/ThriftServerQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37835: Summary: Fix the comments on SQLQueryTestSuite.scala/ThriftServerQueryTestSuite.scala to more

[jira] [Assigned] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37835: Assignee: Apache Spark > Fix the comments on SQLQueryTestSuite.scala to more explicit >

[jira] [Assigned] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37835: Assignee: (was: Apache Spark) > Fix the comments on SQLQueryTestSuite.scala to more

[jira] [Commented] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470382#comment-17470382 ] Apache Spark commented on SPARK-37835: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

[ https://issues.apache.org/jira/browse/SPARK-37838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37838: Assignee: Apache Spark > Upgrade scalatestplus artifacts to 3.3.0-SNAP3 >

[jira] [Commented] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

[ https://issues.apache.org/jira/browse/SPARK-37838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470376#comment-17470376 ] Apache Spark commented on SPARK-37838: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

[ https://issues.apache.org/jira/browse/SPARK-37838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37838: Assignee: (was: Apache Spark) > Upgrade scalatestplus artifacts to 3.3.0-SNAP3 >

[jira] [Created] (SPARK-37838) Upgrade scalatestplus artifacts to 3.3.0-SNAP3

Yuming Wang created SPARK-37838: --- Summary: Upgrade scalatestplus artifacts to 3.3.0-SNAP3 Key: SPARK-37838 URL: https://issues.apache.org/jira/browse/SPARK-37838 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-37826) Use zstd codec name in ORC file names for hive orc impl

[ https://issues.apache.org/jira/browse/SPARK-37826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37826. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35117

[jira] [Assigned] (SPARK-37826) Use zstd codec name in ORC file names for hive orc impl

[ https://issues.apache.org/jira/browse/SPARK-37826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37826: - Assignee: Kent Yao > Use zstd codec name in ORC file names for hive orc impl >

[jira] [Commented] (SPARK-37837) Enable black formatter in dev Python scripts

[ https://issues.apache.org/jira/browse/SPARK-37837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470360#comment-17470360 ] Apache Spark commented on SPARK-37837: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37837) Enable black formatter in dev Python scripts

[ https://issues.apache.org/jira/browse/SPARK-37837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37837: Assignee: (was: Apache Spark) > Enable black formatter in dev Python scripts >

[jira] [Assigned] (SPARK-37837) Enable black formatter in dev Python scripts

[ https://issues.apache.org/jira/browse/SPARK-37837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37837: Assignee: Apache Spark > Enable black formatter in dev Python scripts >

[jira] [Commented] (SPARK-37837) Enable black formatter in dev Python scripts

[ https://issues.apache.org/jira/browse/SPARK-37837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470359#comment-17470359 ] Apache Spark commented on SPARK-37837: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-37837) Enable black formatter in dev Python scripts

Hyukjin Kwon created SPARK-37837: Summary: Enable black formatter in dev Python scripts Key: SPARK-37837 URL: https://issues.apache.org/jira/browse/SPARK-37837 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37836) Enable more flake8 rules for PEP 8 compliance

[ https://issues.apache.org/jira/browse/SPARK-37836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37836: Assignee: Apache Spark > Enable more flake8 rules for PEP 8 compliance >

[jira] [Commented] (SPARK-37836) Enable more flake8 rules for PEP 8 compliance

[ https://issues.apache.org/jira/browse/SPARK-37836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470356#comment-17470356 ] Apache Spark commented on SPARK-37836: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37836) Enable more flake8 rules for PEP 8 compliance

[ https://issues.apache.org/jira/browse/SPARK-37836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37836: Assignee: (was: Apache Spark) > Enable more flake8 rules for PEP 8 compliance >

[jira] [Assigned] (SPARK-37834) Reenable length check in Python linter

[ https://issues.apache.org/jira/browse/SPARK-37834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37834: Assignee: Hyukjin Kwon > Reenable length check in Python linter >

[jira] [Resolved] (SPARK-37834) Reenable length check in Python linter

[ https://issues.apache.org/jira/browse/SPARK-37834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37834. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35123

[jira] [Commented] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470344#comment-17470344 ] Apache Spark commented on SPARK-37802: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Updated] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37835: Description: Currently, the comments on `SQLQueryTestSuite.scala` says: {code:java} * To

[jira] [Updated] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to more explicit

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-37835: Summary: Fix the comments on SQLQueryTestSuite.scala to more explicit (was: Fix the comments on

[jira] [Reopened] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to generate the golden files more gracefully

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee reopened SPARK-37835: - > Fix the comments on SQLQueryTestSuite.scala to generate the golden files more > gracefully >

[jira] [Updated] (SPARK-37836) Enable more flake8 rules for PEP 8 compliance

[ https://issues.apache.org/jira/browse/SPARK-37836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37836: - Summary: Enable more flake8 rules for PEP 8 compliance (was: Enable more flake8 rules) >

[jira] [Assigned] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37820: - Assignee: Kent Yao > Replace ApacheCommonBase64 with JavaBase64 for string fucntions >

[jira] [Resolved] (SPARK-37820) Replace ApacheCommonBase64 with JavaBase64 for string fucntions

[ https://issues.apache.org/jira/browse/SPARK-37820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37820. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35110

[jira] [Updated] (SPARK-37836) Enable more flake8 rules

[ https://issues.apache.org/jira/browse/SPARK-37836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37836: - Issue Type: Improvement (was: Bug) > Enable more flake8 rules > > >

[jira] [Created] (SPARK-37836) Enable more flake8 rules

Hyukjin Kwon created SPARK-37836: Summary: Enable more flake8 rules Key: SPARK-37836 URL: https://issues.apache.org/jira/browse/SPARK-37836 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202

[ https://issues.apache.org/jira/browse/SPARK-37734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37734. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35013

[jira] [Assigned] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202

[ https://issues.apache.org/jira/browse/SPARK-37734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37734: --- Assignee: jiaan.geng > Upgrade h2 from 1.4.195 to 2.0.202 >

[jira] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image

[ https://issues.apache.org/jira/browse/SPARK-37772 ] Yikun Jiang deleted comment on SPARK-37772: - was (Author: yikunkero): To speed up the installation on pypy (aarch64) https://github.com/MacPython/numpy-wheels/issues/143

[jira] [Resolved] (SPARK-37802) composite field name like `field name` doesn't work with Aggregate push down

[ https://issues.apache.org/jira/browse/SPARK-37802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37802. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35108

[jira] [Resolved] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to generate the golden files more gracefully

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-37835. - Resolution: Won't Do > Fix the comments on SQLQueryTestSuite.scala to generate the golden files

[jira] [Commented] (SPARK-37398) Inline type hints for python/pyspark/ml/classification.py

[ https://issues.apache.org/jira/browse/SPARK-37398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470317#comment-17470317 ] Apache Spark commented on SPARK-37398: -- User 'javierivanov' has created a pull request for this

[jira] [Assigned] (SPARK-37398) Inline type hints for python/pyspark/ml/classification.py

[ https://issues.apache.org/jira/browse/SPARK-37398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37398: Assignee: (was: Apache Spark) > Inline type hints for

[jira] [Assigned] (SPARK-37398) Inline type hints for python/pyspark/ml/classification.py

[ https://issues.apache.org/jira/browse/SPARK-37398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37398: Assignee: Apache Spark > Inline type hints for python/pyspark/ml/classification.py >

[jira] [Assigned] (SPARK-37834) Reenable length check in Python linter

[ https://issues.apache.org/jira/browse/SPARK-37834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37834: Assignee: (was: Apache Spark) > Reenable length check in Python linter >

[jira] [Assigned] (SPARK-37834) Reenable length check in Python linter

[ https://issues.apache.org/jira/browse/SPARK-37834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37834: Assignee: Apache Spark > Reenable length check in Python linter >

[jira] [Commented] (SPARK-37834) Reenable length check in Python linter

[ https://issues.apache.org/jira/browse/SPARK-37834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470315#comment-17470315 ] Apache Spark commented on SPARK-37834: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to generate the golden files more gracefully

[ https://issues.apache.org/jira/browse/SPARK-37835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470310#comment-17470310 ] Haejoon Lee commented on SPARK-37835: - I'm fixing > Fix the comments on SQLQueryTestSuite.scala to

[jira] [Commented] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image

[ https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470309#comment-17470309 ] Yikun Jiang commented on SPARK-37772: - Add the PR in

[jira] [Created] (SPARK-37835) Fix the comments on SQLQueryTestSuite.scala to generate the golden files more gracefully

Haejoon Lee created SPARK-37835: --- Summary: Fix the comments on SQLQueryTestSuite.scala to generate the golden files more gracefully Key: SPARK-37835 URL: https://issues.apache.org/jira/browse/SPARK-37835

[jira] [Commented] (SPARK-37786) StreamingQueryListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470307#comment-17470307 ] Apache Spark commented on SPARK-37786: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-37780) QueryExecutionListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470306#comment-17470306 ] Apache Spark commented on SPARK-37780: -- User 'AngersZh' has created a pull request for this

[jira] [Created] (SPARK-37834) Reenable length check in Python linter

Hyukjin Kwon created SPARK-37834: Summary: Reenable length check in Python linter Key: SPARK-37834 URL: https://issues.apache.org/jira/browse/SPARK-37834 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters?

[ https://issues.apache.org/jira/browse/SPARK-37601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470304#comment-17470304 ] Maciej Szymkiewicz commented on SPARK-37601: Thanks for pointing this out [~dongjoon]! >

[jira] [Commented] (SPARK-37833) Add `precondition` jobs for skip the main GitHub Action jobs

[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470301#comment-17470301 ] Apache Spark commented on SPARK-37833: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37833) Add `precondition` jobs for skip the main GitHub Action jobs

[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37833: Assignee: Apache Spark > Add `precondition` jobs for skip the main GitHub Action jobs >

[jira] [Assigned] (SPARK-37833) Add `precondition` jobs for skip the main GitHub Action jobs

[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37833: Assignee: (was: Apache Spark) > Add `precondition` jobs for skip the main GitHub

[jira] [Commented] (SPARK-37833) Add `precondition` jobs for skip the main GitHub Action jobs

[ https://issues.apache.org/jira/browse/SPARK-37833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470302#comment-17470302 ] Apache Spark commented on SPARK-37833: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-37833) Add `precondition` jobs for skip the main GitHub Action jobs

Dongjoon Hyun created SPARK-37833: - Summary: Add `precondition` jobs for skip the main GitHub Action jobs Key: SPARK-37833 URL: https://issues.apache.org/jira/browse/SPARK-37833 Project: Spark

[jira] [Resolved] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37832. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35120

[jira] [Assigned] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37832: - Assignee: Bruce Robbins > Orc struct serializer should look up field converters in an

[jira] [Commented] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image

[ https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470295#comment-17470295 ] Yikun Jiang commented on SPARK-37772: - To speed up the installation on pypy (aarch64)

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application，such as thrift server； as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application，such as thrift server； as only one

[jira] [Updated] (SPARK-37821) spark thrift server RDD ID overflow lead sql execute failed

[ https://issues.apache.org/jira/browse/SPARK-37821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] muhong updated SPARK-37821: --- Description: this problem will happen in long run spark application，such as thrift server； as only one

[jira] [Assigned] (SPARK-37823) Add `is-changed.py` dev script

[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37823: Assignee: Dongjoon Hyun > Add `is-changed.py` dev script >

[jira] [Resolved] (SPARK-37823) Add `is-changed.py` dev script

[ https://issues.apache.org/jira/browse/SPARK-37823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37823. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35112

[jira] [Assigned] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37832: Assignee: (was: Apache Spark) > Orc struct serializer should look up field

[jira] [Commented] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470259#comment-17470259 ] Apache Spark commented on SPARK-37832: -- User 'bersprockets' has created a pull request for this

[jira] [Commented] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470258#comment-17470258 ] Apache Spark commented on SPARK-37832: -- User 'bersprockets' has created a pull request for this

[jira] [Assigned] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37832: Assignee: Apache Spark > Orc struct serializer should look up field converters in an

[jira] [Commented] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

[ https://issues.apache.org/jira/browse/SPARK-37832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470235#comment-17470235 ] Bruce Robbins commented on SPARK-37832: --- I will post of PR shortly. > Orc struct serializer

[jira] [Created] (SPARK-37832) Orc struct serializer should look up field converters in an array rather than a linked list

Bruce Robbins created SPARK-37832: - Summary: Orc struct serializer should look up field converters in an array rather than a linked list Key: SPARK-37832 URL: https://issues.apache.org/jira/browse/SPARK-37832

[jira] [Assigned] (SPARK-37710) Add detailed log message for java.io.IOException occurring on Kryo flow

[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-37710: --- Assignee: Eren Avsarogullari > Add detailed log message for

[jira] [Resolved] (SPARK-37710) Add detailed log message for java.io.IOException occurring on Kryo flow

[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-37710. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-37527. Fix Version/s: 3.3.0 Assignee: jiaan.geng Resolution: Fixed > Translate more

[jira] [Updated] (SPARK-37710) Add detailed log message for java.io.IOException occurring on Kryo flow

[ https://issues.apache.org/jira/browse/SPARK-37710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-37710: --- Summary: Add detailed log message for java.io.IOException occurring on Kryo flow

[jira] [Commented] (SPARK-37578) DSV2 is not updating Output Metrics

[ https://issues.apache.org/jira/browse/SPARK-37578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470178#comment-17470178 ] L. C. Hsieh commented on SPARK-37578: - Thank you [~dongjoon] > DSV2 is not updating Output Metrics

[jira] [Updated] (SPARK-36405) Check that error class SQLSTATEs are valid

[ https://issues.apache.org/jira/browse/SPARK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36405: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Check that error class

[jira] [Updated] (SPARK-36404) Support nested columns in ORC vectorized reader for data source v2

[ https://issues.apache.org/jira/browse/SPARK-36404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36404: -- Affects Version/s: (was: 3.2.0) > Support nested columns in ORC vectorized reader for

[jira] [Updated] (SPARK-36418) Use CAST in parsing of dates/timestamps with default pattern

[ https://issues.apache.org/jira/browse/SPARK-36418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36418: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Use CAST in parsing of

[jira] [Updated] (SPARK-36425) PySpark: support CrossValidatorModel get standard deviation of metrics for each paramMap

[ https://issues.apache.org/jira/browse/SPARK-36425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36425: -- Affects Version/s: 3.3.0 (was: 3.2.0) > PySpark: support

[jira] [Updated] (SPARK-36451) Ivy skips looking for source and doc pom

[ https://issues.apache.org/jira/browse/SPARK-36451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36451: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Ivy skips looking for

[jira] [Updated] (SPARK-36420) Use `isEmpty` to improve performance in Pregel's superstep

[ https://issues.apache.org/jira/browse/SPARK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36420: -- Affects Version/s: 3.3.0 (was: 2.4.7) > Use `isEmpty` to improve

[jira] [Updated] (SPARK-36475) Add doc about spark.shuffle.service.fetch.rdd.enabled

[ https://issues.apache.org/jira/browse/SPARK-36475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36475: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Add doc about

[jira] [Updated] (SPARK-36607) Support BooleanType in UnwrapCastInBinaryComparison

[ https://issues.apache.org/jira/browse/SPARK-36607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36607: -- Affects Version/s: (was: 3.2.0) (was: 3.1.2) > Support

[jira] [Updated] (SPARK-36481) Expose LogisticRegression.setInitialModel

[ https://issues.apache.org/jira/browse/SPARK-36481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36481: -- Affects Version/s: 3.3.0 (was: 3.2.0) > Expose

[jira] [Updated] (SPARK-36644) Push down boolean column filter

[ https://issues.apache.org/jira/browse/SPARK-36644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36644: -- Affects Version/s: 3.3.0 (was: 3.2.0)

[jira] [Commented] (SPARK-36654) Drop type ignores from numpy imports

[ https://issues.apache.org/jira/browse/SPARK-36654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470161#comment-17470161 ] Dongjoon Hyun commented on SPARK-36654: --- I assigned this JIRA to you, [~zero323]. > Drop type

[jira] [Assigned] (SPARK-36654) Drop type ignores from numpy imports

[ https://issues.apache.org/jira/browse/SPARK-36654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36654: - Assignee: Maciej Szymkiewicz > Drop type ignores from numpy imports >

[jira] [Updated] (SPARK-36654) Drop type ignores from numpy imports

[ https://issues.apache.org/jira/browse/SPARK-36654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36654: -- Affects Version/s: (was: 3.2.0) (was: 3.1.2) > Drop type

[jira] [Updated] (SPARK-36665) Add more Not operator optimizations

[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36665: -- Affects Version/s: (was: 3.2.0) (was: 3.1.2) > Add more Not

[jira] [Updated] (SPARK-36721) Simplify boolean equalities if one side is literal

[ https://issues.apache.org/jira/browse/SPARK-36721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36721: -- Affects Version/s: (was: 3.2.0) (was: 3.1.2) > Simplify

[jira] [Updated] (SPARK-36663) When the existing field name is a number, an error will be reported when reading the orc file

[ https://issues.apache.org/jira/browse/SPARK-36663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36663: -- Affects Version/s: 3.3.0 (was: 3.1.2)

[jira] [Updated] (SPARK-36829) Refactor collectionOperation related Null check related code

[ https://issues.apache.org/jira/browse/SPARK-36829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36829: -- Affects Version/s: 3.3.0 (was: 3.0.2)

[jira] [Updated] (SPARK-36838) Improve InSet NaN check generated code performance

[ https://issues.apache.org/jira/browse/SPARK-36838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36838: -- Affects Version/s: 3.3.0 (was: 3.2.0)

[jira] [Updated] (SPARK-36876) Support Dynamic Partition pruning for HiveTableScanExec

[ https://issues.apache.org/jira/browse/SPARK-36876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36876: -- Affects Version/s: 3.3.0 (was: 3.2.0)

[jira] [Updated] (SPARK-36978) InferConstraints rule should create IsNotNull constraints on the nested field instead of the root nested type

[ https://issues.apache.org/jira/browse/SPARK-36978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36978: -- Affects Version/s: 3.3.0 (was: 3.0.0)

[jira] [Updated] (SPARK-36894) RDD.toDF should be synchronized with dispatched variants of SparkSession.createDataFrame

[ https://issues.apache.org/jira/browse/SPARK-36894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36894: -- Affects Version/s: (was: 3.2.0) (was: 3.1.2) > RDD.toDF should

[jira] [Updated] (SPARK-37044) Add Row to __all__ in pyspark.sql.types

[ https://issues.apache.org/jira/browse/SPARK-37044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37044: -- Affects Version/s: (was: 3.1.0) (was: 3.2.0) > Add Row to

[jira] [Commented] (SPARK-37104) RDD and DStream should be covariant

[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470157#comment-17470157 ] Dongjoon Hyun commented on SPARK-37104: --- I removed `3.1.0` and `3.2.0` from the `Affects Versions`

[jira] [Updated] (SPARK-37176) JsonSource's infer should have the same exception handle logic as JacksonParser's parse logic

[ https://issues.apache.org/jira/browse/SPARK-37176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37176: -- Affects Version/s: 3.3.0 (was: 3.2.0)

[jira] [Updated] (SPARK-37104) RDD and DStream should be covariant

[ https://issues.apache.org/jira/browse/SPARK-37104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37104: -- Affects Version/s: (was: 3.1.0) (was: 3.2.0) > RDD and DStream

[jira] [Updated] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS

[ https://issues.apache.org/jira/browse/SPARK-37462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37462: -- Affects Version/s: 3.3.0 (was: 3.1.0)

[jira] [Commented] (SPARK-37578) DSV2 is not updating Output Metrics

[ https://issues.apache.org/jira/browse/SPARK-37578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470155#comment-17470155 ] Dongjoon Hyun commented on SPARK-37578: --- I updated the `Affected Versions` to `3.3.0` because new

  1   2   >