[jira] [Assigned] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37783: Assignee: Hyukjin Kwon > Add @tailrec wherever possible > --

[jira] [Resolved] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37783. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35064

[jira] [Commented] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner

[ https://issues.apache.org/jira/browse/SPARK-37758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466717#comment-17466717 ] Yikun Jiang commented on SPARK-37758: - cpython 3.9 passed:

[jira] [Updated] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner

[ https://issues.apache.org/jira/browse/SPARK-37758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-37758: Description: cpython 3.9 pypy3 > [PYSPARK] Enable PySpark scheduled job on ARM based

[jira] [Commented] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner

[ https://issues.apache.org/jira/browse/SPARK-37757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466716#comment-17466716 ] Yikun Jiang commented on SPARK-37757: - * DistributedSuite.caching in memory, replicated (encryption

[jira] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner

[ https://issues.apache.org/jira/browse/SPARK-37758 ] Yikun Jiang deleted comment on SPARK-37758: - was (Author: yikunkero): * DistributedSuite.caching in memory, replicated (encryption = on) * DistributedSuite.caching on disk, replicated 2

[jira] [Comment Edited] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image

[ https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466715#comment-17466715 ] Yikun Jiang edited comment on SPARK-37772 at 12/30/21, 7:45 AM: There

[jira] [Commented] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image

[ https://issues.apache.org/jira/browse/SPARK-37772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466715#comment-17466715 ] Yikun Jiang commented on SPARK-37772: - There are some depdency conflict on:

[jira] [Updated] (SPARK-37786) StreamingQueryListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-37786: -- Summary: StreamingQueryListener should also support SQLConf (was: CLONE - StreamingQueryListener

[jira] [Created] (SPARK-37786) CLONE - StreamingQueryListener should also support SQLConf

angerszhu created SPARK-37786: - Summary: CLONE - StreamingQueryListener should also support SQLConf Key: SPARK-37786 URL: https://issues.apache.org/jira/browse/SPARK-37786 Project: Spark Issue

[jira] [Commented] (SPARK-37786) CLONE - StreamingQueryListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466713#comment-17466713 ] angerszhu commented on SPARK-37786: --- Raise a pr soon > CLONE - StreamingQueryListener should also

[jira] [Commented] (SPARK-37770) Performance improvements for ColumnVector `putByteArray`

[ https://issues.apache.org/jira/browse/SPARK-37770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466699#comment-17466699 ] Apache Spark commented on SPARK-37770: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Commented] (SPARK-37770) Performance improvements for ColumnVector `putByteArray`

[ https://issues.apache.org/jira/browse/SPARK-37770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466698#comment-17466698 ] Apache Spark commented on SPARK-37770: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37770) Performance improvements for ColumnVector `putByteArray`

[ https://issues.apache.org/jira/browse/SPARK-37770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37770: Assignee: (was: Apache Spark) > Performance improvements for ColumnVector

[jira] [Assigned] (SPARK-37770) Performance improvements for ColumnVector `putByteArray`

[ https://issues.apache.org/jira/browse/SPARK-37770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37770: Assignee: Apache Spark > Performance improvements for ColumnVector `putByteArray` >

[jira] [Assigned] (SPARK-37726) Add spill size metrics for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37726: --- Assignee: Cheng Su > Add spill size metrics for sort merge join >

[jira] [Resolved] (SPARK-37726) Add spill size metrics for sort merge join

[ https://issues.apache.org/jira/browse/SPARK-37726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37726. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34999

[jira] [Assigned] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py

[ https://issues.apache.org/jira/browse/SPARK-37423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37423: Assignee: Apache Spark > Inline type hints for python/pyspark/mllib/fpm.py >

[jira] [Assigned] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py

[ https://issues.apache.org/jira/browse/SPARK-37423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37423: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/mllib/fpm.py >

[jira] [Commented] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py

[ https://issues.apache.org/jira/browse/SPARK-37423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466671#comment-17466671 ] Apache Spark commented on SPARK-37423: -- User 'dchvn' has created a pull request for this issue:

[jira] [Updated] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37779: - Fix Version/s: 3.1.3 3.0.4 3.2.1 > Make ColumnarToRowExec

[jira] [Resolved] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37779. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35058

[jira] [Assigned] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37779: Assignee: Hyukjin Kwon > Make ColumnarToRowExec plan canonicalizable after

[jira] [Updated] (SPARK-37749) Built-in ORC reader cannot read data file in sub-directories created by Hive Tez

[ https://issues.apache.org/jira/browse/SPARK-37749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37749: - Priority: Major (was: Critical) > Built-in ORC reader cannot read data file in sub-directories

[jira] [Resolved] (SPARK-37752) Python UDF fails when it should not get evaluated

[ https://issues.apache.org/jira/browse/SPARK-37752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37752. -- Resolution: Won't Fix > Python UDF fails when it should not get evaluated >

[jira] [Updated] (SPARK-37751) Apache Commons Crypto doesn't support Java 11

[ https://issues.apache.org/jira/browse/SPARK-37751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37751: - Priority: Major (was: Blocker) > Apache Commons Crypto doesn't support Java 11 >

[jira] [Reopened] (SPARK-37752) Python UDF fails when it should not get evaluated

[ https://issues.apache.org/jira/browse/SPARK-37752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-37752: -- > Python UDF fails when it should not get evaluated >

[jira] [Resolved] (SPARK-37752) Python UDF fails when it should not get evaluated

[ https://issues.apache.org/jira/browse/SPARK-37752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37752. -- Resolution: Not A Bug > Python UDF fails when it should not get evaluated >

[jira] [Commented] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1749#comment-1749 ] Hyukjin Kwon commented on SPARK-37781: -- It's just out-of-memory on driver side because there are

[jira] [Resolved] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37781. -- Resolution: Not A Problem > Java Out-Of-Memory Error when retrieving value from dataframe >

[jira] [Updated] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37781: - Priority: Major (was: Blocker) > Java Out-Of-Memory Error when retrieving value from dataframe

[jira] [Commented] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

[ https://issues.apache.org/jira/browse/SPARK-37784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1748#comment-1748 ] Apache Spark commented on SPARK-37784: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

[ https://issues.apache.org/jira/browse/SPARK-37784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1747#comment-1747 ] Apache Spark commented on SPARK-37784: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37785) Add Utils.isAtExecutor

[ https://issues.apache.org/jira/browse/SPARK-37785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37785: Assignee: Apache Spark > Add Utils.isAtExecutor > -- > >

[jira] [Assigned] (SPARK-37785) Add Utils.isAtExecutor

[ https://issues.apache.org/jira/browse/SPARK-37785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37785: Assignee: (was: Apache Spark) > Add Utils.isAtExecutor > -- > >

[jira] [Commented] (SPARK-37785) Add Utils.isAtExecutor

[ https://issues.apache.org/jira/browse/SPARK-37785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1745#comment-1745 ] Apache Spark commented on SPARK-37785: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-37785) Add Utils.isAtExecutor

Hyukjin Kwon created SPARK-37785: Summary: Add Utils.isAtExecutor Key: SPARK-37785 URL: https://issues.apache.org/jira/browse/SPARK-37785 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

[ https://issues.apache.org/jira/browse/SPARK-37784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-37784: --- Description: The {{CodeGenerator.addBufferedState()}} method does not properly handle UDTs: it

[jira] [Assigned] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

[ https://issues.apache.org/jira/browse/SPARK-37784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-37784: -- Assignee: Josh Rosen > CodeGenerator.addBufferedState() does not properly handle UDTs >

[jira] [Created] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs

Josh Rosen created SPARK-37784: -- Summary: CodeGenerator.addBufferedState() does not properly handle UDTs Key: SPARK-37784 URL: https://issues.apache.org/jira/browse/SPARK-37784 Project: Spark

[jira] [Assigned] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37783: Assignee: (was: Apache Spark) > Add @tailrec wherever possible >

[jira] [Commented] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1741#comment-1741 ] Apache Spark commented on SPARK-37783: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37783: Assignee: Apache Spark > Add @tailrec wherever possible > --

[jira] [Commented] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe()

[ https://issues.apache.org/jira/browse/SPARK-37657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466659#comment-17466659 ] Apache Spark commented on SPARK-37657: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

[ https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37782: Assignee: Takuya Ueshin > Make DataFrame.transform take the parameters for the function.

[jira] [Resolved] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

[ https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37782. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35062

[jira] [Updated] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37783: - Attachment: Screen Shot 2021-12-30 at 10.37.27 AM.png > Add @tailrec wherever possible >

[jira] [Commented] (SPARK-37783) Add @tailrec wherever possible

[ https://issues.apache.org/jira/browse/SPARK-37783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466654#comment-17466654 ] Hyukjin Kwon commented on SPARK-37783: -- im gonna run IDE inspection and fix them > Add @tailrec

[jira] [Created] (SPARK-37783) Add @tailrec wherever possible

Hyukjin Kwon created SPARK-37783: Summary: Add @tailrec wherever possible Key: SPARK-37783 URL: https://issues.apache.org/jira/browse/SPARK-37783 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

[ https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37782: Assignee: (was: Apache Spark) > Make DataFrame.transform take the parameters for the

[jira] [Assigned] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

[ https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37782: Assignee: Apache Spark > Make DataFrame.transform take the parameters for the function.

[jira] [Commented] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

[ https://issues.apache.org/jira/browse/SPARK-37782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466634#comment-17466634 ] Apache Spark commented on SPARK-37782: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-37782) Make DataFrame.transform take the parameters for the function.

Takuya Ueshin created SPARK-37782: - Summary: Make DataFrame.transform take the parameters for the function. Key: SPARK-37782 URL: https://issues.apache.org/jira/browse/SPARK-37782 Project: Spark

[jira] [Assigned] (SPARK-36059) Add the ability to specify a scheduler & queue

[ https://issues.apache.org/jira/browse/SPARK-36059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36059: - Assignee: Yikun Jiang (was: Apache Spark) > Add the ability to specify a scheduler &

[jira] [Updated] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thinh Nguyen updated SPARK-37781: - Description: My submitted spark application keeps running into the following error: {code:java}

[jira] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781 ] Thinh Nguyen deleted comment on SPARK-37781: -- was (Author: JIRAUSER282803): My submitted spark application keeps running into the following error: {code:java} Caused by:

[jira] [Updated] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thinh Nguyen updated SPARK-37781: - Description: My submitted spark application keeps running into the following error: {code:java}

[jira] [Updated] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

[ https://issues.apache.org/jira/browse/SPARK-37781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thinh Nguyen updated SPARK-37781: - Environment: (was: My submitted spark application keeps running into the following error:

[jira] [Created] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe

Thinh Nguyen created SPARK-37781: Summary: Java Out-Of-Memory Error when retrieving value from dataframe Key: SPARK-37781 URL: https://issues.apache.org/jira/browse/SPARK-37781 Project: Spark

[jira] [Commented] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466479#comment-17466479 ] Apache Spark commented on SPARK-37369: -- User 'linhongliu-db' has created a pull request for this

[jira] [Commented] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan

[ https://issues.apache.org/jira/browse/SPARK-37369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466476#comment-17466476 ] Apache Spark commented on SPARK-37369: -- User 'linhongliu-db' has created a pull request for this

[jira] [Commented] (SPARK-28137) Data Type Formatting Functions: `to_number`

[ https://issues.apache.org/jira/browse/SPARK-28137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466450#comment-17466450 ] Apache Spark commented on SPARK-28137: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37775) [PYSPARK] Fix mlflow doctest

[ https://issues.apache.org/jira/browse/SPARK-37775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-37775. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35054

[jira] [Assigned] (SPARK-37775) [PYSPARK] Fix mlflow doctest

[ https://issues.apache.org/jira/browse/SPARK-37775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-37775: Assignee: Yikun Jiang > [PYSPARK] Fix mlflow doctest > > >

[jira] [Assigned] (SPARK-37780) QueryExecutionListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37780: Assignee: (was: Apache Spark) > QueryExecutionListener should also support SQLConf >

[jira] [Commented] (SPARK-37780) QueryExecutionListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466425#comment-17466425 ] Apache Spark commented on SPARK-37780: -- User 'AngersZh' has created a pull request for this

[jira] [Assigned] (SPARK-37780) QueryExecutionListener should also support SQLConf

[ https://issues.apache.org/jira/browse/SPARK-37780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37780: Assignee: Apache Spark > QueryExecutionListener should also support SQLConf >

[jira] [Created] (SPARK-37780) QueryExecutionListener should also support SQLConf

angerszhu created SPARK-37780: - Summary: QueryExecutionListener should also support SQLConf Key: SPARK-37780 URL: https://issues.apache.org/jira/browse/SPARK-37780 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37779: Assignee: (was: Apache Spark) > Make ColumnarToRowExec plan canonicalizable after

[jira] [Assigned] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37779: Assignee: Apache Spark > Make ColumnarToRowExec plan canonicalizable after

[jira] [Commented] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466391#comment-17466391 ] Apache Spark commented on SPARK-37779: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

[ https://issues.apache.org/jira/browse/SPARK-37779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-37779: - Affects Version/s: 3.2.0 3.1.2 3.0.3 > Make

[jira] [Created] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization

Hyukjin Kwon created SPARK-37779: Summary: Make ColumnarToRowExec plan canonicalizable after (de)serialization Key: SPARK-37779 URL: https://issues.apache.org/jira/browse/SPARK-37779 Project: Spark

[jira] [Resolved] (SPARK-37778) Upgrade SBT to 1.6.1

[ https://issues.apache.org/jira/browse/SPARK-37778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37778. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35057

[jira] [Assigned] (SPARK-37776) Upgrade silencer to 1.7.7

[ https://issues.apache.org/jira/browse/SPARK-37776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-37776: - Assignee: William Hyun > Upgrade silencer to 1.7.7 > - > >

[jira] [Resolved] (SPARK-37776) Upgrade silencer to 1.7.7

[ https://issues.apache.org/jira/browse/SPARK-37776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-37776. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35053

[jira] [Assigned] (SPARK-37778) Upgrade SBT to 1.6.1

[ https://issues.apache.org/jira/browse/SPARK-37778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37778: Assignee: Apache Spark (was: Kousuke Saruta) > Upgrade SBT to 1.6.1 >

[jira] [Assigned] (SPARK-37778) Upgrade SBT to 1.6.1

[ https://issues.apache.org/jira/browse/SPARK-37778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37778: Assignee: Kousuke Saruta (was: Apache Spark) > Upgrade SBT to 1.6.1 >

[jira] [Commented] (SPARK-37778) Upgrade SBT to 1.6.1

[ https://issues.apache.org/jira/browse/SPARK-37778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466360#comment-17466360 ] Apache Spark commented on SPARK-37778: -- User 'sarutak' has created a pull request for this issue:

[jira] [Created] (SPARK-37778) Upgrade SBT to 1.6.1

Kousuke Saruta created SPARK-37778: -- Summary: Upgrade SBT to 1.6.1 Key: SPARK-37778 URL: https://issues.apache.org/jira/browse/SPARK-37778 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-36703) Remove the Sort if it is the child of RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-36703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36703: --- Assignee: Yuming Wang > Remove the Sort if it is the child of RepartitionByExpression >

[jira] [Resolved] (SPARK-36703) Remove the Sort if it is the child of RepartitionByExpression

[ https://issues.apache.org/jira/browse/SPARK-36703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36703. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 33946

[jira] [Assigned] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: Apache Spark > update the SQL syntax of SHOW FUNCTIONS >

[jira] [Assigned] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3: Assignee: (was: Apache Spark) > update the SQL syntax of SHOW FUNCTIONS >

[jira] [Commented] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS

[ https://issues.apache.org/jira/browse/SPARK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466358#comment-17466358 ] Apache Spark commented on SPARK-3: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS

Wenchen Fan created SPARK-3: --- Summary: update the SQL syntax of SHOW FUNCTIONS Key: SPARK-3 URL: https://issues.apache.org/jira/browse/SPARK-3 Project: Spark Issue Type:

[jira] [Commented] (SPARK-37769) Filter on the metadata struct

[ https://issues.apache.org/jira/browse/SPARK-37769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466351#comment-17466351 ] Apache Spark commented on SPARK-37769: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37769) Filter on the metadata struct

[ https://issues.apache.org/jira/browse/SPARK-37769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37769: Assignee: Apache Spark > Filter on the metadata struct > - >

[jira] [Commented] (SPARK-37769) Filter on the metadata struct

[ https://issues.apache.org/jira/browse/SPARK-37769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466350#comment-17466350 ] Apache Spark commented on SPARK-37769: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37769) Filter on the metadata struct

[ https://issues.apache.org/jira/browse/SPARK-37769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37769: Assignee: (was: Apache Spark) > Filter on the metadata struct >

[jira] [Resolved] (SPARK-34755) Support the utils for transform number format

[ https://issues.apache.org/jira/browse/SPARK-34755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34755. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 31847

[jira] [Assigned] (SPARK-34755) Support the utils for transform number format

[ https://issues.apache.org/jira/browse/SPARK-34755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34755: Assignee: jiaan.geng > Support the utils for transform number format >

[jira] [Commented] (SPARK-37775) [PYSPARK] Fix mlflow doctest

[ https://issues.apache.org/jira/browse/SPARK-37775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466340#comment-17466340 ] Apache Spark commented on SPARK-37775: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37775) [PYSPARK] Fix mlflow doctest

[ https://issues.apache.org/jira/browse/SPARK-37775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37775: Assignee: Apache Spark > [PYSPARK] Fix mlflow doctest > > >

[jira] [Assigned] (SPARK-37775) [PYSPARK] Fix mlflow doctest

[ https://issues.apache.org/jira/browse/SPARK-37775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37775: Assignee: (was: Apache Spark) > [PYSPARK] Fix mlflow doctest >

[jira] [Assigned] (SPARK-37776) Upgrade silencer to 1.7.7

[ https://issues.apache.org/jira/browse/SPARK-37776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37776: Assignee: Apache Spark > Upgrade silencer to 1.7.7 > - > >

[jira] [Assigned] (SPARK-37776) Upgrade silencer to 1.7.7

[ https://issues.apache.org/jira/browse/SPARK-37776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37776: Assignee: (was: Apache Spark) > Upgrade silencer to 1.7.7 >

[jira] [Commented] (SPARK-37776) Upgrade silencer to 1.7.7

[ https://issues.apache.org/jira/browse/SPARK-37776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17466337#comment-17466337 ] Apache Spark commented on SPARK-37776: -- User 'williamhyun' has created a pull request for this