[jira] [Created] (SPARK-50325) Move alias resolution code out of Analyzer.scala

2024-11-15 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50325: Summary: Move alias resolution code out of Analyzer.scala Key: SPARK-50325 URL: https://issues.apache.org/jira/browse/SPARK-50325 Project: Spark Issu

[jira] [Updated] (SPARK-50325) Move alias resolution code out of Analyzer.scala

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50325: --- Labels: pull-request-available (was: ) > Move alias resolution code out of Analyzer.scala >

[jira] [Updated] (SPARK-50133) Support conversion to table argument

2024-11-15 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-50133: - Description: We want to implement a function df.table_argument() (the name can be discussed fur

[jira] [Updated] (SPARK-50326) override parameter to Avro DataFileWriter to avoid to many flush, 1 per block of 64k

2024-11-15 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-50326: Description: when saving big Avro file with spark, it may be extremely slow because of the

[jira] [Created] (SPARK-50326) override parameter to Avro DataFileWriter to avoid to many flush, 1 per block of 64k

2024-11-15 Thread Arnaud Nauwynck (Jira)
Arnaud Nauwynck created SPARK-50326: --- Summary: override parameter to Avro DataFileWriter to avoid to many flush, 1 per block of 64k Key: SPARK-50326 URL: https://issues.apache.org/jira/browse/SPARK-50326

[jira] [Updated] (SPARK-50326) override parameter to Avro DataFileWriter to avoid to many flush, 1 per block of 64k

2024-11-15 Thread Arnaud Nauwynck (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arnaud Nauwynck updated SPARK-50326: Description: when saving big Avro file with spark, it may be extremely slow because of the

[jira] [Updated] (SPARK-50327) Move function resolution code out of Analyzer.scala

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50327: --- Labels: pull-request-available (was: ) > Move function resolution code out of Analyzer.scal

[jira] [Created] (SPARK-50328) Add a separate docker file for SparkR

2024-11-15 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50328: - Summary: Add a separate docker file for SparkR Key: SPARK-50328 URL: https://issues.apache.org/jira/browse/SPARK-50328 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-50328) Add a separate docker file for SparkR

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50328: --- Labels: pull-request-available (was: ) > Add a separate docker file for SparkR > --

[jira] [Assigned] (SPARK-50327) Move function resolution code out of Analyzer.scala

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50327: Assignee: Vladimir Golubev > Move function resolution code out of Analyzer.scala > --

[jira] [Resolved] (SPARK-50327) Move function resolution code out of Analyzer.scala

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50327. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48858 [https://github.com

[jira] [Resolved] (SPARK-50320) Make `--remote` an official option by removing `experimental` warning

2024-11-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50320. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48850 [https://

[jira] [Commented] (SPARK-49555) SQL Pipe Syntax

2024-11-15 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898755#comment-17898755 ] Daniel commented on SPARK-49555: Great, thanks! > SQL Pipe Syntax > --- > >

[jira] [Created] (SPARK-50329) InSet$toString should work for unresolved plan node

2024-11-15 Thread Avery Qi (Jira)
Avery Qi created SPARK-50329: Summary: InSet$toString should work for unresolved plan node Key: SPARK-50329 URL: https://issues.apache.org/jira/browse/SPARK-50329 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-50329) InSet$toString should work for unresolved plan node

2024-11-15 Thread Avery Qi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898802#comment-17898802 ] Avery Qi commented on SPARK-50329: -- [~avery_qi] working on it > InSet$toString should

[jira] [Commented] (SPARK-49555) SQL Pipe Syntax

2024-11-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898739#comment-17898739 ] Dongjoon Hyun commented on SPARK-49555: --- I added a label, `releasenotes`. > SQL P

[jira] [Updated] (SPARK-49555) SQL Pipe Syntax

2024-11-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-49555: -- Labels: releasenotes (was: ) > SQL Pipe Syntax > --- > > Key: SPA

[jira] [Resolved] (SPARK-50309) Add documentation for SQL pipe syntax

2024-11-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-50309. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48852 [https:

[jira] [Updated] (SPARK-50329) InSet$toString should work for unresolved plan node

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50329: --- Labels: pull-request-available (was: ) > InSet$toString should work for unresolved plan nod

[jira] [Updated] (SPARK-50194) TransformWithStateInPandas - Integration of Initial State with Timer Implementation & new timer API

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50194: --- Labels: pull-request-available (was: ) > TransformWithStateInPandas - Integration of Initia

[jira] [Assigned] (SPARK-50309) Add documentation for SQL pipe syntax

2024-11-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-50309: -- Assignee: Daniel > Add documentation for SQL pipe syntax > --

[jira] [Resolved] (SPARK-50237) Assign appropriate error condition for _LEGACY_ERROR_TEMP_2139: CIRCULAR_CLASS_REFERENCE

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50237. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48769 [https://github.com

[jira] [Assigned] (SPARK-50325) Move alias resolution code out of Analyzer.scala

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50325: Assignee: Vladimir Golubev > Move alias resolution code out of Analyzer.scala > -

[jira] [Resolved] (SPARK-50325) Move alias resolution code out of Analyzer.scala

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50325. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48857 [https://github.com

[jira] [Resolved] (SPARK-50322) Cannot resolve parameterized identifier in a sub-query

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50322. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48847 [https://github.com

[jira] [Created] (SPARK-50327) Move function resolution code out of Analyzer.scala

2024-11-15 Thread Vladimir Golubev (Jira)
Vladimir Golubev created SPARK-50327: Summary: Move function resolution code out of Analyzer.scala Key: SPARK-50327 URL: https://issues.apache.org/jira/browse/SPARK-50327 Project: Spark I

[jira] [Updated] (SPARK-50327) Move function resolution code out of Analyzer.scala

2024-11-15 Thread Vladimir Golubev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Golubev updated SPARK-50327: - Description: Some Analyzer code will be used in both fixed-point and single-pass Analyze

[jira] [Updated] (SPARK-50322) Cannot resolve parameterized identifier in a sub-query

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50322: --- Labels: pull-request-available (was: ) > Cannot resolve parameterized identifier in a sub-q

[jira] [Updated] (SPARK-50295) Add a script to build docs with image

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50295: --- Labels: pull-request-available (was: ) > Add a script to build docs with image > --

[jira] [Resolved] (SPARK-50049) Support custom driver metrics in v2 write

2024-11-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50049. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48573 [https://gith

[jira] [Assigned] (SPARK-50237) Assign appropriate error condition for _LEGACY_ERROR_TEMP_2139: CIRCULAR_CLASS_REFERENCE

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50237: Assignee: Haejoon Lee > Assign appropriate error condition for _LEGACY_ERROR_TEMP_2139: > CIRCUL

[jira] [Assigned] (SPARK-50236) Assign appropriate error condition for _LEGACY_ERROR_TEMP_1156: COLUMN_NOT_FOUND_IN_SCHEMA

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-50236: Assignee: Haejoon Lee > Assign appropriate error condition for _LEGACY_ERROR_TEMP_1156: > COLUMN

[jira] [Resolved] (SPARK-50236) Assign appropriate error condition for _LEGACY_ERROR_TEMP_1156: COLUMN_NOT_FOUND_IN_SCHEMA

2024-11-15 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-50236. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48768 [https://github.com

[jira] [Updated] (SPARK-50301) TransformWithState metrics incorrectly counts the time for state removal

2024-11-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50301: --- Labels: pull-request-available (was: ) > TransformWithState metrics incorrectly counts the