[jira] [Commented] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457555#comment-17457555 ] Apache Spark commented on SPARK-37613: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37613: Assignee: Apache Spark > Support ANSI Aggregate Function: regr_count >

[jira] [Assigned] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37613: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: regr_count >

[jira] [Created] (SPARK-37613) Support ANSI Aggregate Function: regr_count

2021-12-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37613: -- Summary: Support ANSI Aggregate Function: regr_count Key: SPARK-37613 URL: https://issues.apache.org/jira/browse/SPARK-37613 Project: Spark Issue Type: New

[jira] [Assigned] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27974: Assignee: (was: Apache Spark) > Support ANSI Aggregate Function: array_agg >

[jira] [Assigned] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27974: Assignee: Apache Spark > Support ANSI Aggregate Function: array_agg >

[jira] [Commented] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457528#comment-17457528 ] Apache Spark commented on SPARK-27974: -- User 'beliefer' has created a pull request for this issue:

[jira] [Updated] (SPARK-37612) Support window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37612: --- Summary: Support window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND

[jira] [Created] (SPARK-37612) Support PostgreSql window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW

2021-12-10 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-37612: -- Summary: Support PostgreSql window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW Key: SPARK-37612 URL:

[jira] [Updated] (SPARK-27974) Support ANSI Aggregate Function: array_agg

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-27974: --- Summary: Support ANSI Aggregate Function: array_agg (was: Add built-in Aggregate Function:

[jira] [Commented] (SPARK-27974) Add built-in Aggregate Function: array_agg

2021-12-10 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457522#comment-17457522 ] jiaan.geng commented on SPARK-27974: I will take a look! > Add built-in Aggregate Function:

[jira] [Resolved] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-37565. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34827

[jira] [Assigned] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-37565: --- Assignee: Yuming Wang > Upgrade mysql-connector-java to 8.0.27 >

[jira] [Commented] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457517#comment-17457517 ] Apache Spark commented on SPARK-37611: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457516#comment-17457516 ] Apache Spark commented on SPARK-37611: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37611: Assignee: (was: Apache Spark) > Remove upper limit of

[jira] [Assigned] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37611: Assignee: Apache Spark > Remove upper limit of spark.kubernetes.memoryOverheadFactor >

[jira] [Created] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor

2021-12-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-37611: - Summary: Remove upper limit of spark.kubernetes.memoryOverheadFactor Key: SPARK-37611 URL: https://issues.apache.org/jira/browse/SPARK-37611 Project: Spark

[jira] [Updated] (SPARK-37608) Can anyone help me to compile a scala file

2021-12-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-37608: - Description: I am working with spark SQL, trying to read data from SAS using JDBC. I have to use

[jira] [Updated] (SPARK-37610) Anonymized/obfuscated query plan?

2021-12-10 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-37610: -- Description: I would like to share a query plan for a specific

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2021-12-10 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457483#comment-17457483 ] Rafal Wojdyla commented on SPARK-37609: --- [~yumwang] I don't have a public code to share. Also

[jira] [Created] (SPARK-37610) Anonymized/obfuscated query plan?

2021-12-10 Thread Rafal Wojdyla (Jira)
Rafal Wojdyla created SPARK-37610: - Summary: Anonymized/obfuscated query plan? Key: SPARK-37610 URL: https://issues.apache.org/jira/browse/SPARK-37610 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2021-12-10 Thread Rafal Wojdyla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated SPARK-37609: -- Environment: py:3.9 > Transient StackOverflowError on DataFrame from Catalyst QueryPlan >

[jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2021-12-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457481#comment-17457481 ] Yuming Wang commented on SPARK-37609: - How to reproduce this issue? > Transient StackOverflowError

[jira] [Created] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan

2021-12-10 Thread Rafal Wojdyla (Jira)
Rafal Wojdyla created SPARK-37609: - Summary: Transient StackOverflowError on DataFrame from Catalyst QueryPlan Key: SPARK-37609 URL: https://issues.apache.org/jira/browse/SPARK-37609 Project: Spark

[jira] [Comment Edited] (SPARK-25299) Use remote storage for persisting shuffle data

2021-12-10 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457384#comment-17457384 ] BoYang edited comment on SPARK-25299 at 12/10/21, 10:01 PM: I am working on

[jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data

2021-12-10 Thread BoYang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457384#comment-17457384 ] BoYang commented on SPARK-25299: I am working on a prototype to store shuffle file on external storage

[jira] [Assigned] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters?

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37601: Assignee: Apache Spark > Could/should sql.DataFrame.transform accept function

[jira] [Assigned] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters?

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37601: Assignee: (was: Apache Spark) > Could/should sql.DataFrame.transform accept function

[jira] [Commented] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters?

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457379#comment-17457379 ] Apache Spark commented on SPARK-37601: -- User 'ravwojdyla' has created a pull request for this

[jira] [Updated] (SPARK-37608) Can anyone help me to compile a scala file

2021-12-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-37608: - Description: I am working with spark SQL, trying to read data from SAS using JDBC. I have to use

[jira] [Updated] (SPARK-37608) Can anyone help me to compile a scala file

2021-12-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-37608: - Description: I am working with spark SQL, trying to read data from SAS using JDBC. I have to use

[jira] [Updated] (SPARK-37608) Can anyone help me to compile a scala file

2021-12-10 Thread Gary Liu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Liu updated SPARK-37608: - Description: I am working with spark SQL, trying to read data from SAS using JDBC. I have to use

[jira] [Created] (SPARK-37608) Can anyone help me to compile a scala file

2021-12-10 Thread Gary Liu (Jira)
Gary Liu created SPARK-37608: Summary: Can anyone help me to compile a scala file Key: SPARK-37608 URL: https://issues.apache.org/jira/browse/SPARK-37608 Project: Spark Issue Type: Question

[jira] [Closed] (SPARK-37606) ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing properties in addition to new properties

2021-12-10 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim closed SPARK-37606. - > ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing properties > in addition to new

[jira] [Resolved] (SPARK-37606) ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing properties in addition to new properties

2021-12-10 Thread Terry Kim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Kim resolved SPARK-37606. --- Resolution: Won't Fix > ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing

[jira] [Updated] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37594: - Priority: Minor (was: Major) > Make UT test("SPARK-34399: Add job commit duration metrics for

[jira] [Resolved] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37594. -- Fix Version/s: 3.3.0 3.2.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37594: Assignee: angerszhu > Make UT test("SPARK-34399: Add job commit duration metrics for >

[jira] [Assigned] (SPARK-37474) Migrate SparkR documentation to pkgdown

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-37474: Assignee: Maciej Szymkiewicz (was: Apache Spark) > Migrate SparkR documentation to

[jira] [Updated] (SPARK-37474) Migrate SparkR documentation to pkgdown

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37474: - Priority: Minor (was: Major) > Migrate SparkR documentation to pkgdown >

[jira] [Resolved] (SPARK-37474) Migrate SparkR documentation to pkgdown

2021-12-10 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-37474. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34728

[jira] [Commented] (SPARK-30471) Fix issue when compare string and IntegerType

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17457093#comment-17457093 ] Apache Spark commented on SPARK-30471: -- User 'Kwafoor' has created a pull request for this issue:

[jira] [Assigned] (SPARK-37567) reuse Exchange failed

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37567: Assignee: (was: Apache Spark) > reuse Exchange failed > -- > >

[jira] [Assigned] (SPARK-37567) reuse Exchange failed

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37567: Assignee: Apache Spark > reuse Exchange failed > -- > >

[jira] [Commented] (SPARK-37567) reuse Exchange failed

2021-12-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456953#comment-17456953 ] Apache Spark commented on SPARK-37567: -- User 'chenjunbiao001' has created a pull request for this

[jira] [Resolved] (SPARK-35414) Completely fix the broadcast timeout issue in AQE

2021-12-10 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-35414. -- Target Version/s: 3.2.0 Assignee: (was: Yu Zhong) Resolution: Duplicate AQE