[jira] [Commented] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696070#comment-17696070 ] XiDuo You commented on SPARK-42650: --- To be clear, it is the issue of Spark 3.2.3. Spark3.2.1, 3.3.x

[jira] [Commented] (SPARK-42660) Infer filters for Join produced by IN and EXISTS clause (RewritePredicateSubquery rule)

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696059#comment-17696059 ] Apache Spark commented on SPARK-42660: -- User 'mskapilks' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42660) Infer filters for Join produced by IN and EXISTS clause (RewritePredicateSubquery rule)

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42660: Assignee: Apache Spark > Infer filters for Join produced by IN and EXISTS clause >

[jira] [Assigned] (SPARK-42660) Infer filters for Join produced by IN and EXISTS clause (RewritePredicateSubquery rule)

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42660: Assignee: (was: Apache Spark) > Infer filters for Join produced by IN and EXISTS

[jira] [Resolved] (SPARK-42609) Add tests for grouping() and grouping_id() functions

2023-03-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42609. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40259

[jira] [Assigned] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42556: Assignee: Apache Spark > Dataset.colregex should link a plan_id when it only matches a

[jira] [Created] (SPARK-42660) Infer filters for Join produced by IN and EXISTS clause (RewritePredicateSubquery rule)

2023-03-02 Thread Kapil Singh (Jira)
Kapil Singh created SPARK-42660: --- Summary: Infer filters for Join produced by IN and EXISTS clause (RewritePredicateSubquery rule) Key: SPARK-42660 URL: https://issues.apache.org/jira/browse/SPARK-42660

[jira] [Assigned] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42556: Assignee: (was: Apache Spark) > Dataset.colregex should link a plan_id when it only

[jira] [Commented] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696046#comment-17696046 ] Apache Spark commented on SPARK-42556: -- User 'beliefer' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42473) An explicit cast will be needed when INSERT OVERWRITE SELECT UNION ALL

2023-03-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42473. - Fix Version/s: 3.3.3 Assignee: Runyao.Chen Resolution: Fixed > An explicit cast

[jira] [Commented] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696042#comment-17696042 ] Apache Spark commented on SPARK-42635: -- User 'chenhao-db' has created a pull request for this

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696037#comment-17696037 ] kevinshin commented on SPARK-42650: --- Spark and Kyuubi are both belong to apache. May Apache community

[jira] [Resolved] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-42635. -- Fix Version/s: 3.4.1 Resolution: Fixed Issue resolved by pull request 40237

[jira] [Assigned] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-42635: Assignee: Chenhao Li > Several counter-intuitive behaviours in the TimestampAdd expression >

[jira] [Resolved] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42656. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40257

[jira] [Assigned] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42656: Assignee: Zhen Li > Spark Connect Scala Client Shell Script >

[jira] [Assigned] (SPARK-42659) Reimplement `FPGrowthModel.transform` with dataframe operations

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42659: Assignee: (was: Apache Spark) > Reimplement `FPGrowthModel.transform` with dataframe

[jira] [Assigned] (SPARK-42659) Reimplement `FPGrowthModel.transform` with dataframe operations

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42659: Assignee: Apache Spark > Reimplement `FPGrowthModel.transform` with dataframe operations

[jira] [Commented] (SPARK-42659) Reimplement `FPGrowthModel.transform` with dataframe operations

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696019#comment-17696019 ] Apache Spark commented on SPARK-42659: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-42659) Reimplement `FPGrowthModel.transform` with dataframe operations

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17696018#comment-17696018 ] Apache Spark commented on SPARK-42659: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-42659) Reimplement `FPGrowthModel.transform` with dataframe operations

2023-03-02 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-42659: - Summary: Reimplement `FPGrowthModel.transform` with dataframe operations Key: SPARK-42659 URL: https://issues.apache.org/jira/browse/SPARK-42659 Project: Spark

[jira] [Assigned] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42651: Assignee: (was: Apache Spark) > Optimize global sort to driver sort >

[jira] [Commented] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695991#comment-17695991 ] Apache Spark commented on SPARK-42651: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42651: Assignee: Apache Spark > Optimize global sort to driver sort >

[jira] [Commented] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695992#comment-17695992 ] Apache Spark commented on SPARK-42651: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695989#comment-17695989 ] Yuming Wang commented on SPARK-42650: - It seems like a Kyuubi bug? > link issue SPARK-42550 >

[jira] [Commented] (SPARK-42556) Dataset.colregex should link a plan_id when it only matches a single column.

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695965#comment-17695965 ] jiaan.geng commented on SPARK-42556: I'm working on. > Dataset.colregex should link a plan_id when

[jira] [Commented] (SPARK-42604) Implement functions.typedlit

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695964#comment-17695964 ] jiaan.geng commented on SPARK-42604: I will take a look! > Implement functions.typedlit >

[jira] [Updated] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42647: - Priority: Minor (was: Major) > Remove aliases from deprecated numpy data types >

[jira] [Assigned] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42647: Assignee: Aimilios Tsouvelekakis > Remove aliases from deprecated numpy data types >

[jira] [Resolved] (SPARK-42647) Remove aliases from deprecated numpy data types

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42647. -- Fix Version/s: 3.3.3 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Resolved] (SPARK-41718) Numpy 1.24 breaks PySpark due to use of `np.bool` instead of `np.bool_` in many places

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-41718. -- Resolution: Duplicate > Numpy 1.24 breaks PySpark due to use of `np.bool` instead of

[jira] [Commented] (SPARK-42615) Refactor the AnalyzePlan RPC and add `session.version`

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695943#comment-17695943 ] Apache Spark commented on SPARK-42615: -- User 'ueshin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-03-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-41497. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-41497) Accumulator undercounting in the case of retry task with rdd cache

2023-03-02 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-41497: --- Assignee: Tengfei Huang > Accumulator undercounting in the case of retry

[jira] [Commented] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695928#comment-17695928 ] Apache Spark commented on SPARK-42630: -- User 'ueshin' has created a pull request for this issue:

[jira] [Commented] (SPARK-42630) Make `parse_data_type` use new proto message `DDLParse`

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695927#comment-17695927 ] Apache Spark commented on SPARK-42630: -- User 'ueshin' has created a pull request for this issue:

[jira] [Updated] (SPARK-42658) Handle timeouts and CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42658: - Description: We would need a retry mechanism on the client side to

[jira] [Updated] (SPARK-42658) Handle timeouts and CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42658: - Summary: Handle timeouts and CRC failures during artifact transfer

[jira] [Created] (SPARK-42658) Handle CRC failures during artifact transfer

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42658: Summary: Handle CRC failures during artifact transfer Key: SPARK-42658 URL: https://issues.apache.org/jira/browse/SPARK-42658 Project: Spark

[jira] [Created] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42657: Summary: Support to find and transfer client-side REPL classfiles to server as artifacts Key: SPARK-42657 URL:

[jira] [Updated] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42657: - Epic Link: SPARK-42554 > Support to find and transfer client-side REPL

[jira] [Assigned] (SPARK-42609) Add tests for grouping() and grouping_id() functions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42609: Assignee: Apache Spark (was: Rui Wang) > Add tests for grouping() and grouping_id()

[jira] [Assigned] (SPARK-42609) Add tests for grouping() and grouping_id() functions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42609: Assignee: Rui Wang (was: Apache Spark) > Add tests for grouping() and grouping_id()

[jira] [Commented] (SPARK-42609) Add tests for grouping() and grouping_id() functions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695912#comment-17695912 ] Apache Spark commented on SPARK-42609: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42640. --- Fix Version/s: 3.4.1 Resolution: Fixed > Remove stale entries from the

[jira] [Updated] (SPARK-42640) Remove stale entries from the excluding rules for CompabilitySuite

2023-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell updated SPARK-42640: -- Epic Link: SPARK-42554 > Remove stale entries from the excluding rules for

[jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42655: Assignee: Apache Spark > Incorrect ambiguous column reference error >

[jira] [Commented] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695892#comment-17695892 ] Apache Spark commented on SPARK-42655: -- User 'shrprasa' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42655: Assignee: (was: Apache Spark) > Incorrect ambiguous column reference error >

[jira] [Assigned] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42656: Assignee: (was: Apache Spark) > Spark Connect Scala Client Shell Script >

[jira] [Assigned] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42656: Assignee: Apache Spark > Spark Connect Scala Client Shell Script >

[jira] [Commented] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695879#comment-17695879 ] Apache Spark commented on SPARK-42656: -- User 'zhenlineo' has created a pull request for this issue:

[jira] [Created] (SPARK-42656) Spark Connect Scala Client Shell Script

2023-03-02 Thread Zhen Li (Jira)
Zhen Li created SPARK-42656: --- Summary: Spark Connect Scala Client Shell Script Key: SPARK-42656 URL: https://issues.apache.org/jira/browse/SPARK-42656 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-36604) timestamp type column analyze result is wrong

2023-03-02 Thread Ritika Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695869#comment-17695869 ] Ritika Maheshwari commented on SPARK-36604: --- Seems to be working correctly in  Spark 3.3.0

[jira] [Updated] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-42655: Description: val df1 =

[jira] [Updated] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shrikant Prasad updated SPARK-42655: Description: val df1 =

[jira] [Created] (SPARK-42655) Incorrect ambiguous column reference error

2023-03-02 Thread Shrikant Prasad (Jira)
Shrikant Prasad created SPARK-42655: --- Summary: Incorrect ambiguous column reference error Key: SPARK-42655 URL: https://issues.apache.org/jira/browse/SPARK-42655 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-42599) Make `CompatibilitySuite` as a tool like `dev/mima`

2023-03-02 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42599. --- Fix Version/s: 3.4.0 Assignee: Yang Jie Resolution: Fixed > Make

[jira] [Commented] (SPARK-26314) support Confluent encoded Avro in Spark Structured Streaming

2023-03-02 Thread Gustavo Martin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695828#comment-17695828 ] Gustavo Martin commented on SPARK-26314: My team just stumbled upon this problem :( I was

[jira] [Updated] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata Sai Akhil Gudesa updated SPARK-42653: - Epic Link: SPARK-42554 > Artifact transfer from Scala/JVM client to

[jira] [Commented] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695820#comment-17695820 ] Apache Spark commented on SPARK-42653: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42653: Assignee: (was: Apache Spark) > Artifact transfer from Scala/JVM client to Server >

[jira] [Assigned] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42653: Assignee: Apache Spark > Artifact transfer from Scala/JVM client to Server >

[jira] [Commented] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695819#comment-17695819 ] Apache Spark commented on SPARK-42653: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42654: Assignee: Apache Spark > Upgrade dropwizard metrics 4.2.17 >

[jira] [Assigned] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42558: Assignee: Apache Spark > Implement DataFrameStatFunctions >

[jira] [Commented] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695816#comment-17695816 ] Apache Spark commented on SPARK-42558: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695814#comment-17695814 ] Apache Spark commented on SPARK-42654: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42558: Assignee: (was: Apache Spark) > Implement DataFrameStatFunctions >

[jira] [Assigned] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42654: Assignee: (was: Apache Spark) > Upgrade dropwizard metrics 4.2.17 >

[jira] [Created] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-42654: Summary: Upgrade dropwizard metrics 4.2.17 Key: SPARK-42654 URL: https://issues.apache.org/jira/browse/SPARK-42654 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42653) Artifact transfer from Scala/JVM client to Server

2023-03-02 Thread Venkata Sai Akhil Gudesa (Jira)
Venkata Sai Akhil Gudesa created SPARK-42653: Summary: Artifact transfer from Scala/JVM client to Server Key: SPARK-42653 URL: https://issues.apache.org/jira/browse/SPARK-42653 Project:

[jira] [Updated] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-02 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-42553: - Fix Version/s: 3.3.3 > NonReserved keyword "interval" can't be column name >

[jira] [Resolved] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-42622. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40219

[jira] [Assigned] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-42622: Assignee: Jelmer Kuperus > StackOverflowError reading json that does not conform to

[jira] [Updated] (SPARK-42622) StackOverflowError reading json that does not conform to schema

2023-03-02 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-42622: - Fix Version/s: 3.4.1 (was: 3.4.0) Priority: Major (was:

[jira] [Created] (SPARK-42652) Improve the multiple watermarking policy documentation

2023-03-02 Thread Sandeep Chandran (Jira)
Sandeep Chandran created SPARK-42652: Summary: Improve the multiple watermarking policy documentation Key: SPARK-42652 URL: https://issues.apache.org/jira/browse/SPARK-42652 Project: Spark

[jira] [Commented] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695706#comment-17695706 ] Yang Jie commented on SPARK-42558: -- Seems DataFrameStatFunctions can only be partially implemented. 

[jira] [Commented] (SPARK-42553) NonReserved keyword "interval" can't be column name

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695696#comment-17695696 ] Apache Spark commented on SPARK-42553: -- User 'jiang13021' has created a pull request for this

[jira] [Commented] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695691#comment-17695691 ] Apache Spark commented on SPARK-42555: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42555: Assignee: Apache Spark > Add JDBC to DataFrameReader > --- > >

[jira] [Assigned] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42555: Assignee: (was: Apache Spark) > Add JDBC to DataFrameReader >

[jira] [Assigned] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

2023-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41725: Assignee: Hyukjin Kwon > Remove the workaround of sql(...).collect back in PySpark tests

[jira] [Updated] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread XiDuo You (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-42651: -- Description: If the size of plan is small enough, it's more efficient to sort all rows at driver side

[jira] [Assigned] (SPARK-42393) Support for Pandas/Arrow Functions API

2023-03-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42393: - Assignee: Xinrong Meng > Support for Pandas/Arrow Functions API >

[jira] [Assigned] (SPARK-42499) Support for Runtime SQL configuration

2023-03-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42499: - Assignee: Takuya Ueshin > Support for Runtime SQL configuration >

[jira] [Created] (SPARK-42651) Optimize global sort to driver sort

2023-03-02 Thread XiDuo You (Jira)
XiDuo You created SPARK-42651: - Summary: Optimize global sort to driver sort Key: SPARK-42651 URL: https://issues.apache.org/jira/browse/SPARK-42651 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-33628) Use the Hive.getPartitionsByNames method instead of Hive.getPartitions in the HiveClientImpl

2023-03-02 Thread Maxim Martynov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695654#comment-17695654 ] Maxim Martynov commented on SPARK-33628: Can anyone review this pull request? > Use the

[jira] [Commented] (SPARK-42578) Add JDBC to DataFrameWriter

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695650#comment-17695650 ] jiaan.geng commented on SPARK-42578: I will take a look! > Add JDBC to DataFrameWriter >

[jira] [Commented] (SPARK-41725) Remove the workaround of sql(...).collect back in PySpark tests

2023-03-02 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695643#comment-17695643 ] Apache Spark commented on SPARK-41725: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-42555) Add JDBC to DataFrameReader

2023-03-02 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695633#comment-17695633 ] jiaan.geng commented on SPARK-42555: I will take a look! > Add JDBC to DataFrameReader >

[jira] [Resolved] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-42641. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40243

[jira] [Assigned] (SPARK-42641) Upgrade buf to v1.15.0

2023-03-02 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-42641: - Assignee: Ruifeng Zheng > Upgrade buf to v1.15.0 > -- > >

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Updated] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread kevinshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevinshin updated SPARK-42650: -- Description: When use

[jira] [Created] (SPARK-42650) link issue SPARK-42550

2023-03-02 Thread kevinshin (Jira)
kevinshin created SPARK-42650: - Summary: link issue SPARK-42550 Key: SPARK-42650 URL: https://issues.apache.org/jira/browse/SPARK-42650 Project: Spark Issue Type: Bug Components: SQL

[jira] [Resolved] (SPARK-42642) Make Python the first code example tab in the Spark documentation

2023-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42642. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40250

[jira] [Assigned] (SPARK-42642) Make Python the first code example tab in the Spark documentation

2023-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42642: Assignee: Allan Folting > Make Python the first code example tab in the Spark

  1   2   >