[jira] [Commented] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Pan Bingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903251#comment-17903251 ] Pan Bingkun commented on SPARK-50126: - I verified on the master that it is correct,

[jira] [Comment Edited] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Pan Bingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903251#comment-17903251 ] Pan Bingkun edited comment on SPARK-50126 at 12/5/24 8:58 AM:

[jira] [Created] (SPARK-50499) Expose metrics from BasePythonRunner

2024-12-05 Thread Sebastian Hillig (Jira)
Sebastian Hillig created SPARK-50499: Summary: Expose metrics from BasePythonRunner Key: SPARK-50499 URL: https://issues.apache.org/jira/browse/SPARK-50499 Project: Spark Issue Type: Impr

[jira] [Updated] (SPARK-50495) Upgrade Volcano to 1.10.0

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50495: -- Parent: SPARK-49524 Issue Type: Sub-task (was: Improvement) > Upgrade Volcano to 1.10

[jira] [Resolved] (SPARK-50495) Upgrade Volcano to 1.10.0

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50495. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49068 [https://

[jira] [Created] (SPARK-50500) Quoted Empty Fields in CSV Not Interpreted as Null When escape is Set to ""

2024-12-05 Thread Naresh K Dulam (Jira)
Naresh K Dulam created SPARK-50500: -- Summary: Quoted Empty Fields in CSV Not Interpreted as Null When escape is Set to "" Key: SPARK-50500 URL: https://issues.apache.org/jira/browse/SPARK-50500 Proj

[jira] [Updated] (SPARK-50501) Update cross-spawn JS module to surpress a warning in lint

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50501: --- Labels: pull-request-available (was: ) > Update cross-spawn JS module to surpress a warning

[jira] [Resolved] (SPARK-50498) Avoid unnecessary py4j call in `listFunctions`

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50498. --- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Updated] (SPARK-49884) Backward Compatibility and Test

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49884: --- Labels: pull-request-available (was: ) > Backward Compatibility and Test >

[jira] [Resolved] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50421. --- Fix Version/s: (was: 3.5.4) Resolution: Fixed This is resolved via [https://githu

[jira] [Updated] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50421: -- Target Version/s: (was: 4.0.0, 3.5.4) > Executor memory config is incorrect when multiple st

[jira] [Assigned] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50421: - Assignee: Terry Wang > Executor memory config is incorrect when multiple stage level re

[jira] [Created] (SPARK-50498) Avoid unnecessary lookup in `listFunctions`

2024-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50498: - Summary: Avoid unnecessary lookup in `listFunctions` Key: SPARK-50498 URL: https://issues.apache.org/jira/browse/SPARK-50498 Project: Spark Issue Type: Imp

[jira] [Updated] (SPARK-50498) Avoid unnecessary py4j call in `listFunctions`

2024-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-50498: -- Summary: Avoid unnecessary py4j call in `listFunctions` (was: Avoid unnecessary lookup in `li

[jira] [Updated] (SPARK-50498) Avoid unnecessary py4j call in `listFunctions`

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50498: --- Labels: pull-request-available (was: ) > Avoid unnecessary py4j call in `listFunctions` > -

[jira] [Updated] (SPARK-50497) Fail queries with proper message if MultiAlias contains non-generator function

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50497: --- Labels: pull-request-available (was: ) > Fail queries with proper message if MultiAlias con

[jira] [Updated] (SPARK-50497) Fail queries with proper message if MultiAlias contains non-generator function

2024-12-05 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-50497: -- Summary: Fail queries with proper message if MultiAlias contains non-generator functio

[jira] [Updated] (SPARK-50421) Executor memory config is incorrect when multiple stage level resource profiles works

2024-12-05 Thread Terry Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Terry Wang updated SPARK-50421: --- Fix Version/s: 4.0.0 3.5.4 > Executor memory config is incorrect when multiple st

[jira] [Updated] (SPARK-50492) Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark

2024-12-05 Thread Livia Zhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Livia Zhu updated SPARK-50492: -- Summary: Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWi

[jira] [Created] (SPARK-50501) Update cross-spawn JS module to surpress a warning in lint

2024-12-05 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-50501: -- Summary: Update cross-spawn JS module to surpress a warning in lint Key: SPARK-50501 URL: https://issues.apache.org/jira/browse/SPARK-50501 Project: Spark

[jira] [Assigned] (SPARK-50344) AS operator

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50344: - Assignee: Daniel > AS operator > --- > > Key: SPARK-50344 >

[jira] [Closed] (SPARK-50221) GROUP BY ALL support

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-50221. - > GROUP BY ALL support > > > Key: SPARK-50221 >

[jira] [Updated] (SPARK-50416) load-spark-env.sh test for terminal or pipe broken / non-portable

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50416: --- Labels: pull-request-available (was: ) > load-spark-env.sh test for terminal or pipe broken

[jira] [Resolved] (SPARK-50343) DROP operator

2024-12-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-50343. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49037 [https:

[jira] [Resolved] (SPARK-50344) AS operator

2024-12-05 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-50344. Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49037 [https:

[jira] [Commented] (SPARK-50308) Add .sql file testing to check equality of SQL pipe queries and many regular SQL queries

2024-12-05 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903455#comment-17903455 ] Daniel commented on SPARK-50308: This was implemented by https://github.com/apache/spark

[jira] [Resolved] (SPARK-50501) Update cross-spawn JS module to surpress a warning in lint

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50501. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49077 [https://

[jira] [Updated] (SPARK-50501) Update cross-spawn JS module to surpress a warning in lint

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50501: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Improvement) > Update cross-spawn JS m

[jira] [Assigned] (SPARK-50501) Update cross-spawn JS module to surpress a warning in lint

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50501: - Assignee: Kousuke Saruta > Update cross-spawn JS module to surpress a warning in lint >

[jira] [Resolved] (SPARK-50308) Add .sql file testing to check equality of SQL pipe queries and many regular SQL queries

2024-12-05 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-50308. Resolution: Fixed > Add .sql file testing to check equality of SQL pipe queries and many regular > SQL qu

[jira] [Updated] (SPARK-50509) Spark build failure

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50509: --- Labels: pull-request-available (was: ) > Spark build failure > --- > >

[jira] [Created] (SPARK-50509) Spark build failure

2024-12-05 Thread cuiyanxiang (Jira)
cuiyanxiang created SPARK-50509: --- Summary: Spark build failure Key: SPARK-50509 URL: https://issues.apache.org/jira/browse/SPARK-50509 Project: Spark Issue Type: Bug Components: Build

[jira] [Commented] (SPARK-50418) Allow optional trailing comma at the end of SELECT lists

2024-12-05 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903483#comment-17903483 ] Daniel commented on SPARK-50418: After investigating this more, I find that it is not ac

[jira] [Created] (SPARK-50504) Enable SQL pipe syntax by default

2024-12-05 Thread Daniel (Jira)
Daniel created SPARK-50504: -- Summary: Enable SQL pipe syntax by default Key: SPARK-50504 URL: https://issues.apache.org/jira/browse/SPARK-50504 Project: Spark Issue Type: Sub-task Componen

[jira] [Resolved] (SPARK-50418) Allow optional trailing comma at the end of SELECT lists

2024-12-05 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-50418. Resolution: Won't Fix > Allow optional trailing comma at the end of SELECT lists > ---

[jira] [Created] (SPARK-50502) Support pushing DeserializeToObject through Union

2024-12-05 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-50502: -- Summary: Support pushing DeserializeToObject through Union Key: SPARK-50502 URL: https://issues.apache.org/jira/browse/SPARK-50502 Project: Spark Issue T

[jira] [Resolved] (SPARK-50505) Fix `spark.storage.replication.proactive` default value documentation

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50505. --- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pul

[jira] [Assigned] (SPARK-50506) Codify Spark Standalone documentation consistently

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50506: - Assignee: Dongjoon Hyun > Codify Spark Standalone documentation consistently >

[jira] [Updated] (SPARK-50507) Group pandas function related tests

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50507: --- Labels: pull-request-available (was: ) > Group pandas function related tests >

[jira] [Resolved] (SPARK-50132) Update join to support lateral join

2024-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-50132. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49033 [https://gi

[jira] [Resolved] (SPARK-50506) Codify Spark Standalone documentation consistently

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50506. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49082 [https://

[jira] [Assigned] (SPARK-50507) Group pandas function related tests

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50507: - Assignee: Ruifeng Zheng > Group pandas function related tests > ---

[jira] [Resolved] (SPARK-50507) Group pandas function related tests

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-50507. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49074 [https://

[jira] [Updated] (SPARK-50480) Extend CharType and VarcharType from StringType

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50480: --- Labels: pull-request-available (was: ) > Extend CharType and VarcharType from StringType >

[jira] [Assigned] (SPARK-50494) Add a separate docker file for python 3.10 daily build

2024-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-50494: - Assignee: Ruifeng Zheng > Add a separate docker file for python 3.10 daily build >

[jira] [Resolved] (SPARK-50494) Add a separate docker file for python 3.10 daily build

2024-12-05 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-50494. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 49067 [https://

[jira] [Assigned] (SPARK-50492) Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark

2024-12-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-50492: Assignee: Livia Zhu > Fix java.util.NoSuchElementException when event time column is drop

[jira] [Updated] (SPARK-50492) Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark

2024-12-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-50492: - Affects Version/s: 3.5.3 3.5.2 3.5.1

[jira] [Resolved] (SPARK-50492) Fix java.util.NoSuchElementException when event time column is dropped after dropDuplicatesWithinWatermark

2024-12-05 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-50492. -- Fix Version/s: 3.5.4 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Updated] (SPARK-50134) Support Spark Connect

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50134: --- Labels: pull-request-available (was: ) > Support Spark Connect > - > >

[jira] [Created] (SPARK-50508) Add more detailed prompt information when broadcasting fails

2024-12-05 Thread guihuawen (Jira)
guihuawen created SPARK-50508: - Summary: Add more detailed prompt information when broadcasting fails Key: SPARK-50508 URL: https://issues.apache.org/jira/browse/SPARK-50508 Project: Spark Issue

[jira] [Assigned] (SPARK-50449) [M1] Fix grammar allowing empty bodies for loops, IF and CASE

2024-12-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-50449: --- Assignee: Dusan Tisma > [M1] Fix grammar allowing empty bodies for loops, IF and CASE > ---

[jira] [Resolved] (SPARK-50449) [M1] Fix grammar allowing empty bodies for loops, IF and CASE

2024-12-05 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-50449. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 48989 [https://gith

[jira] [Commented] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903270#comment-17903270 ] Hyukjin Kwon commented on SPARK-50126: -- string representation of instances are pret

[jira] [Commented] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Pan Bingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903274#comment-17903274 ] Pan Bingkun commented on SPARK-50126: - Okay, thank you! Let's skip it in the the up

[jira] [Comment Edited] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Pan Bingkun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903251#comment-17903251 ] Pan Bingkun edited comment on SPARK-50126 at 12/5/24 9:11 AM:

[jira] [Updated] (SPARK-50126) PySpark expr() (expression) SQL Function returns None in Spark Connect

2024-12-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-50126: - Fix Version/s: (was: 3.5.4) > PySpark expr() (expression) SQL Function returns None in Spark

[jira] [Created] (SPARK-50497) Fail queries if MultiAlias contains non-generator function

2024-12-05 Thread Mihailo Milosevic (Jira)
Mihailo Milosevic created SPARK-50497: - Summary: Fail queries if MultiAlias contains non-generator function Key: SPARK-50497 URL: https://issues.apache.org/jira/browse/SPARK-50497 Project: Spark

[jira] [Updated] (SPARK-50475) NullPointerException when saving a df with 'noop' format after joining wide dfs

2024-12-05 Thread Cedric Cuypers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cedric Cuypers updated SPARK-50475: --- Priority: Blocker (was: Major) > NullPointerException when saving a df with 'noop' format a

[jira] [Created] (SPARK-50505) Fix `spark.storage.replication.proactive` default value documentation

2024-12-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50505: - Summary: Fix `spark.storage.replication.proactive` default value documentation Key: SPARK-50505 URL: https://issues.apache.org/jira/browse/SPARK-50505 Project: Spar

[jira] [Updated] (SPARK-50505) Fix `spark.storage.replication.proactive` default value documentation

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-50505: -- Parent: SPARK-44111 Issue Type: Sub-task (was: Bug) > Fix `spark.storage.replication.

[jira] [Updated] (SPARK-50505) Fix `spark.storage.replication.proactive` default value documentation

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50505: --- Labels: pull-request-available (was: ) > Fix `spark.storage.replication.proactive` default

[jira] [Assigned] (SPARK-50505) Fix `spark.storage.replication.proactive` default value documentation

2024-12-05 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-50505: - Assignee: Dongjoon Hyun > Fix `spark.storage.replication.proactive` default value docum

[jira] [Created] (SPARK-50507) Group pandas function related tests

2024-12-05 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-50507: - Summary: Group pandas function related tests Key: SPARK-50507 URL: https://issues.apache.org/jira/browse/SPARK-50507 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-50504) Enable SQL pipe syntax by default

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50504: --- Labels: pull-request-available (was: ) > Enable SQL pipe syntax by default > --

[jira] [Updated] (SPARK-49828) Expose Column expressions as developer APIs

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-49828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-49828: --- Labels: pull-request-available (was: ) > Expose Column expressions as developer APIs >

[jira] [Updated] (SPARK-50506) Codify Spark Standalone documentation consistently

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50506: --- Labels: pull-request-available (was: ) > Codify Spark Standalone documentation consistently

[jira] [Created] (SPARK-50506) Codify Spark Standalone documentation consistently

2024-12-05 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-50506: - Summary: Codify Spark Standalone documentation consistently Key: SPARK-50506 URL: https://issues.apache.org/jira/browse/SPARK-50506 Project: Spark Issue Ty

[jira] [Updated] (SPARK-50496) Change partitioning to SinglePartition if partition number is 1

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50496: --- Labels: pull-request-available (was: ) > Change partitioning to SinglePartition if partitio

[jira] [Updated] (SPARK-50508) Add more detailed prompt information when broadcasting fails

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50508: --- Labels: pull-request-available (was: ) > Add more detailed prompt information when broadcas

[jira] [Updated] (SPARK-50502) Support pushing DeserializeToObject through Union

2024-12-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-50502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-50502: --- Labels: pull-request-available (was: ) > Support pushing DeserializeToObject through Union