[jira] [Updated] (SPARK-38955) Disable lineSep option in 'from_csv' and 'schema_of_csv'

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38955: -- Summary: Disable lineSep option in 'from_csv' and 'schema_of_csv' (was: from_csv can corrupt

[jira] [Updated] (SPARK-38955) Disable lineSep option in 'from_csv' and 'schema_of_csv'

[ https://issues.apache.org/jira/browse/SPARK-38955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38955: -- Labels: correctness (was: ) > Disable lineSep option in 'from_csv' and 'schema_of_csv' >

[jira] [Updated] (SPARK-38614) Don't push down limit through window that's using percent_rank

[ https://issues.apache.org/jira/browse/SPARK-38614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38614: -- Summary: Don't push down limit through window that's using percent_rank (was: After Spark

[jira] [Updated] (SPARK-38436) Fix `test_ceil` to test `ceil`

[ https://issues.apache.org/jira/browse/SPARK-38436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38436: -- Component/s: Tests > Fix `test_ceil` to test `ceil` > -- > >

[jira] [Updated] (SPARK-38416) Change day to month

[ https://issues.apache.org/jira/browse/SPARK-38416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38416: -- Summary: Change day to month (was: Duplicate functions) > Change day to month >

[jira] [Updated] (SPARK-38416) Duplicate functions

[ https://issues.apache.org/jira/browse/SPARK-38416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38416: -- Component/s: Tests > Duplicate functions > --- > > Key:

[jira] [Updated] (SPARK-38379) Fix Kubernetes Client mode when mounting persistent volume with storage class

[ https://issues.apache.org/jira/browse/SPARK-38379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38379: -- Summary: Fix Kubernetes Client mode when mounting persistent volume with storage class (was:

[jira] [Updated] (SPARK-38271) PoissonSampler may output more rows than MaxRows

[ https://issues.apache.org/jira/browse/SPARK-38271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38271: -- Labels: correctness (was: ) > PoissonSampler may output more rows than MaxRows >

[jira] [Updated] (SPARK-38073) Update atexit function to avoid issues with late binding

[ https://issues.apache.org/jira/browse/SPARK-38073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38073: -- Summary: Update atexit function to avoid issues with late binding (was: NameError: name 'sc'

[jira] [Updated] (SPARK-37675) Prevent overwriting of push shuffle merged files once the shuffle is finalized

[ https://issues.apache.org/jira/browse/SPARK-37675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37675: -- Summary: Prevent overwriting of push shuffle merged files once the shuffle is finalized

[jira] [Updated] (SPARK-37963) Need to update Partition URI after renaming table in InMemoryCatalog

[ https://issues.apache.org/jira/browse/SPARK-37963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37963: -- Labels: correctness (was: ) > Need to update Partition URI after renaming table in

[jira] [Updated] (SPARK-37544) sequence over dates with month interval is producing incorrect results

[ https://issues.apache.org/jira/browse/SPARK-37544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-37544: -- Labels: correctness (was: ) > sequence over dates with month interval is producing incorrect

[jira] [Updated] (SPARK-30062) Add IMMEDIATE statement to the DB2 dialect truncate implementation

[ https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30062: -- Summary: Add IMMEDIATE statement to the DB2 dialect truncate implementation (was: Add the

[jira] [Updated] (SPARK-30062) Add the IMMEDIATE statement to the DB2 dialect truncate implementation

[ https://issues.apache.org/jira/browse/SPARK-30062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-30062: -- Summary: Add the IMMEDIATE statement to the DB2 dialect truncate implementation (was: bug

[jira] [Updated] (SPARK-39030) Rename sum

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39030: -- Summary: Rename sum (was: Remame sum) > Rename sum > -- > > Key:

[jira] [Updated] (SPARK-39030) Rename sum to avoid shading the builtin Python function

[ https://issues.apache.org/jira/browse/SPARK-39030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39030: -- Summary: Rename sum to avoid shading the builtin Python function (was: Rename sum) > Rename

[jira] [Resolved] (SPARK-39292) Make Dataset.melt work with struct fields

[ https://issues.apache.org/jira/browse/SPARK-39292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Enrico Minack resolved SPARK-39292. --- Resolution: Fixed > Make Dataset.melt work with struct fields >

[jira] [Commented] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration

[ https://issues.apache.org/jira/browse/SPARK-39696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17567530#comment-17567530 ] Apache Spark commented on SPARK-39696: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration

[ https://issues.apache.org/jira/browse/SPARK-39696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39696: Assignee: Apache Spark > Uncaught exception in thread executor-heartbeater >

[jira] [Assigned] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration

[ https://issues.apache.org/jira/browse/SPARK-39696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39696: Assignee: (was: Apache Spark) > Uncaught exception in thread executor-heartbeater >

[jira] [Commented] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration

[ https://issues.apache.org/jira/browse/SPARK-39696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17567529#comment-17567529 ] Apache Spark commented on SPARK-39696: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39384) Compile build-in linear regression aggregate functions for JDBC dialect

[ https://issues.apache.org/jira/browse/SPARK-39384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39384: Assignee: jiaan.geng Priority: Minor (was: Major) > Compile build-in linear

[jira] [Resolved] (SPARK-39384) Compile build-in linear regression aggregate functions for JDBC dialect

[ https://issues.apache.org/jira/browse/SPARK-39384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39384. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37188

[jira] [Resolved] (SPARK-39795) New SQL function: try_to_timestamp

[ https://issues.apache.org/jira/browse/SPARK-39795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39795. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37204

[jira] [Resolved] (SPARK-39756) Better error messages for missing pandas scalars

[ https://issues.apache.org/jira/browse/SPARK-39756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39756. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37168

[jira] [Assigned] (SPARK-39756) Better error messages for missing pandas scalars

[ https://issues.apache.org/jira/browse/SPARK-39756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39756: Assignee: Xinrong Meng > Better error messages for missing pandas scalars >

[jira] [Resolved] (SPARK-39312) Use Parquet in predicate for Spark In filter

[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-39312. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36696

[jira] [Assigned] (SPARK-39312) Use Parquet in predicate for Spark In filter

[ https://issues.apache.org/jira/browse/SPARK-39312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-39312: --- Assignee: Huaxin Gao > Use Parquet in predicate for Spark In filter >