[jira] [Updated] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

2024-04-21 Thread Chaoqin Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47793: --- Epic Link: SPARK-46866 > Implement SimpleDataSourceStreamReader for python streaming data source >

[jira] [Updated] (SPARK-47920) Add documentation for python streaming data source

2024-04-21 Thread Chaoqin Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47920: --- Epic Link: SPARK-46866 > Add documentation for python streaming data source >

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

2024-04-21 Thread Chaoqin Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-4: --- Epic Link: SPARK-46866 > Add spark connect test for python streaming data source >

[jira] [Updated] (SPARK-47273) Implement python stream writer interface

2024-04-21 Thread Chaoqin Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47273: --- Epic Link: SPARK-46866 > Implement python stream writer interface >

[jira] [Updated] (SPARK-47107) Implement partition reader for python streaming data source

2024-04-21 Thread Chaoqin Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47107: --- Epic Link: SPARK-46866 > Implement partition reader for python streaming data source >

[jira] [Updated] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47933: --- Labels: pull-request-available (was: ) > Parent Column class for Spark Connect and Spark

[jira] [Updated] (SPARK-47932) Avoid using legacy commons-lang

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47932: --- Labels: pull-request-available (was: ) > Avoid using legacy commons-lang >

[jira] [Created] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

2024-04-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47933: Summary: Parent Column class for Spark Connect and Spark Classic Key: SPARK-47933 URL: https://issues.apache.org/jira/browse/SPARK-47933 Project: Spark

[jira] [Resolved] (SPARK-47902) Compute Current Time* expressions should be foldable

2024-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47902. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46120

[jira] [Assigned] (SPARK-47902) Compute Current Time* expressions should be foldable

2024-04-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47902: --- Assignee: Aleksandar Tomic > Compute Current Time* expressions should be foldable >

[jira] [Commented] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

2024-04-21 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839449#comment-17839449 ] angerszhu commented on SPARK-33826: --- What is RIK? Not sure what do you mean > InsertIntoHiveTable

[jira] [Resolved] (SPARK-47845) Support column type in split function in scala and python

2024-04-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47845. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46045

[jira] [Assigned] (SPARK-47845) Support column type in split function in scala and python

2024-04-21 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-47845: - Assignee: Liu Cao > Support column type in split function in scala and python >

[jira] [Commented] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

2024-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17839436#comment-17839436 ] Hyukjin Kwon commented on SPARK-47909: -- Yes, I am working on it today :-). > Parent DataFrame

[jira] [Resolved] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

2024-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47909. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46129

[jira] [Assigned] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

2024-04-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47909: Assignee: Hyukjin Kwon > Parent DataFrame class for Spark Connect and Spark Classic >

[jira] [Updated] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47600: --- Labels: pull-request-available (was: ) > MLLib: Migrate logInfo with variables to

[jira] [Updated] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-21 Thread Cheng Pan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-47928: -- Affects Version/s: 3.2.0 (was: 4.0.0) > Speed up test "Add jar support Ivy

[jira] [Updated] (SPARK-47351) StringToMap (all collations)

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: StringToMap (all collations) (was: StringToMap) > StringToMap (all collations) >

[jira] [Updated] (SPARK-47354) ParseJson & VariantExplode (all collations)

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: ParseJson & VariantExplode (all collations) (was: ParseJson (all collations)) >

[jira] [Updated] (SPARK-47421) Mask (all collations)

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: Mask (all collations) (was: Mask) > Mask (all collations) > - > >

[jira] [Updated] (SPARK-47353) Mode (all collations)

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47353: - Summary: Mode (all collations) (was: Mode) > Mode (all collations) > - > >

[jira] [Updated] (SPARK-47354) ParseJson (all collations)

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: ParseJson (all collations) (was: TBD) > ParseJson (all collations) >

[jira] [Updated] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47928: --- Labels: pull-request-available (was: ) > Speed up test "Add jar support Ivy URI in SQL" >

[jira] [Created] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

2024-04-21 Thread Cheng Pan (Jira)
Cheng Pan created SPARK-47928: - Summary: Speed up test "Add jar support Ivy URI in SQL" Key: SPARK-47928 URL: https://issues.apache.org/jira/browse/SPARK-47928 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41469: --- Labels: pull-request-available (was: ) > Task rerun on decommissioned executor can be

[jira] [Updated] (SPARK-47692) Fix default StringType meaning in implicit casting

2024-04-21 Thread Mihailo Milosevic (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47692: -- Summary: Fix default StringType meaning in implicit casting (was: Addition of

[jira] [Updated] (SPARK-47421) Mask

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: Mask (was: TBD) > Mask > > > Key: SPARK-47421 >

[jira] [Updated] (SPARK-47351) StringToMap

2024-04-21 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: StringToMap (was: TBD) > StringToMap > --- > > Key:

[jira] [Updated] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

2024-04-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47730: --- Labels: pull-request-available (was: ) > Support APP_ID and EXECUTOR_ID placeholder in

[jira] [Created] (SPARK-47927) Nullability after join not respected in UDF

2024-04-21 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-47927: -- Summary: Nullability after join not respected in UDF Key: SPARK-47927 URL: https://issues.apache.org/jira/browse/SPARK-47927 Project: Spark Issue Type: