[jira] [Resolved] (SPARK-47932) Avoid using legacy commons-lang

[ https://issues.apache.org/jira/browse/SPARK-47932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-47932. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46154 [https://github.com

[jira] [Updated] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ke Jia updated SPARK-47773: --- Description: SPIP doc: [https://docs.google.com/document/d/1v7sndtIHIBdzc4YvLPI8InXxhI7SnnAQ5HvmM2DGjVE/edi

[jira] [Comment Edited] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839497#comment-17839497 ] Ke Jia edited comment on SPARK-47773 at 4/22/24 6:22 AM: - We hav

[jira] [Comment Edited] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839497#comment-17839497 ] Ke Jia edited comment on SPARK-47773 at 4/22/24 6:22 AM: - We hav

[jira] [Commented] (SPARK-47773) Enhancing the Flexibility of Spark's Physical Plan to Enable Execution on Various Native Engines

[ https://issues.apache.org/jira/browse/SPARK-47773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839497#comment-17839497 ] Ke Jia commented on SPARK-47773: We have refined the above [SPIP|[https://docs.google.c

[jira] [Updated] (SPARK-47793) Implement SimpleDataSourceStreamReader for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47793: --- Epic Link: SPARK-46866 > Implement SimpleDataSourceStreamReader for python streaming data source > -

[jira] [Updated] (SPARK-47920) Add documentation for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47920: --- Epic Link: SPARK-46866 > Add documentation for python streaming data source > --

[jira] [Updated] (SPARK-47777) Add spark connect test for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-4: --- Epic Link: SPARK-46866 > Add spark connect test for python streaming data source > -

[jira] [Updated] (SPARK-47273) Implement python stream writer interface

[ https://issues.apache.org/jira/browse/SPARK-47273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47273: --- Epic Link: SPARK-46866 > Implement python stream writer interface >

[jira] [Updated] (SPARK-47107) Implement partition reader for python streaming data source

[ https://issues.apache.org/jira/browse/SPARK-47107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaoqin Li updated SPARK-47107: --- Epic Link: SPARK-46866 > Implement partition reader for python streaming data source > -

[jira] [Updated] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47933: --- Labels: pull-request-available (was: ) > Parent Column class for Spark Connect and Spark Cl

[jira] [Updated] (SPARK-47932) Avoid using legacy commons-lang

[ https://issues.apache.org/jira/browse/SPARK-47932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47932: --- Labels: pull-request-available (was: ) > Avoid using legacy commons-lang >

[jira] [Created] (SPARK-47933) Parent Column class for Spark Connect and Spark Classic

Hyukjin Kwon created SPARK-47933: Summary: Parent Column class for Spark Connect and Spark Classic Key: SPARK-47933 URL: https://issues.apache.org/jira/browse/SPARK-47933 Project: Spark Issue

[jira] [Resolved] (SPARK-47902) Compute Current Time* expressions should be foldable

[ https://issues.apache.org/jira/browse/SPARK-47902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47902. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46120 [https://gith

[jira] [Assigned] (SPARK-47902) Compute Current Time* expressions should be foldable

[ https://issues.apache.org/jira/browse/SPARK-47902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47902: --- Assignee: Aleksandar Tomic > Compute Current Time* expressions should be foldable > ---

[jira] [Commented] (SPARK-33826) InsertIntoHiveTable generate HDFS file with invalid user

[ https://issues.apache.org/jira/browse/SPARK-33826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839449#comment-17839449 ] angerszhu commented on SPARK-33826: --- What is RIK? Not sure what do you mean > InsertI

[jira] [Resolved] (SPARK-47845) Support column type in split function in scala and python

[ https://issues.apache.org/jira/browse/SPARK-47845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-47845. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46045 [https://

[jira] [Assigned] (SPARK-47845) Support column type in split function in scala and python

[ https://issues.apache.org/jira/browse/SPARK-47845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-47845: - Assignee: Liu Cao > Support column type in split function in scala and python > ---

[jira] [Commented] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839436#comment-17839436 ] Hyukjin Kwon commented on SPARK-47909: -- Yes, I am working on it today :-). > Paren

[jira] [Resolved] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47909. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 46129 [https://gi

[jira] [Assigned] (SPARK-47909) Parent DataFrame class for Spark Connect and Spark Classic

[ https://issues.apache.org/jira/browse/SPARK-47909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47909: Assignee: Hyukjin Kwon > Parent DataFrame class for Spark Connect and Spark Classic > ---

[jira] [Updated] (SPARK-47600) MLLib: Migrate logInfo with variables to structured logging framework

[ https://issues.apache.org/jira/browse/SPARK-47600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47600: --- Labels: pull-request-available (was: ) > MLLib: Migrate logInfo with variables to structure

[jira] [Updated] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Pan updated SPARK-47928: -- Affects Version/s: 3.2.0 (was: 4.0.0) > Speed up test "Add jar support Ivy

[jira] [Updated] (SPARK-47351) StringToMap (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: StringToMap (all collations) (was: StringToMap) > StringToMap (all collations) > -

[jira] [Updated] (SPARK-47354) ParseJson & VariantExplode (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: ParseJson & VariantExplode (all collations) (was: ParseJson (all collations)) > Parse

[jira] [Updated] (SPARK-47421) Mask (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: Mask (all collations) (was: Mask) > Mask (all collations) > - > >

[jira] [Updated] (SPARK-47353) Mode (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47353: - Summary: Mode (all collations) (was: Mode) > Mode (all collations) > - > >

[jira] [Updated] (SPARK-47354) ParseJson (all collations)

[ https://issues.apache.org/jira/browse/SPARK-47354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47354: - Summary: ParseJson (all collations) (was: TBD) > ParseJson (all collations) > -

[jira] [Updated] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

[ https://issues.apache.org/jira/browse/SPARK-47928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47928: --- Labels: pull-request-available (was: ) > Speed up test "Add jar support Ivy URI in SQL" > -

[jira] [Created] (SPARK-47928) Speed up test "Add jar support Ivy URI in SQL"

Cheng Pan created SPARK-47928: - Summary: Speed up test "Add jar support Ivy URI in SQL" Key: SPARK-47928 URL: https://issues.apache.org/jira/browse/SPARK-47928 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-41469) Task rerun on decommissioned executor can be avoided if shuffle data has migrated

[ https://issues.apache.org/jira/browse/SPARK-41469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-41469: --- Labels: pull-request-available (was: ) > Task rerun on decommissioned executor can be avoid

[jira] [Updated] (SPARK-47692) Fix default StringType meaning in implicit casting

[ https://issues.apache.org/jira/browse/SPARK-47692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihailo Milosevic updated SPARK-47692: -- Summary: Fix default StringType meaning in implicit casting (was: Addition of priorit

[jira] [Updated] (SPARK-47421) Mask

[ https://issues.apache.org/jira/browse/SPARK-47421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47421: - Summary: Mask (was: TBD) > Mask > > > Key: SPARK-47421 > U

[jira] [Updated] (SPARK-47351) StringToMap

[ https://issues.apache.org/jira/browse/SPARK-47351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uroš Bojanić updated SPARK-47351: - Summary: StringToMap (was: TBD) > StringToMap > --- > > Key: SPARK-4735

[jira] [Updated] (SPARK-47730) Support APP_ID and EXECUTOR_ID placeholder in labels

[ https://issues.apache.org/jira/browse/SPARK-47730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47730: --- Labels: pull-request-available (was: ) > Support APP_ID and EXECUTOR_ID placeholder in labe