[jira] [Assigned] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42460: - Assignee: Herman van Hövell > E2E test should clean-up results >

[jira] [Resolved] (SPARK-42460) E2E test should clean-up results

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42460. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40048

[jira] [Commented] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689568#comment-17689568 ] Apache Spark commented on SPARK-42463: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-27180) Fix testing issues with yarn module in Hadoop-3

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689569#comment-17689569 ] Apache Spark commented on SPARK-27180: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42463: Assignee: (was: Apache Spark) > Clean up the third-party Java source code introduced

[jira] [Assigned] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42463: Assignee: Apache Spark > Clean up the third-party Java source code introduced by

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Affects Version/s: 3.2.3 > Prevent `docker-image-tool.sh` from publishing OCI manifests >

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Affects Version/s: 3.2.4 3.3.3 (was: 3.2.3)

[jira] [Commented] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689571#comment-17689571 ] Apache Spark commented on SPARK-42463: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42462: Assignee: (was: Apache Spark) > Prevent `docker-image-tool.sh` from publishing OCI

[jira] [Commented] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689509#comment-17689509 ] Apache Spark commented on SPARK-42462: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42462: Assignee: Apache Spark > Prevent `docker-image-tool.sh` from publishing OCI manifests >

[jira] [Commented] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689511#comment-17689511 ] Apache Spark commented on SPARK-42462: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Resolved] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42462. --- Fix Version/s: 3.2.4 3.3.2 3.4.0 Resolution:

[jira] [Assigned] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42462: - Assignee: Dongjoon Hyun > Prevent `docker-image-tool.sh` from publishing OCI manifests

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Fix Version/s: 3.3.3 (was: 3.3.2) > Prevent `docker-image-tool.sh`

[jira] [Updated] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40943: -- Affects Version/s: 3.4.0 (was: 3.3.1) > Make MSCK optional in MSCK

[jira] [Updated] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-40943: -- Issue Type: Improvement (was: Task) > Make MSCK optional in MSCK REPAIR TABLE commands >

[jira] [Created] (SPARK-42463) Clean up the third-party Java source code introduced by SPARK-27180

2023-02-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42463: Summary: Clean up the third-party Java source code introduced by SPARK-27180 Key: SPARK-42463 URL: https://issues.apache.org/jira/browse/SPARK-42463 Project: Spark

[jira] [Created] (SPARK-42462) Prevent `docker buildx` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42462: - Summary: Prevent `docker buildx` from publishing OCI manifests Key: SPARK-42462 URL: https://issues.apache.org/jira/browse/SPARK-42462 Project: Spark

[jira] [Updated] (SPARK-42462) Prevent `docker-image-tool.sh` from publishing OCI manifests

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42462: -- Summary: Prevent `docker-image-tool.sh` from publishing OCI manifests (was: Prevent `docker

[jira] [Resolved] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-40943. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38433

[jira] [Assigned] (SPARK-40943) Make MSCK optional in MSCK REPAIR TABLE commands

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-40943: - Assignee: Ben Zhang > Make MSCK optional in MSCK REPAIR TABLE commands >

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42447: Assignee: Apache Spark > Remove Hadoop 2 GitHub Action job >

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

2023-02-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688956#comment-17688956 ] Jungtaek Lim commented on SPARK-42376: -- [~alex-balikov] Thanks! We finally got here and I'd like to

[jira] [Commented] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks commented on SPARK-42359: --- I have a PR that implements this feature:

[jira] [Commented] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688938#comment-17688938 ] Apache Spark commented on SPARK-38324: -- User 'haoyanzhang' has created a pull request for this

[jira] [Commented] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688939#comment-17688939 ] Apache Spark commented on SPARK-42447: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42447: Assignee: (was: Apache Spark) > Remove Hadoop 2 GitHub Action job >

[jira] [Commented] (SPARK-41151) Keep built-in file _metadata column nullable value consistent

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688953#comment-17688953 ] Apache Spark commented on SPARK-41151: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Created] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42447: - Summary: Remove Hadoop 2 GitHub Action job Key: SPARK-42447 URL: https://issues.apache.org/jira/browse/SPARK-42447 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-42435) Update DataTables to 1.13.2

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42435: -- Assignee: Peter Toth > Update DataTables to 1.13.2 > --- > >

[jira] [Resolved] (SPARK-42435) Update DataTables to 1.13.2

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42435. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40014

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Created] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-42448: Summary: spark sql shell prompts wrong database info Key: SPARK-42448 URL: https://issues.apache.org/jira/browse/SPARK-42448 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Commented] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688916#comment-17688916 ] Apache Spark commented on SPARK-42446: -- User 'allanf-db' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42446: Assignee: (was: Apache Spark) > Updating PySpark documentation to enhance usability

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42446: Assignee: Apache Spark > Updating PySpark documentation to enhance usability >

[jira] [Updated] (SPARK-42227) Use approx_percentile function running slower than percentile in spark3

2023-02-15 Thread xuanzhiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuanzhiang updated SPARK-42227: --- Summary: Use approx_percentile function running slower than percentile in spark3 (was: Use

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42446: Assignee: Allan Folting > Updating PySpark documentation to enhance usability >

[jira] [Resolved] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42446. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40032

[jira] [Assigned] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42436: --- Assignee: Peter Toth > Improve multiTransform to generate alternatives dynamically >

[jira] [Resolved] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42436. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40016

[jira] [Resolved] (SPARK-42440) Implement First batch of Dataset APIs

2023-02-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42440. --- Fix Version/s: 3.4.0 Assignee: Herman van Hövell Resolution: Done >

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42447: Assignee: Dongjoon Hyun > Remove Hadoop 2 GitHub Action job >

[jira] [Resolved] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42447. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40034

[jira] [Resolved] (SPARK-42442) Use spark.sql.timestampType for data source inference

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42442. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40022

[jira] [Assigned] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42448: Assignee: (was: Apache Spark) > spark sql shell prompts wrong database info >

[jira] [Assigned] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42448: Assignee: Apache Spark > spark sql shell prompts wrong database info >

[jira] [Commented] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689023#comment-17689023 ] Apache Spark commented on SPARK-42448: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42405) Better documentation of array_insert function

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42405. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39975

[jira] [Comment Edited] (SPARK-42376) Introduce watermark propagation among operators

2023-02-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688956#comment-17688956 ] Jungtaek Lim edited comment on SPARK-42376 at 2/15/23 1:51 PM: ---

[jira] [Created] (SPARK-42451) Remove 3.1 and Java 17 condition check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42451: Summary: Remove 3.1 and Java 17 condition check from `testingVersions` in `HiveExternalCatalogVersionsSuite` Key: SPARK-42451 URL: https://issues.apache.org/jira/browse/SPARK-42451

[jira] [Created] (SPARK-42449) Fix `native-image.propertie` in Scala Client

2023-02-15 Thread Zhen Li (Jira)
Zhen Li created SPARK-42449: --- Summary: Fix `native-image.propertie` in Scala Client Key: SPARK-42449 URL: https://issues.apache.org/jira/browse/SPARK-42449 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Commented] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689214#comment-17689214 ] Apache Spark commented on SPARK-42451: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42451: Assignee: Apache Spark > Remove 3.1 and Java 17 check from filter condition of

[jira] [Assigned] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42451: Assignee: (was: Apache Spark) > Remove 3.1 and Java 17 check from filter condition

[jira] [Updated] (SPARK-42452) Remove hadoop-2 profile from Spark

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42452: - Description: SPARK-40651 Drop Hadoop2 binary distribtuion from release process and SPARK-42447 Remove

[jira] [Updated] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42452: - Summary: Remove hadoop-2 profile from Apache Spark (was: Remove hadoop-2 profile from Spark) > Remove

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689222#comment-17689222 ] Yang Jie commented on SPARK-42452: -- Is it time to clean up hadoop-2 profile ? [~dongjoon]  [~gurwls223] 

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: sql.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Created] (SPARK-42452) Remove hadoop-2 profile from Spark

2023-02-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42452: Summary: Remove hadoop-2 profile from Spark Key: SPARK-42452 URL: https://issues.apache.org/jira/browse/SPARK-42452 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-42399) CONV() silently overflows returning wrong results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42399: Assignee: Apache Spark > CONV() silently overflows returning wrong results >

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: stacktrace.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Created] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
Vadim created SPARK-42450: - Summary: dataset.where() omit quotes if where IN clause has more than 10 operands Key: SPARK-42450 URL: https://issues.apache.org/jira/browse/SPARK-42450 Project: Spark

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: java-code.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Updated] (SPARK-42449) Fix `native-image.propertie` in Scala Client

2023-02-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42449: Description: The content of `native-image.propertie` file is not correct. This file is used by GraalVM

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Commented] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689215#comment-17689215 ] Apache Spark commented on SPARK-42451: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-42399) CONV() silently overflows returning wrong results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689226#comment-17689226 ] Apache Spark commented on SPARK-42399: -- User 'NarekDW' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42399) CONV() silently overflows returning wrong results

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42399: Assignee: (was: Apache Spark) > CONV() silently overflows returning wrong results >

[jira] [Updated] (SPARK-42445) Fix SparkR install.spark function

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-42445: -- Fix Version/s: 3.3.3 > Fix SparkR install.spark function > -

[jira] [Resolved] (SPARK-42445) Fix SparkR install.spark function

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-42445. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40031

[jira] [Assigned] (SPARK-42445) Fix SparkR install.spark function

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-42445: - Assignee: Dongjoon Hyun > Fix SparkR install.spark function >

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Updated] (SPARK-42449) Fix `native-image.propertie` in Scala Client

2023-02-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42449: Description: The content of `native-image.propertie` file is not correct. This file is used to create a

[jira] [Updated] (SPARK-42451) Remove 3.1 and Java 17 check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42451: - Summary: Remove 3.1 and Java 17 check from `testingVersions` in `HiveExternalCatalogVersionsSuite`

[jira] [Updated] (SPARK-42451) Remove 3.1 and Java 17 check from filter condition of `testingVersions` in `HiveExternalCatalogVersionsSuite`

2023-02-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42451: - Summary: Remove 3.1 and Java 17 check from filter condition of `testingVersions` in

[jira] [Commented] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689307#comment-17689307 ] Apache Spark commented on SPARK-42453: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42453: Assignee: Apache Spark > Implement function max in Scala client >

[jira] [Assigned] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42453: Assignee: (was: Apache Spark) > Implement function max in Scala client >

[jira] [Resolved] (SPARK-40653) Protobuf Support in Structured Streaming

2023-02-15 Thread Raghu Angadi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi resolved SPARK-40653. -- Fix Version/s: 3.4.0 Resolution: Fixed Protobuf functions have been in use for couple

[jira] [Created] (SPARK-42454) SPJ: encapsulate all SPJ related parameters in BatchScanExec

2023-02-15 Thread Chao Sun (Jira)
Chao Sun created SPARK-42454: Summary: SPJ: encapsulate all SPJ related parameters in BatchScanExec Key: SPARK-42454 URL: https://issues.apache.org/jira/browse/SPARK-42454 Project: Spark Issue

[jira] [Created] (SPARK-42453) Implement function max in Scala client

2023-02-15 Thread Rui Wang (Jira)
Rui Wang created SPARK-42453: Summary: Implement function max in Scala client Key: SPARK-42453 URL: https://issues.apache.org/jira/browse/SPARK-42453 Project: Spark Issue Type: Task

[jira] [Resolved] (SPARK-42441) Scala Client - Implement Column API

2023-02-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42441. --- Fix Version/s: 3.4.0 Assignee: Herman van Hövell Resolution: Fixed

[jira] [Assigned] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42455: Assignee: Gengliang Wang (was: Apache Spark) > Rename JDBC option inferTimestampNTZType

[jira] [Assigned] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42455: Assignee: Apache Spark (was: Gengliang Wang) > Rename JDBC option inferTimestampNTZType

[jira] [Commented] (SPARK-39904) Rename inferDate to preferDate and fix an issue when inferring schema

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689349#comment-17689349 ] Apache Spark commented on SPARK-39904: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

2023-02-15 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-42455: -- Summary: Rename JDBC option inferTimestampNTZType as preferTimestampNTZ Key: SPARK-42455 URL: https://issues.apache.org/jira/browse/SPARK-42455 Project: Spark

[jira] [Commented] (SPARK-42455) Rename JDBC option inferTimestampNTZType as preferTimestampNTZ

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689343#comment-17689343 ] Apache Spark commented on SPARK-42455: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-42452) Remove hadoop-2 profile from Apache Spark

2023-02-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689354#comment-17689354 ] Dongjoon Hyun commented on SPARK-42452: --- Not yet~ I simply removed the broken one because no one

[jira] [Created] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Allan Folting (Jira)
Allan Folting created SPARK-42456: - Summary: Consolidating the PySpark version upgrade note pages into a single page to make it easier to read Key: SPARK-42456 URL:

[jira] [Updated] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Allan Folting (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allan Folting updated SPARK-42456: -- Description: Creating a new PySpark migration guide sub page and consolidating the existing

[jira] [Commented] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689365#comment-17689365 ] Apache Spark commented on SPARK-42456: -- User 'allanf-db' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42456: Assignee: Apache Spark > Consolidating the PySpark version upgrade note pages into a

[jira] [Assigned] (SPARK-42456) Consolidating the PySpark version upgrade note pages into a single page to make it easier to read

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42456: Assignee: (was: Apache Spark) > Consolidating the PySpark version upgrade note pages

  1   2   >