[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: sql.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Updated] (SPARK-42449) Fix `native-image.propertie` in Scala Client

2023-02-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-42449: Description: The content of `native-image.propertie` file is not correct. This file is used by GraalVM

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Description: dataset.where()/filter() omit string quotes if where IN clause has more than 10 operands. With

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: stacktrace.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Updated] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vadim updated SPARK-42450: -- Attachment: java-code.txt > dataset.where() omit quotes if where IN clause has more than 10 operands >

[jira] [Created] (SPARK-42450) dataset.where() omit quotes if where IN clause has more than 10 operands

2023-02-15 Thread Vadim (Jira)
Vadim created SPARK-42450: - Summary: dataset.where() omit quotes if where IN clause has more than 10 operands Key: SPARK-42450 URL: https://issues.apache.org/jira/browse/SPARK-42450 Project: Spark

[jira] [Created] (SPARK-42449) Fix `native-image.propertie` in Scala Client

2023-02-15 Thread Zhen Li (Jira)
Zhen Li created SPARK-42449: --- Summary: Fix `native-image.propertie` in Scala Client Key: SPARK-42449 URL: https://issues.apache.org/jira/browse/SPARK-42449 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-42440) Implement First batch of Dataset APIs

2023-02-15 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-42440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-42440. --- Fix Version/s: 3.4.0 Assignee: Herman van Hövell Resolution: Done >

[jira] [Comment Edited] (SPARK-42376) Introduce watermark propagation among operators

2023-02-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688956#comment-17688956 ] Jungtaek Lim edited comment on SPARK-42376 at 2/15/23 1:51 PM: ---

[jira] [Resolved] (SPARK-42405) Better documentation of array_insert function

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42405. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39975

[jira] [Assigned] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-42436: --- Assignee: Peter Toth > Improve multiTransform to generate alternatives dynamically >

[jira] [Resolved] (SPARK-42436) Improve multiTransform to generate alternatives dynamically

2023-02-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-42436. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40016

[jira] [Resolved] (SPARK-42442) Use spark.sql.timestampType for data source inference

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42442. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40022

[jira] [Resolved] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42446. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 40032

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42446: Assignee: Allan Folting > Updating PySpark documentation to enhance usability >

[jira] [Resolved] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42447. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40034

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42447: Assignee: Dongjoon Hyun > Remove Hadoop 2 GitHub Action job >

[jira] [Updated] (SPARK-42227) Use approx_percentile function running slower than percentile in spark3

2023-02-15 Thread xuanzhiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuanzhiang updated SPARK-42227: --- Summary: Use approx_percentile function running slower than percentile in spark3 (was: Use

[jira] [Commented] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689023#comment-17689023 ] Apache Spark commented on SPARK-42448: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42448: Assignee: Apache Spark > spark sql shell prompts wrong database info >

[jira] [Assigned] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42448: Assignee: (was: Apache Spark) > spark sql shell prompts wrong database info >

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Created] (SPARK-42448) spark sql shell prompts wrong database info

2023-02-15 Thread Kent Yao (Jira)
Kent Yao created SPARK-42448: Summary: spark sql shell prompts wrong database info Key: SPARK-42448 URL: https://issues.apache.org/jira/browse/SPARK-42448 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Comment Edited] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks edited comment on SPARK-42359 at 2/15/23 10:23 AM: -

[jira] [Commented] (SPARK-42359) Support row skipping when reading CSV files

2023-02-15 Thread Ted Chester Jenks (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17689008#comment-17689008 ] Ted Chester Jenks commented on SPARK-42359: --- I have a PR that implements this feature:

[jira] [Commented] (SPARK-42376) Introduce watermark propagation among operators

2023-02-15 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688956#comment-17688956 ] Jungtaek Lim commented on SPARK-42376: -- [~alex-balikov] Thanks! We finally got here and I'd like to

[jira] [Commented] (SPARK-41151) Keep built-in file _metadata column nullable value consistent

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688953#comment-17688953 ] Apache Spark commented on SPARK-41151: -- User 'Yaohua628' has created a pull request for this issue:

[jira] [Resolved] (SPARK-42435) Update DataTables to 1.13.2

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-42435. Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40014

[jira] [Assigned] (SPARK-42435) Update DataTables to 1.13.2

2023-02-15 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-42435: -- Assignee: Peter Toth > Update DataTables to 1.13.2 > --- > >

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42447: Assignee: Apache Spark > Remove Hadoop 2 GitHub Action job >

[jira] [Assigned] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42447: Assignee: (was: Apache Spark) > Remove Hadoop 2 GitHub Action job >

[jira] [Commented] (SPARK-38324) The second range is not [0, 59] in the day time ANSI interval

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688938#comment-17688938 ] Apache Spark commented on SPARK-38324: -- User 'haoyanzhang' has created a pull request for this

[jira] [Commented] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688939#comment-17688939 ] Apache Spark commented on SPARK-42447: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-42447) Remove Hadoop 2 GitHub Action job

2023-02-15 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-42447: - Summary: Remove Hadoop 2 GitHub Action job Key: SPARK-42447 URL: https://issues.apache.org/jira/browse/SPARK-42447 Project: Spark Issue Type: Test

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42446: Assignee: Apache Spark > Updating PySpark documentation to enhance usability >

[jira] [Assigned] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-42446: Assignee: (was: Apache Spark) > Updating PySpark documentation to enhance usability

[jira] [Commented] (SPARK-42446) Updating PySpark documentation to enhance usability

2023-02-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17688916#comment-17688916 ] Apache Spark commented on SPARK-42446: -- User 'allanf-db' has created a pull request for this issue:

<    1   2