[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486848#comment-17486848 ] Kazuyuki Tanimura commented on SPARK-36665: --- I saw the test case at [https://g

[jira] [Created] (SPARK-38101) MetadataFetchFailedException due to decommission block migrations

2022-02-03 Thread Emil Ejbyfeldt (Jira)
Emil Ejbyfeldt created SPARK-38101: -- Summary: MetadataFetchFailedException due to decommission block migrations Key: SPARK-38101 URL: https://issues.apache.org/jira/browse/SPARK-38101 Project: Spark

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486846#comment-17486846 ] L. C. Hsieh commented on SPARK-36665: - Thanks [~aokolnychyi]. That's good catch! I

[jira] [Comment Edited] (SPARK-38033) The structured streaming processing cannot be started because the commitId and offsetId are inconsistent

2022-02-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486839#comment-17486839 ] Jungtaek Lim edited comment on SPARK-38033 at 2/4/22, 6:29 AM: ---

[jira] [Commented] (SPARK-38033) The structured streaming processing cannot be started because the commitId and offsetId are inconsistent

2022-02-03 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486839#comment-17486839 ] Jungtaek Lim commented on SPARK-38033: -- It is actually ambiguous issue for Spark to

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Kazuyuki Tanimura (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486829#comment-17486829 ] Kazuyuki Tanimura commented on SPARK-36665: --- [~aokolnychyi] Thank you for brin

[jira] [Assigned] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38085: Assignee: (was: Apache Spark) > DataSource V2: Handle DELETE commands for group-based

[jira] [Assigned] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38085: Assignee: Apache Spark > DataSource V2: Handle DELETE commands for group-based sources >

[jira] [Commented] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486827#comment-17486827 ] Apache Spark commented on SPARK-38085: -- User 'aokolnychyi' has created a pull reque

[jira] [Commented] (SPARK-38061) security scan issue with htrace-core4-4.1.0-incubating

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486826#comment-17486826 ] Hyukjin Kwon commented on SPARK-38061: -- [~sujitbiswas], Firstly, your report does n

[jira] [Updated] (SPARK-38061) security scan issue with htrace-core4-4.1.0-incubating

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas updated SPARK-38061: - Affects Version/s: 3.2.1 > security scan issue with htrace-core4-4.1.0-incubating >

[jira] [Updated] (SPARK-38061) security scan issue with htrace-core4-4.1.0-incubating

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas updated SPARK-38061: - Summary: security scan issue with htrace-core4-4.1.0-incubating (was: security scan issue jacks

[jira] [Reopened] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas reopened SPARK-38061: -- htrace-core4-4.1.0-incubating causing multiple CRITICAL and HIGH CVEs > security scan issue jacks

[jira] [Comment Edited] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486819#comment-17486819 ] Anton Okolnychyi edited comment on SPARK-36665 at 2/4/22, 5:16 AM: ---

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486819#comment-17486819 ] Anton Okolnychyi commented on SPARK-36665: -- The proposed logic seems to behave

[jira] [Commented] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486817#comment-17486817 ] Anton Okolnychyi commented on SPARK-36665: -- [~kazuyukitanimura] [~viirya] I am

[jira] [Updated] (SPARK-36665) Add more Not operator optimizations

2022-02-03 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Okolnychyi updated SPARK-36665: - Attachment: Pasted Graphic 3.png > Add more Not operator optimizations > ---

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486803#comment-17486803 ] Hyukjin Kwon commented on SPARK-38061: -- Please reopen this JIRA after editing this

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486802#comment-17486802 ] Hyukjin Kwon commented on SPARK-38061: -- In addition, we do use Jackson with safe ve

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486801#comment-17486801 ] Hyukjin Kwon commented on SPARK-38061: -- [~sujitbiswas] please file a separate JIRA

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486791#comment-17486791 ] Sujit Biswas commented on SPARK-38061: --   *htrace-core4-4.1.0-incubating.jar* is a

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486777#comment-17486777 ] Hyukjin Kwon commented on SPARK-38061: -- [~sujitbiswas] Again, please file a separat

[jira] [Updated] (SPARK-38094) Parquet: enable matching schema columns by field id

2022-02-03 Thread Jackie Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jackie Zhang updated SPARK-38094: - Description: Field Id is a native field in the Parquet schema ([https://github.com/apache/parqu

[jira] [Updated] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas updated SPARK-38061: - Attachment: scan-security-report-spark-3.2.1-jre-11.csv > security scan issue jackson-databindin

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486741#comment-17486741 ] Sujit Biswas commented on SPARK-38061: -- Okay let’s take one issue at a time. For th

[jira] [Resolved] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-38100. Fix Version/s: 3.2.2 3.3 Resolution: Fixed > Remove unused method in `De

[jira] [Assigned] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao reassigned SPARK-38100: -- Assignee: Yang Jie > Remove unused method in `Decimal` > - >

[jira] [Assigned] (SPARK-38086) Make ArrowColumnVector Extendable

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38086: Assignee: (was: Apache Spark) > Make ArrowColumnVector Extendable > -

[jira] [Assigned] (SPARK-38086) Make ArrowColumnVector Extendable

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38086: Assignee: Apache Spark > Make ArrowColumnVector Extendable >

[jira] [Commented] (SPARK-38086) Make ArrowColumnVector Extendable

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486677#comment-17486677 ] Apache Spark commented on SPARK-38086: -- User 'kazuyukitanimura' has created a pull

[jira] [Commented] (SPARK-37980) Extend METADATA column to support row indices for file based data sources

2022-02-03 Thread Prakhar Jain (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486654#comment-17486654 ] Prakhar Jain commented on SPARK-37980: -- Thanks [~cloud_fan] [~lian cheng] for your

[jira] [Commented] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486646#comment-17486646 ] Apache Spark commented on SPARK-38100: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38100: Assignee: Apache Spark > Remove unused method in `Decimal` >

[jira] [Commented] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486645#comment-17486645 ] Apache Spark commented on SPARK-38100: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38100: Assignee: (was: Apache Spark) > Remove unused method in `Decimal` > -

[jira] [Created] (SPARK-38100) Remove unused method in `Decimal`

2022-02-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-38100: Summary: Remove unused method in `Decimal` Key: SPARK-38100 URL: https://issues.apache.org/jira/browse/SPARK-38100 Project: Spark Issue Type: Improvement C

[jira] [Updated] (SPARK-38096) Update sbt to 1.6.2

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38096: -- Affects Version/s: 3.3.0 (was: 3.2.1) > Update sbt to 1.6.2 > -

[jira] [Updated] (SPARK-38096) Update sbt to 1.6.2

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38096: -- Issue Type: Improvement (was: Task) > Update sbt to 1.6.2 > --- > >

[jira] [Updated] (SPARK-38096) Update sbt to 1.6.2

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38096: -- Summary: Update sbt to 1.6.2 (was: [BUILD] Update sbt to 1.6.2) > Update sbt to 1.6.2 > -

[jira] [Assigned] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38096: - Assignee: Martin Tzvetanov Grigorov > [BUILD] Update sbt to 1.6.2 > ---

[jira] [Resolved] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38096. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35388 [https://

[jira] [Resolved] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38014. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35310 [https://

[jira] [Assigned] (SPARK-38014) Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteBenchmark

2022-02-03 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38014: - Assignee: Yang Jie > Add Parquet Data Page V2 test scenario for BuiltInDataSourceWriteB

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486559#comment-17486559 ] Sujit Biswas commented on SPARK-38061: -- [~hyukjin.kwon]  how to download Spark 3.3

[jira] [Updated] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Sujit Biswas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sujit Biswas updated SPARK-38061: - Attachment: image-2022-02-03-08-02-29-071.png > security scan issue jackson-databinding HDFS dep

[jira] [Commented] (SPARK-38098) Support Array of Struct for Pandas UDFs

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486554#comment-17486554 ] Apache Spark commented on SPARK-38098: -- User 'LucaCanali' has created a pull reques

[jira] [Assigned] (SPARK-38098) Support Array of Struct for Pandas UDFs

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38098: Assignee: (was: Apache Spark) > Support Array of Struct for Pandas UDFs > ---

[jira] [Commented] (SPARK-38098) Support Array of Struct for Pandas UDFs

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486553#comment-17486553 ] Apache Spark commented on SPARK-38098: -- User 'LucaCanali' has created a pull reques

[jira] [Updated] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-03 Thread Laurens Versluis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens Versluis updated SPARK-38099: - Description: Running a query with an aggregation functions such as average on literal va

[jira] [Assigned] (SPARK-38098) Support Array of Struct for Pandas UDFs

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38098: Assignee: Apache Spark > Support Array of Struct for Pandas UDFs > --

[jira] [Updated] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-03 Thread Laurens Versluis (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laurens Versluis updated SPARK-38099: - Description: Running a query with an aggregation functions such as average on literal va

[jira] [Created] (SPARK-38099) Query using an aggregation on a literal value with an empty underlying dataframe returns null

2022-02-03 Thread Laurens Versluis (Jira)
Laurens Versluis created SPARK-38099: Summary: Query using an aggregation on a literal value with an empty underlying dataframe returns null Key: SPARK-38099 URL: https://issues.apache.org/jira/browse/SPARK-38

[jira] [Created] (SPARK-38098) Support Array of Struct for Pandas UDFs

2022-02-03 Thread Luca Canali (Jira)
Luca Canali created SPARK-38098: --- Summary: Support Array of Struct for Pandas UDFs Key: SPARK-38098 URL: https://issues.apache.org/jira/browse/SPARK-38098 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up

2022-02-03 Thread krishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483838#comment-17483838 ] krishna edited comment on SPARK-24156 at 2/3/22, 2:53 PM: -- Hi [

[jira] [Commented] (SPARK-37997) Allow query parameters to be passed into spark.read

2022-02-03 Thread Andy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486530#comment-17486530 ] Andy commented on SPARK-37997: -- I have a similar problem to this which I cannot seem to get

[jira] [Comment Edited] (SPARK-24156) Enable no-data micro batches for more eager streaming state clean up

2022-02-03 Thread krishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483838#comment-17483838 ] krishna edited comment on SPARK-24156 at 2/3/22, 2:48 PM: -- Hi [

[jira] [Commented] (SPARK-37936) Use error classes in the parsing errors of intervals

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486470#comment-17486470 ] Apache Spark commented on SPARK-37936: -- User 'senthh' has created a pull request fo

[jira] [Assigned] (SPARK-37941) Use error classes in the compilation errors of casting

2022-02-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37941: Assignee: huangtengfei > Use error classes in the compilation errors of casting > ---

[jira] [Resolved] (SPARK-37941) Use error classes in the compilation errors of casting

2022-02-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37941. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35366 [https://github.com

[jira] [Updated] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-38097: - Description: The error message from: {code:scala} test("Improve the error for pivoting of unsupported

[jira] [Resolved] (SPARK-37937) Use error classes in the parsing errors of lateral join

2022-02-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-37937. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35328 [https://github.com

[jira] [Assigned] (SPARK-37937) Use error classes in the parsing errors of lateral join

2022-02-03 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-37937: Assignee: Terry Kim > Use error classes in the parsing errors of lateral join > -

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

2022-02-03 Thread Charley Guillaume (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486391#comment-17486391 ] Charley Guillaume commented on SPARK-19335: --- This component would be of great

[jira] [Created] (SPARK-38097) Improve the error for pivoting of unsupported value types

2022-02-03 Thread Max Gekk (Jira)
Max Gekk created SPARK-38097: Summary: Improve the error for pivoting of unsupported value types Key: SPARK-38097 URL: https://issues.apache.org/jira/browse/SPARK-38097 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38059) Incorrect query ordering with flatMap() and distinct()

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38059. -- Resolution: Cannot Reproduce > Incorrect query ordering with flatMap() and distinct() > --

[jira] [Commented] (SPARK-38061) security scan issue jackson-databinding HDFS dependency library

2022-02-03 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486344#comment-17486344 ] Hyukjin Kwon commented on SPARK-38061: -- [~sujitbiswas] some changes are not backpor

[jira] [Commented] (SPARK-37943) Use error classes in the compilation errors of grouping

2022-02-03 Thread Saurabh Chawla (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486338#comment-17486338 ] Saurabh Chawla commented on SPARK-37943: [~maxgekk] - The entry for below groupi

[jira] [Assigned] (SPARK-37943) Use error classes in the compilation errors of grouping

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37943: Assignee: (was: Apache Spark) > Use error classes in the compilation errors of groupi

[jira] [Assigned] (SPARK-37943) Use error classes in the compilation errors of grouping

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37943: Assignee: Apache Spark > Use error classes in the compilation errors of grouping > --

[jira] [Assigned] (SPARK-37943) Use error classes in the compilation errors of grouping

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-37943: Assignee: Apache Spark > Use error classes in the compilation errors of grouping > --

[jira] [Commented] (SPARK-37943) Use error classes in the compilation errors of grouping

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486328#comment-17486328 ] Apache Spark commented on SPARK-37943: -- User 'SaurabhChawla100' has created a pull

[jira] [Updated] (SPARK-38091) AvroSerializer can cause java.lang.ClassCastException at run time

2022-02-03 Thread Zhenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhao Li updated SPARK-38091: --- Description: {{{}AvroSerializer{}}}'s implementation, at least in {{{}newConverter{}}}, was not 100

[jira] [Commented] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486317#comment-17486317 ] Apache Spark commented on SPARK-38096: -- User 'martin-g' has created a pull request

[jira] [Commented] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486315#comment-17486315 ] Apache Spark commented on SPARK-38096: -- User 'martin-g' has created a pull request

[jira] [Commented] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486305#comment-17486305 ] Apache Spark commented on SPARK-38096: -- User 'martin-g' has created a pull request

[jira] [Assigned] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38096: Assignee: (was: Apache Spark) > [BUILD] Update sbt to 1.6.2 > ---

[jira] [Commented] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17486304#comment-17486304 ] Apache Spark commented on SPARK-38096: -- User 'martin-g' has created a pull request

[jira] [Assigned] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38096: Assignee: Apache Spark > [BUILD] Update sbt to 1.6.2 > --- > >

[jira] [Created] (SPARK-38096) [BUILD] Update sbt to 1.6.2

2022-02-03 Thread Martin Tzvetanov Grigorov (Jira)
Martin Tzvetanov Grigorov created SPARK-38096: - Summary: [BUILD] Update sbt to 1.6.2 Key: SPARK-38096 URL: https://issues.apache.org/jira/browse/SPARK-38096 Project: Spark Issue T