[jira] [Comment Edited] (SPARK-39784) Put Literal values on the right side of the data source filter after translating Catalyst Expression to data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569272#comment-17569272 ] Dongjoon Hyun edited comment on SPARK-39784 at 7/21/22 5:23 AM:

[jira] [Commented] (SPARK-39784) Put Literal values on the right side of the data source filter after translating Catalyst Expression to data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569272#comment-17569272 ] Dongjoon Hyun commented on SPARK-39784: --- [~huaxingao] . Please use the version of master branch

[jira] [Updated] (SPARK-39784) Put Literal values on the right side of the data source filter after translating Catalyst Expression to data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39784: -- Affects Version/s: 3.4.0 (was: 3.3.0) > Put Literal values on the

[jira] [Updated] (SPARK-39784) Put Literal values on the right side of the data source filter after translating Catalyst Expression to data source filter

[ https://issues.apache.org/jira/browse/SPARK-39784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39784: -- Summary: Put Literal values on the right side of the data source filter after translating

[jira] [Commented] (SPARK-39829) Upgrade log4j2 to 2.18.0

[ https://issues.apache.org/jira/browse/SPARK-39829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569266#comment-17569266 ] Apache Spark commented on SPARK-39829: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-39829) Upgrade log4j2 to 2.18.0

[ https://issues.apache.org/jira/browse/SPARK-39829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39829: Assignee: (was: Apache Spark) > Upgrade log4j2 to 2.18.0 >

[jira] [Assigned] (SPARK-39829) Upgrade log4j2 to 2.18.0

[ https://issues.apache.org/jira/browse/SPARK-39829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39829: Assignee: Apache Spark > Upgrade log4j2 to 2.18.0 > > >

[jira] [Commented] (SPARK-39829) Upgrade log4j2 to 2.18.0

[ https://issues.apache.org/jira/browse/SPARK-39829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569264#comment-17569264 ] Apache Spark commented on SPARK-39829: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-39829) Upgrade log4j2 to 2.18.0

Dongjoon Hyun created SPARK-39829: - Summary: Upgrade log4j2 to 2.18.0 Key: SPARK-39829 URL: https://issues.apache.org/jira/browse/SPARK-39829 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39553) Failed to remove shuffle ${shuffleId} - null when using Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39553: -- Environment: Scala 2.13.8 > Failed to remove shuffle ${shuffleId} - null when using Scala

[jira] [Updated] (SPARK-39553) Failed to remove shuffle ${shuffleId} - null when using Scala 2.13

[ https://issues.apache.org/jira/browse/SPARK-39553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39553: -- Affects Version/s: 3.3.0 3.2.1 > Failed to remove shuffle ${shuffleId}

[jira] [Comment Edited] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568937#comment-17568937 ] zhangdonglin edited comment on SPARK-38992 at 7/21/22 2:20 AM: ---  [~wypoon] 

[jira] [Assigned] (SPARK-39805) Deprecate Trigger.Once and Promote Trigger.AvailableNow

[ https://issues.apache.org/jira/browse/SPARK-39805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-39805: Assignee: Jungtaek Lim > Deprecate Trigger.Once and Promote Trigger.AvailableNow >

[jira] [Resolved] (SPARK-39805) Deprecate Trigger.Once and Promote Trigger.AvailableNow

[ https://issues.apache.org/jira/browse/SPARK-39805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-39805. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37213

[jira] [Updated] (SPARK-39810) Catalog.tableExists should handle nested namespace

[ https://issues.apache.org/jira/browse/SPARK-39810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated SPARK-39810: - Summary: Catalog.tableExists should handle nested namespace (was: tableExists can reuse getTable code)

[jira] [Commented] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569146#comment-17569146 ] Apache Spark commented on SPARK-39828: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39828: Assignee: Apache Spark > Catalog.listTables() should respect currentCatalog >

[jira] [Assigned] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39828: Assignee: (was: Apache Spark) > Catalog.listTables() should respect currentCatalog >

[jira] [Commented] (SPARK-39828) Catalog.listTables() should respect currentCatalog

[ https://issues.apache.org/jira/browse/SPARK-39828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569140#comment-17569140 ] Rui Wang commented on SPARK-39828: -- however it seems that temp table will not be checked. >

[jira] [Created] (SPARK-39828) Catalog.listTables() should respect currentCatalog

Rui Wang created SPARK-39828: Summary: Catalog.listTables() should respect currentCatalog Key: SPARK-39828 URL: https://issues.apache.org/jira/browse/SPARK-39828 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39827) add_months() returns a java error on overflow

[ https://issues.apache.org/jira/browse/SPARK-39827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39827: Assignee: Apache Spark (was: Max Gekk) > add_months() returns a java error on overflow

[jira] [Commented] (SPARK-39827) add_months() returns a java error on overflow

[ https://issues.apache.org/jira/browse/SPARK-39827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569004#comment-17569004 ] Apache Spark commented on SPARK-39827: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39827) add_months() returns a java error on overflow

[ https://issues.apache.org/jira/browse/SPARK-39827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39827: Assignee: Max Gekk (was: Apache Spark) > add_months() returns a java error on overflow

[jira] [Assigned] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

[ https://issues.apache.org/jira/browse/SPARK-39825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39825: Assignee: (was: Apache Spark) > Fix PushDownLeftSemiAntiJoin push through project >

[jira] [Commented] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

[ https://issues.apache.org/jira/browse/SPARK-39825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569002#comment-17569002 ] Apache Spark commented on SPARK-39825: -- User 'ulysses-you' has created a pull request for this

[jira] [Commented] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

[ https://issues.apache.org/jira/browse/SPARK-39825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569003#comment-17569003 ] Apache Spark commented on SPARK-39825: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

[ https://issues.apache.org/jira/browse/SPARK-39825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39825: Assignee: Apache Spark > Fix PushDownLeftSemiAntiJoin push through project >

[jira] [Created] (SPARK-39827) add_months() returns a java error on overflow

Max Gekk created SPARK-39827: Summary: add_months() returns a java error on overflow Key: SPARK-39827 URL: https://issues.apache.org/jira/browse/SPARK-39827 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group column)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568989#comment-17568989 ] Apache Spark commented on SPARK-39819: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group column)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39819: Assignee: Apache Spark > DS V2 aggregate push down can work with Top N or Paging (Sort

[jira] [Assigned] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group column)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39819: Assignee: (was: Apache Spark) > DS V2 aggregate push down can work with Top N or

[jira] [Assigned] (SPARK-39826) Bump scalatest-maven-plugin to 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-39826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39826: Assignee: Apache Spark > Bump scalatest-maven-plugin to 2.1.0 >

[jira] [Assigned] (SPARK-39826) Bump scalatest-maven-plugin to 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-39826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39826: Assignee: (was: Apache Spark) > Bump scalatest-maven-plugin to 2.1.0 >

[jira] [Commented] (SPARK-39826) Bump scalatest-maven-plugin to 2.1.0

[ https://issues.apache.org/jira/browse/SPARK-39826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568987#comment-17568987 ] Apache Spark commented on SPARK-39826: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-39826) Bump scalatest-maven-plugin to 2.1.0

BingKun Pan created SPARK-39826: --- Summary: Bump scalatest-maven-plugin to 2.1.0 Key: SPARK-39826 URL: https://issues.apache.org/jira/browse/SPARK-39826 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-39819) DS V2 aggregate push down can work with Top N or Paging (Sort with group column)

[ https://issues.apache.org/jira/browse/SPARK-39819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39819: --- Summary: DS V2 aggregate push down can work with Top N or Paging (Sort with group column) (was: DS

[jira] [Commented] (SPARK-37899) EliminateInnerJoin to support convert inner join to left semi join

[ https://issues.apache.org/jira/browse/SPARK-37899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568964#comment-17568964 ] Apache Spark commented on SPARK-37899: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-37899) EliminateInnerJoin to support convert inner join to left semi join

[ https://issues.apache.org/jira/browse/SPARK-37899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568963#comment-17568963 ] Apache Spark commented on SPARK-37899: -- User 'wangyum' has created a pull request for this issue:

[jira] [Created] (SPARK-39825) Fix PushDownLeftSemiAntiJoin push through project

XiDuo You created SPARK-39825: - Summary: Fix PushDownLeftSemiAntiJoin push through project Key: SPARK-39825 URL: https://issues.apache.org/jira/browse/SPARK-39825 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568937#comment-17568937 ] zhangdonglin edited comment on SPARK-38992 at 7/20/22 9:19 AM: ---  [~wypoon] 

[jira] [Commented] (SPARK-38992) Avoid using bash -c in ShellBasedGroupsMappingProvider

[ https://issues.apache.org/jira/browse/SPARK-38992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568937#comment-17568937 ] zhangdonglin commented on SPARK-38992: --  [~wypoon]   spark 2.4 also affected. but there are ways

[jira] [Assigned] (SPARK-39824) Introduce pushmask and where for pyspark pandas Index

[ https://issues.apache.org/jira/browse/SPARK-39824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39824: Assignee: (was: Apache Spark) > Introduce pushmask and where for pyspark pandas

[jira] [Assigned] (SPARK-39824) Introduce pushmask and where for pyspark pandas Index

[ https://issues.apache.org/jira/browse/SPARK-39824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39824: Assignee: Apache Spark > Introduce pushmask and where for pyspark pandas Index >

[jira] [Commented] (SPARK-39824) Introduce pushmask and where for pyspark pandas Index

[ https://issues.apache.org/jira/browse/SPARK-39824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568896#comment-17568896 ] Apache Spark commented on SPARK-39824: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Commented] (SPARK-39822) Provides a good error during create Index with different dtype elements

[ https://issues.apache.org/jira/browse/SPARK-39822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568893#comment-17568893 ] Apache Spark commented on SPARK-39822: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Created] (SPARK-39824) Introduce pushmask and where for pyspark pandas Index

bo zhao created SPARK-39824: --- Summary: Introduce pushmask and where for pyspark pandas Index Key: SPARK-39824 URL: https://issues.apache.org/jira/browse/SPARK-39824 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-39822) Provides a good error during create Index with different dtype elements

[ https://issues.apache.org/jira/browse/SPARK-39822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39822: Assignee: (was: Apache Spark) > Provides a good error during create Index with

[jira] [Commented] (SPARK-39822) Provides a good error during create Index with different dtype elements

[ https://issues.apache.org/jira/browse/SPARK-39822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568892#comment-17568892 ] Apache Spark commented on SPARK-39822: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Assigned] (SPARK-39822) Provides a good error during create Index with different dtype elements

[ https://issues.apache.org/jira/browse/SPARK-39822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39822: Assignee: Apache Spark > Provides a good error during create Index with different dtype

[jira] [Commented] (SPARK-39823) add DataFrame.as(StructType) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568890#comment-17568890 ] Apache Spark commented on SPARK-39823: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-39823) add DataFrame.as(StructType) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39823: Assignee: Apache Spark > add DataFrame.as(StructType) in PySpark >

[jira] [Assigned] (SPARK-39823) add DataFrame.as(StructType) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39823: Assignee: (was: Apache Spark) > add DataFrame.as(StructType) in PySpark >

[jira] [Commented] (SPARK-39823) add DataFrame.as(StructType) in PySpark

[ https://issues.apache.org/jira/browse/SPARK-39823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568889#comment-17568889 ] Apache Spark commented on SPARK-39823: -- User 'zhengruifeng' has created a pull request for this

[jira] [Created] (SPARK-39823) add DataFrame.as(StructType) in PySpark

Ruifeng Zheng created SPARK-39823: - Summary: add DataFrame.as(StructType) in PySpark Key: SPARK-39823 URL: https://issues.apache.org/jira/browse/SPARK-39823 Project: Spark Issue Type:

[jira] [Created] (SPARK-39822) Provides a good error during create Index with different dtype elements

bo zhao created SPARK-39822: --- Summary: Provides a good error during create Index with different dtype elements Key: SPARK-39822 URL: https://issues.apache.org/jira/browse/SPARK-39822 Project: Spark

[jira] [Resolved] (SPARK-39789) Remove unused method and redundant throw exception declare

[ https://issues.apache.org/jira/browse/SPARK-39789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-39789. - Resolution: Won't Fix > Remove unused method and redundant throw exception declare >

[jira] [Resolved] (SPARK-39790) Replace put element to map one by one to putAll, remove redundant new ArrayList

[ https://issues.apache.org/jira/browse/SPARK-39790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan resolved SPARK-39790. - Resolution: Won't Fix > Replace put element to map one by one to putAll, remove redundant new

[jira] [Commented] (SPARK-39821) DatetimeIndex error during pyspark session

[ https://issues.apache.org/jira/browse/SPARK-39821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568872#comment-17568872 ] Apache Spark commented on SPARK-39821: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Assigned] (SPARK-39821) DatetimeIndex error during pyspark session

[ https://issues.apache.org/jira/browse/SPARK-39821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39821: Assignee: Apache Spark > DatetimeIndex error during pyspark session >

[jira] [Assigned] (SPARK-39821) DatetimeIndex error during pyspark session

[ https://issues.apache.org/jira/browse/SPARK-39821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39821: Assignee: (was: Apache Spark) > DatetimeIndex error during pyspark session >

[jira] [Commented] (SPARK-39821) DatetimeIndex error during pyspark session

[ https://issues.apache.org/jira/browse/SPARK-39821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568874#comment-17568874 ] Apache Spark commented on SPARK-39821: -- User 'bzhaoopenstack' has created a pull request for this

[jira] [Created] (SPARK-39821) DatetimeIndex error during pyspark session

bo zhao created SPARK-39821: --- Summary: DatetimeIndex error during pyspark session Key: SPARK-39821 URL: https://issues.apache.org/jira/browse/SPARK-39821 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-39820) Add the Support for Custom Authentication for Thrift Server using Http Servlet Request input Param

[ https://issues.apache.org/jira/browse/SPARK-39820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568849#comment-17568849 ] Apache Spark commented on SPARK-39820: -- User 'SaurabhChawla100' has created a pull request for this

[jira] [Assigned] (SPARK-39820) Add the Support for Custom Authentication for Thrift Server using Http Servlet Request input Param

[ https://issues.apache.org/jira/browse/SPARK-39820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39820: Assignee: Apache Spark > Add the Support for Custom Authentication for Thrift Server

[jira] [Assigned] (SPARK-39820) Add the Support for Custom Authentication for Thrift Server using Http Servlet Request input Param

[ https://issues.apache.org/jira/browse/SPARK-39820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39820: Assignee: (was: Apache Spark) > Add the Support for Custom Authentication for Thrift

[jira] [Commented] (SPARK-39820) Add the Support for Custom Authentication for Thrift Server using Http Servlet Request input Param

[ https://issues.apache.org/jira/browse/SPARK-39820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17568848#comment-17568848 ] Apache Spark commented on SPARK-39820: -- User 'SaurabhChawla100' has created a pull request for this