[jira] [Commented] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513817#comment-17513817 ] Apache Spark commented on SPARK-30835: -- User 'abhishekd0907' has created a pull request for this

[jira] [Commented] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513816#comment-17513816 ] Apache Spark commented on SPARK-30835: -- User 'abhishekd0907' has created a pull request for this

[jira] [Assigned] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30835: Assignee: (was: Apache Spark) > Add support for YARN decommissioning & pre-emption >

[jira] [Assigned] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-30835: Assignee: Apache Spark > Add support for YARN decommissioning & pre-emption >

[jira] [Commented] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513815#comment-17513815 ] Apache Spark commented on SPARK-38633: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-30835) Add support for YARN decommissioning & pre-emption

2022-03-28 Thread Abhishek Dixit (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513813#comment-17513813 ] Abhishek Dixit commented on SPARK-30835:  A pull request for this issue:

[jira] [Commented] (SPARK-35253) Upgrade Janino from 3.0.16 to 3.1.4

2022-03-28 Thread Shardul Mahadik (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513801#comment-17513801 ] Shardul Mahadik commented on SPARK-35253: - Hi folks, what is the path forward for this ticket?

[jira] [Commented] (SPARK-32268) Bloom Filter Join

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513796#comment-17513796 ] Apache Spark commented on SPARK-32268: -- User 'ulysses-you' has created a pull request for this

[jira] [Resolved] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38633. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35947

[jira] [Assigned] (SPARK-38633) Support push down Cast to JDBC data source V2

2022-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38633: --- Assignee: jiaan.geng > Support push down Cast to JDBC data source V2 >

[jira] [Resolved] (SPARK-38656) Show options for Pandas API on Spark in UI

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38656. -- Fix Version/s: 3.3.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38680. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35996

[jira] [Assigned] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38680: Assignee: Hyukjin Kwon > Set upperbound for pandas-stubs in CI >

[jira] [Assigned] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38679: Assignee: Apache Spark > Expose the number partitions in a stage to TaskContext >

[jira] [Assigned] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38679: Assignee: (was: Apache Spark) > Expose the number partitions in a stage to

[jira] [Assigned] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38680: Assignee: Apache Spark > Set upperbound for pandas-stubs in CI >

[jira] [Commented] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513741#comment-17513741 ] Apache Spark commented on SPARK-38680: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38680: Assignee: (was: Apache Spark) > Set upperbound for pandas-stubs in CI >

[jira] [Commented] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513742#comment-17513742 ] Apache Spark commented on SPARK-38679: -- User 'vkorukanti' has created a pull request for this

[jira] [Created] (SPARK-38680) Set upperbound for pandas-stubs in CI

2022-03-28 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-38680: Summary: Set upperbound for pandas-stubs in CI Key: SPARK-38680 URL: https://issues.apache.org/jira/browse/SPARK-38680 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Venki Korukanti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Venki Korukanti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Updated] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Venki Korukanti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venki Korukanti updated SPARK-38679: Description: Add a new api to expose total partition count in the stage belonging to the

[jira] [Commented] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513727#comment-17513727 ] Hyukjin Kwon commented on SPARK-38677: -- Thanks for the analysis, [~tgraves]. taking a look now. >

[jira] [Created] (SPARK-38679) Expose the number partitions in a stage to TaskContext

2022-03-28 Thread Venki Korukanti (Jira)
Venki Korukanti created SPARK-38679: --- Summary: Expose the number partitions in a stage to TaskContext Key: SPARK-38679 URL: https://issues.apache.org/jira/browse/SPARK-38679 Project: Spark

[jira] [Updated] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38673: - Priority: Trivial (was: Minor) > Replace java assert with Junit api in Java UTs >

[jira] [Updated] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-38673: - Issue Type: Improvement (was: Bug) > Replace java assert with Junit api in Java UTs >

[jira] [Assigned] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38673: Assignee: Yang Jie > Replace java assert with Junit api in Java UTs >

[jira] [Resolved] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38673. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35987

[jira] [Assigned] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38678: - Assignee: Dongjoon Hyun > Enable RocksDB tests on Apple Silicon on MacOS >

[jira] [Resolved] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38678. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35993

[jira] [Assigned] (SPARK-38605) Retrying on file manager operation in HDFSMetadataLog

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38605: Assignee: (was: Apache Spark) > Retrying on file manager operation in

[jira] [Assigned] (SPARK-38605) Retrying on file manager operation in HDFSMetadataLog

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38605: Assignee: Apache Spark > Retrying on file manager operation in HDFSMetadataLog >

[jira] [Commented] (SPARK-38605) Retrying on file manager operation in HDFSMetadataLog

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513643#comment-17513643 ] Apache Spark commented on SPARK-38605: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513590#comment-17513590 ] Apache Spark commented on SPARK-38678: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38678: Assignee: Apache Spark > Enable RocksDB tests on Apple Silicon on MacOS >

[jira] [Assigned] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38678: Assignee: (was: Apache Spark) > Enable RocksDB tests on Apple Silicon on MacOS >

[jira] [Created] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

2022-03-28 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38678: - Summary: Enable RocksDB tests on Apple Silicon on MacOS Key: SPARK-38678 URL: https://issues.apache.org/jira/browse/SPARK-38678 Project: Spark Issue Type:

[jira] [Updated] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-03-28 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38677: -- Description: In spark 3.2.1 (spark 3.2.0 doesn't show this issue), pyspark will hang when

[jira] [Commented] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-03-28 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513536#comment-17513536 ] Thomas Graves commented on SPARK-38677: --- Note, if you kill the python.daemon process while its

[jira] [Updated] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-03-28 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-38677: -- Affects Version/s: 3.3.0 > pyspark hangs in local mode running rdd map operation >

[jira] [Created] (SPARK-38677) pyspark hangs in local mode running rdd map operation

2022-03-28 Thread Thomas Graves (Jira)
Thomas Graves created SPARK-38677: - Summary: pyspark hangs in local mode running rdd map operation Key: SPARK-38677 URL: https://issues.apache.org/jira/browse/SPARK-38677 Project: Spark

[jira] [Resolved] (SPARK-38257) Upgrade rocksdbjni to 7.0.3

2022-03-28 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38257. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35580

[jira] [Assigned] (SPARK-38676) Provide query context in runtime error of Add/Subtract/Multiply

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38676: Assignee: Gengliang Wang (was: Apache Spark) > Provide query context in runtime error

[jira] [Commented] (SPARK-38676) Provide query context in runtime error of Add/Subtract/Multiply

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513438#comment-17513438 ] Apache Spark commented on SPARK-38676: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-38676) Provide query context in runtime error of Add/Subtract/Multiply

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38676: Assignee: Apache Spark (was: Gengliang Wang) > Provide query context in runtime error

[jira] [Created] (SPARK-38676) Provide query context in runtime error of Add/Subtract/Multiply

2022-03-28 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-38676: -- Summary: Provide query context in runtime error of Add/Subtract/Multiply Key: SPARK-38676 URL: https://issues.apache.org/jira/browse/SPARK-38676 Project: Spark

[jira] [Commented] (SPARK-38675) Race condition in BlockInfoManager during unlock

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513392#comment-17513392 ] Apache Spark commented on SPARK-38675: -- User 'hvanhovell' has created a pull request for this

[jira] [Updated] (SPARK-37853) Clean up deprecation compilation warning related to log4j2

2022-03-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-37853: - Priority: Trivial (was: Minor) > Clean up deprecation compilation warning related to log4j2 >

[jira] [Commented] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513318#comment-17513318 ] Apache Spark commented on SPARK-38639: -- User 'TonyDoen' has created a pull request for this issue:

[jira] [Commented] (SPARK-38639) Support ignoreCorruptRecord flag to ensure querying broken sequence file table smoothly

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513316#comment-17513316 ] Apache Spark commented on SPARK-38639: -- User 'TonyDoen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38673: Assignee: Apache Spark > Replace java assert with Junit api in Java UTs >

[jira] [Assigned] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38673: Assignee: (was: Apache Spark) > Replace java assert with Junit api in Java UTs >

[jira] [Created] (SPARK-38675) Race condition in BlockInfoManager during unlock

2022-03-28 Thread Jira
Herman van Hövell created SPARK-38675: - Summary: Race condition in BlockInfoManager during unlock Key: SPARK-38675 URL: https://issues.apache.org/jira/browse/SPARK-38675 Project: Spark

[jira] [Commented] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513302#comment-17513302 ] Apache Spark commented on SPARK-38674: -- User 'wangyum' has created a pull request for this issue:

[jira] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674 ] Yuming Wang deleted comment on SPARK-38674: - was (Author: q79969786): https://github.com/apache/spark/pull/35989 > Remove useless deduplicate in SubqueryBroadcastExec >

[jira] [Commented] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513300#comment-17513300 ] Apache Spark commented on SPARK-38674: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513301#comment-17513301 ] Yuming Wang commented on SPARK-38674: - https://github.com/apache/spark/pull/35989 > Remove useless

[jira] [Assigned] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38674: Assignee: (was: Apache Spark) > Remove useless deduplicate in SubqueryBroadcastExec

[jira] [Assigned] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38674: Assignee: Apache Spark > Remove useless deduplicate in SubqueryBroadcastExec >

[jira] [Updated] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-38674: Description: Distinct performance:

[jira] [Resolved] (SPARK-38671) Publish snapshot from branch-3.3

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38671. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 35986

[jira] [Assigned] (SPARK-38671) Publish snapshot from branch-3.3

2022-03-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38671: Assignee: Yuming Wang > Publish snapshot from branch-3.3 >

[jira] [Commented] (SPARK-38432) Refactor framework so as JDBC dialect could compile filter by self way

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513248#comment-17513248 ] Apache Spark commented on SPARK-38432: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-38674) Remove useless deduplicate in SubqueryBroadcastExec

2022-03-28 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-38674: --- Summary: Remove useless deduplicate in SubqueryBroadcastExec Key: SPARK-38674 URL: https://issues.apache.org/jira/browse/SPARK-38674 Project: Spark Issue

[jira] [Commented] (SPARK-37673) Implement `ps.timedelta_range` method

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513179#comment-17513179 ] Apache Spark commented on SPARK-37673: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-37673) Implement `ps.timedelta_range` method

2022-03-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513178#comment-17513178 ] Apache Spark commented on SPARK-37673: -- User 'LuciferYang' has created a pull request for this

[jira] [Resolved] (SPARK-38672) Kafka, spark data frame read fails when a message does not exist for the timestamp in all partitions

2022-03-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-38672. -- Resolution: Invalid > Kafka, spark data frame read fails when a message does not exist for

[jira] [Commented] (SPARK-38672) Kafka, spark data frame read fails when a message does not exist for the timestamp in all partitions

2022-03-28 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17513175#comment-17513175 ] Jungtaek Lim commented on SPARK-38672: -- Could you please add the option

[jira] [Updated] (SPARK-38655) OffsetWindowFunctionFrameBase cannot find the offset row whose input is not null

2022-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-38655: Fix Version/s: 3.2.2 > OffsetWindowFunctionFrameBase cannot find the offset row whose input is

[jira] [Resolved] (SPARK-38655) OffsetWindowFunctionFrameBase cannot find the offset row whose input is not null

2022-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38655. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 35971

[jira] [Assigned] (SPARK-38655) OffsetWindowFunctionFrameBase cannot find the offset row whose input is not null

2022-03-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38655: --- Assignee: jiaan.geng > OffsetWindowFunctionFrameBase cannot find the offset row whose

[jira] [Created] (SPARK-38673) Replace java assert with Junit api in Java UTs

2022-03-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-38673: Summary: Replace java assert with Junit api in Java UTs Key: SPARK-38673 URL: https://issues.apache.org/jira/browse/SPARK-38673 Project: Spark Issue Type: Bug