[jira] [Created] (SPARK-39338) Remove dynamic pruning subquery if pruningKey's references is empty

2022-05-29 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-39338: --- Summary: Remove dynamic pruning subquery if pruningKey's references is empty Key: SPARK-39338 URL: https://issues.apache.org/jira/browse/SPARK-39338 Project: Spark

[jira] [Resolved] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

2022-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-37523. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36644 [https://gith

[jira] [Assigned] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified

2022-05-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-37523: --- Assignee: Huaxin Gao > Support optimize skewed partitions in Distribution and Ordering if

[jira] [Created] (SPARK-39337) Refactor DescribeTableExec

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39337: - Summary: Refactor DescribeTableExec Key: SPARK-39337 URL: https://issues.apache.org/jira/browse/SPARK-39337 Project: Spark Issue Type: Task Components: S

[jira] [Updated] (SPARK-39337) Refactor DescribeTableExec

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39337: -- Description: Repeated code, refactor the code. {code:java} private def addTableDetails(rows: Arra

[jira] [Commented] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543775#comment-17543775 ] Apache Spark commented on SPARK-39335: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39335: Assignee: Apache Spark > DescribeTableCommand should redact properties >

[jira] [Commented] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543774#comment-17543774 ] Apache Spark commented on SPARK-39335: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39335: Assignee: (was: Apache Spark) > DescribeTableCommand should redact properties > -

[jira] [Updated] (SPARK-39335) DescribeTableCommand should redact properties

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39335: -- Summary: DescribeTableCommand should redact properties (was: Redact table should redact properties)

[jira] [Created] (SPARK-39336) Redact table/partition properties

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39336: - Summary: Redact table/partition properties Key: SPARK-39336 URL: https://issues.apache.org/jira/browse/SPARK-39336 Project: Spark Issue Type: Task Compon

[jira] [Updated] (SPARK-39335) Redact table should redact properties

2022-05-29 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-39335: -- Parent: SPARK-39336 Issue Type: Sub-task (was: Task) > Redact table should redact properties

[jira] [Assigned] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39333: Assignee: Yang Jie > Change to use `foreach` when `map` produce no result > -

[jira] [Resolved] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39333. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36720 [https://gi

[jira] [Created] (SPARK-39335) Redact table should redact properties

2022-05-29 Thread angerszhu (Jira)
angerszhu created SPARK-39335: - Summary: Redact table should redact properties Key: SPARK-39335 URL: https://issues.apache.org/jira/browse/SPARK-39335 Project: Spark Issue Type: Task Co

[jira] [Assigned] (SPARK-39334) Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after upgrade hadoop to 3.3.3

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39334: Assignee: (was: Apache Spark) > Change to exclude `slf4j-reload4j` for `hadoop-minikd

[jira] [Commented] (SPARK-39334) Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after upgrade hadoop to 3.3.3

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543771#comment-17543771 ] Apache Spark commented on SPARK-39334: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39334) Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after upgrade hadoop to 3.3.3

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39334: Assignee: Apache Spark > Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after up

[jira] [Created] (SPARK-39334) Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after upgrade hadoop to 3.3.3

2022-05-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-39334: Summary: Change to exclude `slf4j-reload4j` for `hadoop-minikdc` after upgrade hadoop to 3.3.3 Key: SPARK-39334 URL: https://issues.apache.org/jira/browse/SPARK-39334 Project

[jira] [Commented] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543750#comment-17543750 ] Apache Spark commented on SPARK-39333: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39333: Assignee: (was: Apache Spark) > Change to use `foreach` when `map` produce no result

[jira] [Assigned] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39333: Assignee: Apache Spark > Change to use `foreach` when `map` produce no result > -

[jira] [Resolved] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39331. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36718 [https://gi

[jira] [Assigned] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39331: Assignee: Hyukjin Kwon > Flay test: StreamingListenerTests.test_listener_events > ---

[jira] [Created] (SPARK-39333) Change to use `foreach` when `map` produce no result

2022-05-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-39333: Summary: Change to use `foreach` when `map` produce no result Key: SPARK-39333 URL: https://issues.apache.org/jira/browse/SPARK-39333 Project: Spark Issue Type: Impr

[jira] [Commented] (SPARK-38819) Run Pandas on Spark with Pandas 1.4.x

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543746#comment-17543746 ] Hyukjin Kwon commented on SPARK-38819: -- Yeah, that sounds perfect. > Run Pandas on

[jira] [Commented] (SPARK-39293) The accumulator of ArrayAggregate should copy the intermediate result if string, struct, array, or map

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543745#comment-17543745 ] Hyukjin Kwon commented on SPARK-39293: -- Yeah I agree. > The accumulator of ArrayAg

[jira] [Resolved] (SPARK-39317) groupby.apply doc test failed when SPARK_CONF_ARROW_ENABLED disable

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39317. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36699 [https://gi

[jira] [Assigned] (SPARK-39317) groupby.apply doc test failed when SPARK_CONF_ARROW_ENABLED disable

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39317: Assignee: Yikun Jiang > groupby.apply doc test failed when SPARK_CONF_ARROW_ENABLED disab

[jira] [Resolved] (SPARK-39197) Implement `skipna` parameter of `GroupBy.all`

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39197. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36547 [https://gi

[jira] [Assigned] (SPARK-39197) Implement `skipna` parameter of `GroupBy.all`

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39197: Assignee: Xinrong Meng > Implement `skipna` parameter of `GroupBy.all` >

[jira] [Resolved] (SPARK-39303) timestamp type support precision, example: timestamp(3)

2022-05-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39303. -- Resolution: Invalid No response from the reporter. > timestamp type support precision, exampl

[jira] [Assigned] (SPARK-39332) Upgrade RoaringBitmap to 0.9.28

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39332: Assignee: (was: Apache Spark) > Upgrade RoaringBitmap to 0.9.28 > ---

[jira] [Assigned] (SPARK-39332) Upgrade RoaringBitmap to 0.9.28

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39332: Assignee: Apache Spark > Upgrade RoaringBitmap to 0.9.28 > --

[jira] [Commented] (SPARK-39332) Upgrade RoaringBitmap to 0.9.28

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543736#comment-17543736 ] Apache Spark commented on SPARK-39332: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-39332) Upgrade RoaringBitmap to 0.9.28

2022-05-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-39332: Summary: Upgrade RoaringBitmap to 0.9.28 Key: SPARK-39332 URL: https://issues.apache.org/jira/browse/SPARK-39332 Project: Spark Issue Type: Improvement Com

[jira] [Closed] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-39330. - > Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT > them` > --

[jira] [Resolved] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39330. --- Resolution: Duplicate This is resolved via SPARK-39265 > Flaky Test: `INSERT rows, ALTER TA

[jira] [Updated] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39330: -- Description: {code} INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them *** F

[jira] [Commented] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543733#comment-17543733 ] Apache Spark commented on SPARK-39331: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39331: Assignee: Apache Spark > Flay test: StreamingListenerTests.test_listener_events > ---

[jira] [Assigned] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39331: Assignee: (was: Apache Spark) > Flay test: StreamingListenerTests.test_listener_event

[jira] [Commented] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543732#comment-17543732 ] Apache Spark commented on SPARK-39331: -- User 'HyukjinKwon' has created a pull reque

[jira] [Updated] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39330: -- Description: {code} INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them *** F

[jira] [Updated] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39330: -- Description: {code} INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them *** F

[jira] [Updated] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39330: -- Description: {code} INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them *** F

[jira] [Created] (SPARK-39331) Flay test: StreamingListenerTests.test_listener_events

2022-05-29 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-39331: Summary: Flay test: StreamingListenerTests.test_listener_events Key: SPARK-39331 URL: https://issues.apache.org/jira/browse/SPARK-39331 Project: Spark Issue

[jira] [Created] (SPARK-39330) Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them`

2022-05-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39330: - Summary: Flaky Test: `INSERT rows, ALTER TABLE ADD COLUMNS with DEFAULTs, then SELECT them` Key: SPARK-39330 URL: https://issues.apache.org/jira/browse/SPARK-39330

[jira] [Updated] (SPARK-39329) Flaky Test: 'single listener, check trigger events are generated correctly`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39329: -- Description: {code} StreamingQueryListenerSuite: single listener, check trigger events are gen

[jira] [Created] (SPARK-39329) Flaky Test: 'single listener, check trigger events are generated correctly`

2022-05-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39329: - Summary: Flaky Test: 'single listener, check trigger events are generated correctly` Key: SPARK-39329 URL: https://issues.apache.org/jira/browse/SPARK-39329 Project

[jira] [Updated] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39328: -- Issue Type: Test (was: Improvement) > Flaky Test: `SPARK-37753: Inhibit broadcast in left out

[jira] [Created] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`

2022-05-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-39328: - Summary: Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side` Key: SPARK-39328 URL: https://issues.apache.org/

[jira] [Updated] (SPARK-39328) Flaky Test: `SPARK-37753: Inhibit broadcast in left outer join when there are many empty partitions on outer/left side`

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39328: -- Description: {code} SPARK-37753: Inhibit broadcast in left outer join when there are many empt

[jira] [Assigned] (SPARK-39323) Hide empty `taskResourceAssignments` from INFO log

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39323: - Assignee: Dongjoon Hyun > Hide empty `taskResourceAssignments` from INFO log >

[jira] [Resolved] (SPARK-39323) Hide empty `taskResourceAssignments` from INFO log

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39323. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36706 [https://

[jira] [Commented] (SPARK-33274) [SS] Fix job hang in cp mode when total cores less than total kafka partition

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543693#comment-17543693 ] Apache Spark commented on SPARK-33274: -- User 'warrenzhu25' has created a pull reque

[jira] [Commented] (SPARK-33274) [SS] Fix job hang in cp mode when total cores less than total kafka partition

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543692#comment-17543692 ] Apache Spark commented on SPARK-33274: -- User 'warrenzhu25' has created a pull reque

[jira] [Commented] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543645#comment-17543645 ] Apache Spark commented on SPARK-39062: -- User 'ivoson' has created a pull request fo

[jira] [Assigned] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39062: Assignee: (was: Apache Spark) > Add Standalone backend support for Stage Level Schedu

[jira] [Assigned] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39062: Assignee: Apache Spark > Add Standalone backend support for Stage Level Scheduling >

[jira] [Commented] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-05-29 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17543644#comment-17543644 ] Apache Spark commented on SPARK-39062: -- User 'ivoson' has created a pull request fo

[jira] [Updated] (SPARK-39327) ExecutorRollPolicy.ID should consider ID as a numerical number.

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39327: -- Fix Version/s: 3.3.1 (was: 3.3.0) > ExecutorRollPolicy.ID should consid

[jira] [Assigned] (SPARK-39327) ExecutorRollPolicy.ID should consider ID as a numerical number.

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39327: - Assignee: William Hyun > ExecutorRollPolicy.ID should consider ID as a numerical number

[jira] [Resolved] (SPARK-39327) ExecutorRollPolicy.ID should consider ID as a numerical number.

2022-05-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39327. --- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36715 [https://