[jira] [Created] (SPARK-36797) Union should resolve nested columns as top-level columns

2021-09-18 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-36797: --- Summary: Union should resolve nested columns as top-level columns Key: SPARK-36797 URL: https://issues.apache.org/jira/browse/SPARK-36797 Project: Spark Issue

[jira] [Assigned] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

2021-09-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-36772: -- Assignee: Ye Zhou > FinalizeShuffleMerge fails with an exception due to attempt id no

[jira] [Resolved] (SPARK-36772) FinalizeShuffleMerge fails with an exception due to attempt id not matching

2021-09-18 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-36772. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34018 [https:

[jira] [Commented] (SPARK-36797) Union should resolve nested columns as top-level columns

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417069#comment-17417069 ] Apache Spark commented on SPARK-36797: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-36797) Union should resolve nested columns as top-level columns

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36797: Assignee: Apache Spark > Union should resolve nested columns as top-level columns > -

[jira] [Assigned] (SPARK-36797) Union should resolve nested columns as top-level columns

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36797: Assignee: (was: Apache Spark) > Union should resolve nested columns as top-level colu

[jira] [Created] (SPARK-36798) When SparkContext is stopped, metrics system should be flushed after listeners have finished processing

2021-09-18 Thread Harsh Panchal (Jira)
Harsh Panchal created SPARK-36798: - Summary: When SparkContext is stopped, metrics system should be flushed after listeners have finished processing Key: SPARK-36798 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Assigned] (SPARK-36798) When SparkContext is stopped, metrics system should be flushed after listeners have finished processing

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36798: Assignee: Apache Spark > When SparkContext is stopped, metrics system should be flushed a

[jira] [Assigned] (SPARK-36798) When SparkContext is stopped, metrics system should be flushed after listeners have finished processing

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36798: Assignee: (was: Apache Spark) > When SparkContext is stopped, metrics system should b

[jira] [Commented] (SPARK-36798) When SparkContext is stopped, metrics system should be flushed after listeners have finished processing

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417093#comment-17417093 ] Apache Spark commented on SPARK-36798: -- User 'BOOTMGR' has created a pull request f

[jira] [Commented] (SPARK-36798) When SparkContext is stopped, metrics system should be flushed after listeners have finished processing

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417094#comment-17417094 ] Apache Spark commented on SPARK-36798: -- User 'BOOTMGR' has created a pull request f

[jira] [Resolved] (SPARK-25936) InsertIntoDataSourceCommand does not use Cached Data

2021-09-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-25936. - Resolution: Not A Bug > InsertIntoDataSourceCommand does not use Cached Data > -

[jira] [Commented] (SPARK-36701) Structured streaming maxOffsetsPerTrigger Invalidation

2021-09-18 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417122#comment-17417122 ] liujinhui commented on SPARK-36701: --- Can anyone help me, please ping me if you need mo

[jira] [Assigned] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36785: Assignee: Apache Spark > Fix ps.DataFrame.isin > - > >

[jira] [Commented] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417185#comment-17417185 ] Apache Spark commented on SPARK-36785: -- User 'dgd-contributor' has created a pull r

[jira] [Assigned] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36785: Assignee: (was: Apache Spark) > Fix ps.DataFrame.isin > - > >

[jira] [Commented] (SPARK-36785) Fix ps.DataFrame.isin

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417186#comment-17417186 ] Apache Spark commented on SPARK-36785: -- User 'dgd-contributor' has created a pull r

[jira] [Created] (SPARK-36799) Pass queryExecution name in CLI when only select query

2021-09-18 Thread dzcxzl (Jira)
dzcxzl created SPARK-36799: -- Summary: Pass queryExecution name in CLI when only select query Key: SPARK-36799 URL: https://issues.apache.org/jira/browse/SPARK-36799 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-36799) Pass queryExecution name in CLI when only select query

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417198#comment-17417198 ] Apache Spark commented on SPARK-36799: -- User 'cxzl25' has created a pull request fo

[jira] [Assigned] (SPARK-36799) Pass queryExecution name in CLI when only select query

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36799: Assignee: (was: Apache Spark) > Pass queryExecution name in CLI when only select quer

[jira] [Assigned] (SPARK-36799) Pass queryExecution name in CLI when only select query

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36799: Assignee: Apache Spark > Pass queryExecution name in CLI when only select query > ---

[jira] [Commented] (SPARK-36799) Pass queryExecution name in CLI when only select query

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417200#comment-17417200 ] Apache Spark commented on SPARK-36799: -- User 'cxzl25' has created a pull request fo

[jira] [Commented] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417232#comment-17417232 ] Apache Spark commented on SPARK-35985: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-35985) File source V2 ignores partition filters when empty readDataSchema

2021-09-18 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417233#comment-17417233 ] Apache Spark commented on SPARK-35985: -- User 'huaxingao' has created a pull request

[jira] [Commented] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17417234#comment-17417234 ] L. C. Hsieh commented on SPARK-36776: - This is duplicated to SPARK-35985. We just ne

[jira] [Resolved] (SPARK-36776) Partition filter of DataSourceV2ScanRelation can not push down when select none dataSchema from FileScan

2021-09-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-36776. - Resolution: Duplicate > Partition filter of DataSourceV2ScanRelation can not push down when sele

[jira] [Updated] (SPARK-36790) Update user-facing catalog to adapt CatalogPlugin

2021-09-18 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-36790: Issue Type: Improvement (was: Task) > Update user-facing catalog to adapt CatalogPlugin > ---