[jira] [Assigned] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33911: Assignee: (was: Apache Spark) > Update SQL migration guide about changes in

[jira] [Commented] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254759#comment-17254759 ] Apache Spark commented on SPARK-33911: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33911: Assignee: Apache Spark > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.0.2 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 2.4.8 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: 3.1.0 > Update SQL migration guide about changes in HiveClientImpl >

[jira] [Created] (SPARK-33912) Refactor DependencyUtils ivy property parameter

2020-12-24 Thread angerszhu (Jira)
angerszhu created SPARK-33912: - Summary: Refactor DependencyUtils ivy property parameter Key: SPARK-33912 URL: https://issues.apache.org/jira/browse/SPARK-33912 Project: Spark Issue Type:

[jira] [Updated] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33911: --- Affects Version/s: (was: 2.4.8) (was: 3.1.0) > Update SQL migration

[jira] [Created] (SPARK-33911) Update SQL migration guide about changes in HiveClientImpl

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33911: -- Summary: Update SQL migration guide about changes in HiveClientImpl Key: SPARK-33911 URL: https://issues.apache.org/jira/browse/SPARK-33911 Project: Spark Issue

[jira] [Updated] (SPARK-33910) Simplify conditional

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: Simplify CaseWhen/If conditionals. We can improve these cases: 1. Reduce read

[jira] [Updated] (SPARK-33910) Simplify conditional

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33910: Description: Simplify CaseWhen/If with EqualTo if all values are Literal and always false, this

[jira] [Updated] (SPARK-33884) Simplify conditional if all branches are foldable boolean type

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33884: Summary: Simplify conditional if all branches are foldable boolean type (was: Simplify CaseWhen

[jira] [Updated] (SPARK-33798) Add new rule to push down the foldable expressions through CaseWhen/If

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33798: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Add new rule to push down

[jira] [Updated] (SPARK-33845) Improve SimplifyConditionals

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33845: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Improve

[jira] [Updated] (SPARK-33847) Replace None of elseValue inside CaseWhen if all branches are FalseLiteral

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33847: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Replace None of elseValue

[jira] [Updated] (SPARK-33848) Push the cast into (if / case) branches

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33848: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Push the cast into (if /

[jira] [Updated] (SPARK-33861) Simplify conditional in predicate

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33861: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Simplify conditional in

[jira] [Updated] (SPARK-33884) Simplify CaseWhen when one clause is null and another is boolean

2020-12-24 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-33884: Parent: SPARK-33910 Issue Type: Sub-task (was: Improvement) > Simplify CaseWhen when one

[jira] [Created] (SPARK-33910) Simplify conditional

2020-12-24 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-33910: --- Summary: Simplify conditional Key: SPARK-33910 URL: https://issues.apache.org/jira/browse/SPARK-33910 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254735#comment-17254735 ] Apache Spark commented on SPARK-33804: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33804: Assignee: (was: Apache Spark) > Cleanup "view bounds are deprecated" compilation

[jira] [Assigned] (SPARK-33804) Cleanup "view bounds are deprecated" compilation warnings

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33804: Assignee: Apache Spark > Cleanup "view bounds are deprecated" compilation warnings >

[jira] [Assigned] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33909: Assignee: (was: Apache Spark) > Check rand functions seed is legal at analyer side >

[jira] [Commented] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254730#comment-17254730 ] Apache Spark commented on SPARK-33909: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33909: Assignee: Apache Spark > Check rand functions seed is legal at analyer side >

[jira] [Commented] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254731#comment-17254731 ] Apache Spark commented on SPARK-33909: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33908: Assignee: Apache Spark > Refact SparkSubmitUtils.resolveMavenCoordinates return

[jira] [Assigned] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33908: Assignee: (was: Apache Spark) > Refact SparkSubmitUtils.resolveMavenCoordinates

[jira] [Commented] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254720#comment-17254720 ] Apache Spark commented on SPARK-33908: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-33909: Description: It's better to check seed expression is legal at analyzer side instead of execution.

[jira] [Updated] (SPARK-33909) Check rand functions seed is legal at analyer side

2020-12-24 Thread ulysses you (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ulysses you updated SPARK-33909: Summary: Check rand functions seed is legal at analyer side (was: Check rand functions seed data

[jira] [Created] (SPARK-33909) Check rand functions seed data type at analyer side

2020-12-24 Thread ulysses you (Jira)
ulysses you created SPARK-33909: --- Summary: Check rand functions seed data type at analyer side Key: SPARK-33909 URL: https://issues.apache.org/jira/browse/SPARK-33909 Project: Spark Issue

[jira] [Created] (SPARK-33908) Refact SparkSubmitUtils.resolveMavenCoordinates return parameter

2020-12-24 Thread angerszhu (Jira)
angerszhu created SPARK-33908: - Summary: Refact SparkSubmitUtils.resolveMavenCoordinates return parameter Key: SPARK-33908 URL: https://issues.apache.org/jira/browse/SPARK-33908 Project: Spark

[jira] [Resolved] (SPARK-33084) Add jar support ivy path

2020-12-24 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-33084. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolve by

[jira] [Assigned] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30027: - Assignee: Takeshi Yamamuro > Support codegen for filter exprs in HashAggregateExec >

[jira] [Resolved] (SPARK-30027) Support codegen for filter exprs in HashAggregateExec

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30027. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 27019

[jira] [Resolved] (SPARK-33857) Unify random functions and make Uuid Shuffle support seed in SQL

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33857. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30864

[jira] [Assigned] (SPARK-33857) Unify random functions and make Uuid Shuffle support seed in SQL

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33857: - Assignee: ulysses you > Unify random functions and make Uuid Shuffle support seed in

[jira] [Resolved] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33907. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30921

[jira] [Commented] (SPARK-31685) Spark structured streaming with Kafka fails with HDFS_DELEGATION_TOKEN expiration issue

2020-12-24 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254670#comment-17254670 ] Jim Huang commented on SPARK-31685: --- Thanks Rajeev for all the work you have done on this ticket so

[jira] [Commented] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254669#comment-17254669 ] Baohe Zhang commented on SPARK-33906: - The more underlay reason seems to be that the stage complete

[jira] [Commented] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254668#comment-17254668 ] Baohe Zhang commented on SPARK-33906: - [~dongjoon] Yes. > SPARK UI Executors page stuck when

[jira] [Commented] (SPARK-23432) Expose executor memory metrics in the web UI for executors

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254667#comment-17254667 ] Dongjoon Hyun commented on SPARK-23432: --- SPARK-33906 seems to report an issue at this patch. >

[jira] [Commented] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254666#comment-17254666 ] Dongjoon Hyun commented on SPARK-33906: --- Thank you for reporting, [~Baohe Zhang]. Is this caused

[jira] [Updated] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33906: -- Priority: Blocker (was: Major) > SPARK UI Executors page stuck when

[jira] [Assigned] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33907: Assignee: Apache Spark (was: L. C. Hsieh) > Only prune columns of from_json if parsing

[jira] [Assigned] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33907: Assignee: Apache Spark (was: L. C. Hsieh) > Only prune columns of from_json if parsing

[jira] [Assigned] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33907: Assignee: L. C. Hsieh (was: Apache Spark) > Only prune columns of from_json if parsing

[jira] [Commented] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254658#comment-17254658 ] Apache Spark commented on SPARK-33907: -- User 'viirya' has created a pull request for this issue:

[jira] [Updated] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-33907: Affects Version/s: 3.2.0 > Only prune columns of from_json if parsing options is empty >

[jira] [Created] (SPARK-33907) Only prune columns of from_json if parsing options is empty

2020-12-24 Thread L. C. Hsieh (Jira)
L. C. Hsieh created SPARK-33907: --- Summary: Only prune columns of from_json if parsing options is empty Key: SPARK-33907 URL: https://issues.apache.org/jira/browse/SPARK-33907 Project: Spark

[jira] [Resolved] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33784. --- Fix Version/s: 3.1.0 Resolution: Fixed This is resolved via

[jira] [Updated] (SPARK-33621) Add a way to inject data source rewrite rules

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33621: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Add a way to inject data source

[jira] [Assigned] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33906: Assignee: Apache Spark > SPARK UI Executors page stuck when

[jira] [Assigned] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33906: Assignee: (was: Apache Spark) > SPARK UI Executors page stuck when

[jira] [Commented] (SPARK-33621) Add a way to inject data source rewrite rules

2020-12-24 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254651#comment-17254651 ] Dongjoon Hyun commented on SPARK-33621: --- This landed at branch-3.1 via

[jira] [Commented] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254650#comment-17254650 ] Apache Spark commented on SPARK-33906: -- User 'baohe-zhang' has created a pull request for this

[jira] [Commented] (SPARK-33621) Add a way to inject data source rewrite rules

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254649#comment-17254649 ] Apache Spark commented on SPARK-33621: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-33621) Add a way to inject data source rewrite rules

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254648#comment-17254648 ] Apache Spark commented on SPARK-33621: -- User 'aokolnychyi' has created a pull request for this

[jira] [Updated] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-33906: Description: How to reproduce it? In mac OS standalone mode, open a spark-shell and run

[jira] [Commented] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254647#comment-17254647 ] Baohe Zhang commented on SPARK-33906: - I will put a PR soon. > SPARK UI Executors page stuck when

[jira] [Updated] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-33906: Description: How to reproduce it? In mac OS standalone mode, open a spark-shell and run

[jira] [Updated] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baohe Zhang updated SPARK-33906: Attachment: executor-page.png > SPARK UI Executors page stuck when

[jira] [Created] (SPARK-33906) SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset

2020-12-24 Thread Baohe Zhang (Jira)
Baohe Zhang created SPARK-33906: --- Summary: SPARK UI Executors page stuck when ExecutorSummary.peakMemoryMetrics is unset Key: SPARK-33906 URL: https://issues.apache.org/jira/browse/SPARK-33906 Project:

[jira] [Created] (SPARK-33905) Can't configure response header size

2020-12-24 Thread jcc (Jira)
jcc created SPARK-33905: --- Summary: Can't configure response header size Key: SPARK-33905 URL: https://issues.apache.org/jira/browse/SPARK-33905 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-33830) Describe the PURGE option of ALTER TABLE .. DROP PARTITION

2020-12-24 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk resolved SPARK-33830. Resolution: Won't Fix > Describe the PURGE option of ALTER TABLE .. DROP PARTITION >

[jira] [Assigned] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33904: Assignee: Apache Spark > Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

[jira] [Assigned] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33904: Assignee: (was: Apache Spark) > Recognize `spark_catalog` in `saveAsTable()` and

[jira] [Commented] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254628#comment-17254628 ] Apache Spark commented on SPARK-33904: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254627#comment-17254627 ] Apache Spark commented on SPARK-33904: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-33904) Recognize `spark_catalog` in `saveAsTable()` and `insertInto()`

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33904: -- Summary: Recognize `spark_catalog` in `saveAsTable()` and `insertInto()` Key: SPARK-33904 URL: https://issues.apache.org/jira/browse/SPARK-33904 Project: Spark

[jira] [Updated] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-33900: --- Fix Version/s: 3.2.0 3.1.0 3.0.2 > Show shuffle read

[jira] [Resolved] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-33900. Resolution: Fixed > Show shuffle read size / records correctly when only remotebytesread

[jira] [Assigned] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta reassigned SPARK-33900: -- Assignee: dzcxzl > Show shuffle read size / records correctly when only

[jira] [Assigned] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33901: Assignee: (was: Apache Spark) > Char and Varchar display error after DDLs >

[jira] [Assigned] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33901: Assignee: Apache Spark > Char and Varchar display error after DDLs >

[jira] [Assigned] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33901: Assignee: Apache Spark > Char and Varchar display error after DDLs >

[jira] [Commented] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254550#comment-17254550 ] Apache Spark commented on SPARK-33901: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Created] (SPARK-33903) CREATE VIEW AS SELECT FOR V2

2020-12-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-33903: Summary: CREATE VIEW AS SELECT FOR V2 Key: SPARK-33903 URL: https://issues.apache.org/jira/browse/SPARK-33903 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-33902) CREATE TABLE LIKE FOR V2

2020-12-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-33902: Summary: CREATE TABLE LIKE FOR V2 Key: SPARK-33902 URL: https://issues.apache.org/jira/browse/SPARK-33902 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-33901) Char and Varchar display error after DDLs

2020-12-24 Thread Kent Yao (Jira)
Kent Yao created SPARK-33901: Summary: Char and Varchar display error after DDLs Key: SPARK-33901 URL: https://issues.apache.org/jira/browse/SPARK-33901 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33784) Rename dataSourceRewriteRules and customDataSourceRewriteRules in BaseSessionStateBuilder

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254514#comment-17254514 ] Apache Spark commented on SPARK-33784: -- User 'aokolnychyi' has created a pull request for this

[jira] [Commented] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254487#comment-17254487 ] Apache Spark commented on SPARK-33900: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33900: Assignee: Apache Spark > Show shuffle read size / records correctly when only

[jira] [Assigned] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33900: Assignee: (was: Apache Spark) > Show shuffle read size / records correctly when only

[jira] [Commented] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254485#comment-17254485 ] Apache Spark commented on SPARK-33900: -- User 'cxzl25' has created a pull request for this issue:

[jira] [Created] (SPARK-33900) Show shuffle read size / records correctly when only remotebytesread is available

2020-12-24 Thread dzcxzl (Jira)
dzcxzl created SPARK-33900: -- Summary: Show shuffle read size / records correctly when only remotebytesread is available Key: SPARK-33900 URL: https://issues.apache.org/jira/browse/SPARK-33900 Project: Spark

[jira] [Commented] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254481#comment-17254481 ] Apache Spark commented on SPARK-33899: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33899: Assignee: Apache Spark > v1 SHOW TABLES fails with assert on spark_catalog >

[jira] [Assigned] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33899: Assignee: (was: Apache Spark) > v1 SHOW TABLES fails with assert on spark_catalog >

[jira] [Created] (SPARK-33899) v1 SHOW TABLES fails with assert on spark_catalog

2020-12-24 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-33899: -- Summary: v1 SHOW TABLES fails with assert on spark_catalog Key: SPARK-33899 URL: https://issues.apache.org/jira/browse/SPARK-33899 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-33892) Char and Varchar display in show table/column definition command

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33892: --- Assignee: Kent Yao > Char and Varchar display in show table/column definition command >

[jira] [Resolved] (SPARK-33892) Char and Varchar display in show table/column definition command

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33892. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 30908

[jira] [Assigned] (SPARK-33881) Check null and empty string as partition values in v1 and v2 tests

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33881: --- Assignee: Maxim Gekk > Check null and empty string as partition values in v1 and v2 tests

[jira] [Resolved] (SPARK-33881) Check null and empty string as partition values in v1 and v2 tests

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33881. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30893

[jira] [Assigned] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33443: --- Assignee: jiaan.geng > LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ] >

[jira] [Resolved] (SPARK-33443) LEAD/LAG should support [ IGNORE NULLS | RESPECT NULLS ]

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33443. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30387

[jira] [Resolved] (SPARK-33861) Simplify conditional in predicate

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33861. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30865

[jira] [Assigned] (SPARK-33861) Simplify conditional in predicate

2020-12-24 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33861: --- Assignee: Yuming Wang > Simplify conditional in predicate >