[jira] [Updated] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34055: --- Description: Here is the example to reproduce the issue: {code:sql} spark-sql> create table tbl2 (co

[jira] [Created] (SPARK-34055) ALTER TABLE .. ADD PARTITION doesn't refresh cache

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34055: -- Summary: ALTER TABLE .. ADD PARTITION doesn't refresh cache Key: SPARK-34055 URL: https://issues.apache.org/jira/browse/SPARK-34055 Project: Spark Issue Type: Bu

[jira] [Created] (SPARK-34054) BlockManagerDecommissioner cleanup

2021-01-08 Thread wuyi (Jira)
wuyi created SPARK-34054: Summary: BlockManagerDecommissioner cleanup Key: SPARK-34054 URL: https://issues.apache.org/jira/browse/SPARK-34054 Project: Spark Issue Type: Sub-task Components:

[jira] [Commented] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261790#comment-17261790 ] Apache Spark commented on SPARK-34039: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261789#comment-17261789 ] Apache Spark commented on SPARK-34039: -- User 'sunchao' has created a pull request f

[jira] [Commented] (SPARK-33933) Broadcast timeout happened unexpectedly in AQE

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261769#comment-17261769 ] Apache Spark commented on SPARK-33933: -- User 'zhongyu09' has created a pull request

[jira] [Resolved] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34049. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31093 [https://

[jira] [Assigned] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34049: - Assignee: Anton Okolnychyi > DataSource V2: Use Write abstraction in StreamExecution >

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261695#comment-17261695 ] Hyukjin Kwon commented on SPARK-34053: -- +1 thanks [~dongjoon] > Please reduce GitH

[jira] [Commented] (SPARK-33106) Fix sbt resolvers clash

2021-01-08 Thread Denis Pyshev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261694#comment-17261694 ] Denis Pyshev commented on SPARK-33106: -- [~nonsleepr], could you please provide deta

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261678#comment-17261678 ] Dongjoon Hyun commented on SPARK-34053: --- I filed INFRA-21287 . > Please reduce Gi

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261670#comment-17261670 ] Hyukjin Kwon commented on SPARK-34053: -- BTW, i have been contacting GitHub to addre

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34053: -- Description: GitHub Actions queue is very high for Apache projects, and it looks like a signi

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261665#comment-17261665 ] Dongjoon Hyun commented on SPARK-34053: --- I'll remove the above wrong claim to avoi

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261664#comment-17261664 ] Dongjoon Hyun commented on SPARK-34053: --- In addition, [~vladimirsitnikov]. The fol

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261657#comment-17261657 ] Dongjoon Hyun commented on SPARK-34053: --- I removed the suggested plugin from the J

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34053: -- Description: GitHub Actions queue is very high for Apache projects, and it looks like a signi

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261647#comment-17261647 ] Dongjoon Hyun commented on SPARK-34053: --- Unfortunately, it turns out that the sugg

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34053: -- Attachment: Screen Shot 2021-01-08 at 2.57.07 PM.png > Please reduce GitHub Actions matrix or

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261644#comment-17261644 ] Apache Spark commented on SPARK-34053: -- User 'dongjoon-hyun' has created a pull req

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261641#comment-17261641 ] Apache Spark commented on SPARK-34053: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34053: Assignee: (was: Apache Spark) > Please reduce GitHub Actions matrix or improve the bu

[jira] [Assigned] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34053: Assignee: Apache Spark > Please reduce GitHub Actions matrix or improve the build time >

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34053: -- Affects Version/s: (was: 2.4.8) > Please reduce GitHub Actions matrix or improve the build

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261625#comment-17261625 ] Dongjoon Hyun commented on SPARK-34053: --- BTW, according to the graph, the majority

[jira] [Commented] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261614#comment-17261614 ] Dongjoon Hyun commented on SPARK-34053: --- Thank you for reporting, [~vladimirsitnik

[jira] [Commented] (SPARK-31891) `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop partition if partition specific location is not exist any more

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261565#comment-17261565 ] Apache Spark commented on SPARK-31891: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31891) `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop partition if partition specific location is not exist any more

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31891: Assignee: Apache Spark > `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop

[jira] [Commented] (SPARK-31891) `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop partition if partition specific location is not exist any more

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261564#comment-17261564 ] Apache Spark commented on SPARK-31891: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-31891) `ALTER TABLE multipartIdentifier RECOVER PARTITIONS` should drop partition if partition specific location is not exist any more

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31891: Assignee: (was: Apache Spark) > `ALTER TABLE multipartIdentifier RECOVER PARTITIONS`

[jira] [Updated] (SPARK-33729) When refreshing cache, Spark should not use cached plan when recaching data

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-33729: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > When refreshing cache, Spark should not u

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Vladimir Sitnikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Sitnikov updated SPARK-34053: -- Description: GitHub Actions queue is very high for Apache projects, and it looks like

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Vladimir Sitnikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Sitnikov updated SPARK-34053: -- Description: GitHub Actions queue is very high for Apache projects, and it looks like

[jira] [Updated] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Vladimir Sitnikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Sitnikov updated SPARK-34053: -- Priority: Critical (was: Major) > Please reduce GitHub Actions matrix or improve the

[jira] [Created] (SPARK-34053) Please reduce GitHub Actions matrix or improve the build time

2021-01-08 Thread Vladimir Sitnikov (Jira)
Vladimir Sitnikov created SPARK-34053: - Summary: Please reduce GitHub Actions matrix or improve the build time Key: SPARK-34053 URL: https://issues.apache.org/jira/browse/SPARK-34053 Project: Spar

[jira] [Updated] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26836: -- Affects Version/s: 3.2.0 3.1.0 3.0.1 > Columns g

[jira] [Assigned] (SPARK-32917) Add support for executors to push shuffle blocks after successful map task completion

2021-01-08 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-32917: --- Assignee: Chandni Singh > Add support for executors to push shuffle blocks

[jira] [Resolved] (SPARK-32917) Add support for executors to push shuffle blocks after successful map task completion

2021-01-08 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan resolved SPARK-32917. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 303

[jira] [Updated] (SPARK-33507) Improve and fix cache behavior in v1 and v2

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33507: -- Priority: Critical (was: Major) > Improve and fix cache behavior in v1 and v2 > -

[jira] [Updated] (SPARK-34052) A view doesn't become invalid after a table is dropped or replaced in V2

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34052: - Affects Version/s: 3.1.0 > A view doesn't become invalid after a table is dropped or replaced in V2 > --

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34039: - Affects Version/s: 3.0.1 > [DSv2] ReplaceTable should invalidate cache > ---

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34039: -- Target Version/s: 3.1.1 > [DSv2] ReplaceTable should invalidate cache > --

[jira] [Created] (SPARK-34052) A view doesn't become invalid after a table is dropped or replaced in V2

2021-01-08 Thread Chao Sun (Jira)
Chao Sun created SPARK-34052: Summary: A view doesn't become invalid after a table is dropped or replaced in V2 Key: SPARK-34052 URL: https://issues.apache.org/jira/browse/SPARK-34052 Project: Spark

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated SPARK-34039: - Parent: SPARK-33507 Issue Type: Sub-task (was: Bug) > [DSv2] ReplaceTable should invalidate cac

[jira] [Commented] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261468#comment-17261468 ] Chao Sun commented on SPARK-34039: -- Thanks for verifying this [~dongjoon]! > [DSv2] R

[jira] [Commented] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261458#comment-17261458 ] Apache Spark commented on SPARK-34051: -- User 'sarutak' has created a pull request f

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34039: -- Priority: Blocker (was: Minor) > [DSv2] ReplaceTable should invalidate cache > --

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34039: -- Labels: correctness (was: ) > [DSv2] ReplaceTable should invalidate cache > -

[jira] [Commented] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261460#comment-17261460 ] Apache Spark commented on SPARK-34051: -- User 'sarutak' has created a pull request f

[jira] [Assigned] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34051: Assignee: Apache Spark (was: Kousuke Saruta) > Support 32-bit unicode escape in string l

[jira] [Assigned] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34051: Assignee: Kousuke Saruta (was: Apache Spark) > Support 32-bit unicode escape in string l

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34039: -- Issue Type: Bug (was: Improvement) > [DSv2] ReplaceTable should invalidate cache > --

[jira] [Updated] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34039: -- Affects Version/s: 3.1.0 > [DSv2] ReplaceTable should invalidate cache > -

[jira] [Commented] (SPARK-34039) [DSv2] ReplaceTable should invalidate cache

2021-01-08 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261455#comment-17261455 ] Dongjoon Hyun commented on SPARK-34039: --- [~csun]. I tested with Apache Spark 3.1.0

[jira] [Created] (SPARK-34051) Support 32-bit unicode escape in string literals

2021-01-08 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-34051: -- Summary: Support 32-bit unicode escape in string literals Key: SPARK-34051 URL: https://issues.apache.org/jira/browse/SPARK-34051 Project: Spark Issue Ty

[jira] [Comment Edited] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

2021-01-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261398#comment-17261398 ] Attila Zsolt Piros edited comment on SPARK-26836 at 1/8/21, 4:15 PM: -

[jira] [Commented] (SPARK-26836) Columns get switched in Spark SQL using Avro backed Hive table if schema evolves

2021-01-08 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261398#comment-17261398 ] Attila Zsolt Piros commented on SPARK-26836: I am working on a this > Colu

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261388#comment-17261388 ] Apache Spark commented on SPARK-33591: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261389#comment-17261389 ] Apache Spark commented on SPARK-33591: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261368#comment-17261368 ] Apache Spark commented on SPARK-33591: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261365#comment-17261365 ] Apache Spark commented on SPARK-33591: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-33591: --- Assignee: Maxim Gekk > NULL is recognized as the "null" string in partition specs > ---

[jira] [Resolved] (SPARK-33591) NULL is recognized as the "null" string in partition specs

2021-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-33591. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30538 [https://gith

[jira] [Commented] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261306#comment-17261306 ] Apache Spark commented on SPARK-34049: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34049: Assignee: Apache Spark > DataSource V2: Use Write abstraction in StreamExecution > --

[jira] [Assigned] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34049: Assignee: (was: Apache Spark) > DataSource V2: Use Write abstraction in StreamExecuti

[jira] [Commented] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261305#comment-17261305 ] Apache Spark commented on SPARK-34049: -- User 'aokolnychyi' has created a pull reque

[jira] [Updated] (SPARK-34050) Parquet 2 CSV conversion wrong quoting

2021-01-08 Thread Laszlo Torok (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laszlo Torok updated SPARK-34050: - Description: Hi Experts,  I work for GE Corporate. We have a Backup+Restore+extras project with

[jira] [Created] (SPARK-34050) Parquet 2 CSV conversion wrong quoting

2021-01-08 Thread Laszlo Torok (Jira)
Laszlo Torok created SPARK-34050: Summary: Parquet 2 CSV conversion wrong quoting Key: SPARK-34050 URL: https://issues.apache.org/jira/browse/SPARK-34050 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-34049) DataSource V2: Use Write abstraction in StreamExecution

2021-01-08 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-34049: Summary: DataSource V2: Use Write abstraction in StreamExecution Key: SPARK-34049 URL: https://issues.apache.org/jira/browse/SPARK-34049 Project: Spark

[jira] [Assigned] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34048: Assignee: (was: Apache Spark) > Check the amount of calls to Hive external catalog >

[jira] [Commented] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261257#comment-17261257 ] Apache Spark commented on SPARK-34048: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34048: Assignee: Apache Spark > Check the amount of calls to Hive external catalog > ---

[jira] [Created] (SPARK-34048) Check the amount of calls to Hive external catalog

2021-01-08 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34048: -- Summary: Check the amount of calls to Hive external catalog Key: SPARK-34048 URL: https://issues.apache.org/jira/browse/SPARK-34048 Project: Spark Issue Type: Su

[jira] [Assigned] (SPARK-34032) Add Kafka delegation token truststore and keystore type confiuration

2021-01-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34032: Assignee: Gabor Somogyi > Add Kafka delegation token truststore and keystore type confiur

[jira] [Resolved] (SPARK-34032) Add Kafka delegation token truststore and keystore type confiuration

2021-01-08 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34032. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31070 [https://gi

[jira] [Commented] (SPARK-33796) Show hidden text from the left menu of Spark Doc

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261194#comment-17261194 ] Apache Spark commented on SPARK-33796: -- User 'sarutak' has created a pull request f

[jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11

2021-01-08 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261186#comment-17261186 ] Yuming Wang commented on SPARK-24417: - Hadoop 2.7 users should back port HADOOP-1276

[jira] [Resolved] (SPARK-33773) expose intermediateStorageLevel in mllib

2021-01-08 Thread zhengruifeng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-33773. -- Resolution: Not A Problem > expose intermediateStorageLevel in mllib > ---

[jira] [Commented] (SPARK-34047) save tree models in single partition

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261158#comment-17261158 ] Apache Spark commented on SPARK-34047: -- User 'zhengruifeng' has created a pull requ

[jira] [Assigned] (SPARK-34047) save tree models in single partition

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34047: Assignee: Apache Spark > save tree models in single partition > -

[jira] [Assigned] (SPARK-34047) save tree models in single partition

2021-01-08 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34047: Assignee: (was: Apache Spark) > save tree models in single partition > --

[jira] [Created] (SPARK-34047) save tree models in single partition

2021-01-08 Thread zhengruifeng (Jira)
zhengruifeng created SPARK-34047: Summary: save tree models in single partition Key: SPARK-34047 URL: https://issues.apache.org/jira/browse/SPARK-34047 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-34003) Rule conflicts between PaddingAndLengthCheckForCharVarchar and ResolveAggregateFunctions

2021-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34003. - Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31027 [https://gith

[jira] [Assigned] (SPARK-34003) Rule conflicts between PaddingAndLengthCheckForCharVarchar and ResolveAggregateFunctions

2021-01-08 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34003: --- Assignee: Kent Yao > Rule conflicts between PaddingAndLengthCheckForCharVarchar and > Reso

[jira] [Commented] (SPARK-33601) Group exception messages in catalyst/parser

2021-01-08 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261125#comment-17261125 ] jiaan.geng commented on SPARK-33601: I'm working on. > Group exception messages in