[jira] [Updated] (SPARK-33381) Unify DSv1 and DSv2 command tests

2021-02-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-33381: --- Affects Version/s: 3.2.0 > Unify DSv1 and DSv2 command tests > - > >

[jira] [Created] (SPARK-34450) Unify v1 and v2 `ALTER TABLE .. RENAME` tests

2021-02-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34450: -- Summary: Unify v1 and v2 `ALTER TABLE .. RENAME` tests Key: SPARK-34450 URL: https://issues.apache.org/jira/browse/SPARK-34450 Project: Spark Issue Type: Sub-tas

[jira] [Updated] (SPARK-34450) Unify v1 and v2 `ALTER TABLE .. RENAME` tests

2021-02-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34450: --- Description: Extract ALTER TABLE .. RENAME tests to the common place to run them for V1 and v2 datas

[jira] [Updated] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

2021-02-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34450: --- Summary: Unify v1 and v2 ALTER TABLE .. RENAME tests (was: Unify v1 and v2 `ALTER TABLE .. RENAME`

[jira] [Commented] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285718#comment-17285718 ] Apache Spark commented on SPARK-34450: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34450: Assignee: Apache Spark > Unify v1 and v2 ALTER TABLE .. RENAME tests > --

[jira] [Assigned] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34450: Assignee: (was: Apache Spark) > Unify v1 and v2 ALTER TABLE .. RENAME tests > ---

[jira] [Commented] (SPARK-34450) Unify v1 and v2 ALTER TABLE .. RENAME tests

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285720#comment-17285720 ] Apache Spark commented on SPARK-34450: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34451: -- Summary: Add alternatives for datetime rebasing SQL configs and deprecate legacy configs Key: SPARK-34451 URL: https://issues.apache.org/jira/browse/SPARK-34451 Project:

[jira] [Commented] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285804#comment-17285804 ] Apache Spark commented on SPARK-34451: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34451: Assignee: Apache Spark > Add alternatives for datetime rebasing SQL configs and deprecate

[jira] [Assigned] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34451: Assignee: (was: Apache Spark) > Add alternatives for datetime rebasing SQL configs an

[jira] [Commented] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285805#comment-17285805 ] Apache Spark commented on SPARK-34451: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34452) OneVsRest with GBTClassifier throws exception in 3.1.0 - InternalCompilerException

2021-02-17 Thread Jira
Danijel Zečević created SPARK-34452: --- Summary: OneVsRest with GBTClassifier throws exception in 3.1.0 - InternalCompilerException Key: SPARK-34452 URL: https://issues.apache.org/jira/browse/SPARK-34452

[jira] [Updated] (SPARK-34452) OneVsRest with GBTClassifier throws InternalCompilerException in 3.1.0

2021-02-17 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-34452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danijel Zečević updated SPARK-34452: Summary: OneVsRest with GBTClassifier throws InternalCompilerException in 3.1.0 (was: One

[jira] [Created] (SPARK-34453) ExecutorPodsLifecycleManager fails to remove executors in Kubernetes, SPARK 3.0.1

2021-02-17 Thread Dmitro Valentiev (Jira)
Dmitro Valentiev created SPARK-34453: Summary: ExecutorPodsLifecycleManager fails to remove executors in Kubernetes, SPARK 3.0.1 Key: SPARK-34453 URL: https://issues.apache.org/jira/browse/SPARK-34453

[jira] [Updated] (SPARK-34453) ExecutorPodsLifecycleManager fails to remove executors in Kubernetes, SPARK 3.0.1

2021-02-17 Thread Dmitro Valentiev (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dmitro Valentiev updated SPARK-34453: - Attachment: driver.log executors.png > ExecutorPodsLifecycleManager fail

[jira] [Assigned] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34451: --- Assignee: Maxim Gekk > Add alternatives for datetime rebasing SQL configs and deprecate leg

[jira] [Resolved] (SPARK-34451) Add alternatives for datetime rebasing SQL configs and deprecate legacy configs

2021-02-17 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34451. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31576 [https://gith

[jira] [Updated] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34454: --- Affects Version/s: (was: 3.0.0) 3.2.0 > SQL configs from the legacy names

[jira] [Created] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34454: -- Summary: SQL configs from the legacy namespace must be internal Key: SPARK-34454 URL: https://issues.apache.org/jira/browse/SPARK-34454 Project: Spark Issue Type

[jira] [Updated] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Maxim Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-34454: --- Fix Version/s: (was: 3.0.0) > SQL configs from the legacy namespace must be internal > -

[jira] [Assigned] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34454: Assignee: Maxim Gekk (was: Apache Spark) > SQL configs from the legacy namespace must be

[jira] [Assigned] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34454: Assignee: Apache Spark (was: Maxim Gekk) > SQL configs from the legacy namespace must be

[jira] [Commented] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286029#comment-17286029 ] Apache Spark commented on SPARK-34454: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-34454) SQL configs from the legacy namespace must be internal

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286030#comment-17286030 ] Apache Spark commented on SPARK-34454: -- User 'MaxGekk' has created a pull request f

[jira] [Created] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-34455: -- Summary: Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled Key: SPARK-34455 URL: https://issues.apache.org/jira/browse/SPARK-34455 Project: Spark Is

[jira] [Commented] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286056#comment-17286056 ] Erik Krogen commented on SPARK-34455: - +1 it is time to get around to this! > Depre

[jira] [Commented] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286068#comment-17286068 ] Apache Spark commented on SPARK-34455: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34455: Assignee: (was: Apache Spark) > Deprecate spark.sql.legacy.replaceDatabricksSparkAvro

[jira] [Assigned] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34455: Assignee: Apache Spark > Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled >

[jira] [Created] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-34456: Summary: Remove unused write options from BatchWriteHelper Key: SPARK-34456 URL: https://issues.apache.org/jira/browse/SPARK-34456 Project: Spark Is

[jira] [Created] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Anton Okolnychyi (Jira)
Anton Okolnychyi created SPARK-34457: Summary: DataSource V2: Add default null ordering to SortDirection Key: SPARK-34457 URL: https://issues.apache.org/jira/browse/SPARK-34457 Project: Spark

[jira] [Commented] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Anton Okolnychyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286104#comment-17286104 ] Anton Okolnychyi commented on SPARK-33736: -- PR is on the way. > Handle MERGE i

[jira] [Created] (SPARK-34458) Spark-hive: apache hive dependency with CVEs

2021-02-17 Thread Gang Liang (Jira)
Gang Liang created SPARK-34458: -- Summary: Spark-hive: apache hive dependency with CVEs Key: SPARK-34458 URL: https://issues.apache.org/jira/browse/SPARK-34458 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286156#comment-17286156 ] Apache Spark commented on SPARK-33736: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33736: Assignee: (was: Apache Spark) > Handle MERGE in ReplaceNullWithFalseInPredicate > ---

[jira] [Assigned] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33736: Assignee: Apache Spark > Handle MERGE in ReplaceNullWithFalseInPredicate > --

[jira] [Assigned] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34456: Assignee: (was: Apache Spark) > Remove unused write options from BatchWriteHelper >

[jira] [Commented] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286163#comment-17286163 ] Apache Spark commented on SPARK-34456: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34456: Assignee: Apache Spark > Remove unused write options from BatchWriteHelper > ---

[jira] [Assigned] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34457: Assignee: (was: Apache Spark) > DataSource V2: Add default null ordering to SortDirec

[jira] [Commented] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286178#comment-17286178 ] Apache Spark commented on SPARK-34457: -- User 'aokolnychyi' has created a pull reque

[jira] [Commented] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286179#comment-17286179 ] Apache Spark commented on SPARK-34457: -- User 'aokolnychyi' has created a pull reque

[jira] [Assigned] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34457: Assignee: Apache Spark > DataSource V2: Add default null ordering to SortDirection >

[jira] [Assigned] (SPARK-34457) DataSource V2: Add default null ordering to SortDirection

2021-02-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34457: Assignee: Apache Spark > DataSource V2: Add default null ordering to SortDirection >

[jira] [Created] (SPARK-34459) map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap

2021-02-17 Thread Allison Wang (Jira)
Allison Wang created SPARK-34459: Summary: map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap Key: SPARK-34459 URL: https://issues.apache.org/jira/browse/SPARK-34459 Proj

[jira] [Resolved] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-34446. -- Fix Version/s: 3.1.1 Resolution: Fixed Issue resolved by pull request 31572 [https://gi

[jira] [Assigned] (SPARK-34446) Add documentation for full outer and left semi stream-stream join

2021-02-17 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-34446: Assignee: Cheng Su > Add documentation for full outer and left semi stream-stream join >

[jira] [Resolved] (SPARK-33763) Add metrics for better tracking of dynamic allocation

2021-02-17 Thread Holden Karau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Holden Karau resolved SPARK-33763. -- Fix Version/s: 3.2.0 Assignee: Attila Zsolt Piros Resolution: Fixed > Add metr

[jira] [Resolved] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34456. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31581 [https://

[jira] [Assigned] (SPARK-34456) Remove unused write options from BatchWriteHelper

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34456: - Assignee: Anton Okolnychyi > Remove unused write options from BatchWriteHelper > -

[jira] [Assigned] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-33736: - Assignee: Anton Okolnychyi > Handle MERGE in ReplaceNullWithFalseInPredicate >

[jira] [Resolved] (SPARK-33736) Handle MERGE in ReplaceNullWithFalseInPredicate

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-33736. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31579 [https://

[jira] [Updated] (SPARK-34448) Binary logistic regression incorrectly computes the intercept and coefficients when data is not centered

2021-02-17 Thread Yakov Kerzhner (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yakov Kerzhner updated SPARK-34448: --- Summary: Binary logistic regression incorrectly computes the intercept and coefficients when

[jira] [Resolved] (SPARK-34433) Lock jekyll version by Gemfile and Bundler

2021-02-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34433. -- Fix Version/s: 3.2.0 Assignee: Attila Zsolt Piros Resolution: Fixed Fixed in h

[jira] [Created] (SPARK-34460) Add missing tests for APIs

2021-02-17 Thread wuyi (Jira)
wuyi created SPARK-34460: Summary: Add missing tests for APIs Key: SPARK-34460 URL: https://issues.apache.org/jira/browse/SPARK-34460 Project: Spark Issue Type: Improvement Components: Spar

[jira] [Resolved] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34455. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31578 [https://

[jira] [Assigned] (SPARK-34455) Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled

2021-02-17 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34455: - Assignee: Maxim Gekk > Deprecate spark.sql.legacy.replaceDatabricksSparkAvro.enabled >

[jira] [Created] (SPARK-34461) Collect API feedback and maybe revj

2021-02-17 Thread wuyi (Jira)
wuyi created SPARK-34461: Summary: Collect API feedback and maybe revj Key: SPARK-34461 URL: https://issues.apache.org/jira/browse/SPARK-34461 Project: Spark Issue Type: Improvement Compone

[jira] [Updated] (SPARK-34461) Collect API feedback and maybe revise some APIs

2021-02-17 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34461: - Summary: Collect API feedback and maybe revise some APIs (was: Collect API feedback and maybe revj) > Collect

[jira] [Updated] (SPARK-34461) Collect API feedback and maybe revise some APIs

2021-02-17 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-34461: - Description: For example,  `ResourceProfileBuilder.require` uses the same API name for both task and executor.

[jira] [Commented] (SPARK-34459) map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap

2021-02-17 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286299#comment-17286299 ] Xiao Li commented on SPARK-34459: - cc [~beliefer] > map_from_arrays() throws Unsupporte

[jira] [Commented] (SPARK-34459) map_from_arrays() throws UnsupportedOperationException with array of ColumnarMap

2021-02-17 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286311#comment-17286311 ] jiaan.geng commented on SPARK-34459: [~smilegator] I see. Let me do it. > map_from_

[jira] [Created] (SPARK-34462) thriftserver create many empty files

2021-02-17 Thread Zhang Jianguo (Jira)
Zhang Jianguo created SPARK-34462: - Summary: thriftserver create many empty files Key: SPARK-34462 URL: https://issues.apache.org/jira/browse/SPARK-34462 Project: Spark Issue Type: Improvemen

[jira] [Updated] (SPARK-34462) thriftserver create many empty files

2021-02-17 Thread Zhang Jianguo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhang Jianguo updated SPARK-34462: -- Priority: Minor (was: Major) > thriftserver create many empty files > ---