[jira] [Commented] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288224#comment-17288224 ] Dongjoon Hyun commented on SPARK-34479: --- [~yumwang]. I filed SPARK-34496 and made a PR. Could you

[jira] [Updated] (SPARK-34485) GeneratedIterator grows beyond 64 KB in Structured Streaming application

2021-02-21 Thread Kim Min Woo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kim Min Woo updated SPARK-34485: Description: I ran the following Structured Streaming application, but failed with ERROR

[jira] [Commented] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288222#comment-17288222 ] Apache Spark commented on SPARK-34496: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288220#comment-17288220 ] Apache Spark commented on SPARK-34496: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-34485) GeneratedIterator grows beyond 64 KB in Structured Streaming application

2021-02-21 Thread Kim Min Woo (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kim Min Woo updated SPARK-34485: Summary: GeneratedIterator grows beyond 64 KB in Structured Streaming application (was:

[jira] [Assigned] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34496: Assignee: Apache Spark > Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility >

[jira] [Assigned] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34496: Assignee: (was: Apache Spark) > Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility >

[jira] [Created] (SPARK-34496) Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility

2021-02-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34496: - Summary: Upgrade ZSTD-JNI to 1.4.8-5 to API compatibility Key: SPARK-34496 URL: https://issues.apache.org/jira/browse/SPARK-34496 Project: Spark Issue

[jira] [Assigned] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34495: Assignee: Dongjoon Hyun > Add DedicatedJVMTest test tag > -

[jira] [Resolved] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34495. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31607

[jira] [Updated] (SPARK-33438) set -v couldn't dump all the conf entries

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33438: - Fix Version/s: (was: 3.1.2) 3.1.1 > set -v couldn't dump all the conf

[jira] [Updated] (SPARK-34334) ExecutorPodsAllocator fails to identify some excess requests during downscaling

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34334: - Fix Version/s: (was: 3.1.2) 3.1.1 > ExecutorPodsAllocator fails to

[jira] [Updated] (SPARK-34407) KubernetesClusterSchedulerBackend.stop should clean up K8s resources

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34407: - Fix Version/s: (was: 3.1.2) 3.1.1 >

[jira] [Updated] (SPARK-20977) NPE in CollectionAccumulator

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-20977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20977: - Fix Version/s: (was: 3.1.2) 3.1.1 > NPE in CollectionAccumulator >

[jira] [Updated] (SPARK-34449) Upgrade Jetty to fix CVE-2020-27218

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34449: - Fix Version/s: (was: 3.1.2) 3.1.1 > Upgrade Jetty to fix CVE-2020-27218

[jira] [Updated] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34373: - Fix Version/s: (was: 3.1.2) 3.1.1 > HiveThriftServer2 startWithContext

[jira] [Updated] (SPARK-33434) Document spark.conf.isModifiable()

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-33434: - Fix Version/s: (was: 3.1.2) 3.1.1 > Document spark.conf.isModifiable() >

[jira] [Updated] (SPARK-34384) Add missing docs for ResourceProfile APIs

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34384: - Fix Version/s: (was: 3.1.2) 3.1.1 > Add missing docs for ResourceProfile

[jira] [Updated] (SPARK-34469) Ignore RegisterExecutor when SparkContext is stopped

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34469: - Fix Version/s: 3.1.1 > Ignore RegisterExecutor when SparkContext is stopped >

[jira] [Assigned] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34167: --- Assignee: Raza Jafri > Reading parquet with Decimal(8,2) written as a Decimal64 blows up >

[jira] [Resolved] (SPARK-34167) Reading parquet with Decimal(8,2) written as a Decimal64 blows up

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34167. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31284

[jira] [Assigned] (SPARK-34468) Fix v2 ALTER TABLE .. RENAME TO

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34468: --- Assignee: Maxim Gekk > Fix v2 ALTER TABLE .. RENAME TO > --- >

[jira] [Resolved] (SPARK-34468) Fix v2 ALTER TABLE .. RENAME TO

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34468. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31594

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-34421: Fix Version/s: 3.0.3 > Custom functions can't be used in temporary views with CTEs >

[jira] [Commented] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288169#comment-17288169 ] Apache Spark commented on SPARK-34495: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288163#comment-17288163 ] Apache Spark commented on SPARK-34495: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34495: Assignee: Apache Spark > Add DedicatedJVMTest test tag > - >

[jira] [Assigned] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34495: Assignee: (was: Apache Spark) > Add DedicatedJVMTest test tag >

[jira] [Resolved] (SPARK-34401) Update public docs about altering cached tables/views

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-34401. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31524

[jira] [Assigned] (SPARK-34401) Update public docs about altering cached tables/views

2021-02-21 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-34401: --- Assignee: Maxim Gekk > Update public docs about altering cached tables/views >

[jira] [Created] (SPARK-34495) Add DedicatedJVMTest test tag

2021-02-21 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-34495: - Summary: Add DedicatedJVMTest test tag Key: SPARK-34495 URL: https://issues.apache.org/jira/browse/SPARK-34495 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-34490) table maybe resolved as a view if the table is dropped

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288153#comment-17288153 ] Apache Spark commented on SPARK-34490: -- User 'linhongliu-db' has created a pull request for this

[jira] [Assigned] (SPARK-34490) table maybe resolved as a view if the table is dropped

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34490: Assignee: (was: Apache Spark) > table maybe resolved as a view if the table is

[jira] [Assigned] (SPARK-34490) table maybe resolved as a view if the table is dropped

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34490: Assignee: Apache Spark > table maybe resolved as a view if the table is dropped >

[jira] [Commented] (SPARK-34490) table maybe resolved as a view if the table is dropped

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288152#comment-17288152 ] Apache Spark commented on SPARK-34490: -- User 'linhongliu-db' has created a pull request for this

[jira] [Created] (SPARK-34494) Move data source options from Python and Scala into a single page.

2021-02-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34494: --- Summary: Move data source options from Python and Scala into a single page. Key: SPARK-34494 URL: https://issues.apache.org/jira/browse/SPARK-34494 Project: Spark

[jira] [Created] (SPARK-34493) Create "TEXT Files" page for Data Source documents.

2021-02-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34493: --- Summary: Create "TEXT Files" page for Data Source documents. Key: SPARK-34493 URL: https://issues.apache.org/jira/browse/SPARK-34493 Project: Spark Issue

[jira] [Created] (SPARK-34492) Create "CSV Files" page for Data Source documents.

2021-02-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34492: --- Summary: Create "CSV Files" page for Data Source documents. Key: SPARK-34492 URL: https://issues.apache.org/jira/browse/SPARK-34492 Project: Spark Issue Type:

[jira] [Updated] (SPARK-34491) Move data source options docs for Python and Scala into a single page

2021-02-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-34491: Description: Currently we documents options of various data sources for Python and Scala in a

[jira] [Updated] (SPARK-34491) Move data source options docs for Python and Scala into a single page

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-34491: - Affects Version/s: (was: 3.0.2) 3.2.0 > Move data source options

[jira] [Created] (SPARK-34491) Move data source options docs for Python and Scala into a single page

2021-02-21 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-34491: --- Summary: Move data source options docs for Python and Scala into a single page Key: SPARK-34491 URL: https://issues.apache.org/jira/browse/SPARK-34491 Project: Spark

[jira] [Created] (SPARK-34490) table maybe resolved as a view if the table is dropped

2021-02-21 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-34490: --- Summary: table maybe resolved as a view if the table is dropped Key: SPARK-34490 URL: https://issues.apache.org/jira/browse/SPARK-34490 Project: Spark Issue

[jira] [Resolved] (SPARK-33420) BroadCastJoin failure when keys on join side has cast from DateTyte to String

2021-02-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-33420. - Resolution: Duplicate > BroadCastJoin failure when keys on join side has cast from DateTyte to

[jira] [Commented] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288106#comment-17288106 ] Dongjoon Hyun commented on SPARK-34479: --- In addition to that, Apache Parquet master is also using

[jira] [Commented] (SPARK-34479) Add zstandard codec to spark.sql.avro.compression.codec

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288105#comment-17288105 ] Dongjoon Hyun commented on SPARK-34479: --- [~yumwang].  FYI, both Apache Spark master and Apache

[jira] [Commented] (SPARK-34483) Make check point compress codec configurable

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288103#comment-17288103 ] Dongjoon Hyun commented on SPARK-34483: --- Sounds reasonable. Thanks for the suggestion,

[jira] [Closed] (SPARK-34489) my personal blog

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun closed SPARK-34489. - > my personal blog > - > > Key: SPARK-34489 > URL:

[jira] [Resolved] (SPARK-34489) my personal blog

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34489. --- Resolution: Abandoned > my personal blog > - > > Key:

[jira] [Resolved] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34029. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31603

[jira] [Assigned] (SPARK-34029) Add OrcEncryptionSuite and FakeKeyProvider

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34029: - Assignee: Dongjoon Hyun > Add OrcEncryptionSuite and FakeKeyProvider >

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: [~angerszhuuu] and [~ron8hu] discussed a generic and consistent way for overall stages, i.e.

[jira] [Resolved] (SPARK-34129) Add table name to LogicalRelation.simpleString

2021-02-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-34129. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31196

[jira] [Updated] (SPARK-34129) Add table name to LogicalRelation.simpleString

2021-02-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-34129: - Priority: Minor (was: Major) > Add table name to LogicalRelation.simpleString >

[jira] [Assigned] (SPARK-34129) Add table name to LogicalRelation.simpleString

2021-02-21 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-34129: Assignee: Yuming Wang > Add table name to LogicalRelation.simpleString >

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: [~angerszhuuu] and [~ron8hu] discussed a generic and consistent way for overall stages, i.e.

[jira] [Updated] (SPARK-34443) Replace symbol literals with Symbol constructor invocations to comply with Scala 2.13

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34443: -- Parent: SPARK-25075 Issue Type: Sub-task (was: Improvement) > Replace symbol

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Description: [~angerszhuuu] and [~ron8hu] discussed a generic and consistent way for endpoint

[jira] [Commented] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288026#comment-17288026 ] Ron Hu commented on SPARK-26399: Add an example of task Metrics percentile Distributions. 

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Attachment: executorMetricsDistributions.json > Define query parameters to support various filtering

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Attachment: taskMetricsDistributions.json > Define query parameters to support various filtering conditions

[jira] [Updated] (SPARK-26399) Define query parameters to support various filtering conditions in REST API for overall stages

2021-02-21 Thread Ron Hu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Hu updated SPARK-26399: --- Attachment: taskMetricsDistributions.json > Define query parameters to support various filtering conditions

[jira] [Updated] (SPARK-33005) Kubernetes GA Preparation

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-33005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33005: -- Fix Version/s: (was: 3.1.0) 3.1.1 > Kubernetes GA Preparation >

[jira] [Updated] (SPARK-34469) Ignore RegisterExecutor when SparkContext is stopped

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34469: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Improvement) > Ignore

[jira] [Updated] (SPARK-34487) K8s integration test should use the runtime Hadoop Version

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34487: -- Parent: SPARK-33005 Issue Type: Sub-task (was: Bug) > K8s integration test should

[jira] [Resolved] (SPARK-34487) K8s integration test should use the runtime Hadoop Version

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-34487. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 31604

[jira] [Updated] (SPARK-34487) K8s integration test should use the runtime Hadoop Version

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-34487: -- Fix Version/s: (was: 3.1.0) 3.1.1 3.2.0 > K8s

[jira] [Assigned] (SPARK-34487) K8s integration test should use the runtime Hadoop Version

2021-02-21 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-34487: - Assignee: Dongjoon Hyun > K8s integration test should use the runtime Hadoop Version >

[jira] [Commented] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287993#comment-17287993 ] Apache Spark commented on SPARK-34290: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287994#comment-17287994 ] Apache Spark commented on SPARK-34290: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34290: Assignee: (was: Apache Spark) > Support v2 TRUNCATE TABLE >

[jira] [Assigned] (SPARK-34290) Support v2 TRUNCATE TABLE

2021-02-21 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-34290: Assignee: Apache Spark > Support v2 TRUNCATE TABLE > - > >

[jira] [Commented] (SPARK-34043) Linear Discriminant Analysis for dimensionality reduction

2021-02-21 Thread Harsh Vardhan verma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287895#comment-17287895 ] Harsh Vardhan verma commented on SPARK-34043: - This is an important feature and I am looking

[jira] [Assigned] (SPARK-34486) Upgrade kubernetes-client to 4.13.2

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34486: Assignee: Dongjoon Hyun > Upgrade kubernetes-client to 4.13.2 >

[jira] [Resolved] (SPARK-34486) Upgrade kubernetes-client to 4.13.2

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34486. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 31602

[jira] [Assigned] (SPARK-34384) Add missing docs for ResourceProfile APIs

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34384: Assignee: wuyi > Add missing docs for ResourceProfile APIs >

[jira] [Resolved] (SPARK-34384) Add missing docs for ResourceProfile APIs

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34384. -- Fix Version/s: 3.1.2 Resolution: Fixed Issue resolved by pull request 31496

[jira] [Resolved] (SPARK-34360) Support table truncation by v2 Table Catalogs

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34360. -- Resolution: Fixed Issue resolved by pull request 31475

[jira] [Resolved] (SPARK-34373) HiveThriftServer2 startWithContext may hang with a race issue

2021-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34373. -- Fix Version/s: 3.1.2 Assignee: Kent Yao Resolution: Fixed Fixed in