[jira] [Assigned] (SPARK-29082) Spark driver cannot start with only delegation tokens

[ https://issues.apache.org/jira/browse/SPARK-29082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-29082: -- Assignee: Marcelo Vanzin > Spark driver cannot start with only delegation tokens >

[jira] [Resolved] (SPARK-29082) Spark driver cannot start with only delegation tokens

[ https://issues.apache.org/jira/browse/SPARK-29082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-29082. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25805

[jira] [Assigned] (SPARK-28091) Extend Spark metrics system with user-defined metrics using executor plugins

[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28091: -- Assignee: Luca Canali > Extend Spark metrics system with user-defined metrics using

[jira] [Resolved] (SPARK-28091) Extend Spark metrics system with user-defined metrics using executor plugins

[ https://issues.apache.org/jira/browse/SPARK-28091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28091. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24901

[jira] [Assigned] (SPARK-29105) SHS may delete driver log file of in progress application

[ https://issues.apache.org/jira/browse/SPARK-29105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-29105: -- Assignee: Marcelo Vanzin > SHS may delete driver log file of in progress application

[jira] [Resolved] (SPARK-29105) SHS may delete driver log file of in progress application

[ https://issues.apache.org/jira/browse/SPARK-29105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-29105. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25819

[jira] [Resolved] (SPARK-29027) KafkaDelegationTokenSuite fails

[ https://issues.apache.org/jira/browse/SPARK-29027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-29027. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25803

[jira] [Assigned] (SPARK-29027) KafkaDelegationTokenSuite fails

[ https://issues.apache.org/jira/browse/SPARK-29027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-29027: -- Assignee: Gabor Somogyi > KafkaDelegationTokenSuite fails >

[jira] [Created] (SPARK-29105) SHS may delete driver log file of in progress application

Marcelo Vanzin created SPARK-29105: -- Summary: SHS may delete driver log file of in progress application Key: SPARK-29105 URL: https://issues.apache.org/jira/browse/SPARK-29105 Project: Spark

[jira] [Assigned] (SPARK-26929) table owner should use user instead of principal when use kerberos

[ https://issues.apache.org/jira/browse/SPARK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26929: -- Assignee: hong dongdong > table owner should use user instead of principal when use

[jira] [Resolved] (SPARK-26929) table owner should use user instead of principal when use kerberos

[ https://issues.apache.org/jira/browse/SPARK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26929. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 23952

[jira] [Created] (SPARK-29082) Spark driver cannot start with only delegation tokens

Marcelo Vanzin created SPARK-29082: -- Summary: Spark driver cannot start with only delegation tokens Key: SPARK-29082 URL: https://issues.apache.org/jira/browse/SPARK-29082 Project: Spark

[jira] [Assigned] (SPARK-24663) Flaky test: StreamingContextSuite "stop slow receiver gracefully"

[ https://issues.apache.org/jira/browse/SPARK-24663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24663: -- Assignee: Jungtaek Lim > Flaky test: StreamingContextSuite "stop slow receiver

[jira] [Resolved] (SPARK-24663) Flaky test: StreamingContextSuite "stop slow receiver gracefully"

[ https://issues.apache.org/jira/browse/SPARK-24663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-24663. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25725

[jira] [Resolved] (SPARK-29007) Possible leak of SparkContext in tests / test suites initializing StreamingContext

[ https://issues.apache.org/jira/browse/SPARK-29007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-29007. Fix Version/s: 3.0.0 Assignee: Jungtaek Lim Resolution: Fixed > Possible

[jira] [Resolved] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries

[ https://issues.apache.org/jira/browse/SPARK-26989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26989. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25706

[jira] [Assigned] (SPARK-26989) Flaky test:DAGSchedulerSuite.Barrier task failures from the same stage attempt don't trigger multiple stage retries

[ https://issues.apache.org/jira/browse/SPARK-26989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26989: -- Assignee: Jungtaek Lim > Flaky test:DAGSchedulerSuite.Barrier task failures from the

[jira] [Resolved] (SPARK-28570) Shuffle Storage API: Use writer API in UnsafeShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28570. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25304

[jira] [Assigned] (SPARK-28570) Shuffle Storage API: Use writer API in UnsafeShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28570: -- Assignee: Matt Cheah > Shuffle Storage API: Use writer API in UnsafeShuffleWriter >

[jira] [Assigned] (SPARK-28928) Use Kafka delegation token protocol on sources/sinks

[ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28928: -- Assignee: Gabor Somogyi > Use Kafka delegation token protocol on sources/sinks >

[jira] [Resolved] (SPARK-28928) Use Kafka delegation token protocol on sources/sinks

[ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28928. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25631

[jira] [Resolved] (SPARK-28214) Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28214. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25731

[jira] [Assigned] (SPARK-28214) Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28214: -- Assignee: Jungtaek Lim > Flaky test:

[jira] [Assigned] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer

[ https://issues.apache.org/jira/browse/SPARK-25151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25151: -- Assignee: Jungtaek Lim > Apply Apache Commons Pool to KafkaDataConsumer >

[jira] [Resolved] (SPARK-25151) Apply Apache Commons Pool to KafkaDataConsumer

[ https://issues.apache.org/jira/browse/SPARK-25151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25151. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 22138

[jira] [Resolved] (SPARK-28931) Fix couple of bugs in FsHistoryProviderSuite

[ https://issues.apache.org/jira/browse/SPARK-28931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28931. Fix Version/s: 3.0.0 Assignee: Jungtaek Lim Resolution: Fixed > Fix

[jira] [Assigned] (SPARK-28571) Shuffle storage API: Use API in SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28571: -- Assignee: Matt Cheah > Shuffle storage API: Use API in SortShuffleWriter >

[jira] [Resolved] (SPARK-28571) Shuffle storage API: Use API in SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28571. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25342

[jira] [Resolved] (SPARK-28760) Add end-to-end Kafka delegation token test

[ https://issues.apache.org/jira/browse/SPARK-28760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28760. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25477

[jira] [Assigned] (SPARK-28760) Add end-to-end Kafka delegation token test

[ https://issues.apache.org/jira/browse/SPARK-28760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28760: -- Assignee: Gabor Somogyi > Add end-to-end Kafka delegation token test >

[jira] [Commented] (SPARK-25874) Simplify abstractions in the K8S backend

[ https://issues.apache.org/jira/browse/SPARK-25874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918813#comment-16918813 ] Marcelo Vanzin commented on SPARK-25874: I'm going to close this one; the only remaining task is

[jira] [Resolved] (SPARK-25874) Simplify abstractions in the K8S backend

[ https://issues.apache.org/jira/browse/SPARK-25874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25874. Fix Version/s: 3.0.0 Resolution: Done > Simplify abstractions in the K8S backend >

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918204#comment-16918204 ] Marcelo Vanzin commented on SPARK-28906: The code is fine. This is a problem in the release

[jira] [Resolved] (SPARK-28875) Cover Task retry scenario with test in Kafka connector

[ https://issues.apache.org/jira/browse/SPARK-28875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28875. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25582

[jira] [Assigned] (SPARK-28875) Cover Task retry scenario with test in Kafka connector

[ https://issues.apache.org/jira/browse/SPARK-28875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28875: -- Assignee: Gabor Somogyi > Cover Task retry scenario with test in Kafka connector >

[jira] [Resolved] (SPARK-28679) Spark Yarn ResourceRequestHelper shouldn't lookup setResourceInformation is no resources specified

[ https://issues.apache.org/jira/browse/SPARK-28679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28679. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25403

[jira] [Assigned] (SPARK-28679) Spark Yarn ResourceRequestHelper shouldn't lookup setResourceInformation is no resources specified

[ https://issues.apache.org/jira/browse/SPARK-28679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28679: -- Assignee: Alessandro Bellina > Spark Yarn ResourceRequestHelper shouldn't lookup

[jira] [Resolved] (SPARK-28607) Don't hold a reference to two partitionLengths arrays

[ https://issues.apache.org/jira/browse/SPARK-28607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28607. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25341

[jira] [Assigned] (SPARK-28607) Don't hold a reference to two partitionLengths arrays

[ https://issues.apache.org/jira/browse/SPARK-28607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28607: -- Assignee: Matt Cheah > Don't hold a reference to two partitionLengths arrays >

[jira] [Assigned] (SPARK-28839) ExecutorMonitor$Tracker NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-28839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28839: -- Assignee: Hyukjin Kwon > ExecutorMonitor$Tracker NullPointerException >

[jira] [Resolved] (SPARK-28839) ExecutorMonitor$Tracker NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-28839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28839. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25551

[jira] [Updated] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27937: --- Docs Text: In Spark 3.0, the behavior for automatic delegation token retrieval for file

[jira] [Resolved] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27937. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24785

[jira] [Assigned] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27937: -- Assignee: Dhruve Ashar > Revert changes introduced as a part of Automatic namespace

[jira] [Assigned] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28634: -- Assignee: Marcelo Vanzin > Failed to start SparkSession with Keytab file >

[jira] [Resolved] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28634. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25467

[jira] [Resolved] (SPARK-25262) Support tmpfs for local dirs in k8s

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25262. Fix Version/s: 3.0.0 Assignee: Rob Vesse Resolution: Fixed > Support

[jira] [Updated] (SPARK-25262) Support tmpfs for local dirs in k8s

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-25262: --- Summary: Support tmpfs for local dirs in k8s (was: Make Spark local dir volumes

[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910616#comment-16910616 ] Marcelo Vanzin commented on SPARK-25262: Full configurability was actually added in SPARK-28042.

[jira] [Updated] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28634: --- Priority: Minor (was: Major) > Failed to start SparkSession with Keytab file >

[jira] [Reopened] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-28634: > Failed to start SparkSession with Keytab file >

[jira] [Commented] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908450#comment-16908450 ] Marcelo Vanzin commented on SPARK-28634: I think it's still worth it to fix it, so that users

[jira] [Resolved] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23977. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24970

[jira] [Assigned] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23977: -- Assignee: Steve Loughran > Add commit protocol binding to Hadoop 3.1

[jira] [Resolved] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28487. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25236

[jira] [Assigned] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28487: -- Assignee: Marcelo Vanzin > K8S pod allocator behaves poorly with dynamic allocation

[jira] [Assigned] (SPARK-28638) Task summary metrics are wrong when there are running tasks

[ https://issues.apache.org/jira/browse/SPARK-28638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28638: -- Assignee: Gengliang Wang > Task summary metrics are wrong when there are running

[jira] [Resolved] (SPARK-28638) Task summary metrics are wrong when there are running tasks

[ https://issues.apache.org/jira/browse/SPARK-28638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28638. Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 Issue resolved by

[jira] [Commented] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902238#comment-16902238 ] Marcelo Vanzin commented on SPARK-28634: Ah. If you use {{--principal}} and {{--keytab}} this

[jira] [Comment Edited] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902238#comment-16902238 ] Marcelo Vanzin edited comment on SPARK-28634 at 8/7/19 4:48 PM: Ah. If

[jira] [Updated] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

[ https://issues.apache.org/jira/browse/SPARK-28584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28584: --- Summary: Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite (was: Fix thread

[jira] [Comment Edited] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

[ https://issues.apache.org/jira/browse/SPARK-28584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898225#comment-16898225 ] Marcelo Vanzin edited comment on SPARK-28584 at 8/1/19 5:42 PM: Please

[jira] [Resolved] (SPARK-28564) Access history application defaults to the last attempt id

[ https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28564. Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 Issue resolved by

[jira] [Assigned] (SPARK-28564) Access history application defaults to the last attempt id

[ https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28564: -- Assignee: dzcxzl > Access history application defaults to the last attempt id >

[jira] [Created] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

Marcelo Vanzin created SPARK-28584: -- Summary: Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite Key: SPARK-28584 URL: https://issues.apache.org/jira/browse/SPARK-28584 Project: Spark

[jira] [Resolved] (SPARK-28209) Shuffle Storage API: Writes

[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28209. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25007

[jira] [Assigned] (SPARK-28209) Shuffle Storage API: Writes

[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28209: -- Assignee: Matt Cheah > Shuffle Storage API: Writes > --- > >

[jira] [Resolved] (SPARK-28525) Allow Launcher to be applied Java options

[ https://issues.apache.org/jira/browse/SPARK-28525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28525. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25265

[jira] [Assigned] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28042: -- Assignee: Junjie Chen > Support mapping spark.local.dir to hostPath volume >

[jira] [Resolved] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28042. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24879

[jira] [Created] (SPARK-28535) Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

Marcelo Vanzin created SPARK-28535: -- Summary: Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader" Key: SPARK-28535 URL: https://issues.apache.org/jira/browse/SPARK-28535

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25285: -- Assignee: Luca Canali > Add executor task metrics to track the number of tasks

[jira] [Resolved] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25285. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22290

[jira] [Resolved] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28465. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25222

[jira] [Assigned] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28465: -- Assignee: Stavros Kontopoulos > K8s integration tests fail due to missing ceph-nano

[jira] [Resolved] (SPARK-28496) Use branch name instead of tag during dry-run

[ https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28496. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25240

[jira] [Assigned] (SPARK-28496) Use branch name instead of tag during dry-run

[ https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28496: -- Assignee: Dongjoon Hyun > Use branch name instead of tag during dry-run >

[jira] [Commented] (SPARK-28509) K8S integration tests are failing

[ https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892079#comment-16892079 ] Marcelo Vanzin commented on SPARK-28509: [~shaneknapp] in case this is an infra issue. > K8S

[jira] [Created] (SPARK-28509) K8S integration tests are failing

Marcelo Vanzin created SPARK-28509: -- Summary: K8S integration tests are failing Key: SPARK-28509 URL: https://issues.apache.org/jira/browse/SPARK-28509 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25590) kubernetes-model-2.0.0.jar masks default Spark logging config

[ https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25590. Resolution: Duplicate > kubernetes-model-2.0.0.jar masks default Spark logging config >

[jira] [Created] (SPARK-28488) Race in k8s scheduler shutdown can lead to misleading exceptions.

Marcelo Vanzin created SPARK-28488: -- Summary: Race in k8s scheduler shutdown can lead to misleading exceptions. Key: SPARK-28488 URL: https://issues.apache.org/jira/browse/SPARK-28488 Project: Spark

[jira] [Created] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

Marcelo Vanzin created SPARK-28487: -- Summary: K8S pod allocator behaves poorly with dynamic allocation Key: SPARK-28487 URL: https://issues.apache.org/jira/browse/SPARK-28487 Project: Spark

[jira] [Created] (SPARK-28455) Executor may be timed out too soon because of overflow in tracking code

Marcelo Vanzin created SPARK-28455: -- Summary: Executor may be timed out too soon because of overflow in tracking code Key: SPARK-28455 URL: https://issues.apache.org/jira/browse/SPARK-28455 Project:

[jira] [Resolved] (SPARK-28417) Spark Submit does not use Proxy User Credentials to Resolve Path for Resources

[ https://issues.apache.org/jira/browse/SPARK-28417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28417. Resolution: Duplicate > Spark Submit does not use Proxy User Credentials to Resolve Path

[jira] [Resolved] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27963. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24817

[jira] [Assigned] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27963: -- Assignee: Marcelo Vanzin > Allow dynamic allocation without an external shuffle

[jira] [Resolved] (SPARK-27959) Change YARN resource configs to use .amount

[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27959. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24989

[jira] [Assigned] (SPARK-27959) Change YARN resource configs to use .amount

[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27959: -- Assignee: Thomas Graves > Change YARN resource configs to use .amount >

[jira] [Resolved] (SPARK-28407) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28407. Resolution: Duplicate This had already been cloned elsewhere. > Support mapping

[jira] [Commented] (SPARK-27499) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-27499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885578#comment-16885578 ] Marcelo Vanzin commented on SPARK-27499: I can't see an option to reopen this, so I'll clone it

[jira] [Created] (SPARK-28407) Support mapping spark.local.dir to hostPath volume

Marcelo Vanzin created SPARK-28407: -- Summary: Support mapping spark.local.dir to hostPath volume Key: SPARK-28407 URL: https://issues.apache.org/jira/browse/SPARK-28407 Project: Spark Issue

[jira] [Updated] (SPARK-28371) Parquet "starts with" filter is not null-safe

[ https://issues.apache.org/jira/browse/SPARK-28371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28371: --- Description: I ran into this when running unit tests with Parquet 1.11. It seems that 1.10

[jira] [Created] (SPARK-28371) Parquet "starts with" filter is not null-safe

Marcelo Vanzin created SPARK-28371: -- Summary: Parquet "starts with" filter is not null-safe Key: SPARK-28371 URL: https://issues.apache.org/jira/browse/SPARK-28371 Project: Spark Issue

[jira] [Assigned] (SPARK-23472) Add config properties for administrator JVM options

[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23472: -- Assignee: Gabor Somogyi > Add config properties for administrator JVM options >

[jira] [Resolved] (SPARK-23472) Add config properties for administrator JVM options

[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23472. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24804

[jira] [Resolved] (SPARK-28055) Add delegation token custom AdminClient configurations.

[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28055. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24875

[jira] [Assigned] (SPARK-28055) Add delegation token custom AdminClient configurations.

[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28055: -- Assignee: Gabor Somogyi > Add delegation token custom AdminClient configurations. >

[jira] [Created] (SPARK-28214) Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery

Marcelo Vanzin created SPARK-28214: -- Summary: Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery Key: SPARK-28214 URL:

[jira] [Deleted] (SPARK-28207) https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit

[ https://issues.apache.org/jira/browse/SPARK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-28207: --- > https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit >

[jira] [Assigned] (SPARK-28187) Add hadoop-cloud module to PR builders

[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28187: -- Assignee: Marcelo Vanzin > Add hadoop-cloud module to PR builders >

  1   2   3   4   5   6   7   8   9   10   >