[jira] [Assigned] (SPARK-28607) Don't hold a reference to two partitionLengths arrays

[ https://issues.apache.org/jira/browse/SPARK-28607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28607: -- Assignee: Matt Cheah > Don't hold a reference to two partitionLengths arr

[jira] [Assigned] (SPARK-28839) ExecutorMonitor$Tracker NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-28839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28839: -- Assignee: Hyukjin Kwon > ExecutorMonitor$Tracker NullPointerExcept

[jira] [Resolved] (SPARK-28839) ExecutorMonitor$Tracker NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-28839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28839. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25551 [https

[spark] branch master updated (07c4b9b -> d25cbd4)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 07c4b9b Revert "[SPARK-25474][SQL] Support `spark.sql.statistics.fallBackToHdfs` in data source tables"

[jira] [Updated] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27937: --- Docs Text: In Spark 3.0, the behavior for automatic delegation token retrieval for file

[spark] branch master updated (39c1127 -> a50959a)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 39c1127 [SPARK-28753][SQL] Dynamically reuse subqueries in AQE add a50959a [SPARK-27937][CORE] Revert partial

[jira] [Resolved] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27937. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 24785 [https

[jira] [Assigned] (SPARK-27937) Revert changes introduced as a part of Automatic namespace discovery [SPARK-24149]

[ https://issues.apache.org/jira/browse/SPARK-27937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27937: -- Assignee: Dhruve Ashar > Revert changes introduced as a part of Automatic namesp

[jira] [Assigned] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28634: -- Assignee: Marcelo Vanzin > Failed to start SparkSession with Keytab f

[spark] branch master updated (1de4a22 -> 5f6eb5d)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1de4a22 Revert "[SPARK-28759][BUILD] Upgrade scala-maven-plugin to 4.1.1" add 5f6eb5d [SPARK-2

[jira] [Resolved] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28634. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25467 [https

[jira] [Resolved] (SPARK-25262) Support tmpfs for local dirs in k8s

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25262. Fix Version/s: 3.0.0 Assignee: Rob Vesse Resolution: Fixed > Supp

[jira] [Updated] (SPARK-25262) Support tmpfs for local dirs in k8s

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-25262: --- Summary: Support tmpfs for local dirs in k8s (was: Make Spark local dir volumes

[jira] [Commented] (SPARK-25262) Make Spark local dir volumes configurable with Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910616#comment-16910616 ] Marcelo Vanzin commented on SPARK-25262: Full configurability was actually added in SPARK-28042

[jira] [Updated] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28634: --- Priority: Minor (was: Major) > Failed to start SparkSession with Keytab f

[jira] [Reopened] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-28634: > Failed to start SparkSession with Keytab f

[jira] [Commented] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908450#comment-16908450 ] Marcelo Vanzin commented on SPARK-28634: I think it's still worth it to fix it, so that users

[jira] [Resolved] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23977. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24970 [https

[jira] [Assigned] (SPARK-23977) Add commit protocol binding to Hadoop 3.1 PathOutputCommitter mechanism

[ https://issues.apache.org/jira/browse/SPARK-23977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23977: -- Assignee: Steve Loughran > Add commit protocol binding to Hadoop

[spark] branch master updated: [SPARK-23977][SQL] Support High Performance S3A committers [test-hadoop3.2]

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ac6163 [SPARK-23977][SQL] Support High

[jira] [Resolved] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28487. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25236 [https

[jira] [Assigned] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-28487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28487: -- Assignee: Marcelo Vanzin > K8S pod allocator behaves poorly with dynamic allocat

[spark] branch master updated (331f265 -> 0343854)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 331f265 [SPARK-27768][SQL] Support Infinity/NaN-related float/double literals case-insensitively add 0343854

[spark] branch branch-2.4 updated: [SPARK-28638][WEBUI] Task summary should only contain successful tasks' metrics

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new c37abba [SPARK-28638][WEBUI] Task

[jira] [Assigned] (SPARK-28638) Task summary metrics are wrong when there are running tasks

[ https://issues.apache.org/jira/browse/SPARK-28638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28638: -- Assignee: Gengliang Wang > Task summary metrics are wrong when there are runn

[jira] [Resolved] (SPARK-28638) Task summary metrics are wrong when there are running tasks

[ https://issues.apache.org/jira/browse/SPARK-28638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28638. Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 Issue resolved

[spark] branch master updated: [SPARK-28638][WEBUI] Task summary should only contain successful tasks' metrics

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 48d04f7 [SPARK-28638][WEBUI] Task summary

[jira] [Commented] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902238#comment-16902238 ] Marcelo Vanzin commented on SPARK-28634: Ah. If you use {{--principal}} and {{--keytab

[jira] [Comment Edited] (SPARK-28634) Failed to start SparkSession with Keytab file

[ https://issues.apache.org/jira/browse/SPARK-28634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902238#comment-16902238 ] Marcelo Vanzin edited comment on SPARK-28634 at 8/7/19 4:48 PM: Ah

[jira] [Updated] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

[ https://issues.apache.org/jira/browse/SPARK-28584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28584: --- Summary: Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite (was: Fix thread

[jira] [Comment Edited] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

[ https://issues.apache.org/jira/browse/SPARK-28584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898225#comment-16898225 ] Marcelo Vanzin edited comment on SPARK-28584 at 8/1/19 5:42 PM: Please

[jira] [Resolved] (SPARK-28564) Access history application defaults to the last attempt id

[ https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28564. Resolution: Fixed Fix Version/s: 2.4.4 3.0.0 Issue resolved

[spark] branch branch-2.4 updated: [SPARK-28564][CORE] Access history application defaults to the last attempt id

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 6a361d4 [SPARK-28564][CORE] Access

[jira] [Assigned] (SPARK-28564) Access history application defaults to the last attempt id

[ https://issues.apache.org/jira/browse/SPARK-28564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28564: -- Assignee: dzcxzl > Access history application defaults to the last attempt

[spark] branch master updated: [SPARK-28564][CORE] Access history application defaults to the last attempt id

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 70ef906 [SPARK-28564][CORE] Access history

[jira] [Created] (SPARK-28584) Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite

Marcelo Vanzin created SPARK-28584: -- Summary: Flaky test: org.apache.spark.scheduler.TaskSchedulerImplSuite Key: SPARK-28584 URL: https://issues.apache.org/jira/browse/SPARK-28584 Project: Spark

[jira] [Resolved] (SPARK-28209) Shuffle Storage API: Writes

[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28209. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25007 [https

[spark] branch master updated: [SPARK-28209][CORE][SHUFFLE] Proposed new shuffle writer API

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new abef84a [SPARK-28209][CORE][SHUFFLE] Proposed

[jira] [Assigned] (SPARK-28209) Shuffle Storage API: Writes

[ https://issues.apache.org/jira/browse/SPARK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28209: -- Assignee: Matt Cheah > Shuffle Storage API: Wri

[spark] branch master updated (44c28d7 -> 121f933)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 44c28d7 [SPARK-28399][ML][PYTHON] implement RobustScaler add 121f933 [SPARK-28525][DEPLOY] Allow Launcher

[jira] [Resolved] (SPARK-28525) Allow Launcher to be applied Java options

[ https://issues.apache.org/jira/browse/SPARK-28525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28525. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25265 [https

[jira] [Assigned] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28042: -- Assignee: Junjie Chen > Support mapping spark.local.dir to hostPath vol

[spark] branch master updated: [SPARK-28042][K8S] Support using volume mount as local storage

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 780d176 [SPARK-28042][K8S] Support using volume

[jira] [Resolved] (SPARK-28042) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28042. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24879 [https

[jira] [Created] (SPARK-28535) Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader"

Marcelo Vanzin created SPARK-28535: -- Summary: Flaky test: JobCancellationSuite."interruptible iterator of shuffle reader" Key: SPARK-28535 URL: https://issues.apache.org/jira/browse/S

[jira] [Assigned] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25285: -- Assignee: Luca Canali > Add executor task metrics to track the number of ta

[jira] [Resolved] (SPARK-25285) Add executor task metrics to track the number of tasks started and of tasks successfully completed

[ https://issues.apache.org/jira/browse/SPARK-25285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25285. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22290 [https

[spark] branch master updated: [SPARK-25285][CORE] Add startedTasks and finishedTasks to the metrics system in the executor instance

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f2a2d98 [SPARK-25285][CORE] Add startedTasks

[spark] branch master updated: [SPARK-28465][K8S] Fix integration tests which fail due to missing ceph-nano image

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 7504eab [SPARK-28465][K8S] Fix integration

[jira] [Resolved] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28465. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25222 [https

[jira] [Assigned] (SPARK-28465) K8s integration tests fail due to missing ceph-nano image

[ https://issues.apache.org/jira/browse/SPARK-28465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28465: -- Assignee: Stavros Kontopoulos > K8s integration tests fail due to missing ceph-n

[jira] [Resolved] (SPARK-28496) Use branch name instead of tag during dry-run

[ https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28496. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 25240 [https

[jira] [Assigned] (SPARK-28496) Use branch name instead of tag during dry-run

[ https://issues.apache.org/jira/browse/SPARK-28496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28496: -- Assignee: Dongjoon Hyun > Use branch name instead of tag during dry-

[spark] branch master updated (045191e -> cfca26e)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 045191e [SPARK-28293][SQL] Implement Spark's own GetTableTypesOperation add cfca26e [SPARK-28496][INFRA] Use

[jira] [Commented] (SPARK-28509) K8S integration tests are failing

[ https://issues.apache.org/jira/browse/SPARK-28509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892079#comment-16892079 ] Marcelo Vanzin commented on SPARK-28509: [~shaneknapp] in case this is an infra issue. >

[jira] [Created] (SPARK-28509) K8S integration tests are failing

Marcelo Vanzin created SPARK-28509: -- Summary: K8S integration tests are failing Key: SPARK-28509 URL: https://issues.apache.org/jira/browse/SPARK-28509 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25590) kubernetes-model-2.0.0.jar masks default Spark logging config

[ https://issues.apache.org/jira/browse/SPARK-25590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25590. Resolution: Duplicate > kubernetes-model-2.0.0.jar masks default Spark logging con

[jira] [Created] (SPARK-28488) Race in k8s scheduler shutdown can lead to misleading exceptions.

Marcelo Vanzin created SPARK-28488: -- Summary: Race in k8s scheduler shutdown can lead to misleading exceptions. Key: SPARK-28488 URL: https://issues.apache.org/jira/browse/SPARK-28488 Project: Spark

[jira] [Created] (SPARK-28487) K8S pod allocator behaves poorly with dynamic allocation

Marcelo Vanzin created SPARK-28487: -- Summary: K8S pod allocator behaves poorly with dynamic allocation Key: SPARK-28487 URL: https://issues.apache.org/jira/browse/SPARK-28487 Project: Spark

[jira] [Created] (SPARK-28455) Executor may be timed out too soon because of overflow in tracking code

Marcelo Vanzin created SPARK-28455: -- Summary: Executor may be timed out too soon because of overflow in tracking code Key: SPARK-28455 URL: https://issues.apache.org/jira/browse/SPARK-28455 Project

[jira] [Resolved] (SPARK-28417) Spark Submit does not use Proxy User Credentials to Resolve Path for Resources

[ https://issues.apache.org/jira/browse/SPARK-28417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28417. Resolution: Duplicate > Spark Submit does not use Proxy User Credentials to Resolve P

[jira] [Resolved] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27963. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24817 [https

[spark] branch master updated: [SPARK-27963][CORE] Allow dynamic allocation without a shuffle service.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 2ddeff9 [SPARK-27963][CORE] Allow dynamic

[jira] [Assigned] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27963: -- Assignee: Marcelo Vanzin > Allow dynamic allocation without an external shuf

[jira] [Resolved] (SPARK-27959) Change YARN resource configs to use .amount

[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27959. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24989 [https

[spark] branch master updated: [SPARK-27959][YARN] Change YARN resource configs to use .amount

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 43d68cd [SPARK-27959][YARN] Change YARN

[jira] [Assigned] (SPARK-27959) Change YARN resource configs to use .amount

[ https://issues.apache.org/jira/browse/SPARK-27959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27959: -- Assignee: Thomas Graves > Change YARN resource configs to use .amo

[jira] [Resolved] (SPARK-28407) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-28407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28407. Resolution: Duplicate This had already been cloned elsewhere. > Support mapp

[jira] [Commented] (SPARK-27499) Support mapping spark.local.dir to hostPath volume

[ https://issues.apache.org/jira/browse/SPARK-27499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885578#comment-16885578 ] Marcelo Vanzin commented on SPARK-27499: I can't see an option to reopen this, so I'll clone

[jira] [Created] (SPARK-28407) Support mapping spark.local.dir to hostPath volume

Marcelo Vanzin created SPARK-28407: -- Summary: Support mapping spark.local.dir to hostPath volume Key: SPARK-28407 URL: https://issues.apache.org/jira/browse/SPARK-28407 Project: Spark Issue

[spark] branch master updated: [SPARK-28150][CORE][FOLLOW-UP] Don't try to log in when impersonating.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8d1e87a [SPARK-28150][CORE][FOLLOW-UP] Don't

[jira] [Updated] (SPARK-28371) Parquet "starts with" filter is not null-safe

[ https://issues.apache.org/jira/browse/SPARK-28371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28371: --- Description: I ran into this when running unit tests with Parquet 1.11. It seems that 1.10

[jira] [Created] (SPARK-28371) Parquet "starts with" filter is not null-safe

Marcelo Vanzin created SPARK-28371: -- Summary: Parquet "starts with" filter is not null-safe Key: SPARK-28371 URL: https://issues.apache.org/jira/browse/SPARK-28371 Project: Spark

[jira] [Assigned] (SPARK-23472) Add config properties for administrator JVM options

[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-23472: -- Assignee: Gabor Somogyi > Add config properties for administrator JVM opti

[jira] [Resolved] (SPARK-23472) Add config properties for administrator JVM options

[ https://issues.apache.org/jira/browse/SPARK-23472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-23472. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24804 [https

[spark] branch master updated: [SPARK-23472][CORE] Add defaultJavaOptions for driver and executor.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new f830005 [SPARK-23472][CORE] Add

[spark] branch master updated: [SPARK-28055][SS][DSTREAMS] Add delegation token custom AdminClient configurations.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new d47c219 [SPARK-28055][SS][DSTREAMS] Add

[jira] [Resolved] (SPARK-28055) Add delegation token custom AdminClient configurations.

[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28055. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24875 [https

[jira] [Assigned] (SPARK-28055) Add delegation token custom AdminClient configurations.

[ https://issues.apache.org/jira/browse/SPARK-28055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28055: -- Assignee: Gabor Somogyi > Add delegation token custom AdminClient configurati

[jira] [Created] (SPARK-28214) Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery

Marcelo Vanzin created SPARK-28214: -- Summary: Flaky test: org.apache.spark.streaming.CheckpointSuite.basic rdd checkpoints + dstream graph checkpoint recovery Key: SPARK-28214 URL: https://issues.apache.org

[jira] [Deleted] (SPARK-28207) https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-rohit

[ https://issues.apache.org/jira/browse/SPARK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin deleted SPARK-28207: --- > https://rtatdotblog.wordpress.com/2019/05/30/rohit-travels-tours-ro

[spark] branch master updated: [SPARK-28187][BUILD] Add support for hadoop-cloud to the PR builder.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 11e21cc [SPARK-28187][BUILD] Add support

[jira] [Assigned] (SPARK-28187) Add hadoop-cloud module to PR builders

[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28187: -- Assignee: Marcelo Vanzin > Add hadoop-cloud module to PR build

[jira] [Resolved] (SPARK-28187) Add hadoop-cloud module to PR builders

[ https://issues.apache.org/jira/browse/SPARK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28187. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24987 [https

[spark] branch master updated (cded421 -> 6af47b9)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cded421 [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs add

[jira] [Resolved] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28150. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24955 [https

[jira] [Assigned] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28150: -- Assignee: Marcelo Vanzin > Failure to create multiple contexts in same

[jira] [Created] (SPARK-28187) Add hadoop-cloud module to PR builders

Marcelo Vanzin created SPARK-28187: -- Summary: Add hadoop-cloud module to PR builders Key: SPARK-28187 URL: https://issues.apache.org/jira/browse/SPARK-28187 Project: Spark Issue Type

[jira] [Resolved] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27622. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24554 [https

[jira] [Assigned] (SPARK-27622) Avoid the network when block manager fetches disk persisted RDD blocks from the same host

[ https://issues.apache.org/jira/browse/SPARK-27622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-27622: -- Assignee: Attila Zsolt Piros > Avoid the network when block manager fetches d

[spark] branch master updated (1a3858a -> b71c130)

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 1a3858a [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian archit

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: (was: Marcelo Vanzin) > Add support for dynamic resource allocat

[jira] [Assigned] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24432: -- Assignee: Marcelo Vanzin > Add support for dynamic resource allocat

[jira] [Updated] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

[ https://issues.apache.org/jira/browse/SPARK-28150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-28150: --- Description: Take the following small app that creates multiple contexts (not concurrently

[jira] [Created] (SPARK-28150) Failure to create multiple contexts in same JVM with Kerberos auth

Marcelo Vanzin created SPARK-28150: -- Summary: Failure to create multiple contexts in same JVM with Kerberos auth Key: SPARK-28150 URL: https://issues.apache.org/jira/browse/SPARK-28150 Project

[jira] [Commented] (SPARK-27963) Allow dynamic allocation without an external shuffle service

[ https://issues.apache.org/jira/browse/SPARK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16857146#comment-16857146 ] Marcelo Vanzin commented on SPARK-27963: FYI I have a WIP patch to implement this that I plan

[jira] [Created] (SPARK-27963) Allow dynamic allocation without an external shuffle service

Marcelo Vanzin created SPARK-27963: -- Summary: Allow dynamic allocation without an external shuffle service Key: SPARK-27963 URL: https://issues.apache.org/jira/browse/SPARK-27963 Project: Spark

[jira] [Resolved] (SPARK-27748) Kafka consumer/producer password/token redaction

[ https://issues.apache.org/jira/browse/SPARK-27748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-27748. Resolution: Fixed Assignee: Gabor Somogyi Fix Version/s: 3.0.0 > Ka

[spark] branch master updated: [SPARK-27748][SS] Kafka consumer/producer password/token redaction.

This is an automated email from the ASF dual-hosted git repository. vanzin pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 911fadf [SPARK-27748][SS] Kafka consumer

[jira] [Commented] (SPARK-27891) Long running spark jobs fail because of HDFS delegation token expires

[ https://issues.apache.org/jira/browse/SPARK-27891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852420#comment-16852420 ] Marcelo Vanzin commented on SPARK-27891: Ok, the updated logs show the issue. But they're from

<    1   2   3   4   5   6   7   8   9   10   >