[jira] [Comment Edited] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400803#comment-17400803 ] Gengliang Wang edited comment on SPARK-36465 at 8/18/21, 5:51 AM: --

[jira] [Commented] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400803#comment-17400803 ] Gengliang Wang commented on SPARK-36465: [~viirya][~kabhwan]FYI I converted this one as a

[jira] [Updated] (SPARK-36465) Dynamic gap duration in session window

[ https://issues.apache.org/jira/browse/SPARK-36465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36465: --- Parent: SPARK-10816 Issue Type: Sub-task (was: Improvement) > Dynamic gap duration

[jira] [Commented] (SPARK-36538) Environment variables part in config doc isn't properly documented.

[ https://issues.apache.org/jira/browse/SPARK-36538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400791#comment-17400791 ] Apache Spark commented on SPARK-36538: -- User 'yutoacts' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36538) Environment variables part in config doc isn't properly documented.

[ https://issues.apache.org/jira/browse/SPARK-36538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36538: Assignee: Apache Spark > Environment variables part in config doc isn't properly

[jira] [Assigned] (SPARK-36538) Environment variables part in config doc isn't properly documented.

[ https://issues.apache.org/jira/browse/SPARK-36538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36538: Assignee: (was: Apache Spark) > Environment variables part in config doc isn't

[jira] [Commented] (SPARK-36386) Fix DataFrame groupby-expanding to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400777#comment-17400777 ] Apache Spark commented on SPARK-36386: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-36388) Fix DataFrame groupby-rolling to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400774#comment-17400774 ] Apache Spark commented on SPARK-36388: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-36386) Fix DataFrame groupby-expanding to follow pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400775#comment-17400775 ] Apache Spark commented on SPARK-36386: -- User 'itholic' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36398) Redact sensitive information in Spark Thrift Server log

[ https://issues.apache.org/jira/browse/SPARK-36398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36398. Fix Version/s: 3.1.3 3.2.0 Assignee: Kousuke Saruta

[jira] [Resolved] (SPARK-36400) Redact sensitive information in Spark Thrift Server UI

[ https://issues.apache.org/jira/browse/SPARK-36400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-36400. Fix Version/s: 3.1.3 3.2.0 Assignee: Kousuke Saruta

[jira] [Updated] (SPARK-36538) Environment variables part in config doc isn't properly documented.

[ https://issues.apache.org/jira/browse/SPARK-36538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuto Akutsu updated SPARK-36538: Description: It says environment variables are not reflected through spark-env.sh in YARN

[jira] [Commented] (SPARK-36428) the 'seconds' parameter of 'make_timestamp' should accept integer type

[ https://issues.apache.org/jira/browse/SPARK-36428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400740#comment-17400740 ] Apache Spark commented on SPARK-36428: -- User 'beliefer' has created a pull request for this issue:

[jira] [Created] (SPARK-36538) Environment variables part in config doc isn't properly documented.

Yuto Akutsu created SPARK-36538: --- Summary: Environment variables part in config doc isn't properly documented. Key: SPARK-36538 URL: https://issues.apache.org/jira/browse/SPARK-36538 Project: Spark

[jira] [Commented] (SPARK-36519) Store the RocksDB format in the checkpoint for a streaming query

[ https://issues.apache.org/jira/browse/SPARK-36519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400736#comment-17400736 ] Gengliang Wang commented on SPARK-36519: [~zsxwing] FYI I am converting this one as sub-task of

[jira] [Updated] (SPARK-36519) Store the RocksDB format in the checkpoint for a streaming query

[ https://issues.apache.org/jira/browse/SPARK-36519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-36519: --- Parent: SPARK-34198 Issue Type: Sub-task (was: Improvement) > Store the RocksDB

[jira] [Commented] (SPARK-36303) Refactor fourteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400717#comment-17400717 ] Apache Spark commented on SPARK-36303: -- User 'dgd-contributor' has created a pull request for this

[jira] [Assigned] (SPARK-36303) Refactor fourteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36303: Assignee: Apache Spark > Refactor fourteenth set of 20 query execution errors to use

[jira] [Assigned] (SPARK-36303) Refactor fourteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36303: Assignee: (was: Apache Spark) > Refactor fourteenth set of 20 query execution errors

[jira] [Commented] (SPARK-36303) Refactor fourteenth set of 20 query execution errors to use error classes

[ https://issues.apache.org/jira/browse/SPARK-36303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400716#comment-17400716 ] Apache Spark commented on SPARK-36303: -- User 'dgd-contributor' has created a pull request for this

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400696#comment-17400696 ] Apache Spark commented on SPARK-34309: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34309) Use Caffeine instead of Guava Cache

[ https://issues.apache.org/jira/browse/SPARK-34309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400695#comment-17400695 ] Apache Spark commented on SPARK-34309: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400655#comment-17400655 ] Sean R. Owen commented on SPARK-34415: -- I agree; I think it was mostly as it makes it simple to

[jira] [Commented] (SPARK-34415) Use randomization as a possibly better technique than grid search in optimizing hyperparameters

[ https://issues.apache.org/jira/browse/SPARK-34415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400644#comment-17400644 ] Xiangrui Meng commented on SPARK-34415: --- [~phenry] [~srowen] The implementation doesn't do uniform

[jira] [Updated] (SPARK-36493) Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container

[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Resolved] (SPARK-36535) refine the sql reference doc

[ https://issues.apache.org/jira/browse/SPARK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-36535. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33767

[jira] [Assigned] (SPARK-36535) refine the sql reference doc

[ https://issues.apache.org/jira/browse/SPARK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-36535: - Assignee: Wenchen Fan > refine the sql reference doc > >

[jira] [Updated] (SPARK-36537) Take care of other tests disabled related to inplace updates with CategoricalDtype.

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36537: -- Description: There are some more tests disabled related to inplace updates with

[jira] [Updated] (SPARK-36537) Take care of other tests disabled related to inplace updates with CategoricalDtype.

[ https://issues.apache.org/jira/browse/SPARK-36537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-36537: -- Summary: Take care of other tests disabled related to inplace updates with CategoricalDtype.

[jira] [Created] (SPARK-36537) Take care of other tests disabled.

Takuya Ueshin created SPARK-36537: - Summary: Take care of other tests disabled. Key: SPARK-36537 URL: https://issues.apache.org/jira/browse/SPARK-36537 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400579#comment-17400579 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Commented] (SPARK-35011) Avoid Block Manager registerations when StopExecutor msg is in-flight.

[ https://issues.apache.org/jira/browse/SPARK-35011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400578#comment-17400578 ] Apache Spark commented on SPARK-35011: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Commented] (SPARK-34949) Executor.reportHeartBeat reregisters blockManager even when Executor is shutting down

[ https://issues.apache.org/jira/browse/SPARK-34949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400577#comment-17400577 ] Apache Spark commented on SPARK-34949: -- User 'sumeetgajjar' has created a pull request for this

[jira] [Assigned] (SPARK-36536) Split the JSON/CSV option of datetime format to in read and in write

[ https://issues.apache.org/jira/browse/SPARK-36536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36536: Assignee: Apache Spark (was: Max Gekk) > Split the JSON/CSV option of datetime format

[jira] [Assigned] (SPARK-36536) Split the JSON/CSV option of datetime format to in read and in write

[ https://issues.apache.org/jira/browse/SPARK-36536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36536: Assignee: Max Gekk (was: Apache Spark) > Split the JSON/CSV option of datetime format

[jira] [Commented] (SPARK-36536) Split the JSON/CSV option of datetime format to in read and in write

[ https://issues.apache.org/jira/browse/SPARK-36536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400574#comment-17400574 ] Apache Spark commented on SPARK-36536: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Created] (SPARK-36536) Split the JSON/CSV option of datetime format to in read and in write

Max Gekk created SPARK-36536: Summary: Split the JSON/CSV option of datetime format to in read and in write Key: SPARK-36536 URL: https://issues.apache.org/jira/browse/SPARK-36536 Project: Spark

[jira] [Commented] (SPARK-36370) Avoid using SelectionMixin._builtin_table which is removed in pandas 1.3

[ https://issues.apache.org/jira/browse/SPARK-36370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400544#comment-17400544 ] Apache Spark commented on SPARK-36370: -- User 'ueshin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36387) Fix Series.astype from datetime to nullable string

[ https://issues.apache.org/jira/browse/SPARK-36387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36387. --- Fix Version/s: 3.3.0 Assignee: Haejoon Lee Resolution: Fixed Issue resolved

[jira] [Assigned] (SPARK-36535) refine the sql reference doc

[ https://issues.apache.org/jira/browse/SPARK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36535: Assignee: (was: Apache Spark) > refine the sql reference doc >

[jira] [Commented] (SPARK-36535) refine the sql reference doc

[ https://issues.apache.org/jira/browse/SPARK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400499#comment-17400499 ] Apache Spark commented on SPARK-36535: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36535) refine the sql reference doc

[ https://issues.apache.org/jira/browse/SPARK-36535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36535: Assignee: Apache Spark > refine the sql reference doc > > >

[jira] [Created] (SPARK-36535) refine the sql reference doc

Wenchen Fan created SPARK-36535: --- Summary: refine the sql reference doc Key: SPARK-36535 URL: https://issues.apache.org/jira/browse/SPARK-36535 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400478#comment-17400478 ] Dror Speiser commented on SPARK-27442: -- Hey, I'm going over the parquet format specification

[jira] [Commented] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400445#comment-17400445 ] Apache Spark commented on SPARK-36352: -- User 'AngersZh' has created a pull request for this

[jira] [Commented] (SPARK-36352) Spark should check result plan's output schema name

[ https://issues.apache.org/jira/browse/SPARK-36352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400444#comment-17400444 ] Apache Spark commented on SPARK-36352: -- User 'AngersZh' has created a pull request for this

[jira] [Updated] (SPARK-36052) Introduce pending pod limit for Spark on K8s

[ https://issues.apache.org/jira/browse/SPARK-36052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-36052: -- Labels: releasenotes (was: ) > Introduce pending pod limit for Spark on K8s >

[jira] [Commented] (SPARK-23693) SQL function uuid()

[ https://issues.apache.org/jira/browse/SPARK-23693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400411#comment-17400411 ] Jean Georges Perrin commented on SPARK-23693: - [~rxin] - You could require a parameter to

[jira] [Commented] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400382#comment-17400382 ] Apache Spark commented on SPARK-36533: -- User 'bozhang2820' has created a pull request for this

[jira] [Assigned] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36533: Assignee: Apache Spark > Allow streaming queries with Trigger.Once run in multiple

[jira] [Assigned] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

[ https://issues.apache.org/jira/browse/SPARK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36533: Assignee: (was: Apache Spark) > Allow streaming queries with Trigger.Once run in

[jira] [Updated] (SPARK-36493) Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container

[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Summary: Skip Retrieving keytab with SparkFiles.get if keytab found in the CWD of Yarn Container (was:

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Commented] (SPARK-35028) ANSI mode: disallow group by aliases

[ https://issues.apache.org/jira/browse/SPARK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400357#comment-17400357 ] Gengliang Wang commented on SPARK-35028: This is reverted in

[jira] [Updated] (SPARK-36493) SparkFiles.get is not needed for the JDBC keytab provided by the "--files" option

[ https://issues.apache.org/jira/browse/SPARK-36493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zikun updated SPARK-36493: -- Description: Currently we have the logic to deal with the JDBC keytab provided by the "--files" option {{if

[jira] [Updated] (SPARK-36534) No way to check If Spark Session is created successfully with No Exceptions and ready to execute Tasks

[ https://issues.apache.org/jira/browse/SPARK-36534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jahar updated SPARK-36534: -- Description: I am running Spark on Kubernetes in Client mode. Spark driver is spawned programmatically (No

[jira] [Created] (SPARK-36534) No way to check If Spark Session is created successfully with No Exceptions and ready to execute Tasks

Jahar created SPARK-36534: - Summary: No way to check If Spark Session is created successfully with No Exceptions and ready to execute Tasks Key: SPARK-36534 URL: https://issues.apache.org/jira/browse/SPARK-36534

[jira] [Commented] (SPARK-36379) Null at root level of a JSON array causes the parsing failure (w/ permissive mode)

[ https://issues.apache.org/jira/browse/SPARK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400314#comment-17400314 ] Apache Spark commented on SPARK-36379: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-35426) When addMergerLocation exceed the maxRetainedMergerLocations , we should remove the merger based on merged shuffle data size.

[ https://issues.apache.org/jira/browse/SPARK-35426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated SPARK-35426: --- Description: Now When addMergerLocation exceed the maxRetainedMergerLocations , we just remove the oldest

[jira] [Updated] (SPARK-35426) When addMergerLocation exceed the maxRetainedMergerLocations , we should remove the merger based on merged shuffle data size.

[ https://issues.apache.org/jira/browse/SPARK-35426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated SPARK-35426: --- Description: Now When addMergerLocation exceed the maxRetainedMergerLocations , we just remove the oldest

[jira] [Created] (SPARK-36533) Allow streaming queries with Trigger.Once run in multiple batches

Bo Zhang created SPARK-36533: Summary: Allow streaming queries with Trigger.Once run in multiple batches Key: SPARK-36533 URL: https://issues.apache.org/jira/browse/SPARK-36533 Project: Spark

[jira] [Resolved] (SPARK-36524) Add common class/trait for ANSI interval types

[ https://issues.apache.org/jira/browse/SPARK-36524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-36524. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 33753

[jira] [Assigned] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36518: Assignee: Apache Spark > spark should support distribute directory to cluster >

[jira] [Assigned] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36518: Assignee: (was: Apache Spark) > spark should support distribute directory to cluster

[jira] [Commented] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400231#comment-17400231 ] Apache Spark commented on SPARK-36518: -- User 'fhygh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36532: Assignee: (was: Apache Spark) > Deadlock in

[jira] [Assigned] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36532: Assignee: Apache Spark > Deadlock in CoarseGrainedExecutorBackend.onDisconnected >

[jira] [Commented] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

[ https://issues.apache.org/jira/browse/SPARK-36532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400188#comment-17400188 ] Apache Spark commented on SPARK-36532: -- User 'Ngone51' has created a pull request for this issue:

[jira] [Commented] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400172#comment-17400172 ] YuanGuanhu commented on SPARK-36518: [~hyukjin.kwon] we should support it like using --files command

[jira] [Commented] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400162#comment-17400162 ] Hyukjin Kwon commented on SPARK-36518: -- Can you try {{SparkContext.addFile("...", recursive =

[jira] [Commented] (SPARK-36518) spark should support distribute directory to cluster

[ https://issues.apache.org/jira/browse/SPARK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400159#comment-17400159 ] YuanGuanhu commented on SPARK-36518: [~hyukjin.kwon] ya, i know this parameter, but this will have

[jira] [Created] (SPARK-36532) Deadlock in CoarseGrainedExecutorBackend.onDisconnected

wuyi created SPARK-36532: Summary: Deadlock in CoarseGrainedExecutorBackend.onDisconnected Key: SPARK-36532 URL: https://issues.apache.org/jira/browse/SPARK-36532 Project: Spark Issue Type: Bug