[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784194#comment-16784194 ] Shahid K I commented on SPARK-27019: Please show me the screenshot of the sql page of the second

[jira] [Assigned] (SPARK-26602) Insert into table fails after querying the UDF which is loaded with wrong hdfs path

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26602: Assignee: (was: Apache Spark) > Insert into table fails after querying the UDF which

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784172#comment-16784172 ] peay edited comment on SPARK-27019 at 3/5/19 7:28 AM: -- Great! -Is that compatible

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784179#comment-16784179 ] Shahid K I commented on SPARK-27019: Thanks [~peay] could you please share the event log for that

[jira] [Assigned] (SPARK-26602) Insert into table fails after querying the UDF which is loaded with wrong hdfs path

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26602: Assignee: Apache Spark > Insert into table fails after querying the UDF which is loaded

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784172#comment-16784172 ] peay commented on SPARK-27019: -- Great! Is that compatible with my second observation above? (I tested

[jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data

[ https://issues.apache.org/jira/browse/SPARK-18105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784164#comment-16784164 ] Lewin Ma commented on SPARK-18105: -- Still hit the same issue in Spark 2.3.1：   {code:java}  

[jira] [Commented] (SPARK-26850) Make EventLoggingListener LOG_FILE_PERMISSIONS configurable

[ https://issues.apache.org/jira/browse/SPARK-26850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784159#comment-16784159 ] Jungtaek Lim commented on SPARK-26850: -- Looks like duplicated on SPARK-26912, as well as

[jira] [Commented] (SPARK-24602) In Spark SQL, ALTER TABLE--CHANGE column1 column2 datatype is not supported in 2.3.1

[ https://issues.apache.org/jira/browse/SPARK-24602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784155#comment-16784155 ] Sushanta Sen commented on SPARK-24602: -- This issue is logged prior to other JIRAs as mentioned in

[jira] [Assigned] (SPARK-26922) Set socket timeout consistently in Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-26922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26922: Assignee: (was: Apache Spark) > Set socket timeout consistently in Arrow

[jira] [Assigned] (SPARK-27054) Remove Calcite dependency

[ https://issues.apache.org/jira/browse/SPARK-27054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27054: Assignee: Apache Spark > Remove Calcite dependency > - > >

[jira] [Assigned] (SPARK-26922) Set socket timeout consistently in Arrow optimization

[ https://issues.apache.org/jira/browse/SPARK-26922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26922: Assignee: Apache Spark > Set socket timeout consistently in Arrow optimization >

[jira] [Reopened] (SPARK-26602) Insert into table fails after querying the UDF which is loaded with wrong hdfs path

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chakravarthi reopened SPARK-26602: -- > Insert into table fails after querying the UDF which is loaded with wrong > hdfs path >

[jira] [Updated] (SPARK-26602) Insert into table fails after querying the UDF which is loaded with wrong hdfs path

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chakravarthi updated SPARK-26602: - Summary: Insert into table fails after querying the UDF which is loaded with wrong hdfs path

[jira] [Commented] (SPARK-26850) Make EventLoggingListener LOG_FILE_PERMISSIONS configurable

[ https://issues.apache.org/jira/browse/SPARK-26850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784139#comment-16784139 ] Sandeep Katta commented on SPARK-26850: --- [~srowen] I feel this use case should be supported,

[jira] [Commented] (SPARK-26602) Once creating and quering udf with incorrect path,followed by querying tables or functions registered with correct path gives the runtime exception within the same ses

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784137#comment-16784137 ] Chakravarthi commented on SPARK-26602: -- And the problem is, though the jar does not exist ,it is

[jira] [Commented] (SPARK-26602) Once creating and quering udf with incorrect path,followed by querying tables or functions registered with correct path gives the runtime exception within the same ses

[ https://issues.apache.org/jira/browse/SPARK-26602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784134#comment-16784134 ] Chakravarthi commented on SPARK-26602: -- Hi [~srowen] , this issue is not duplicate of SPARK-26560.

[jira] [Comment Edited] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung edited comment on SPARK-26918 at 3/5/19 5:47 AM: --

[jira] [Assigned] (SPARK-26920) Deduplicate type checking across Arrow optimization and vectorized APIs in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26920: Assignee: (was: Apache Spark) > Deduplicate type checking across Arrow optimization

[jira] [Commented] (SPARK-26918) All .md should have ASF license header

[ https://issues.apache.org/jira/browse/SPARK-26918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784109#comment-16784109 ] Felix Cheung commented on SPARK-26918: -- [~rmsm...@gmail.com] - you don't need to checkout a tag -

[jira] [Assigned] (SPARK-27054) Remove Calcite dependency

[ https://issues.apache.org/jira/browse/SPARK-27054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27054: Assignee: (was: Apache Spark) > Remove Calcite dependency >

[jira] [Assigned] (SPARK-26920) Deduplicate type checking across Arrow optimization and vectorized APIs in SparkR

[ https://issues.apache.org/jira/browse/SPARK-26920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26920: Assignee: Apache Spark > Deduplicate type checking across Arrow optimization and

[jira] [Commented] (SPARK-26850) Make EventLoggingListener LOG_FILE_PERMISSIONS configurable

[ https://issues.apache.org/jira/browse/SPARK-26850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784107#comment-16784107 ] sandeep katta commented on SPARK-26850: --- [~happyhua] thanks for raising this issue, I will work on

[jira] [Resolved] (SPARK-24278) Create table if not exists is throwing table already exists exception

[ https://issues.apache.org/jira/browse/SPARK-24278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandeep katta resolved SPARK-24278. --- Resolution: Invalid It is the exception thrown by the Hive as mentioned above  > Create

[jira] [Created] (SPARK-27054) Remove Calcite dependency

Yuming Wang created SPARK-27054: --- Summary: Remove Calcite dependency Key: SPARK-27054 URL: https://issues.apache.org/jira/browse/SPARK-27054 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-27020) Unable to insert data with partial dynamic partition with Spark & Hive 3

[ https://issues.apache.org/jira/browse/SPARK-27020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784047#comment-16784047 ] Truong Duc Kien commented on SPARK-27020: - Hi, here are the command to reproduce the issue on my

[jira] [Created] (SPARK-27053) How about allowing engineers to use a different ExecutorBackend in StandAlone mode?

Ross Brigoli created SPARK-27053: Summary: How about allowing engineers to use a different ExecutorBackend in StandAlone mode? Key: SPARK-27053 URL: https://issues.apache.org/jira/browse/SPARK-27053

[jira] [Resolved] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27051. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23965

[jira] [Resolved] (SPARK-27039) toPandas with Arrow swallows maxResultSize errors

[ https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27039. -- Resolution: Cannot Reproduce > toPandas with Arrow swallows maxResultSize errors >

[jira] [Commented] (SPARK-27025) Speed up toLocalIterator

[ https://issues.apache.org/jira/browse/SPARK-27025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784014#comment-16784014 ] Hyukjin Kwon commented on SPARK-27025: -- Yes but there might be many variants of implementations. It

[jira] [Resolved] (SPARK-27028) PySpark read .dat file. Multiline issue

[ https://issues.apache.org/jira/browse/SPARK-27028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-27028. -- Resolution: Not A Problem > PySpark read .dat file. Multiline issue >

[jira] [Commented] (SPARK-27039) toPandas with Arrow swallows maxResultSize errors

[ https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784012#comment-16784012 ] Hyukjin Kwon commented on SPARK-27039: -- Given the history, it will be roughly between May and July

[jira] [Assigned] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-27051: Assignee: Yanbo Liang > Bump Jackson version to 2.9.8 > - >

[jira] [Commented] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783944#comment-16783944 ] Martin Loncaric commented on SPARK-27015: - Created a PR:

[jira] [Assigned] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27015: Assignee: (was: Apache Spark) > spark-submit does not properly escape arguments sent

[jira] [Assigned] (SPARK-27015) spark-submit does not properly escape arguments sent to Mesos dispatcher

[ https://issues.apache.org/jira/browse/SPARK-27015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27015: Assignee: Apache Spark > spark-submit does not properly escape arguments sent to Mesos

[jira] [Updated] (SPARK-27048) A way to execute functions on Executor Startup and Executor Exit in Standalone

[ https://issues.apache.org/jira/browse/SPARK-27048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27048: -- Target Version/s: (was: 2.4.0) > A way to execute functions on Executor Startup and Executor Exit

[jira] [Resolved] (SPARK-26205) Optimize InSet expression for bytes, shorts, ints, dates

[ https://issues.apache.org/jira/browse/SPARK-26205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26205. --- Resolution: Fixed Assignee: Anton Okolnychyi Fix Version/s: 3.0.0 This is

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783885#comment-16783885 ] Hyukjin Kwon commented on SPARK-26016: -- BTW, IIRC some codes assume other ascii compatible

[jira] [Commented] (SPARK-26016) Encoding not working when using a map / mapPartitions call

[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783878#comment-16783878 ] Sean Owen commented on SPARK-26016: --- It's "Fixed" in the sense that at least we plugged the

[jira] [Resolved] (SPARK-26016) Encoding not working when using a map / mapPartitions call

[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26016. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23962

[jira] [Assigned] (SPARK-26016) Encoding not working when using a map / mapPartitions call

[ https://issues.apache.org/jira/browse/SPARK-26016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26016: Assignee: Sean Owen > Encoding not working when using a map / mapPartitions call >

[jira] [Commented] (SPARK-26947) Pyspark KMeans Clustering job fails on large values of k

[ https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783858#comment-16783858 ] Sean Owen commented on SPARK-26947: --- That doesn't sound "very big" but how big are the vectors you

[jira] [Commented] (SPARK-26947) Pyspark KMeans Clustering job fails on large values of k

[ https://issues.apache.org/jira/browse/SPARK-26947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783849#comment-16783849 ] Parth Gandhi commented on SPARK-26947: -- [~srowen] for this particular case, k is set to 1.

[jira] [Commented] (SPARK-26972) Issue with CSV import and inferSchema set to true

[ https://issues.apache.org/jira/browse/SPARK-26972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783834#comment-16783834 ] Jean Georges Perrin commented on SPARK-26972: - [~srowen], [~hyukjin.kwon] - thanks guy for

[jira] [Assigned] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-27051: --- Assignee: (was: Yanbo Liang) > Bump Jackson version to 2.9.8 >

[jira] [Commented] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783810#comment-16783810 ] Martin Loncaric commented on SPARK-26192: - [~dongjoon] Thanks, I will pay more attention to

[jira] [Created] (SPARK-27052) Using PySpark udf in transform yields NULL values

hejsgpuom62c created SPARK-27052: Summary: Using PySpark udf in transform yields NULL values Key: SPARK-27052 URL: https://issues.apache.org/jira/browse/SPARK-27052 Project: Spark Issue

[jira] [Comment Edited] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783810#comment-16783810 ] Martin Loncaric edited comment on SPARK-26192 at 3/4/19 9:51 PM: -

[jira] [Commented] (SPARK-27014) Support removal of jars and Spark binaries from Mesos driver and executor sandboxes

[ https://issues.apache.org/jira/browse/SPARK-27014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783811#comment-16783811 ] Martin Loncaric commented on SPARK-27014: - Sure, will keep that in mind. > Support removal of

[jira] [Assigned] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27051: Assignee: (was: Apache Spark) > Bump Jackson version to 2.9.8 >

[jira] [Assigned] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27051: Assignee: Apache Spark > Bump Jackson version to 2.9.8 > - >

[jira] [Comment Edited] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783810#comment-16783810 ] Martin Loncaric edited comment on SPARK-26192 at 3/4/19 9:49 PM: -

[jira] [Created] (SPARK-27050) Bean Encoder serializes data in a wrong order if input schema is not ordered

hejsgpuom62c created SPARK-27050: Summary: Bean Encoder serializes data in a wrong order if input schema is not ordered Key: SPARK-27050 URL: https://issues.apache.org/jira/browse/SPARK-27050

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-27051: Description: Fasterxml Jackson version before 2.9.8 is affected by multiple CVEs

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-27051: Description: Fasterxml Jackson version before 2.9.8 is affected by multiple CVEs

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-27051: Description: Fasterxml Jackson version before 2.9.8 is affected by multiple

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-27051: Description: Fasterxml Jackson version before 2.9.8 is affected by multiple [CVEs | 

[jira] [Updated] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-27051: Description: Fasterxml Jackson version before 2.9.8 is affected by multiple

[jira] [Assigned] (SPARK-27051) Bump Jackson version to 2.9.8

[ https://issues.apache.org/jira/browse/SPARK-27051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang reassigned SPARK-27051: --- Assignee: Yanbo Liang > Bump Jackson version to 2.9.8 > - > >

[jira] [Created] (SPARK-27051) Bump Jackson version to 2.9.8

Yanbo Liang created SPARK-27051: --- Summary: Bump Jackson version to 2.9.8 Key: SPARK-27051 URL: https://issues.apache.org/jira/browse/SPARK-27051 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25865) Add GC information to ExecutorMetrics

[ https://issues.apache.org/jira/browse/SPARK-25865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-25865. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 22874

[jira] [Assigned] (SPARK-25865) Add GC information to ExecutorMetrics

[ https://issues.apache.org/jira/browse/SPARK-25865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-25865: Assignee: Lantao Jin > Add GC information to ExecutorMetrics >

[jira] [Comment Edited] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783745#comment-16783745 ] Dongjoon Hyun edited comment on SPARK-26192 at 3/4/19 8:15 PM: --- [~mwlon].

[jira] [Comment Edited] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783745#comment-16783745 ] Dongjoon Hyun edited comment on SPARK-26192 at 3/4/19 8:16 PM: --- [~mwlon].

[jira] [Assigned] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

[ https://issues.apache.org/jira/browse/SPARK-26688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-26688: Assignee: Attila Zsolt Piros > Provide configuration of initially blacklisted YARN nodes

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26192: -- Priority: Minor (was: Major) > MesosClusterScheduler reads options from dispatcher conf

[jira] [Resolved] (SPARK-26688) Provide configuration of initially blacklisted YARN nodes

[ https://issues.apache.org/jira/browse/SPARK-26688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26688. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23616

[jira] [Commented] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783745#comment-16783745 ] Dongjoon Hyun commented on SPARK-26192: --- [~mwlon]. Thank you for reporting and making a PR.

[jira] [Resolved] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26192. --- Resolution: Fixed Assignee: Martin Loncaric Fix Version/s: (was: 2.3.4)

[jira] [Updated] (SPARK-26192) MesosClusterScheduler reads options from dispatcher conf instead of submission conf

[ https://issues.apache.org/jira/browse/SPARK-26192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-26192: -- Issue Type: Improvement (was: Bug) > MesosClusterScheduler reads options from dispatcher

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783727#comment-16783727 ] Mi Zi commented on SPARK-26961: --- Hi Ajith,   IMHO ClassLoader.registerAsParallelCapable() only helps to

[jira] [Assigned] (SPARK-24120) Show `Jobs` page when `jobId` is missing

[ https://issues.apache.org/jira/browse/SPARK-24120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24120: Assignee: (was: Apache Spark) > Show `Jobs` page when `jobId` is missing >

[jira] [Assigned] (SPARK-24120) Show `Jobs` page when `jobId` is missing

[ https://issues.apache.org/jira/browse/SPARK-24120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24120: Assignee: Apache Spark > Show `Jobs` page when `jobId` is missing >

[jira] [Commented] (SPARK-27039) toPandas with Arrow swallows maxResultSize errors

[ https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783711#comment-16783711 ] peay commented on SPARK-27039: -- Interesting, thanks for checking. Yes, I can definitely live without that

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: Apache Spark > Add output bytes metrics for each Executor >

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: (was: Apache Spark) > Add output bytes metrics for each Executor >

[jira] [Assigned] (SPARK-24120) Show `Jobs` page when `jobId` is missing

[ https://issues.apache.org/jira/browse/SPARK-24120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24120: -- Assignee: Marcelo Vanzin > Show `Jobs` page when `jobId` is missing >

[jira] [Assigned] (SPARK-24120) Show `Jobs` page when `jobId` is missing

[ https://issues.apache.org/jira/browse/SPARK-24120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24120: -- Assignee: (was: Marcelo Vanzin) > Show `Jobs` page when `jobId` is missing >

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: Marcelo Vanzin (was: Apache Spark) > Add output bytes metrics for each

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25564: -- Assignee: Marcelo Vanzin > Add output bytes metrics for each Executor >

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25564: -- Assignee: Marcelo Vanzin > Add output bytes metrics for each Executor >

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25564: -- Assignee: (was: Marcelo Vanzin) > Add output bytes metrics for each Executor >

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25564: Assignee: Apache Spark (was: Marcelo Vanzin) > Add output bytes metrics for each

[jira] [Assigned] (SPARK-25564) Add output bytes metrics for each Executor

[ https://issues.apache.org/jira/browse/SPARK-25564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25564: -- Assignee: (was: Marcelo Vanzin) > Add output bytes metrics for each Executor >

[jira] [Commented] (SPARK-27039) toPandas with Arrow swallows maxResultSize errors

[ https://issues.apache.org/jira/browse/SPARK-27039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783690#comment-16783690 ] Bryan Cutler commented on SPARK-27039: -- I was able to reproduce in v2.4.0, but it looks like

[jira] [Assigned] (SPARK-26792) Apply custom log URL to Spark UI

[ https://issues.apache.org/jira/browse/SPARK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-26792: -- Assignee: Jungtaek Lim > Apply custom log URL to Spark UI >

[jira] [Resolved] (SPARK-26792) Apply custom log URL to Spark UI

[ https://issues.apache.org/jira/browse/SPARK-26792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26792. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23790

[jira] [Assigned] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24135: Assignee: Apache Spark > [K8s] Executors that fail to start up because of init-container

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25681: -- Assignee: (was: Marcelo Vanzin) > Delegation Tokens fetched twice upon

[jira] [Resolved] (SPARK-26995) Running Spark in Docker image with Alpine Linux 3.9.0 throws errors when using snappy

[ https://issues.apache.org/jira/browse/SPARK-26995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-26995. Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23898

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25681: -- Assignee: Marcelo Vanzin > Delegation Tokens fetched twice upon

[jira] [Assigned] (SPARK-25750) Integration Testing for Kerberos Support for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25750: Assignee: Apache Spark > Integration Testing for Kerberos Support for Spark on

[jira] [Assigned] (SPARK-25750) Integration Testing for Kerberos Support for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25750: Assignee: (was: Apache Spark) > Integration Testing for Kerberos Support for Spark

[jira] [Assigned] (SPARK-25750) Integration Testing for Kerberos Support for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25750: -- Assignee: Marcelo Vanzin > Integration Testing for Kerberos Support for Spark on

[jira] [Assigned] (SPARK-25750) Integration Testing for Kerberos Support for Spark on Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25750: -- Assignee: (was: Marcelo Vanzin) > Integration Testing for Kerberos Support for

[jira] [Assigned] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24135: Assignee: (was: Apache Spark) > [K8s] Executors that fail to start up because of

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25681: Assignee: Apache Spark > Delegation Tokens fetched twice upon

[jira] [Assigned] (SPARK-25681) Delegation Tokens fetched twice upon HadoopFSDelegationTokenProvider creation

[ https://issues.apache.org/jira/browse/SPARK-25681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25681: Assignee: (was: Apache Spark) > Delegation Tokens fetched twice upon

[jira] [Assigned] (SPARK-24135) [K8s] Executors that fail to start up because of init-container errors are not retried and limit the executor pool size

[ https://issues.apache.org/jira/browse/SPARK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-24135: -- Assignee: Marcelo Vanzin > [K8s] Executors that fail to start up because of

  1   2   3   >