[jira] [Created] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

Maxim Gekk created SPARK-27199: -- Summary: Replace TimeZone by ZoneId in TimestampFormatter API Key: SPARK-27199 URL: https://issues.apache.org/jira/browse/SPARK-27199 Project: Spark Issue Type:

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: image-2019-03-19-15-17-25-522.png > number of active tasks is negative on executors page > ---

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: job_1924.log > number of active tasks is negative on executors page >

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795774#comment-16795774 ] acupple commented on SPARK-27169: - I have enabled event log, on the spark UI, the job ha

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795774#comment-16795774 ] acupple edited comment on SPARK-27169 at 3/19/19 7:22 AM: -- I ha

[jira] [Assigned] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

[ https://issues.apache.org/jira/browse/SPARK-27199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27199: Assignee: (was: Apache Spark) > Replace TimeZone by ZoneId in TimestampFormatter API

[jira] [Assigned] (SPARK-27199) Replace TimeZone by ZoneId in TimestampFormatter API

[ https://issues.apache.org/jira/browse/SPARK-27199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27199: Assignee: Apache Spark > Replace TimeZone by ZoneId in TimestampFormatter API > -

[jira] [Commented] (SPARK-27052) Using PySpark udf in transform yields NULL values

[ https://issues.apache.org/jira/browse/SPARK-27052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795797#comment-16795797 ] Artem Rybin commented on SPARK-27052: - Hi [~hejsgpuom62c]! I reproduced this issue.

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27194: Assignee: Apache Spark > Job failures when task attempts do not clean up spark-staging pa

[jira] [Assigned] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27194: Assignee: (was: Apache Spark) > Job failures when task attempts do not clean up spark

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795878#comment-16795878 ] shahid commented on SPARK-27169: Thank you. Could you please provide full event log if p

[jira] [Commented] (SPARK-27052) Using PySpark udf in transform yields NULL values

[ https://issues.apache.org/jira/browse/SPARK-27052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795883#comment-16795883 ] Hyukjin Kwon commented on SPARK-27052: -- It doesn't usually and necessarily assign s

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795890#comment-16795890 ] Nikolay Kashtanov commented on SPARK-24668: --- Hi [~Karthik Palaniappan] are you

[jira] [Comment Edited] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795878#comment-16795878 ] shahid edited comment on SPARK-27169 at 3/19/19 9:38 AM: - Thank

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795907#comment-16795907 ] Nikolay Kashtanov commented on SPARK-24668: --- [~hyukjin.kwon] could you please

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795908#comment-16795908 ] Hyukjin Kwon commented on SPARK-24668: -- It doesn't usually and neccesarily assign s

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795903#comment-16795903 ] Hyukjin Kwon commented on SPARK-24668: -- Please go ahead. > PySpark crashes when ge

[jira] [Created] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

Ajith S created SPARK-27200: --- Summary: History Environment tab must sort Configurations/Properties by default Key: SPARK-27200 URL: https://issues.apache.org/jira/browse/SPARK-27200 Project: Spark

[jira] [Assigned] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

[ https://issues.apache.org/jira/browse/SPARK-27200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27200: Assignee: Apache Spark > History Environment tab must sort Configurations/Properties by d

[jira] [Assigned] (SPARK-27200) History Environment tab must sort Configurations/Properties by default

[ https://issues.apache.org/jira/browse/SPARK-27200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27200: Assignee: (was: Apache Spark) > History Environment tab must sort Configurations/Prop

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:12 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:16 AM: -

[jira] [Commented] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade commented on SPARK-26985: --- Hi [~srowen], [~hyukjin.kwon] I have obs

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:18 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: -

[jira] [Resolved] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26555. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24085 [https://gith

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:24 AM: -

[jira] [Assigned] (SPARK-26555) Thread safety issue causes createDataset to fail with misleading errors

[ https://issues.apache.org/jira/browse/SPARK-26555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26555: --- Assignee: Martin Loncaric > Thread safety issue causes createDataset to fail with misleadin

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:17 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:24 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:32 AM: -

[jira] [Comment Edited] (SPARK-26985) Test "access only some column of the all of columns " fails on big endian

[ https://issues.apache.org/jira/browse/SPARK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795931#comment-16795931 ] Anuja Jakhade edited comment on SPARK-26985 at 3/19/19 10:19 AM: -

[jira] [Resolved] (SPARK-27151) ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27151. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0 Reso

[jira] [Assigned] (SPARK-26176) Verify column name when creating table via `STORED AS`

[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-26176: --- Assignee: Sujith Chacko > Verify column name when creating table via `STORED AS` >

[jira] [Resolved] (SPARK-26176) Verify column name when creating table via `STORED AS`

[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-26176. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24075 [https://gith

[jira] [Updated] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] acupple updated SPARK-27169: Attachment: stage_3511.log > number of active tasks is negative on executors page > --

[jira] [Commented] (SPARK-27169) number of active tasks is negative on executors page

[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796039#comment-16796039 ] acupple commented on SPARK-27169: - The full event log is too large. unknown stage log：

[jira] [Commented] (SPARK-26739) Standardized Join Types for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796045#comment-16796045 ] Valeria Vasylieva commented on SPARK-26739: --- [~slehan] hi! I strongly agree th

[jira] [Created] (SPARK-27201) Show full job description on click

Gengliang Wang created SPARK-27201: -- Summary: Show full job description on click Key: SPARK-27201 URL: https://issues.apache.org/jira/browse/SPARK-27201 Project: Spark Issue Type: Task

[jira] [Assigned] (SPARK-27201) Show full job description on click

[ https://issues.apache.org/jira/browse/SPARK-27201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27201: Assignee: Apache Spark > Show full job description on click > ---

[jira] [Assigned] (SPARK-27201) Show full job description on click

[ https://issues.apache.org/jira/browse/SPARK-27201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27201: Assignee: (was: Apache Spark) > Show full job description on click >

[jira] [Created] (SPARK-27202) update comments to keep according with code

EdisonWang created SPARK-27202: -- Summary: update comments to keep according with code Key: SPARK-27202 URL: https://issues.apache.org/jira/browse/SPARK-27202 Project: Spark Issue Type: Improveme

[jira] [Assigned] (SPARK-27202) update comments to keep according with code

[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27202: Assignee: Apache Spark > update comments to keep according with code > --

[jira] [Assigned] (SPARK-27202) update comments to keep according with code

[ https://issues.apache.org/jira/browse/SPARK-27202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27202: Assignee: (was: Apache Spark) > update comments to keep according with code > ---

[jira] [Created] (SPARK-27203) Fails to read a view using CTE (WITH clause) and created via beeline

Igor Ngouagna created SPARK-27203: - Summary: Fails to read a view using CTE (WITH clause) and created via beeline Key: SPARK-27203 URL: https://issues.apache.org/jira/browse/SPARK-27203 Project: Spar

[jira] [Updated] (SPARK-27203) Spark Fails to read a view using CTE (WITH clause) and created via beeline

[ https://issues.apache.org/jira/browse/SPARK-27203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Ngouagna updated SPARK-27203: -- Summary: Spark Fails to read a view using CTE (WITH clause) and created via beeline (was: Fa

[jira] [Updated] (SPARK-27203) Spark Fails to read a view using CTE (WITH clause) and created via beeline

[ https://issues.apache.org/jira/browse/SPARK-27203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Ngouagna updated SPARK-27203: -- Environment: (was: *Spark: 2.1.1* *Beeline: 1.2.1000*) > Spark Fails to read a view using

[jira] [Commented] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

[ https://issues.apache.org/jira/browse/SPARK-27204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796110#comment-16796110 ] shahid commented on SPARK-27204: Thanks. I will analyze, > First time Loading applicati

[jira] [Created] (SPARK-27204) First time Loading application page from History Server is taking time when event log size is huge

ABHISHEK KUMAR GUPTA created SPARK-27204: Summary: First time Loading application page from History Server is taking time when event log size is huge Key: SPARK-27204 URL: https://issues.apache.org/jira/br

[jira] [Commented] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796125#comment-16796125 ] Jungtaek Lim commented on SPARK-27205: -- I have a patch now: it's not just a rollbac

[jira] [Created] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

Jungtaek Lim created SPARK-27205: Summary: spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars Key: SPARK-27205 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Updated] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-27205: - Description: I found this bug while testing my patch regarding Spark SQL Kafka module - I tend

[jira] [Assigned] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27205: Assignee: Apache Spark > spark-shell with packages option fails to load transitive depend

[jira] [Assigned] (SPARK-27205) spark-shell with packages option fails to load transitive dependencies even ivy successfully pulls jars

[ https://issues.apache.org/jira/browse/SPARK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27205: Assignee: (was: Apache Spark) > spark-shell with packages option fails to load transi

[jira] [Created] (SPARK-27206) Using slice method with streaming api's Interval on DStream

Aarthi created SPARK-27206: -- Summary: Using slice method with streaming api's Interval on DStream Key: SPARK-27206 URL: https://issues.apache.org/jira/browse/SPARK-27206 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24668) PySpark crashes when getting the webui url if the webui is disabled

[ https://issues.apache.org/jira/browse/SPARK-24668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796263#comment-16796263 ] Karthik Palaniappan commented on SPARK-24668: - Please take it :) I didn't ha

[jira] [Assigned] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-27179: - Assignee: Yuming Wang Priority: Minor (was: Major) > Exclude javax.ws.rs:jsr311-api from h

[jira] [Resolved] (SPARK-27179) Exclude javax.ws.rs:jsr311-api from hadoop-client

[ https://issues.apache.org/jira/browse/SPARK-27179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-27179. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24114 [https://github.c

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27194: -- Description: When a container fails for some reason (for example when killed by yarn for exce

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27194: -- Description: When a container fails for some reason (for example when killed by yarn for exce

[jira] [Commented] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796434#comment-16796434 ] Dongjoon Hyun commented on SPARK-27194: --- Hi, [~ajithshetty]. Just out of curiosity

[jira] [Created] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

Parth Gandhi created SPARK-27207: Summary: There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize Key: SPARK-27207 URL: https:

[jira] [Assigned] (SPARK-26288) add initRegisteredExecutorsDB in ExternalShuffleService

[ https://issues.apache.org/jira/browse/SPARK-26288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-26288: Assignee: weixiuli > add initRegisteredExecutorsDB in ExternalShuffleService > --

[jira] [Resolved] (SPARK-26288) add initRegisteredExecutorsDB in ExternalShuffleService

[ https://issues.apache.org/jira/browse/SPARK-26288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26288. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23393 [https://gi

[jira] [Commented] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796539#comment-16796539 ] Imran Rashid commented on SPARK-27112: -- Fixed in 2.4 & 2.3 by https://github.com/ap

[jira] [Updated] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-27112: - Fix Version/s: 2.4.1 2.3.4 > Spark Scheduler encounters two independent Deadl

[jira] [Commented] (SPARK-27208) RestSubmissionClient only supports http

[ https://issues.apache.org/jira/browse/SPARK-27208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796544#comment-16796544 ] Jorge Machado commented on SPARK-27208: --- relates to this as the follow up error >

[jira] [Assigned] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

[ https://issues.apache.org/jira/browse/SPARK-27207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27207: Assignee: Apache Spark > There exists a bug with SortBasedAggregator where merge()/update

[jira] [Assigned] (SPARK-27207) There exists a bug with SortBasedAggregator where merge()/update() operations get invoked on the aggregate buffer without calling initialize

[ https://issues.apache.org/jira/browse/SPARK-27207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27207: Assignee: (was: Apache Spark) > There exists a bug with SortBasedAggregator where mer

[jira] [Created] (SPARK-27208) RestSubmissionClient only supports http

Jorge Machado created SPARK-27208: - Summary: RestSubmissionClient only supports http Key: SPARK-27208 URL: https://issues.apache.org/jira/browse/SPARK-27208 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-27194) Job failures when task attempts do not clean up spark-staging parquet files

[ https://issues.apache.org/jira/browse/SPARK-27194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-27194: --- Description: When a container fails for some reason (for example when killed by yarn for ex

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: Marcelo Vanzin > Dynamic allocation will preserve cached data > ---

[jira] [Assigned] (SPARK-21097) Dynamic allocation will preserve cached data

[ https://issues.apache.org/jira/browse/SPARK-21097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-21097: -- Assignee: (was: Marcelo Vanzin) > Dynamic allocation will preserve cached data >

[jira] [Resolved] (SPARK-27197) Add ReadNestedSchemaTest for file-based data sources

[ https://issues.apache.org/jira/browse/SPARK-27197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-27197. - Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 24139 [https://github.com/a

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:00 AM: ---

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:02 AM: ---

[jira] [Comment Edited] (SPARK-19254) Support Seq, Map, and Struct in functions.lit

[ https://issues.apache.org/jira/browse/SPARK-19254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16753582#comment-16753582 ] Artem Rukavytsia edited comment on SPARK-19254 at 3/20/19 1:03 AM: ---

[jira] [Updated] (SPARK-26736) if filter condition `And` has non-determined sub function it does not do partition prunning

[ https://issues.apache.org/jira/browse/SPARK-26736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated SPARK-26736: --- Summary: if filter condition `And` has non-determined sub function it does not do partition prunning

[jira] [Commented] (SPARK-27186) Optimize SortShuffleWriter writing process

[ https://issues.apache.org/jira/browse/SPARK-27186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796671#comment-16796671 ] Apache Spark commented on SPARK-27186: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796677#comment-16796677 ] Imran Rashid commented on SPARK-27112: -- I revised the fix version for 2.4 to 2.4.2,

[jira] [Updated] (SPARK-27112) Spark Scheduler encounters two independent Deadlocks when trying to kill executors either due to dynamic allocation or blacklisting

[ https://issues.apache.org/jira/browse/SPARK-27112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-27112: - Fix Version/s: (was: 2.4.1) 2.4.2 > Spark Scheduler encounters two indepe

[jira] [Resolved] (SPARK-26975) Support nested-column pruning over limit/sample/repartition

[ https://issues.apache.org/jira/browse/SPARK-26975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-26975. --- Resolution: Fixed Fix Version/s: 3.0.0 This is resolved via https://github.com/apache

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27160: -- Fix Version/s: (was: 2.4.1) > Incorrect Literal Casting of DecimalType in OrcFilters > ---

[jira] [Commented] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796760#comment-16796760 ] Dongjoon Hyun commented on SPARK-27160: --- Hi, [~sadhen]. Thank you so much for this

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 4:00 AM:

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 3:59 AM:

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 4:02 AM:

[jira] [Comment Edited] (SPARK-16190) Worker registration failed: Duplicate worker ID

[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796772#comment-16796772 ] zuotingbing edited comment on SPARK-16190 at 3/20/19 3:57 AM:

[jira] [Commented] (SPARK-16190) Worker registration failed: Duplicate worker ID

[ https://issues.apache.org/jira/browse/SPARK-16190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796772#comment-16796772 ] zuotingbing commented on SPARK-16190: - i faced the same issue. worker log as follows

[jira] [Created] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

Dilip Biswal created SPARK-27209: Summary: Split parsing of SELECT and INSERT into two top-level rules in the grammar file. Key: SPARK-27209 URL: https://issues.apache.org/jira/browse/SPARK-27209 Proj

[jira] [Assigned] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27209: Assignee: (was: Apache Spark) > Split parsing of SELECT and INSERT into two top-level

[jira] [Assigned] (SPARK-27209) Split parsing of SELECT and INSERT into two top-level rules in the grammar file.

[ https://issues.apache.org/jira/browse/SPARK-27209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27209: Assignee: Apache Spark > Split parsing of SELECT and INSERT into two top-level rules in t

[jira] [Commented] (SPARK-27086) DataSourceV2 MicroBatchExecution commits last batch only if new batch is constructed

[ https://issues.apache.org/jira/browse/SPARK-27086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796812#comment-16796812 ] Jungtaek Lim commented on SPARK-27086: -- [~sebastianherold] This sounds like a kind

[jira] [Comment Edited] (SPARK-27086) DataSourceV2 MicroBatchExecution commits last batch only if new batch is constructed

[ https://issues.apache.org/jira/browse/SPARK-27086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796812#comment-16796812 ] Jungtaek Lim edited comment on SPARK-27086 at 3/20/19 5:38 AM: ---

[jira] [Assigned] (SPARK-26739) Standardized Join Types for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26739: Assignee: (was: Apache Spark) > Standardized Join Types for DataFrames >

[jira] [Assigned] (SPARK-26739) Standardized Join Types for DataFrames

[ https://issues.apache.org/jira/browse/SPARK-26739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26739: Assignee: Apache Spark > Standardized Join Types for DataFrames > ---

[jira] [Commented] (SPARK-15544) Bouncing Zookeeper node causes Active spark master to exit

[ https://issues.apache.org/jira/browse/SPARK-15544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796825#comment-16796825 ] Jungtaek Lim commented on SPARK-15544: -- [~moein7tl] Do you make some progress? If

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27160: -- Priority: Major (was: Blocker) > Incorrect Literal Casting of DecimalType in OrcFilters > ---

[jira] [Updated] (SPARK-27160) Incorrect Literal Casting of DecimalType in OrcFilters

[ https://issues.apache.org/jira/browse/SPARK-27160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-27160: -- Fix Version/s: (was: 3.0.0) > Incorrect Literal Casting of DecimalType in OrcFilters > ---

  1   2   >