[jira] [Assigned] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27021: Assignee: Apache Spark > Leaking Netty event loop group for shuffle chunk fetch requests

[jira] [Assigned] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27021: Assignee: (was: Apache Spark) > Leaking Netty event loop group for shuffle chunk

[jira] [Updated] (SPARK-27021) Netty related thread leaks ()

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Netty related thread leaks () (was: Netty related thread leaks) > Netty

[jira] [Updated] (SPARK-27021) Leaking Netty event loop group for shuffle chunk fetch requests

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Leaking Netty event loop group for shuffle chunk fetch requests (was:

[jira] [Updated] (SPARK-27021) Netty related thread leaks (event loop group for shuffle chunk fetch requests)

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-27021: --- Summary: Netty related thread leaks (event loop group for shuffle chunk fetch

[jira] [Commented] (SPARK-26346) Upgrade parquet to 1.11.0

2019-03-01 Thread Xinli Shang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781953#comment-16781953 ] Xinli Shang commented on SPARK-26346: - +1, [~yumwang] , Is there any pre-testing done on RC4 or RC3? 

[jira] [Resolved] (SPARK-26967) Put MetricsSystem instance names together for clearer management

2019-03-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26967. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23869

[jira] [Assigned] (SPARK-26967) Put MetricsSystem instance names together for clearer management

2019-03-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26967: - Assignee: SongYadong > Put MetricsSystem instance names together for clearer management >

[jira] [Commented] (SPARK-26839) on JDK11, IsolatedClientLoader must be able to load java.sql classes

2019-03-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781903#comment-16781903 ] Sean Owen commented on SPARK-26839: --- Just sharing where I have gotten to with this as well: I think we

[jira] [Commented] (SPARK-24295) Purge Structured streaming FileStreamSinkLog metadata compact file data.

2019-03-01 Thread Iqbal Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781879#comment-16781879 ] Iqbal Singh commented on SPARK-24295: - Agree, [~kabhwan]. It's very tricky to purge metadata as it

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826 ] shahid edited comment on SPARK-27019 at 3/1/19 4:11 PM: Yes. The issue happened

[jira] [Created] (SPARK-27025) Speed up toLocalIterator

2019-03-01 Thread Erik van Oosten (JIRA)
Erik van Oosten created SPARK-27025: --- Summary: Speed up toLocalIterator Key: SPARK-27025 URL: https://issues.apache.org/jira/browse/SPARK-27025 Project: Spark Issue Type: Wish

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781826#comment-16781826 ] shahid commented on SPARK-27019: Yes. The issue happened because of the event reordering when the query

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27019: --- Attachment: Screenshot from 2019-03-01 21-31-48.png > Spark UI's SQL tab shows inconsistent values >

[jira] [Assigned] (SPARK-27022) Kafka delegation token support

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27022: Assignee: Apache Spark > Kafka delegation token support > --

[jira] [Assigned] (SPARK-27022) Kafka delegation token support

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27022: Assignee: (was: Apache Spark) > Kafka delegation token support >

[jira] [Commented] (SPARK-27024) Design executor interface to support GPU resources

2019-03-01 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781734#comment-16781734 ] Thomas Graves commented on SPARK-27024: --- I will be looking at this and propose a design. > Design

[jira] [Created] (SPARK-27024) Design executor interface to support GPU resources

2019-03-01 Thread Xingbo Jiang (JIRA)
Xingbo Jiang created SPARK-27024: Summary: Design executor interface to support GPU resources Key: SPARK-27024 URL: https://issues.apache.org/jira/browse/SPARK-27024 Project: Spark Issue

[jira] [Commented] (SPARK-26969) [Spark] Using ODBC not able to see the data in table when datatype is decimal

2019-03-01 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781731#comment-16781731 ] ABHISHEK KUMAR GUPTA commented on SPARK-26969: -- ODBC INSTALLATION Follow Below Steps : 1.

[jira] [Commented] (SPARK-27005) Design sketch: Accelerator-aware scheduling

2019-03-01 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781728#comment-16781728 ] Thomas Graves commented on SPARK-27005: --- It seems like we are mixing gpu's as static resource vs

[jira] [Assigned] (SPARK-27023) Kubernetes client timeouts should be configurable

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27023: Assignee: Apache Spark > Kubernetes client timeouts should be configurable >

[jira] [Assigned] (SPARK-27023) Kubernetes client timeouts should be configurable

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27023: Assignee: (was: Apache Spark) > Kubernetes client timeouts should be configurable >

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay updated SPARK-27019: - Attachment: application_1550040445209_4748 > Spark UI's SQL tab shows inconsistent values >

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781718#comment-16781718 ] peay commented on SPARK-27019: -- Attached: [^application_1550040445209_4748] > Spark UI's SQL tab shows

[jira] [Created] (SPARK-27022) Kafka delegation token support

2019-03-01 Thread Gabor Somogyi (JIRA)
Gabor Somogyi created SPARK-27022: - Summary: Kafka delegation token support Key: SPARK-27022 URL: https://issues.apache.org/jira/browse/SPARK-27022 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-27023) Kubernetes client timeouts should be configurable

2019-03-01 Thread Onur Satici (JIRA)
Onur Satici created SPARK-27023: --- Summary: Kubernetes client timeouts should be configurable Key: SPARK-27023 URL: https://issues.apache.org/jira/browse/SPARK-27023 Project: Spark Issue Type:

[jira] [Created] (SPARK-27021) Netty related thread leaks

2019-03-01 Thread Attila Zsolt Piros (JIRA)
Attila Zsolt Piros created SPARK-27021: -- Summary: Netty related thread leaks Key: SPARK-27021 URL: https://issues.apache.org/jira/browse/SPARK-27021 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-27021) Netty related thread leaks

2019-03-01 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781707#comment-16781707 ] Attila Zsolt Piros commented on SPARK-27021: I am already working on it. > Netty related

[jira] [Commented] (SPARK-27020) Unable to insert data with partial dynamic partition with Spark & Hive 3

2019-03-01 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781697#comment-16781697 ] Yuming Wang commented on SPARK-27020: - cc @[~hyukjin.kwon] > Unable to insert data with partial

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid commented on SPARK-27019: seems event reordering has happened. Job start event came after sql

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:33 PM: seems event reordering

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781670#comment-16781670 ] shahid edited comment on SPARK-27019 at 3/1/19 1:29 PM: seems event reordering

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781657#comment-16781657 ] Marco Gaido commented on SPARK-27018: - First the issue is fixed on master and then it is backported

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651 ] peay edited comment on SPARK-27019 at 3/1/19 1:06 PM: -- Sure does. I've done one

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781651#comment-16781651 ] peay commented on SPARK-27019: -- Sure does. I've done one more test, using no executors and running the

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781640#comment-16781640 ] Piotr Kołaczkowski commented on SPARK-27018: For master only? Why not for 2.2, 2.3, master?

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781638#comment-16781638 ] Jungtaek Lim commented on SPARK-27019: -- Submitted date feels me as "-1", as UNIX epoch 0 represents

[jira] [Commented] (SPARK-26176) Verify column name when creating table via `STORED AS`

2019-03-01 Thread Denes Gerencser (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781607#comment-16781607 ] Denes Gerencser commented on SPARK-26176: - Hi, I think this ticket is not valid any more as

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay updated SPARK-27019: - Attachment: query-job-1.png query-1-details.png query-1-list.png > Spark UI's

[jira] [Issue Comment Deleted] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-27019: --- Comment: was deleted (was: Seems event reordering has happened. ie. JobStart event came after

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781606#comment-16781606 ] shahid commented on SPARK-27019: Seems event reordering has happened. ie. JobStart event came after

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781604#comment-16781604 ] peay commented on SPARK-27019: -- OK, I can actually reproduce it pretty easily with pyspark: {code:java}

[jira] [Created] (SPARK-27020) Unable to insert data with partial dynamic partition with Spark & Hive 3

2019-03-01 Thread Truong Duc Kien (JIRA)
Truong Duc Kien created SPARK-27020: --- Summary: Unable to insert data with partial dynamic partition with Spark & Hive 3 Key: SPARK-27020 URL: https://issues.apache.org/jira/browse/SPARK-27020

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595 ] peay commented on SPARK-27019: -- I don't really have a minimal example - this uses a bunch of python jobs

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781595#comment-16781595 ] peay edited comment on SPARK-27019 at 3/1/19 11:40 AM: --- I don't really have a

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781588#comment-16781588 ] shahid commented on SPARK-27019: Hi [~peay] Could you please add test to reproduce it? > Spark UI's SQL

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781583#comment-16781583 ] peay commented on SPARK-27019: -- Also seeing this both for the Spark UI for live jobs, and when accessing

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay updated SPARK-27019: - Description: Since 2.4.0, I am frequently seeing broken outputs in the SQL tab of the Spark UI, where

[jira] [Comment Edited] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581 ] peay edited comment on SPARK-27019 at 3/1/19 11:10 AM: --- Seems like the screenshots

[jira] [Commented] (SPARK-26727) CREATE OR REPLACE VIEW query fails with TableAlreadyExistsException

2019-03-01 Thread Udbhav Agrawal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781582#comment-16781582 ] Udbhav Agrawal commented on SPARK-26727: works fine for me, cannot reproduce it > CREATE OR

[jira] [Updated] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] peay updated SPARK-27019: - Attachment: screenshot-spark-ui-list.png screenshot-spark-ui-details.png > Spark UI's SQL tab

[jira] [Commented] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781581#comment-16781581 ] peay commented on SPARK-27019: -- Seems like the screenshot did not embed, attaching them instead. > Spark

[jira] [Created] (SPARK-27019) Spark UI's SQL tab shows inconsistent values

2019-03-01 Thread peay (JIRA)
peay created SPARK-27019: Summary: Spark UI's SQL tab shows inconsistent values Key: SPARK-27019 URL: https://issues.apache.org/jira/browse/SPARK-27019 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-26872) Use a configurable value for final termination in the JobScheduler.stop() method

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26872: Assignee: Apache Spark > Use a configurable value for final termination in the

[jira] [Assigned] (SPARK-26872) Use a configurable value for final termination in the JobScheduler.stop() method

2019-03-01 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26872: Assignee: (was: Apache Spark) > Use a configurable value for final termination in

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781558#comment-16781558 ] Marco Gaido commented on SPARK-27018: - [~pkolaczk] thanks for reporting the issue. Spark works with

[jira] [Commented] (SPARK-26815) run command "Spark-shell --proxy-user " failed in kerberos environment

2019-03-01 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781556#comment-16781556 ] Yuming Wang commented on SPARK-26815: - I thinks it's your environment issue. It works for me:

[jira] [Updated] (SPARK-26815) run command "Spark-shell --proxy-user " failed in kerberos environment

2019-03-01 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-26815: Attachment: image-2019-03-01-18-38-18-173.png > run command "Spark-shell --proxy-user " failed in

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Affects Version/s: 2.2.3 > Checkpointed RDD deleted prematurely when using

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Affects Version/s: 2.3.3 > Checkpointed RDD deleted prematurely when using

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781501#comment-16781501 ] Piotr Kołaczkowski commented on SPARK-27018: Atached patch for Spark 2.2.2. Should be

[jira] [Comment Edited] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781501#comment-16781501 ] Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:32 AM:

[jira] [Updated] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Kołaczkowski updated SPARK-27018: --- Attachment:

[jira] [Commented] (SPARK-26991) Investigate difference of `returnNullable` between ScalaReflection.deserializerFor and JavaTypeInference.deserializerFor

2019-03-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781487#comment-16781487 ] Jungtaek Lim commented on SPARK-26991: -- This issue could be extended to investigate the difference

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781492#comment-16781492 ] Piotr Kołaczkowski commented on SPARK-27018: PeriodicCheckpointer: {noformat} // Remove

[jira] [Comment Edited] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781481#comment-16781481 ] Piotr Kołaczkowski edited comment on SPARK-27018 at 3/1/19 9:04 AM:

[jira] [Commented] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781481#comment-16781481 ] Piotr Kołaczkowski commented on SPARK-27018: The checkpoint is deleted here (stacktrace):

[jira] [Comment Edited] (SPARK-26388) No support for "alter table .. replace columns" to drop columns

2019-03-01 Thread nivedita singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16780365#comment-16780365 ] nivedita singh edited comment on SPARK-26388 at 3/1/19 8:45 AM: I even

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

2019-03-01 Thread Jungtaek Lim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16781458#comment-16781458 ] Jungtaek Lim commented on SPARK-26961: -- Which distribution of Spark are you using? Specifically the 

[jira] [Created] (SPARK-27018) Checkpointed RDD deleted prematurely when using GBTClassifier

2019-03-01 Thread JIRA
Piotr Kołaczkowski created SPARK-27018: -- Summary: Checkpointed RDD deleted prematurely when using GBTClassifier Key: SPARK-27018 URL: https://issues.apache.org/jira/browse/SPARK-27018 Project:

<    1   2