[jira] [Comment Edited] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625404#comment-16625404 ] Yinan Li edited comment on SPARK-25500 at 9/24/18 5:51 AM: --- We don't plan to

[jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625404#comment-16625404 ] Yinan Li commented on SPARK-25500: -- We don't plan to add more configuration properties for pod

[jira] [Assigned] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25478: - Assignee: Yuming Wang > Refactor CompressionSchemeBenchmark to use main method >

[jira] [Resolved] (SPARK-25478) Refactor CompressionSchemeBenchmark to use main method

[ https://issues.apache.org/jira/browse/SPARK-25478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25478. --- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22486

[jira] [Resolved] (SPARK-23039) Fix the bug in alter table set location.

[ https://issues.apache.org/jira/browse/SPARK-23039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-23039. - Resolution: Won't Fix > Fix the bug in alter table set location. >

[jira] [Commented] (SPARK-20712) [SPARK 2.1 REGRESSION][SQL] Spark can't read Hive table when column type has length greater than 4000 bytes

[ https://issues.apache.org/jira/browse/SPARK-20712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625344#comment-16625344 ] Yuming Wang commented on SPARK-20712: - I can't reproduce it on master by {{scala}} API: {code:scala}

[jira] [Commented] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625305#comment-16625305 ] Yuming Wang commented on SPARK-23985: - [~uzadude] It seems already works: {code:scala}

[jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625303#comment-16625303 ] Sean Owen commented on SPARK-20937: --- Hm, is this really important? it selects behavior from Spark

[jira] [Commented] (SPARK-25250) Race condition with tasks running when new attempt for same stage is created leads to other task in the next attempt running on the same partition id retry multiple ti

[ https://issues.apache.org/jira/browse/SPARK-25250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625283#comment-16625283 ] Parth Gandhi commented on SPARK-25250: -- Currently working on this issue, will file a pull request

[jira] [Commented] (SPARK-25455) Spark bundles jackson library version, which is vulnerable

[ https://issues.apache.org/jira/browse/SPARK-25455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625280#comment-16625280 ] Hajime Osako commented on SPARK-25455: -- Isn't this a dupe of SPARK-24601? > Spark bundles jackson

[jira] [Assigned] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20845: Assignee: Apache Spark > Support specification of column names in INSERT INTO >

[jira] [Commented] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625254#comment-16625254 ] Apache Spark commented on SPARK-20845: -- User 'misutoth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20845) Support specification of column names in INSERT INTO

[ https://issues.apache.org/jira/browse/SPARK-20845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20845: Assignee: (was: Apache Spark) > Support specification of column names in INSERT INTO

[jira] [Resolved] (SPARK-25489) Refactor UDTSerializationBenchmark

[ https://issues.apache.org/jira/browse/SPARK-25489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25489. --- Resolution: Fixed Fix Version/s: 2.5.0 Issue resolved by pull request 22499

[jira] [Assigned] (SPARK-25489) Refactor UDTSerializationBenchmark

[ https://issues.apache.org/jira/browse/SPARK-25489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25489: - Assignee: Chenxiao Mao > Refactor UDTSerializationBenchmark >

[jira] [Commented] (SPARK-25415) Make plan change log in RuleExecutor configurable by SQLConf

[ https://issues.apache.org/jira/browse/SPARK-25415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625154#comment-16625154 ] Apache Spark commented on SPARK-25415: -- User 'wangyum' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624695#comment-16624695 ] shahid edited comment on SPARK-25502 at 9/23/18 1:00 PM: - I have raised PR

[jira] [Comment Edited] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093 ] shahid edited comment on SPARK-25448 at 9/23/18 12:51 PM: -- I am not able to

[jira] [Issue Comment Deleted] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25504: --- Comment: was deleted (was: I am analyzing the issue. Will raise a PR soon.) > [Spark Job History]If the

[jira] [Commented] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625095#comment-16625095 ] shahid commented on SPARK-25504: According to the code in the AppStatusListener.scala,

[jira] [Updated] (SPARK-25504) [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask value, then stage page of UI should display upto the value set in the retainedTask.

[ https://issues.apache.org/jira/browse/SPARK-25504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25504: --- Attachment: AppStatusListener.png > [Spark Job History]If the number of tasks exceeds spark.ui.retainedTask

[jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625093#comment-16625093 ] shahid commented on SPARK-25448: I am not able to reproduce the issue with spark2.3.1 Test steps: 1)

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: (was: historyJobs.jpg) > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: image-2018-09-23-18-01-35-554.png > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: historyJobs.jpg > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: (was: jobpage.png) > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Assigned] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24869: Assignee: Apache Spark > SaveIntoDataSourceCommand's input Dataset does not use Cached

[jira] [Assigned] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24869: Assignee: (was: Apache Spark) > SaveIntoDataSourceCommand's input Dataset does not

[jira] [Commented] (SPARK-24869) SaveIntoDataSourceCommand's input Dataset does not use Cached Data

[ https://issues.apache.org/jira/browse/SPARK-24869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625080#comment-16625080 ] Apache Spark commented on SPARK-24869: -- User 'wangyum' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Comment: was deleted (was: I am not able to reproduce the issue with the below steps 1) bin/spark-shell

[jira] [Commented] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625075#comment-16625075 ] shahid commented on SPARK-25448: I am not able to reproduce the issue with the below steps 1)

[jira] [Updated] (SPARK-25448) [Spark Job History] Job Staged page shows 1000 Jobs only

[ https://issues.apache.org/jira/browse/SPARK-25448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-25448: --- Attachment: jobpage.png > [Spark Job History] Job Staged page shows 1000 Jobs only >

[jira] [Commented] (SPARK-24499) Documentation improvement of Spark core and SQL

[ https://issues.apache.org/jira/browse/SPARK-24499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625061#comment-16625061 ] Li Yuanjian commented on SPARK-24499: - [~smilegator] Sorry for the late reply for this, we'll give

[jira] [Comment Edited] (SPARK-24486) Slow performance reading ArrayType columns

[ https://issues.apache.org/jira/browse/SPARK-24486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624723#comment-16624723 ] Yuming Wang edited comment on SPARK-24486 at 9/23/18 8:42 AM: --

[jira] [Comment Edited] (SPARK-24486) Slow performance reading ArrayType columns

[ https://issues.apache.org/jira/browse/SPARK-24486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624723#comment-16624723 ] Yuming Wang edited comment on SPARK-24486 at 9/23/18 8:38 AM: --

[jira] [Updated] (SPARK-25513) Read zipped CSV and JSON files

[ https://issues.apache.org/jira/browse/SPARK-25513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-25513: --- Description: Spark can read compression files if there is compression codec for them. By default,

[jira] [Commented] (SPARK-25319) Spark MLlib, GraphX 2.4 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-25319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625013#comment-16625013 ] Weichen Xu commented on SPARK-25319: Sure! > Spark MLlib, GraphX 2.4 QA umbrella >