[jira] [Commented] (SPARK-28759) Upgrade scala-maven-plugin to 4.2.0

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920028#comment-16920028 ] Hyukjin Kwon commented on SPARK-28759: -- (let me turn this back to SPARK-24417 since now 4.2.0 has

[jira] [Updated] (SPARK-28759) Upgrade scala-maven-plugin to 4.2.0

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28759: - Parent: SPARK-24417 Issue Type: Sub-task (was: Improvement) > Upgrade

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920018#comment-16920018 ] Jungtaek Lim edited comment on SPARK-28025 at 8/31/19 4:30 AM: --- FYI, I

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920018#comment-16920018 ] Jungtaek Lim edited comment on SPARK-28025 at 8/31/19 4:30 AM: --- FYI, I

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920018#comment-16920018 ] Jungtaek Lim commented on SPARK-28025: -- FYI, I just submitted a patch for HADOOP-16225. Hope we can

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920009#comment-16920009 ] zhao bo commented on SPARK-28770: - Thanks Lim, yeah, we also found that most test jobs will pass towards

[jira] [Commented] (SPARK-28937) Improve error reporting in Spark Secrets Test Suite

[ https://issues.apache.org/jira/browse/SPARK-28937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919991#comment-16919991 ] holdenk commented on SPARK-28937: - I'm working on this > Improve error reporting in Spark Secrets Test

[jira] [Created] (SPARK-28937) Improve error reporting in Spark Secrets Test Suite

holdenk created SPARK-28937: --- Summary: Improve error reporting in Spark Secrets Test Suite Key: SPARK-28937 URL: https://issues.apache.org/jira/browse/SPARK-28937 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28936) Simplify Spark K8s tests by replacing race condition during command execution

[ https://issues.apache.org/jira/browse/SPARK-28936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919990#comment-16919990 ] holdenk commented on SPARK-28936: - I'm working on this. > Simplify Spark K8s tests by replacing race

[jira] [Created] (SPARK-28936) Simplify Spark K8s tests by replacing race condition during command execution

holdenk created SPARK-28936: --- Summary: Simplify Spark K8s tests by replacing race condition during command execution Key: SPARK-28936 URL: https://issues.apache.org/jira/browse/SPARK-28936 Project: Spark

[jira] [Comment Edited] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919982#comment-16919982 ] Jungtaek Lim edited comment on SPARK-28770 at 8/31/19 12:44 AM: Just hit

[jira] [Commented] (SPARK-28770) Flaky Tests: Test ReplayListenerSuite.End-to-end replay with compression failed

[ https://issues.apache.org/jira/browse/SPARK-28770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919982#comment-16919982 ] Jungtaek Lim commented on SPARK-28770: -- Just hit again.

[jira] [Commented] (SPARK-28935) Document SQL metrics for Details for Query Plan

[ https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919975#comment-16919975 ] Liang-Chi Hsieh commented on SPARK-28935: - Thanks for pinging me! I will look into this. >

[jira] [Resolved] (SPARK-28926) CLONE - ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances

[ https://issues.apache.org/jira/browse/SPARK-28926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh resolved SPARK-28926. - Resolution: Duplicate I think this is duplicate to SPARK-28927. > CLONE -

[jira] [Commented] (SPARK-28935) Document SQL metrics for Details for Query Plan

[ https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919972#comment-16919972 ] Xiao Li commented on SPARK-28935: - cc [~viirya] Are you interested on this? You added a few metrics

[jira] [Updated] (SPARK-28935) Document SQL metrics for Details for Query Plan

[ https://issues.apache.org/jira/browse/SPARK-28935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-28935: Description: [https://github.com/apache/spark/pull/25349] shows the query plans but it does not describe

[jira] [Created] (SPARK-28935) Document SQL metrics for Details for Query Plan

Xiao Li created SPARK-28935: --- Summary: Document SQL metrics for Details for Query Plan Key: SPARK-28935 URL: https://issues.apache.org/jira/browse/SPARK-28935 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-28934) Add `spark.sql.compatiblity.mode`

[ https://issues.apache.org/jira/browse/SPARK-28934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28934: -- Reporter: Xiao Li (was: Dongjoon Hyun) > Add `spark.sql.compatiblity.mode` >

[jira] [Created] (SPARK-28934) Add `spark.sql.compatiblity.mode`

Dongjoon Hyun created SPARK-28934: - Summary: Add `spark.sql.compatiblity.mode` Key: SPARK-28934 URL: https://issues.apache.org/jira/browse/SPARK-28934 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-28933) Reduce unnecessary shuffle in ALS when initializing factors

[ https://issues.apache.org/jira/browse/SPARK-28933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh reassigned SPARK-28933: --- Assignee: Liang-Chi Hsieh > Reduce unnecessary shuffle in ALS when initializing

[jira] [Created] (SPARK-28933) Reduce unnecessary shuffle in ALS when initializing factors

Liang-Chi Hsieh created SPARK-28933: --- Summary: Reduce unnecessary shuffle in ALS when initializing factors Key: SPARK-28933 URL: https://issues.apache.org/jira/browse/SPARK-28933 Project: Spark

[jira] [Updated] (SPARK-28932) Maven install fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28932: -- Component/s: (was: Spark Core) Build > Maven install fails on JDK11 >

[jira] [Assigned] (SPARK-28932) Maven install fails on JDK11

[ https://issues.apache.org/jira/browse/SPARK-28932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28932: - Target Version/s: 3.0.0 Assignee: Dongjoon Hyun > Maven install fails on

[jira] [Resolved] (SPARK-28804) Document DESCRIBE QUERY in SQL Reference.

[ https://issues.apache.org/jira/browse/SPARK-28804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-28804. - Fix Version/s: 3.0.0 Assignee: Dilip Biswal Resolution: Fixed > Document DESCRIBE QUERY

[jira] [Updated] (SPARK-26046) Add a way for StreamingQueryManager to remove all listeners

[ https://issues.apache.org/jira/browse/SPARK-26046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Murthy updated SPARK-26046: - Description: StreamingQueryManager should have a way to clear out all listeners. There's

[jira] [Created] (SPARK-28932) Maven install fails on JDK11

Dongjoon Hyun created SPARK-28932: - Summary: Maven install fails on JDK11 Key: SPARK-28932 URL: https://issues.apache.org/jira/browse/SPARK-28932 Project: Spark Issue Type: Sub-task

[jira] [Reopened] (SPARK-26046) Add a way for StreamingQueryManager to remove all listeners

[ https://issues.apache.org/jira/browse/SPARK-26046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Murthy reopened SPARK-26046: -- >From some other discussions I've had, I actually think it's a reasonable to >have a way to

[jira] [Resolved] (SPARK-28894) Jenkins does not report test results of SQLQueryTestSuite in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-28894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28894. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25630

[jira] [Assigned] (SPARK-28894) Jenkins does not report test results of SQLQueryTestSuite in Jenkins

[ https://issues.apache.org/jira/browse/SPARK-28894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28894: - Assignee: Hyukjin Kwon > Jenkins does not report test results of SQLQueryTestSuite in

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-28921: --- Affects Version/s: 2.3.3 > Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6,

[jira] [Comment Edited] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

[ https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919907#comment-16919907 ] Andy Grove edited comment on SPARK-28925 at 8/30/19 9:54 PM: - This also

[jira] [Comment Edited] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

[ https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919907#comment-16919907 ] Andy Grove edited comment on SPARK-28925 at 8/30/19 9:55 PM: - This also

[jira] [Updated] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

[ https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated SPARK-28925: --- Affects Version/s: 2.3.3 > Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13

[jira] [Commented] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

[ https://issues.apache.org/jira/browse/SPARK-28925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919907#comment-16919907 ] Andy Grove commented on SPARK-28925: This also impacts Spark 2.3.3 > Update Kubernetes-client to

[jira] [Commented] (SPARK-21181) Suppress memory leak errors reported by netty

[ https://issues.apache.org/jira/browse/SPARK-21181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919903#comment-16919903 ] Thangamani Murugasamy commented on SPARK-21181: --- I have same problem in Spark 2.3   RROR

[jira] [Commented] (SPARK-28891) do-release-docker.sh in master does not work for branch-2.3

[ https://issues.apache.org/jira/browse/SPARK-28891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919896#comment-16919896 ] Dongjoon Hyun commented on SPARK-28891: --- Since 2.3.4 vote passed, this is merged to `branch-2.3`

[jira] [Assigned] (SPARK-28891) do-release-docker.sh in master does not work for branch-2.3

[ https://issues.apache.org/jira/browse/SPARK-28891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28891: - Assignee: Kazuaki Ishizaki > do-release-docker.sh in master does not work for

[jira] [Resolved] (SPARK-28891) do-release-docker.sh in master does not work for branch-2.3

[ https://issues.apache.org/jira/browse/SPARK-28891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28891. --- Fix Version/s: 2.3.4 Resolution: Fixed Issue resolved by pull request 25607

[jira] [Assigned] (SPARK-27931) Accept 'on' and 'off' as input for boolean data type

[ https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-27931: - Assignee: YoungGyu Chun > Accept 'on' and 'off' as input for boolean data type >

[jira] [Resolved] (SPARK-27931) Accept 'on' and 'off' as input for boolean data type

[ https://issues.apache.org/jira/browse/SPARK-27931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27931. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25458

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919893#comment-16919893 ] Kazuaki Ishizaki commented on SPARK-28906: -- For user name, we have to pass {{USER}} environment

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919869#comment-16919869 ] Dongjoon Hyun commented on SPARK-28921: --- Could you make a PR with your test case, [~psschwei]? >

[jira] [Comment Edited] (SPARK-28889) Allow UDTs to define custom casting behavior

[ https://issues.apache.org/jira/browse/SPARK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919822#comment-16919822 ] Zachary S Ennenga edited comment on SPARK-28889 at 8/30/19 6:43 PM:

[jira] [Commented] (SPARK-28889) Allow UDTs to define custom casting behavior

[ https://issues.apache.org/jira/browse/SPARK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919822#comment-16919822 ] Zachary S Ennenga commented on SPARK-28889: --- While I understand if the spark team is not

[jira] [Commented] (SPARK-28889) Allow UDTs to define custom casting behavior

[ https://issues.apache.org/jira/browse/SPARK-28889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919819#comment-16919819 ] Zachary S Ennenga commented on SPARK-28889: --- Based on

[jira] [Issue Comment Deleted] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Schweigert updated SPARK-28921: Comment: was deleted (was: Possible duplicate of 

[jira] [Issue Comment Deleted] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Schweigert updated SPARK-28921: Comment: was deleted (was: Longer-term solution will be to upgrade the version of the

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28930: -- Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect 

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-28930: -- Component/s: (was: Spark Shell) > Spark DESC FORMATTED TABLENAME information display

[jira] [Assigned] (SPARK-28571) Shuffle storage API: Use API in SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-28571: -- Assignee: Matt Cheah > Shuffle storage API: Use API in SortShuffleWriter >

[jira] [Resolved] (SPARK-28571) Shuffle storage API: Use API in SortShuffleWriter

[ https://issues.apache.org/jira/browse/SPARK-28571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-28571. Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25342

[jira] [Resolved] (SPARK-28759) Upgrade scala-maven-plugin to 4.2.0

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28759. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25633

[jira] [Assigned] (SPARK-28759) Upgrade scala-maven-plugin to 4.2.0

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-28759: - Assignee: Hyukjin Kwon > Upgrade scala-maven-plugin to 4.2.0 >

[jira] [Resolved] (SPARK-28866) Persist item factors RDD when checkpointing in ALS

[ https://issues.apache.org/jira/browse/SPARK-28866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-28866. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 25576

[jira] [Assigned] (SPARK-28866) Persist item factors RDD when checkpointing in ALS

[ https://issues.apache.org/jira/browse/SPARK-28866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-28866: - Assignee: Liang-Chi Hsieh > Persist item factors RDD when checkpointing in ALS >

[jira] [Commented] (SPARK-28900) Test Pyspark, SparkR on JDK 11 with run-tests

[ https://issues.apache.org/jira/browse/SPARK-28900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919697#comment-16919697 ] Josh Rosen commented on SPARK-28900: Some quick notes / braindump (I may write more later): * AFAIK

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Schweigert updated SPARK-28921: Description: Spark jobs are failing on latest versions of Kubernetes when jobs attempt to

[jira] [Created] (SPARK-28931) Fix couple of bugs in FsHistoryProviderSuite

Jungtaek Lim created SPARK-28931: Summary: Fix couple of bugs in FsHistoryProviderSuite Key: SPARK-28931 URL: https://issues.apache.org/jira/browse/SPARK-28931 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Schweigert updated SPARK-28921: Priority: Critical (was: Minor) > Spark jobs failing on latest versions of Kubernetes

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919608#comment-16919608 ] Paul Schweigert commented on SPARK-28921: - Possible duplicate of 

[jira] [Commented] (SPARK-28921) Spark jobs failing on latest versions of Kubernetes (1.15.3, 1.14.6, 1,13.10)

[ https://issues.apache.org/jira/browse/SPARK-28921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919596#comment-16919596 ] Paul Schweigert commented on SPARK-28921: - Longer-term solution will be to upgrade the version

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919583#comment-16919583 ] Stavros Kontopoulos commented on SPARK-28025: - Thanks I will have a look :) >

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919577#comment-16919577 ] Stavros Kontopoulos edited comment on SPARK-28025 at 8/30/19 2:15 PM:

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919580#comment-16919580 ] Gabor Somogyi commented on SPARK-28025: --- [~skonto], this one: 

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919577#comment-16919577 ] Stavros Kontopoulos commented on SPARK-28025: - [~kabhwan] which PR? >

[jira] [Commented] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919563#comment-16919563 ] Sujith Chacko commented on SPARK-28930: --- @ [~jobitmathew] As i remember Issue 3 is already handled

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-28930: - Description: Spark DESC FORMATTED TABLENAME information display issues.Showing incorrect  *Last

[jira] [Commented] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919524#comment-16919524 ] Rakesh Raushan commented on SPARK-28929: i am working on this. > Spark Logging level should be

[jira] [Issue Comment Deleted] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pavithra ramachandran updated SPARK-28929: -- Comment: was deleted (was: I am working on this  ) > Spark Logging level

[jira] [Commented] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

[ https://issues.apache.org/jira/browse/SPARK-28929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919523#comment-16919523 ] pavithra ramachandran commented on SPARK-28929: --- I am working on this   > Spark Logging

[jira] [Updated] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

[ https://issues.apache.org/jira/browse/SPARK-28930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jobit mathew updated SPARK-28930: - Environment: (was: _*_emphasized text_*_) > Spark DESC FORMATTED TABLENAME information

[jira] [Created] (SPARK-28930) Spark DESC FORMATTED TABLENAME information display issues

jobit mathew created SPARK-28930: Summary: Spark DESC FORMATTED TABLENAME information display issues Key: SPARK-28930 URL: https://issues.apache.org/jira/browse/SPARK-28930 Project: Spark

[jira] [Created] (SPARK-28929) Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918]

jobit mathew created SPARK-28929: Summary: Spark Logging level should be INFO instead of Debug in Executor Plugin API[SPARK-24918] Key: SPARK-28929 URL: https://issues.apache.org/jira/browse/SPARK-28929

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919514#comment-16919514 ] Steve Loughran commented on SPARK-28025: Has anyone considered enhancing

[jira] [Updated] (SPARK-28759) Upgrade scala-maven-plugin to 4.2.0

[ https://issues.apache.org/jira/browse/SPARK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28759: - Summary: Upgrade scala-maven-plugin to 4.2.0 (was: Upgrade scala-maven-plugin to 4.1.1) >

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919507#comment-16919507 ] Jungtaek Lim commented on SPARK-28025: -- [~skonto] Please take a look at my PR as my PR didn't

[jira] [Resolved] (SPARK-28911) Unify Kafka source option pattern

[ https://issues.apache.org/jira/browse/SPARK-28911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved SPARK-28911. --- Resolution: Won't Do Based on the discussion on the PR this can be closed too. > Unify

[jira] [Closed] (SPARK-28911) Unify Kafka source option pattern

[ https://issues.apache.org/jira/browse/SPARK-28911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed SPARK-28911. - > Unify Kafka source option pattern > - > > Key:

[jira] [Comment Edited] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919471#comment-16919471 ] Stavros Kontopoulos edited comment on SPARK-28025 at 8/30/19 11:54 AM:

[jira] [Commented] (SPARK-28025) HDFSBackedStateStoreProvider should not leak .crc files

[ https://issues.apache.org/jira/browse/SPARK-28025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919471#comment-16919471 ] Stavros Kontopoulos commented on SPARK-28025: - @[~dongjoon] [~zsxwing] this needs to be

[jira] [Updated] (SPARK-28928) Take over Kafka delegation token protocol on sources/sinks

[ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi updated SPARK-28928: -- Summary: Take over Kafka delegation token protocol on sources/sinks (was: Take over

[jira] [Commented] (SPARK-28928) Take over delegation token protocol on sources/sinks

[ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919463#comment-16919463 ] Gabor Somogyi commented on SPARK-28928: --- I'm working on this. > Take over delegation token

[jira] [Created] (SPARK-28928) Take over delegation token protocol on sources/sinks

Gabor Somogyi created SPARK-28928: - Summary: Take over delegation token protocol on sources/sinks Key: SPARK-28928 URL: https://issues.apache.org/jira/browse/SPARK-28928 Project: Spark Issue

[jira] [Comment Edited] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919420#comment-16919420 ] Kazuaki Ishizaki edited comment on SPARK-28906 at 8/30/19 10:51 AM:

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919420#comment-16919420 ] Kazuaki Ishizaki commented on SPARK-28906: -- In {{jars/spark-core_2.11-2.3.*.jar}},

[jira] [Comment Edited] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919346#comment-16919346 ] Björn edited comment on SPARK-28444 at 8/30/19 9:07 AM: We're running into the

[jira] [Commented] (SPARK-28444) Bump Kubernetes Client Version to 4.3.0

[ https://issues.apache.org/jira/browse/SPARK-28444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919346#comment-16919346 ] Björn commented on SPARK-28444: --- We're running into the same issue. As I'm developing with a local

[jira] [Commented] (SPARK-28906) `bin/spark-submit --version` shows incorrect info

[ https://issues.apache.org/jira/browse/SPARK-28906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919330#comment-16919330 ] Kazuaki Ishizaki commented on SPARK-28906: -- I attached output of 2.3.0 and 2.3.4 in one comment

[jira] [Commented] (SPARK-28913) ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances

[ https://issues.apache.org/jira/browse/SPARK-28913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919300#comment-16919300 ] Qiang Wang commented on SPARK-28913: Sorry, I can not find the way to close the issue, just ignore

[jira] [Commented] (SPARK-28926) CLONE - ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances

[ https://issues.apache.org/jira/browse/SPARK-28926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919299#comment-16919299 ] Qiang Wang commented on SPARK-28926: Sorry, I can not find the way to close the issue, just ignore

[jira] [Created] (SPARK-28927) ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances

Qiang Wang created SPARK-28927: -- Summary: ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances Key: SPARK-28927 URL:

[jira] [Created] (SPARK-28926) CLONE - ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances

Qiang Wang created SPARK-28926: -- Summary: CLONE - ArrayIndexOutOfBoundsException and Not-stable AUC metrics in ALS for datasets with 12 billion instances Key: SPARK-28926 URL:

[jira] [Resolved] (SPARK-28872) Will Spark SQL suport the auto analyze for table or partitions like hive by seting hive.stats.autogather=true.

[ https://issues.apache.org/jira/browse/SPARK-28872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28872. -- Resolution: Invalid > Will Spark SQL suport the auto analyze for table or partitions like

[jira] [Resolved] (SPARK-28874) Pyspark date_format add one years in the last days off year

[ https://issues.apache.org/jira/browse/SPARK-28874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28874. -- Resolution: Invalid > Pyspark date_format add one years in the last days off year >

[jira] [Commented] (SPARK-28874) Pyspark date_format add one years in the last days off year

[ https://issues.apache.org/jira/browse/SPARK-28874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919294#comment-16919294 ] Hyukjin Kwon commented on SPARK-28874: -- Use {{y}}. {{Y}} is {{Y week-based-year

[jira] [Created] (SPARK-28925) Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14

Eric created SPARK-28925: Summary: Update Kubernetes-client to 4.4.2 to be compatible with Kubernetes 1.13 and 1.14 Key: SPARK-28925 URL: https://issues.apache.org/jira/browse/SPARK-28925 Project: Spark

[jira] [Updated] (SPARK-28874) Pyspark date_format add one years in the last days off year

[ https://issues.apache.org/jira/browse/SPARK-28874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28874: - Summary: Pyspark date_format add one years in the last days off year (was: Pyspark bug in

[jira] [Updated] (SPARK-28874) Pyspark bug in date_format

[ https://issues.apache.org/jira/browse/SPARK-28874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28874: - Description: Pyspark date_format add one years in the last days off year : Example :

[jira] [Resolved] (SPARK-28668) Support the V2SessionCatalog with AlterTable commands

[ https://issues.apache.org/jira/browse/SPARK-28668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-28668. - Fix Version/s: 3.0.0 Assignee: Burak Yavuz Resolution: Fixed > Support the

[jira] [Updated] (SPARK-28874) Pyspark bug in date_format

[ https://issues.apache.org/jira/browse/SPARK-28874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-28874: - Description: Pyspark date_format add one years in the last days off year : Example :

  1   2   >