[jira] [Commented] (SPARK-18626) Concurrent write to table fails from spark

2020-05-26 Thread Shyam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-18626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117441#comment-17117441 ] Shyam commented on SPARK-18626: --- Hi , Even i am getting same issue I am using 2.4.1version

[jira] [Commented] (SPARK-31813) Cannot write snappy-compressed text files

2020-05-26 Thread Ondrej Kokes (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117440#comment-17117440 ] Ondrej Kokes commented on SPARK-31813: -- Tried a different Docker image - openjdk:8,

[jira] [Created] (SPARK-31833) Set HiveThriftServer2 with actual port while configured 0

2020-05-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-31833: Summary: Set HiveThriftServer2 with actual port while configured 0 Key: SPARK-31833 URL: https://issues.apache.org/jira/browse/SPARK-31833 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31832) Add tool tip for Structured streaming page tables

2020-05-26 Thread Lidiya Nixon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117427#comment-17117427 ] Lidiya Nixon commented on SPARK-31832: -- I would like to work on this > Add tool ti

[jira] [Created] (SPARK-31832) Add tool tip for Structured streaming page tables

2020-05-26 Thread jobit mathew (Jira)
jobit mathew created SPARK-31832: Summary: Add tool tip for Structured streaming page tables Key: SPARK-31832 URL: https://issues.apache.org/jira/browse/SPARK-31832 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26646) Flaky test: pyspark.mllib.tests.test_streaming_algorithms StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

2020-05-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117400#comment-17117400 ] Jungtaek Lim commented on SPARK-26646: -- Still happening. https://amplab.cs.berkele

[jira] [Commented] (SPARK-29137) Flaky test: pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction

2020-05-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117399#comment-17117399 ] Jungtaek Lim commented on SPARK-29137: -- Still valid on latest master. https://ampl

[jira] [Created] (SPARK-31831) Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector)

2020-05-26 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-31831: Summary: Flaky test: org.apache.spark.sql.hive.thriftserver.HiveSessionImplSuite.(It is not a test it is a sbt.testing.SuiteSelector) Key: SPARK-31831 URL: https://issues.apache.

[jira] [Commented] (SPARK-31696) Support spark.kubernetes.driver.service.annotation

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117360#comment-17117360 ] Dongjoon Hyun commented on SPARK-31696: --- I'll give a talk at Spark Summit next mon

[jira] [Commented] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117334#comment-17117334 ] Apache Spark commented on SPARK-31830: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31830: Assignee: Apache Spark > Consistent error handling for datetime formatting functions > --

[jira] [Assigned] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31830: Assignee: (was: Apache Spark) > Consistent error handling for datetime formatting fun

[jira] [Assigned] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31830: Assignee: Apache Spark > Consistent error handling for datetime formatting functions > --

[jira] [Created] (SPARK-31830) Consistent error handling for datetime formatting functions

2020-05-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-31830: Summary: Consistent error handling for datetime formatting functions Key: SPARK-31830 URL: https://issues.apache.org/jira/browse/SPARK-31830 Project: Spark Issue Ty

[jira] [Assigned] (SPARK-31829) Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table before computation

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31829: Assignee: Apache Spark > Check for partition existence for Insert overwrite if not exists

[jira] [Assigned] (SPARK-31829) Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table before computation

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31829: Assignee: (was: Apache Spark) > Check for partition existence for Insert overwrite if

[jira] [Commented] (SPARK-31829) Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table before computation

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117262#comment-17117262 ] Apache Spark commented on SPARK-31829: -- User 'aniket486' has created a pull request

[jira] [Updated] (SPARK-31829) Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table before computation

2020-05-26 Thread Aniket Namadeo Mokashi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Namadeo Mokashi updated SPARK-31829: --- Summary: Check for partition existence for Insert overwrite if not exists qu

[jira] [Created] (SPARK-31829) Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table

2020-05-26 Thread Aniket Namadeo Mokashi (Jira)
Aniket Namadeo Mokashi created SPARK-31829: -- Summary: Check for partition existence for Insert overwrite if not exists queries on Hive Serde Table Key: SPARK-31829 URL: https://issues.apache.org/jira/brow

[jira] [Commented] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117253#comment-17117253 ] Apache Spark commented on SPARK-31788: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117252#comment-17117252 ] Apache Spark commented on SPARK-31788: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31788: Assignee: Apache Spark (was: Hyukjin Kwon) > Error when creating UnionRDD of PairRDDs >

[jira] [Assigned] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31788: Assignee: Hyukjin Kwon (was: Apache Spark) > Error when creating UnionRDD of PairRDDs >

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Description: Union RDD of Pair RDD's seems to have issues SparkSession available as 'spark'. {

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Target Version/s: 3.0.0 Affects Version/s: (was: 3.0.1) Description: Union RD

[jira] [Reopened] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-31788: -- Assignee: Hyukjin Kwon (was: Sanket Reddy) > Error when creating UnionRDD of PairRDDs > ---

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Priority: Blocker (was: Major) > Error when creating UnionRDD of PairRDDs > ---

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Fix Version/s: (was: 3.0.0) > Error when creating UnionRDD of PairRDDs > ---

[jira] [Updated] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31788: - Component/s: DStreams > Error when creating UnionRDD of PairRDDs > -

[jira] [Commented] (SPARK-31813) Cannot write snappy-compressed text files

2020-05-26 Thread ZhangShuai (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117231#comment-17117231 ] ZhangShuai commented on SPARK-31813: In my environment, it works fine. > Cannot wri

[jira] [Commented] (SPARK-31788) Error when creating UnionRDD of PairRDDs

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117224#comment-17117224 ] Hyukjin Kwon commented on SPARK-31788: -- Reverted at https://github.com/apache/spar

[jira] [Commented] (SPARK-31828) Retain table properties at CreateTableLikeCommand

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117218#comment-17117218 ] Apache Spark commented on SPARK-31828: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-31828) Retain table properties at CreateTableLikeCommand

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31828: Assignee: Apache Spark > Retain table properties at CreateTableLikeCommand >

[jira] [Commented] (SPARK-31828) Retain table properties at CreateTableLikeCommand

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117217#comment-17117217 ] Apache Spark commented on SPARK-31828: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-31828) Retain table properties at CreateTableLikeCommand

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31828: Assignee: (was: Apache Spark) > Retain table properties at CreateTableLikeCommand > -

[jira] [Assigned] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31821: - Assignee: Gabor Somogyi > Remove mssql-jdbc dependencies >

[jira] [Resolved] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31821. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28640 [https://

[jira] [Created] (SPARK-31828) Retain table properties at CreateTableLikeCommand

2020-05-26 Thread ulysses you (Jira)
ulysses you created SPARK-31828: --- Summary: Retain table properties at CreateTableLikeCommand Key: SPARK-31828 URL: https://issues.apache.org/jira/browse/SPARK-31828 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-26 Thread Devaraj Kavali (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117202#comment-17117202 ] Devaraj Kavali commented on SPARK-31800: If we look at the log, about *krb5.conf

[jira] [Commented] (SPARK-21784) Add ALTER TABLE ADD CONSTRANT DDL to support defining primary key and foreign keys

2020-05-26 Thread Sunitha Kambhampati (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117169#comment-17117169 ] Sunitha Kambhampati commented on SPARK-21784: - [~krish_the_coder], [~Tagar] 

[jira] [Assigned] (SPARK-31819) Add a workaround for Java 8u251+/K8s 1.17 and update integration test cases

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31819: - Assignee: Dongjoon Hyun > Add a workaround for Java 8u251+/K8s 1.17 and update integrat

[jira] [Commented] (SPARK-31819) Add a workaround for Java 8u251+/K8s 1.17 and update integration test cases

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117053#comment-17117053 ] Dongjoon Hyun commented on SPARK-31819: --- Yes. I fixed master/branch-3.0 via SPARK-

[jira] [Resolved] (SPARK-31819) Add a workaround for Java 8u251+/K8s 1.17 and update integration test cases

2020-05-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31819. --- Fix Version/s: 2.4.6 Resolution: Fixed Issue resolved by pull request 28638 [https://

[jira] [Commented] (SPARK-27997) kubernetes client token expired

2020-05-26 Thread rameshkrishnan muthusamy (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116925#comment-17116925 ] rameshkrishnan muthusamy commented on SPARK-27997: -- I am currently work

[jira] [Commented] (SPARK-31819) Add a workaround for Java 8u251+/K8s 1.17 and update integration test cases

2020-05-26 Thread Xiao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116845#comment-17116845 ] Xiao Li commented on SPARK-31819: - [~dongjoon]This is 2.4 only? > Add a workaround for

[jira] [Commented] (SPARK-31827) better error message for the JDK bug of stand-alone form

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116825#comment-17116825 ] Apache Spark commented on SPARK-31827: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-31827) better error message for the JDK bug of stand-alone form

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31827: Assignee: Apache Spark (was: Wenchen Fan) > better error message for the JDK bug of stan

[jira] [Assigned] (SPARK-31827) better error message for the JDK bug of stand-alone form

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31827: Assignee: Wenchen Fan (was: Apache Spark) > better error message for the JDK bug of stan

[jira] [Created] (SPARK-31827) better error message for the JDK bug of stand-alone form

2020-05-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31827: --- Summary: better error message for the JDK bug of stand-alone form Key: SPARK-31827 URL: https://issues.apache.org/jira/browse/SPARK-31827 Project: Spark Issue

[jira] [Commented] (SPARK-23206) Additional Memory Tuning Metrics

2020-05-26 Thread Itamar Turner-Trauring (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116803#comment-17116803 ] Itamar Turner-Trauring commented on SPARK-23206: It seems like one of th

[jira] [Commented] (SPARK-31822) Cost too much resources when read orc hive table for infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116778#comment-17116778 ] lithiumlee-_- commented on SPARK-31822: --- And i notice that : {quote}Spark 2.1.1 in

[jira] [Commented] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116777#comment-17116777 ] Hyukjin Kwon commented on SPARK-31763: -- Please go ahead > DataFrame.inputFiles()

[jira] [Assigned] (SPARK-31826) Support composed type of case class for typed Scala UDF

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31826: Assignee: (was: Apache Spark) > Support composed type of case class for typed Scala U

[jira] [Assigned] (SPARK-31826) Support composed type of case class for typed Scala UDF

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31826: Assignee: Apache Spark > Support composed type of case class for typed Scala UDF > --

[jira] [Commented] (SPARK-31826) Support composed type of case class for typed Scala UDF

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116755#comment-17116755 ] Apache Spark commented on SPARK-31826: -- User 'Ngone51' has created a pull request f

[jira] [Commented] (SPARK-31763) DataFrame.inputFiles() not Available

2020-05-26 Thread Rakesh Raushan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116738#comment-17116738 ] Rakesh Raushan commented on SPARK-31763: Shall I open a PR for this? > DataFram

[jira] [Created] (SPARK-31826) Support composed type of case class for typed Scala UDF

2020-05-26 Thread wuyi (Jira)
wuyi created SPARK-31826: Summary: Support composed type of case class for typed Scala UDF Key: SPARK-31826 URL: https://issues.apache.org/jira/browse/SPARK-31826 Project: Spark Issue Type: Improveme

[jira] [Resolved] (SPARK-31820) Flaky JavaBeanDeserializationSuite

2020-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31820. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28639 [https://gith

[jira] [Assigned] (SPARK-31820) Flaky JavaBeanDeserializationSuite

2020-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31820: --- Assignee: Maxim Gekk > Flaky JavaBeanDeserializationSuite > ---

[jira] [Comment Edited] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-26 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116657#comment-17116657 ] James Boylan edited comment on SPARK-31800 at 5/26/20, 11:40 AM: -

[jira] [Commented] (SPARK-31800) Unable to disable Kerberos when submitting jobs to Kubernetes

2020-05-26 Thread James Boylan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116657#comment-17116657 ] James Boylan commented on SPARK-31800: -- There are a couple problems with that: # I

[jira] [Commented] (SPARK-23539) Add support for Kafka headers in Structured Streaming

2020-05-26 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116653#comment-17116653 ] Jungtaek Lim commented on SPARK-23539: -- You can ignore the affect version in most c

[jira] [Resolved] (SPARK-31771) Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31771. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28637 [https://gith

[jira] [Assigned] (SPARK-31771) Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q'

2020-05-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31771: --- Assignee: Kent Yao > Disable Narrow TextStyle for datetime pattern 'G/M/L/E/u/Q/q' > --

[jira] [Commented] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116629#comment-17116629 ] Apache Spark commented on SPARK-31762: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-31762) Fix perf regression of date/timestamp formatting in toHiveString

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116628#comment-17116628 ] Apache Spark commented on SPARK-31762: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-23539) Add support for Kafka headers in Structured Streaming

2020-05-26 Thread Martin Andersson (Jira)
[ https://issues.apache.org/jira/browse/SPARK-23539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116607#comment-17116607 ] Martin Andersson commented on SPARK-23539: -- Why does it say {{Affects Version/s

[jira] [Updated] (SPARK-31825) Spark History Server UI does not come up when hosted on a custom path

2020-05-26 Thread Abhishek Rao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Rao updated SPARK-31825: - Attachment: Faulty Spark History UI.PNG > Spark History Server UI does not come up when hosted o

[jira] [Created] (SPARK-31825) Spark History Server UI does not come up when hosted on a custom path

2020-05-26 Thread Abhishek Rao (Jira)
Abhishek Rao created SPARK-31825: Summary: Spark History Server UI does not come up when hosted on a custom path Key: SPARK-31825 URL: https://issues.apache.org/jira/browse/SPARK-31825 Project: Spark

[jira] [Commented] (SPARK-31809) Infer IsNotNull for all children of NullIntolerant expressions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116577#comment-17116577 ] Apache Spark commented on SPARK-31809: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-31809) Infer IsNotNull for all children of NullIntolerant expressions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116576#comment-17116576 ] Apache Spark commented on SPARK-31809: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-31809) Infer IsNotNull for all children of NullIntolerant expressions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31809: Assignee: Yuming Wang (was: Apache Spark) > Infer IsNotNull for all children of NullInto

[jira] [Assigned] (SPARK-31809) Infer IsNotNull for all children of NullIntolerant expressions

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31809: Assignee: Apache Spark (was: Yuming Wang) > Infer IsNotNull for all children of NullInto

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table for infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Labels: HiveMetastoreCatalog orc (was: ) > Cost too much resources when read orc hive table f

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table for infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Description: When read a hive orc partitioned table without spark schema properties , spark r

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table for infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Summary: Cost too much resources when read orc hive table for infer schema (was: Cost too muc

[jira] [Commented] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116567#comment-17116567 ] Apache Spark commented on SPARK-31824: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31824: Assignee: (was: Apache Spark) > DAGSchedulerSuite: Improve and reuse completeShuffleM

[jira] [Assigned] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31824: Assignee: Apache Spark > DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSucc

[jira] [Commented] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116565#comment-17116565 ] Apache Spark commented on SPARK-31824: -- User 'beliefer' has created a pull request

[jira] [Created] (SPARK-31824) DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully

2020-05-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31824: -- Summary: DAGSchedulerSuite: Improve and reuse completeShuffleMapStageSuccessfully Key: SPARK-31824 URL: https://issues.apache.org/jira/browse/SPARK-31824 Project: Spark

[jira] [Created] (SPARK-31823) Improve the current Spark Scheduler test framework

2020-05-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31823: -- Summary: Improve the current Spark Scheduler test framework Key: SPARK-31823 URL: https://issues.apache.org/jira/browse/SPARK-31823 Project: Spark Issue Type: Im

[jira] [Commented] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17116561#comment-17116561 ] Apache Spark commented on SPARK-31821: -- User 'gaborgsomogyi' has created a pull req

[jira] [Assigned] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31821: Assignee: (was: Apache Spark) > Remove mssql-jdbc dependencies >

[jira] [Assigned] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31821: Assignee: Apache Spark > Remove mssql-jdbc dependencies > --

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table to infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Component/s: SQL > Cost too much resources when read orc hive table to infer schema >

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table to infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Description: When read a hive orc partitioned table without spark schema properties , spark r

[jira] [Updated] (SPARK-31822) Cost too much resources when read orc hive table to infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lithiumlee-_- updated SPARK-31822: -- Description: When read a hive orc partitioned table without spark schema properties , spark r

[jira] [Created] (SPARK-31822) Cost too much resources when read orc hive table to infer schema

2020-05-26 Thread lithiumlee-_- (Jira)
lithiumlee-_- created SPARK-31822: - Summary: Cost too much resources when read orc hive table to infer schema Key: SPARK-31822 URL: https://issues.apache.org/jira/browse/SPARK-31822 Project: Spark

[jira] [Created] (SPARK-31821) Remove mssql-jdbc dependencies

2020-05-26 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-31821: - Summary: Remove mssql-jdbc dependencies Key: SPARK-31821 URL: https://issues.apache.org/jira/browse/SPARK-31821 Project: Spark Issue Type: Bug Co