[jira] [Updated] (SPARK-25521) Job id showing null when insert into command Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Summary: Job id showing null when insert into command Job is finished. (was: Job id showing null when Job

[jira] [Comment Edited] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626849#comment-16626849 ] Sujith edited comment on SPARK-25521 at 9/25/18 6:39 AM: - [~Bjan

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: (was: null.JPG) > Job id showing null when Job is finished. >

[jira] [Commented] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626849#comment-16626849 ] Sujith commented on SPARK-25521: [~Bjangir] I could see the jobcontext doesn't have jobI

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: null.JPG > Job id showing null when Job is finished. > ---

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Description: scala> spark.sql("create table x1(name string,age int) stored as parquet") scala> spark.sql(

[jira] [Updated] (SPARK-25521) Job id showing null when Job is finished.

[ https://issues.apache.org/jira/browse/SPARK-25521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Babulal updated SPARK-25521: Attachment: image-2018-09-25-12-01-31-871.png > Job id showing null when Job is finished. > --

[jira] [Created] (SPARK-25521) Job id showing null when Job is finished.

Babulal created SPARK-25521: --- Summary: Job id showing null when Job is finished. Key: SPARK-25521 URL: https://issues.apache.org/jira/browse/SPARK-25521 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-25520) The state of executors is KILLED on standalone

[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AKSonic updated SPARK-25520: Description: I create spark standalone cluster (4 servers) by using spark 2.3.1. The job can be finished

[jira] [Commented] (SPARK-25520) The state of executors is KILLED on standalone

[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626831#comment-16626831 ] AKSonic commented on SPARK-25520: - You can see the snapshot in the attached Spark.zip >

[jira] [Created] (SPARK-25520) The state of executors is KILLED on standalone

AKSonic created SPARK-25520: --- Summary: The state of executors is KILLED on standalone Key: SPARK-25520 URL: https://issues.apache.org/jira/browse/SPARK-25520 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-25520) The state of executors is KILLED on standalone

[ https://issues.apache.org/jira/browse/SPARK-25520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AKSonic updated SPARK-25520: Attachment: Spark.zip > The state of executors is KILLED on standalone >

[jira] [Commented] (SPARK-25380) Generated plans occupy over 50% of Spark driver memory

[ https://issues.apache.org/jira/browse/SPARK-25380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626790#comment-16626790 ] Michael Spector commented on SPARK-25380: - It's really difficult to extract a wo

[jira] [Resolved] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25519. - Resolution: Fixed Issue resolved by pull request 22542 [https://github.com/apache/spark/pull/225

[jira] [Resolved] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous

[ https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-25503. --- Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 Issue resolved by pul

[jira] [Assigned] (SPARK-25503) [Spark Job History] Total task message in stage page is ambiguous

[ https://issues.apache.org/jira/browse/SPARK-25503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-25503: - Assignee: shahid > [Spark Job History] Total task message in stage page is ambiguous >

[jira] [Commented] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626685#comment-16626685 ] Apache Spark commented on SPARK-25517: -- User 'softmanu' has created a pull request

[jira] [Assigned] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25517: Assignee: (was: Apache Spark) > Spark DataFrame option inferSchema="true", dataFormat

[jira] [Commented] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626683#comment-16626683 ] Apache Spark commented on SPARK-25517: -- User 'softmanu' has created a pull request

[jira] [Assigned] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25517: Assignee: Apache Spark > Spark DataFrame option inferSchema="true", dataFormat=MM/dd/

[jira] [Assigned] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25502: -- Assignee: shahid (was: ABHISHEK KUMAR GUPTA) > [Spark Job History] Empty Page when p

[jira] [Commented] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626628#comment-16626628 ] shahid commented on SPARK-25502: Hi [~vanzin], Could you please change the Assignee to m

[jira] [Commented] (SPARK-25510) Create new trait replace BenchmarkWithCodegen

[ https://issues.apache.org/jira/browse/SPARK-25510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626593#comment-16626593 ] Apache Spark commented on SPARK-25510: -- User 'wangyum' has created a pull request f

[jira] [Commented] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626497#comment-16626497 ] Apache Spark commented on SPARK-25519: -- User 'dilipbiswal' has created a pull reque

[jira] [Assigned] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25519: Assignee: Apache Spark (was: Dilip Biswal) > ArrayRemove function may return incorrect r

[jira] [Assigned] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25519: Assignee: Dilip Biswal (was: Apache Spark) > ArrayRemove function may return incorrect r

[jira] [Commented] (SPARK-23907) Support regr_* functions

[ https://issues.apache.org/jira/browse/SPARK-23907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626493#comment-16626493 ] Apache Spark commented on SPARK-23907: -- User 'rxin' has created a pull request for

[jira] [Resolved] (SPARK-25518) Spark kafka delegation token supported

[ https://issues.apache.org/jira/browse/SPARK-25518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25518. Resolution: Duplicate > Spark kafka delegation token supported >

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626477#comment-16626477 ] Ankur Gupta commented on SPARK-24523: - Hi [~umayr_nuna] - I am not sure how much eve

[jira] [Assigned] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reassigned SPARK-25502: -- Assignee: ABHISHEK KUMAR GUPTA > [Spark Job History] Empty Page when page number exce

[jira] [Resolved] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-25502. Resolution: Fixed Fix Version/s: 2.4.0 2.3.3 Issue resolved by p

[jira] [Updated] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-25519: - Description: In ArrayRemove, we currently cast the right hand side expression to match the elem

[jira] [Created] (SPARK-25519) ArrayRemove function may return incorrect result when right expression is implicitly downcasted.

Dilip Biswal created SPARK-25519: Summary: ArrayRemove function may return incorrect result when right expression is implicitly downcasted. Key: SPARK-25519 URL: https://issues.apache.org/jira/browse/SPARK-25519

[jira] [Created] (SPARK-25518) Spark kafka delegation token supported

Mingjie Tang created SPARK-25518: Summary: Spark kafka delegation token supported Key: SPARK-25518 URL: https://issues.apache.org/jira/browse/SPARK-25518 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-24523) InterruptedException when closing SparkContext

[ https://issues.apache.org/jira/browse/SPARK-24523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626446#comment-16626446 ] Umayr Hassan commented on SPARK-24523: -- [~ankur.gupta] Increasing queue size does g

[jira] [Commented] (SPARK-24324) Pandas Grouped Map UserDefinedFunction mixes column labels

[ https://issues.apache.org/jira/browse/SPARK-24324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626405#comment-16626405 ] Apache Spark commented on SPARK-24324: -- User 'gatorsmile' has created a pull reques

[jira] [Updated] (SPARK-25514) Generating pretty JSON by to_json

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-25514: --- Summary: Generating pretty JSON by to_json (was: Pretty JSON) > Generating pretty JSON by to_json >

[jira] [Updated] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoranjan Kumar updated SPARK-25517: - Description: spark.read.format("csv").option("inferSchema", true).option("dateFormat",

[jira] [Resolved] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

[ https://issues.apache.org/jira/browse/SPARK-25516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Kugler resolved SPARK-25516. Resolution: Not A Problem > spark-history and spark-shuffle-service scripts can not run in

[jira] [Updated] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoranjan Kumar updated SPARK-25517: - Issue Type: Bug (was: Improvement) > Spark DataFrame option inferSchema="true", dataFor

[jira] [Updated] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoranjan Kumar updated SPARK-25517: - Description: spark.read.format("csv").option("inferSchema", true).option("dateFormat",

[jira] [Updated] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

[ https://issues.apache.org/jira/browse/SPARK-25517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoranjan Kumar updated SPARK-25517: - Description: spark.read.format("csv").option("inferSchema", true).option("dateFormat",

[jira] [Created] (SPARK-25517) Spark DataFrame option inferSchema="true", dataFormat=MM/dd/yyyy, fails to detect date type from the csv file while reading

Manoranjan Kumar created SPARK-25517: Summary: Spark DataFrame option inferSchema="true", dataFormat=MM/dd/, fails to detect date type from the csv file while reading Key: SPARK-25517 URL: https://issues.a

[jira] [Assigned] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

[ https://issues.apache.org/jira/browse/SPARK-25516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25516: Assignee: Apache Spark > spark-history and spark-shuffle-service scripts can not run in d

[jira] [Assigned] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

[ https://issues.apache.org/jira/browse/SPARK-25516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25516: Assignee: (was: Apache Spark) > spark-history and spark-shuffle-service scripts can n

[jira] [Commented] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

[ https://issues.apache.org/jira/browse/SPARK-25516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626262#comment-16626262 ] Apache Spark commented on SPARK-25516: -- User 'BYondRAK' has created a pull request

[jira] [Created] (SPARK-25516) spark-history and spark-shuffle-service scripts can not run in docker image

Richard Kugler created SPARK-25516: -- Summary: spark-history and spark-shuffle-service scripts can not run in docker image Key: SPARK-25516 URL: https://issues.apache.org/jira/browse/SPARK-25516 Proje

[jira] [Commented] (SPARK-25461) PySpark Pandas UDF outputs incorrect results when input columns contain None

[ https://issues.apache.org/jira/browse/SPARK-25461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626198#comment-16626198 ] Stu (Michael Stewart) commented on SPARK-25461: --- [~hyukjin.kwon] I have al

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626181#comment-16626181 ] Apache Spark commented on SPARK-21291: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21291: Assignee: (was: Apache Spark) > R bucketBy partitionBy API >

[jira] [Commented] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626180#comment-16626180 ] Apache Spark commented on SPARK-21291: -- User 'huaxingao' has created a pull request

[jira] [Assigned] (SPARK-21291) R bucketBy partitionBy API

[ https://issues.apache.org/jira/browse/SPARK-21291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21291: Assignee: Apache Spark > R bucketBy partitionBy API > -- > >

[jira] [Commented] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code

[ https://issues.apache.org/jira/browse/SPARK-25432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626148#comment-16626148 ] Bryan Cutler commented on SPARK-25432: -- moved description :) > Consider if using s

[jira] [Updated] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code

[ https://issues.apache.org/jira/browse/SPARK-25432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-25432: - Description: As we saw in [https://github.com/apache/spark/pull/22295/files] the logic can get a

[jira] [Updated] (SPARK-25432) Consider if using standard getOrCreate from PySpark into JVM SparkSession would simplify code

[ https://issues.apache.org/jira/browse/SPARK-25432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bryan Cutler updated SPARK-25432: - Environment: (was: As we saw in [https://github.com/apache/spark/pull/22295/files] the logic

[jira] [Commented] (SPARK-25511) Map with "null" key not working in spark 2.3

[ https://issues.apache.org/jira/browse/SPARK-25511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626138#comment-16626138 ] Ravi Shankar commented on SPARK-25511: -- Is there any option to have a key->value da

[jira] [Updated] (SPARK-25502) [Spark Job History] Empty Page when page number exceeds the reatinedTask size

[ https://issues.apache.org/jira/browse/SPARK-25502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25502: -- Priority: Minor (was: Major) > [Spark Job History] Empty Page when page number exceeds the reatinedTa

[jira] [Updated] (SPARK-25460) DataSourceV2: Structured Streaming does not respect SessionConfigSupport

[ https://issues.apache.org/jira/browse/SPARK-25460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25460: -- Fix Version/s: (was: 2.5.0) 2.4.0 > DataSourceV2: Structured Streaming

[jira] [Commented] (SPARK-25422) flaky test: org.apache.spark.DistributedSuite.caching on disk, replicated (encryption = on) (with replication as stream)

[ https://issues.apache.org/jira/browse/SPARK-25422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625983#comment-16625983 ] Imran Rashid commented on SPARK-25422: -- As it might be useful in the future, lemme

[jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625961#comment-16625961 ] Sean Owen commented on SPARK-20937: --- Yeah see discussion on PR – this is really about

[jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625943#comment-16625943 ] Tim Armstrong commented on SPARK-20937: --- [~srowen] I would say it is. I know Spark

[jira] [Commented] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625876#comment-16625876 ] Yuming Wang commented on SPARK-23985: - Thanks [~uzadude] I will deep dive it. > pre

[jira] [Resolved] (SPARK-25416) ArrayPosition function may return incorrect result when right expression is implicitly downcasted.

[ https://issues.apache.org/jira/browse/SPARK-25416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25416. - Resolution: Fixed Assignee: Dilip Biswal Fix Version/s: 2.4.0 > ArrayPosition fu

[jira] [Resolved] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous.

[ https://issues.apache.org/jira/browse/SPARK-21318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21318. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 18544 [https://gith

[jira] [Assigned] (SPARK-21318) The exception message thrown by `lookupFunction` is ambiguous.

[ https://issues.apache.org/jira/browse/SPARK-21318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21318: --- Assignee: StanZhai > The exception message thrown by `lookupFunction` is ambiguous. > -

[jira] [Commented] (SPARK-25501) Kafka delegation token support

[ https://issues.apache.org/jira/browse/SPARK-25501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625826#comment-16625826 ] Gabor Somogyi commented on SPARK-25501: --- [~kabhwan], yeah as usual there will be S

[jira] [Commented] (SPARK-25153) Improve error messages for columns with dots/periods

[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625820#comment-16625820 ] Aleksei Izmalkin commented on SPARK-25153: -- Hello [~holdenk], Do you mean that

[jira] [Commented] (SPARK-25153) Improve error messages for columns with dots/periods

[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625803#comment-16625803 ] Aleksei Izmalkin commented on SPARK-25153: -- Hello [~holdenk], > Improve error

[jira] [Issue Comment Deleted] (SPARK-25153) Improve error messages for columns with dots/periods

[ https://issues.apache.org/jira/browse/SPARK-25153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksei Izmalkin updated SPARK-25153: - Comment: was deleted (was: Hello [~holdenk],) > Improve error messages for columns with

[jira] [Comment Edited] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625661#comment-16625661 ] Abhishek Rao edited comment on SPARK-25500 at 9/24/18 11:21 AM: --

[jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625661#comment-16625661 ] Abhishek Rao commented on SPARK-25500: -- Even thought templates work for all scenari

[jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625659#comment-16625659 ] Apache Spark commented on SPARK-25500: -- User 'abhisrao' has created a pull request

[jira] [Commented] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625660#comment-16625660 ] Apache Spark commented on SPARK-25500: -- User 'abhisrao' has created a pull request

[jira] [Assigned] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25500: Assignee: (was: Apache Spark) > Specify configmap and secrets in Spark driver and exe

[jira] [Assigned] (SPARK-25500) Specify configmap and secrets in Spark driver and executor pods in Kubernetes

[ https://issues.apache.org/jira/browse/SPARK-25500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25500: Assignee: Apache Spark > Specify configmap and secrets in Spark driver and executor pods

[jira] [Commented] (SPARK-18364) Expose metrics for YarnShuffleService

[ https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625608#comment-16625608 ] Marek Simunek commented on SPARK-18364: --- Hi, [~aash] could you please take a look

[jira] [Commented] (SPARK-21548) Support insert into serial columns of table

[ https://issues.apache.org/jira/browse/SPARK-21548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625583#comment-16625583 ] Mihaly Toth commented on SPARK-21548: - You may want to look at the PR on this very s

[jira] [Commented] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625575#comment-16625575 ] Prashant Sharma commented on SPARK-25515: - Also add a fail fast option, if the p

[jira] [Updated] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

[ https://issues.apache.org/jira/browse/SPARK-25515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Sharma updated SPARK-25515: Description: Currently, if a pod fails to start due to some failure, it gets removed and n

[jira] [Created] (SPARK-25515) Add a config property for disabling auto deletion of PODS for debugging.

Prashant Sharma created SPARK-25515: --- Summary: Add a config property for disabling auto deletion of PODS for debugging. Key: SPARK-25515 URL: https://issues.apache.org/jira/browse/SPARK-25515 Projec

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625570#comment-16625570 ] Apache Spark commented on SPARK-17636: -- User 'dbtsai' has created a pull request fo

[jira] [Commented] (SPARK-17636) Parquet filter push down doesn't handle struct fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625568#comment-16625568 ] Apache Spark commented on SPARK-17636: -- User 'dbtsai' has created a pull request fo

[jira] [Commented] (SPARK-25514) Pretty JSON

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625547#comment-16625547 ] Apache Spark commented on SPARK-25514: -- User 'MaxGekk' has created a pull request f

[jira] [Commented] (SPARK-25514) Pretty JSON

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625546#comment-16625546 ] Apache Spark commented on SPARK-25514: -- User 'MaxGekk' has created a pull request f

[jira] [Assigned] (SPARK-25514) Pretty JSON

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25514: Assignee: Apache Spark > Pretty JSON > --- > > Key: SPARK-25514 >

[jira] [Assigned] (SPARK-25514) Pretty JSON

[ https://issues.apache.org/jira/browse/SPARK-25514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25514: Assignee: (was: Apache Spark) > Pretty JSON > --- > > Key: SP

[jira] [Created] (SPARK-25514) Pretty JSON

Maxim Gekk created SPARK-25514: -- Summary: Pretty JSON Key: SPARK-25514 URL: https://issues.apache.org/jira/browse/SPARK-25514 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Comment Edited] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625448#comment-16625448 ] Ohad Raviv edited comment on SPARK-23985 at 9/24/18 7:15 AM: -

[jira] [Updated] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ohad Raviv updated SPARK-23985: --- Description: while predicate push down works with this query:  {code:sql} select * from ( select

[jira] [Commented] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625448#comment-16625448 ] Ohad Raviv commented on SPARK-23985: {quote}You should move where("a>'1'") before wi

[jira] [Comment Edited] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625436#comment-16625436 ] Ohad Raviv edited comment on SPARK-23985 at 9/24/18 7:07 AM: -

[jira] [Comment Edited] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625432#comment-16625432 ] Yuming Wang edited comment on SPARK-23985 at 9/24/18 7:07 AM:

[jira] [Commented] (SPARK-23985) predicate push down doesn't work with simple compound partition spec

[ https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16625436#comment-16625436 ] Ohad Raviv commented on SPARK-23985: the same is true for Spark 2.4: {code} sparkSes