[jira] [Commented] (SPARK-48311) Nested pythonUDF in groupBy and aggregate result in Binding Exception

[ https://issues.apache.org/jira/browse/SPARK-48311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848511#comment-17848511 ] kalyan s commented on SPARK-48311: -- Seems something changed in  ExtractGroupingPythonUD

[jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717882#comment-17717882 ] kalyan s commented on SPARK-43106: -- Thank you for the response [~dongjoon] . Most of t

[jira] [Comment Edited] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717461#comment-17717461 ] kalyan s edited comment on SPARK-43106 at 4/28/23 5:03 AM: --- [~

[jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails

[ https://issues.apache.org/jira/browse/SPARK-43106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17717461#comment-17717461 ] kalyan s commented on SPARK-43106: -- [~cloud_fan] , [~dongjoon]  , [~gurwls223]  Input

[jira] [Commented] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`)

[ https://issues.apache.org/jira/browse/SPARK-37690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17578422#comment-17578422 ] Z. S. commented on SPARK-37690: --- If anyone figures out a workaround please let us know.. 

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506805#comment-17506805 ] kalyan s commented on SPARK-38536: -- Thank you [~ulysses]. That should be the fix. I gu

[jira] [Comment Edited] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506781#comment-17506781 ] kalyan s edited comment on SPARK-38536 at 3/15/22, 8:27 AM:

[jira] [Commented] (SPARK-38536) Spark 3 can not read mixed format partitions

[ https://issues.apache.org/jira/browse/SPARK-38536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506781#comment-17506781 ] kalyan s commented on SPARK-38536: -- I guess the bug could be because, in [https://gith

[jira] [Created] (SPARK-38426) Fix the permissions for GitHub workflows

Naveen S created SPARK-38426: Summary: Fix the permissions for GitHub workflows Key: SPARK-38426 URL: https://issues.apache.org/jira/browse/SPARK-38426 Project: Spark Issue Type: Bug Co

[jira] [Created] (SPARK-37798) Pyspark Pandas API: Cross and Conditional Merging

A S created SPARK-37798: --- Summary: Pyspark Pandas API: Cross and Conditional Merging Key: SPARK-37798 URL: https://issues.apache.org/jira/browse/SPARK-37798 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-36916) Enable Dependabot for improving security posture of the dependencies

Naveen S created SPARK-36916: Summary: Enable Dependabot for improving security posture of the dependencies Key: SPARK-36916 URL: https://issues.apache.org/jira/browse/SPARK-36916 Project: Spark

[jira] [Created] (SPARK-36915) Pin actions to a full length commit SHA

Naveen S created SPARK-36915: Summary: Pin actions to a full length commit SHA Key: SPARK-36915 URL: https://issues.apache.org/jira/browse/SPARK-36915 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-26961) Found Java-level deadlock in Spark Driver

[ https://issues.apache.org/jira/browse/SPARK-26961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17272272#comment-17272272 ] Ajith S commented on SPARK-26961: - Scala issue : https://github.com/scala/bug/issues/114

[jira] [Commented] (SPARK-33444) Adding support to set an initial GMM in spark.ml

[ https://issues.apache.org/jira/browse/SPARK-33444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231408#comment-17231408 ] Shahar S commented on SPARK-33444: -- I will create a pull request with an implementation

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185643#comment-17185643 ] S commented on SPARK-19335: --- Efficient UPSERT using Spark DataFrame - is it available now? If

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177708#comment-17177708 ] Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/14/20, 11:22 AM: ---

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177708#comment-17177708 ] Ramakrishna Prasad K S commented on SPARK-32234: Thanks [~saurabhc100] I

[jira] [Commented] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924 ] Ramakrishna Prasad K S commented on SPARK-32234: [~saurabhc100] has the

[jira] [Comment Edited] (SPARK-32234) Spark sql commands are failing on select Queries for the orc tables

[ https://issues.apache.org/jira/browse/SPARK-32234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173924#comment-17173924 ] Ramakrishna Prasad K S edited comment on SPARK-32234 at 8/9/20, 5:14 PM: -

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 9:00 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:57 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:56 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:52 AM: -

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/9/20, 8:51 AM: -

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17173779#comment-17173779 ] Ramakrishna Prasad K S commented on SPARK-32558: Hi [~dongjoon] Thanks

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Attachment: image-2020-08-09-14-07-00-521.png > ORC target files that Spark_

[jira] [Commented] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172805#comment-17172805 ] Ramakrishna Prasad K S commented on SPARK-32558: [~rohitmishr1484] [~hyu

[jira] [Comment Edited] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17172805#comment-17172805 ] Ramakrishna Prasad K S edited comment on SPARK-32558 at 8/7/20, 4:07 AM: -

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Environment: Spark 3.0 and Hadoop cluster having Hive_2.1.1 version. (was:

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Environment: Spark 3.0 and Hadoop cluster having Hive_2.1.1 version. (Linux

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue: --- 

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue:     Download Spark_3.0 on Linu

[jira] [Updated] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

[ https://issues.apache.org/jira/browse/SPARK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramakrishna Prasad K S updated SPARK-32558: --- Description: Steps to reproduce the issue:     Download Spark_3.0 on Linu

[jira] [Created] (SPARK-32558) ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working)

Ramakrishna Prasad K S created SPARK-32558: -- Summary: ORC target files that Spark_3.0 produces does not work with Hive_2.1.1 (work-around of using spark.sql.orc.impl=hive is also not working) Key: SPARK-32558

[jira] [Created] (SPARK-30621) Dynamic Pruning thread propagates the localProperties to task

Ajith S created SPARK-30621: --- Summary: Dynamic Pruning thread propagates the localProperties to task Key: SPARK-30621 URL: https://issues.apache.org/jira/browse/SPARK-30621 Project: Spark Issue Ty

[jira] [Commented] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021937#comment-17021937 ] Ajith S commented on SPARK-30556: - Yes, it exist in lower version like 2.3.x too > Copy

[jira] [Commented] (SPARK-30556) Copy sparkContext.localproperties to child thread inSubqueryExec.executionContext

[ https://issues.apache.org/jira/browse/SPARK-30556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021936#comment-17021936 ] Ajith S commented on SPARK-30556: - Raised backport PR for branch 2.4 [https://github.com

[jira] [Updated] (SPARK-30360) Avoid Redact classpath entries in History Server UI

[ https://issues.apache.org/jira/browse/SPARK-30360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-30360: Description: Currently SPARK history server display the classpath entries in the Environment tab with clas

[jira] [Updated] (SPARK-30360) Avoid Redact classpath entries in History Server UI

[ https://issues.apache.org/jira/browse/SPARK-30360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-30360: Summary: Avoid Redact classpath entries in History Server UI (was: Redact classpath entries in Spark UI)

[jira] [Updated] (SPARK-22590) Broadcast thread propagates the localProperties to task

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-22590: Affects Version/s: 3.0.0 2.4.4 > Broadcast thread propagates the localProperties to

[jira] [Created] (SPARK-30556) SubqueryExec passes local properties to SubqueryExec.executionContext

Ajith S created SPARK-30556: --- Summary: SubqueryExec passes local properties to SubqueryExec.executionContext Key: SPARK-30556 URL: https://issues.apache.org/jira/browse/SPARK-30556 Project: Spark

[jira] [Updated] (SPARK-22590) Broadcast thread propagates the localProperties to task

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-22590: Summary: Broadcast thread propagates the localProperties to task (was: SparkContext's local properties mi

[jira] [Updated] (SPARK-22590) SparkContext's local properties missing from TaskContext properties

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-22590: Description: Local properties set via sparkContext are not available as TaskContext properties when execu

[jira] [Reopened] (SPARK-22590) SparkContext's local properties missing from TaskContext properties

[ https://issues.apache.org/jira/browse/SPARK-22590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reopened SPARK-22590: - Adding Fix > SparkContext's local properties missing from TaskContext properties >

[jira] [Reopened] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reopened SPARK-23626: - Old PR was closed due to inactivity. Reopening with a new PR and hence to conclude > DAGScheduler blocked

[jira] [Comment Edited] (SPARK-30517) Support SHOW TABLES EXTENDED

[ https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015706#comment-17015706 ] Ajith S edited comment on SPARK-30517 at 1/15/20 8:01 AM: -- [~sr

[jira] [Commented] (SPARK-30517) Support SHOW TABLES EXTENDED

[ https://issues.apache.org/jira/browse/SPARK-30517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015706#comment-17015706 ] Ajith S commented on SPARK-30517: - [~srowen] [~dongjoon] [~vanzin] Please let me know ab

[jira] [Created] (SPARK-30517) Support SHOW TABLES EXTENDED

Ajith S created SPARK-30517: --- Summary: Support SHOW TABLES EXTENDED Key: SPARK-30517 URL: https://issues.apache.org/jira/browse/SPARK-30517 Project: Spark Issue Type: New Feature Componen

[jira] [Comment Edited] (SPARK-30484) Job History Storage Tab does not display RDD Table

[ https://issues.apache.org/jira/browse/SPARK-30484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013656#comment-17013656 ] Ajith S edited comment on SPARK-30484 at 1/12/20 6:36 AM: -- This

[jira] [Commented] (SPARK-30484) Job History Storage Tab does not display RDD Table

[ https://issues.apache.org/jira/browse/SPARK-30484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013656#comment-17013656 ] Ajith S commented on SPARK-30484: - As SparkListenerBlockUpdated is filtered by default f

[jira] [Commented] (SPARK-30488) Deadlock between block-manager-slave-async-thread-pool and spark context cleaner

[ https://issues.apache.org/jira/browse/SPARK-30488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013651#comment-17013651 ] Ajith S commented on SPARK-30488: - As from log, i see `sbt` classes  in the deadlock thr

[jira] [Commented] (SPARK-30440) Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite.reset

[ https://issues.apache.org/jira/browse/SPARK-30440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009433#comment-17009433 ] Ajith S commented on SPARK-30440: - Found a race between reviveOffers in org.apache.spar

[jira] [Created] (SPARK-30406) OneForOneStreamManager use AtomicLong

Ajith S created SPARK-30406: --- Summary: OneForOneStreamManager use AtomicLong Key: SPARK-30406 URL: https://issues.apache.org/jira/browse/SPARK-30406 Project: Spark Issue Type: Bug Compone

[jira] [Created] (SPARK-30405) ArrayKeyIndexType should use Arrays.hashCode

Ajith S created SPARK-30405: --- Summary: ArrayKeyIndexType should use Arrays.hashCode Key: SPARK-30405 URL: https://issues.apache.org/jira/browse/SPARK-30405 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30382) start-thriftserver throws ClassNotFoundException

Ajith S created SPARK-30382: --- Summary: start-thriftserver throws ClassNotFoundException Key: SPARK-30382 URL: https://issues.apache.org/jira/browse/SPARK-30382 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-25061) Spark SQL Thrift Server fails to not pick up hiveconf passing parameter

[ https://issues.apache.org/jira/browse/SPARK-25061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004736#comment-17004736 ] Ajith S commented on SPARK-25061: - I could reproduce this and as per documentation, htt

[jira] [Commented] (SPARK-25030) SparkSubmit.doSubmit will not return result if the mainClass submitted creates a Timer()

[ https://issues.apache.org/jira/browse/SPARK-25030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003932#comment-17003932 ] Ajith S commented on SPARK-25030: - [~jiangxb1987] is there a reproduce case for this.? i

[jira] [Created] (SPARK-30361) Monitoring URL do not redact information about environment

Ajith S created SPARK-30361: --- Summary: Monitoring URL do not redact information about environment Key: SPARK-30361 URL: https://issues.apache.org/jira/browse/SPARK-30361 Project: Spark Issue Type:

[jira] [Created] (SPARK-30360) Redact classpath entries in Spark UI

Ajith S created SPARK-30360: --- Summary: Redact classpath entries in Spark UI Key: SPARK-30360 URL: https://issues.apache.org/jira/browse/SPARK-30360 Project: Spark Issue Type: Bug Componen

[jira] [Commented] (SPARK-27719) Set maxDisplayLogSize for spark history server

[ https://issues.apache.org/jira/browse/SPARK-27719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16985021#comment-16985021 ] Ajith S commented on SPARK-27719: - Currently our production also encounter this issue, I

[jira] [Commented] (SPARK-25440) Dump query execution info to a file

[ https://issues.apache.org/jira/browse/SPARK-25440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944434#comment-16944434 ] Shasidhar E S commented on SPARK-25440: --- [~maxgekk] How do we use this feature? Is

[jira] [Commented] (SPARK-29174) LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source

[ https://issues.apache.org/jira/browse/SPARK-29174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933203#comment-16933203 ] Ajith S commented on SPARK-29174: - Had checked with original author for this https://git

[jira] [Resolved] (SPARK-28848) insert overwrite local directory stored as parquet does not creates snappy.parquet data file at local directory path

[ https://issues.apache.org/jira/browse/SPARK-28848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S resolved SPARK-28848. - Resolution: Duplicate Will be fixed as part of SPARK-28659 > insert overwrite local directory stored a

[jira] [Commented] (SPARK-28848) insert overwrite local directory stored as parquet does not creates snappy.parquet data file at local directory path

[ https://issues.apache.org/jira/browse/SPARK-28848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16913027#comment-16913027 ] Ajith S commented on SPARK-28848: - Thanks for reporting. Will look into this. On initial

[jira] [Commented] (SPARK-28726) Spark with DynamicAllocation always got connect rest by peers

[ https://issues.apache.org/jira/browse/SPARK-28726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16907112#comment-16907112 ] Ajith S commented on SPARK-28726: - As i see, this is driver trying to clean up RDDs, bro

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906881#comment-16906881 ] Ajith S commented on SPARK-28696: - [~hyukjin.kwon] okay, should we disallow tables names

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905196#comment-16905196 ] Ajith S commented on SPARK-28696: - I think we should disallow if a identifier starts wit

[jira] [Comment Edited] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905144#comment-16905144 ] Ajith S edited comment on SPARK-28697 at 8/12/19 1:28 PM: -- !sc

[jira] [Comment Edited] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905144#comment-16905144 ] Ajith S edited comment on SPARK-28697 at 8/12/19 12:44 PM: --- !

[jira] [Commented] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905144#comment-16905144 ] Ajith S commented on SPARK-28697: - !screenshot-1.png! Here due to org.apache.hadoop.

[jira] [Updated] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-28697: Attachment: screenshot-1.png > select * from _; throws InvalidInputException and says path does not exist

[jira] [Comment Edited] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905138#comment-16905138 ] Ajith S edited comment on SPARK-28697 at 8/12/19 12:35 PM: --- Fo

[jira] [Comment Edited] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905138#comment-16905138 ] Ajith S edited comment on SPARK-28697 at 8/12/19 12:35 PM: --- Fo

[jira] [Commented] (SPARK-28697) select * from _; throws InvalidInputException and says path does not exists at HDFS side

[ https://issues.apache.org/jira/browse/SPARK-28697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905138#comment-16905138 ] Ajith S commented on SPARK-28697: - Found this even in single node, local filesystem case

[jira] [Commented] (SPARK-28696) create database _; allowing in Spark but Hive throws Parse Exception

[ https://issues.apache.org/jira/browse/SPARK-28696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905127#comment-16905127 ] Ajith S commented on SPARK-28696: - Thanks for reporting. I can see this due to https://

[jira] [Created] (SPARK-28676) Avoid Excessive logging from ContextCleaner

Ajith S created SPARK-28676: --- Summary: Avoid Excessive logging from ContextCleaner Key: SPARK-28676 URL: https://issues.apache.org/jira/browse/SPARK-28676 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the drop of the same column fail to filter the all the records

[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Issue Type: Question (was: Bug) > In spark 2.2.1 filter on a particular column follwed

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the drop of the same column fail to filter the all the records

[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Summary: In spark 2.2.1 filter on a particular column follwed by the drop of the same co

[jira] [Updated] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records

[ https://issues.apache.org/jira/browse/SPARK-27982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karan Hebbar K S updated SPARK-27982: - Description: The issue here follows the design of the spark, If the filer is applied on

[jira] [Created] (SPARK-27982) In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records

Karan Hebbar K S created SPARK-27982: Summary: In spark 2.2.1 filter on a particular column follwed by the same column fail to filter the all the records Key: SPARK-27982 URL: https://issues.apache.org/jira/br

[jira] [Updated] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Affects Version/s: 2.4.3 > DAGScheduler blocked due to JobSubmitted event > -

[jira] [Updated] (SPARK-23626) DAGScheduler blocked due to JobSubmitted event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Summary: DAGScheduler blocked due to JobSubmitted event (was: Spark DAGScheduler scheduling performance

[jira] [Updated] (SPARK-23626) Spark DAGScheduler scheduling performance hindered on JobSubmitted Event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Labels: (was: bulk-closed) > Spark DAGScheduler scheduling performance hindered on JobSubmitted Event >

[jira] [Updated] (SPARK-27907) HiveUDAF with 0 rows throw NPE

[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27907: Description: When query returns zero rows, the HiveUDAFFunction throws NPE CASE 1: create table abc(a int

[jira] [Updated] (SPARK-27907) HiveUDAF with 0 rows throw NPE

[ https://issues.apache.org/jira/browse/SPARK-27907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-27907: Summary: HiveUDAF with 0 rows throw NPE (was: HiveUDAF with 0 rows throw NPE when try to serialize) > Hi

[jira] [Created] (SPARK-27907) HiveUDAF with 0 rows throw NPE when try to serialize

Ajith S created SPARK-27907: --- Summary: HiveUDAF with 0 rows throw NPE when try to serialize Key: SPARK-27907 URL: https://issues.apache.org/jira/browse/SPARK-27907 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-23626) Spark DAGScheduler scheduling performance hindered on JobSubmitted Event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Affects Version/s: 3.0.0 > Spark DAGScheduler scheduling performance hindered on JobSubmitted Event >

[jira] [Updated] (SPARK-23626) Spark DAGScheduler scheduling performance hindered on JobSubmitted Event

[ https://issues.apache.org/jira/browse/SPARK-23626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated SPARK-23626: Affects Version/s: 2.3.3 > Spark DAGScheduler scheduling performance hindered on JobSubmitted Event >

  1   2   3   4   >