[jira] [Comment Edited] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

2020-09-15 Thread Aman Rastogi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196721#comment-17196721 ] Aman Rastogi edited comment on SPARK-32778 at 9/16/20, 6:46 AM: --

[jira] [Reopened] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

2020-09-15 Thread Aman Rastogi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Rastogi reopened SPARK-32778: -- I have reproduced the issue with v2.4.4. Code is also similar as it was in v2.2.0  https://githu

[jira] [Updated] (SPARK-32778) Accidental Data Deletion on calling saveAsTable

2020-09-15 Thread Aman Rastogi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aman Rastogi updated SPARK-32778: - Affects Version/s: (was: 2.2.0) 2.4.4 > Accidental Data Deletion on c

[jira] [Created] (SPARK-32898) totalExecutorRunTimeMs is too big

2020-09-15 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-32898: --- Summary: totalExecutorRunTimeMs is too big Key: SPARK-32898 URL: https://issues.apache.org/jira/browse/SPARK-32898 Project: Spark Issue Type: Bug Com

[jira] [Commented] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196660#comment-17196660 ] Apache Spark commented on SPARK-32804: -- User 'KevinSmile' has created a pull reques

[jira] [Commented] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196658#comment-17196658 ] Apache Spark commented on SPARK-32804: -- User 'KevinSmile' has created a pull reques

[jira] [Commented] (SPARK-32894) Timestamp cast in exernal ocr table

2020-09-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196651#comment-17196651 ] Hyukjin Kwon commented on SPARK-32894: -- How did you create the Hive table? > Times

[jira] [Assigned] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32897: Assignee: Apache Spark > SparkSession.builder.getOrCreate should not show deprecation war

[jira] [Assigned] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32897: Assignee: (was: Apache Spark) > SparkSession.builder.getOrCreate should not show depr

[jira] [Commented] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196648#comment-17196648 ] Apache Spark commented on SPARK-32897: -- User 'HyukjinKwon' has created a pull reque

[jira] [Resolved] (SPARK-32688) LiteralGenerator for float and double does not generate special values

2020-09-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32688. -- Fix Version/s: 3.1.0 3.02 Assignee: Tanel Kiis Resol

[jira] [Assigned] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32896: Assignee: Apache Spark (was: Jungtaek Lim) > Add DataStreamWriter.table API > --

[jira] [Commented] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196644#comment-17196644 ] Apache Spark commented on SPARK-32896: -- User 'HeartSaVioR' has created a pull reque

[jira] [Assigned] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32896: Assignee: Jungtaek Lim (was: Apache Spark) > Add DataStreamWriter.table API > --

[jira] [Created] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32897: Summary: SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext Key: SPARK-32897 URL: https://issues.apache.org/jira/browse/SPARK-32897 Pr

[jira] [Commented] (SPARK-32187) User Guide - Shipping Python Package

2020-09-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196634#comment-17196634 ] Hyukjin Kwon commented on SPARK-32187: -- Thank you so much [~fhoering]! > User Guid

[jira] [Created] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-32896: Summary: Add DataStreamWriter.table API Key: SPARK-32896 URL: https://issues.apache.org/jira/browse/SPARK-32896 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-32704) Logging plan changes for execution

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196613#comment-17196613 ] Apache Spark commented on SPARK-32704: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32704) Logging plan changes for execution

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196612#comment-17196612 ] Apache Spark commented on SPARK-32704: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32888: Assignee: (was: Apache Spark) > reading a parallized rdd with two identical records r

[jira] [Commented] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196591#comment-17196591 ] Apache Spark commented on SPARK-32888: -- User 'viirya' has created a pull request fo

[jira] [Assigned] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32888: Assignee: Apache Spark > reading a parallized rdd with two identical records results in a

[jira] [Commented] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196590#comment-17196590 ] L. C. Hsieh commented on SPARK-32888: - This was documented in CSV related codes, al

[jira] [Updated] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32888: Issue Type: Documentation (was: Bug) > reading a parallized rdd with two identical records result

[jira] [Updated] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32891: Description: It sounds like {{UTF8String.trim}} is not implemented well. We may need to look at h

[jira] [Created] (SPARK-32895) DataSourceV2 allow ACCEPT_ANY_SCHEMA in write path

2020-09-15 Thread Sebastian Herold (Jira)
Sebastian Herold created SPARK-32895: Summary: DataSourceV2 allow ACCEPT_ANY_SCHEMA in write path Key: SPARK-32895 URL: https://issues.apache.org/jira/browse/SPARK-32895 Project: Spark Is

[jira] [Updated] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32893: Priority: Major (was: Blocker) > Structured Streaming and Dynamic Allocation on StandaloneCluster

[jira] [Created] (SPARK-32894) Timestamp cast in exernal ocr table

2020-09-15 Thread Grigory Skvortsov (Jira)
Grigory Skvortsov created SPARK-32894: - Summary: Timestamp cast in exernal ocr table Key: SPARK-32894 URL: https://issues.apache.org/jira/browse/SPARK-32894 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread Duarte Ferreira (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duarte Ferreira updated SPARK-32893: Priority: Blocker (was: Major) > Structured Streaming and Dynamic Allocation on Standalon

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196433#comment-17196433 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196432#comment-17196432 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196300#comment-17196300 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196309#comment-17196309 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for

[jira] [Resolved] (SPARK-32884) Mark TPCDSQuery*Suite as ExtendedSQLTest

2020-09-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32884. --- Fix Version/s: 3.1.0 Assignee: Dongjoon Hyun Resolution: Fixed > Mark TPCDSQ

[jira] [Resolved] (SPARK-32827) Add spark.sql.maxMetadataStringLength config

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32827. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29688 [https://gith

[jira] [Assigned] (SPARK-32827) Add spark.sql.maxMetadataStringLength config

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32827: --- Assignee: ulysses you > Add spark.sql.maxMetadataStringLength config >

[jira] [Created] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread Duarte Ferreira (Jira)
Duarte Ferreira created SPARK-32893: --- Summary: Structured Streaming and Dynamic Allocation on StandaloneCluster Key: SPARK-32893 URL: https://issues.apache.org/jira/browse/SPARK-32893 Project: Spark

[jira] [Commented] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196168#comment-17196168 ] Apache Spark commented on SPARK-32892: -- User 'mundaym' has created a pull request f

[jira] [Commented] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196167#comment-17196167 ] Apache Spark commented on SPARK-32892: -- User 'mundaym' has created a pull request f

[jira] [Assigned] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32892: Assignee: Apache Spark > Murmur3 and xxHash64 implementations do not produce the correct

[jira] [Assigned] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32892: Assignee: (was: Apache Spark) > Murmur3 and xxHash64 implementations do not produce t

[jira] [Created] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Michael Munday (Jira)
Michael Munday created SPARK-32892: -- Summary: Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms Key: SPARK-32892 URL: https://issues.apache.org/jira/browse/SPARK-3289

[jira] [Assigned] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31448: Assignee: Abhishek Dixit > Difference in Storage Levels used in cache() and persist() for

[jira] [Resolved] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31448. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29242 [https://gi

[jira] [Commented] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196157#comment-17196157 ] Sean R. Owen commented on SPARK-32891: -- Can you inline a basic description here? wh

[jira] [Created] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32891: --- Summary: Enhance UTF8String.trim Key: SPARK-32891 URL: https://issues.apache.org/jira/browse/SPARK-32891 Project: Spark Issue Type: Improvement Compo

[jira] [Commented] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196143#comment-17196143 ] Apache Spark commented on SPARK-32889: -- User 'jzc928' has created a pull request fo

[jira] [Assigned] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32889: Assignee: (was: Apache Spark) > orc table column name doesn't support special charact

[jira] [Assigned] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32889: Assignee: Apache Spark > orc table column name doesn't support special characters. >

[jira] [Assigned] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32890: Assignee: Apache Spark > Pass all `sql/hive` module UTs in Scala 2.13 > -

[jira] [Commented] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196132#comment-17196132 ] Apache Spark commented on SPARK-32890: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32890: Assignee: (was: Apache Spark) > Pass all `sql/hive` module UTs in Scala 2.13 > --

[jira] [Resolved] (SPARK-32874) Enhance result set meta data check for execute statement operation for thrift server

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32874. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29746 [https://gith

[jira] [Assigned] (SPARK-32874) Enhance result set meta data check for execute statement operation for thrift server

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32874: --- Assignee: Kent Yao > Enhance result set meta data check for execute statement operation for

[jira] [Created] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-32890: Summary: Pass all `sql/hive` module UTs in Scala 2.13 Key: SPARK-32890 URL: https://issues.apache.org/jira/browse/SPARK-32890 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread jason jin (Jira)
jason jin created SPARK-32889: - Summary: orc table column name doesn't support special characters. Key: SPARK-32889 URL: https://issues.apache.org/jira/browse/SPARK-32889 Project: Spark Issue Typ

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196024#comment-17196024 ] Apache Spark commented on SPARK-32887: -- User 'Udbhav30' has created a pull request

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196025#comment-17196025 ] Apache Spark commented on SPARK-32481: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196023#comment-17196023 ] Apache Spark commented on SPARK-32481: -- User 'HyukjinKwon' has created a pull reque

[jira] [Assigned] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32887: Assignee: (was: Apache Spark) > Example command in > https://spark.apache.org/docs/l

[jira] [Assigned] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32887: Assignee: Apache Spark > Example command in > https://spark.apache.org/docs/latest/sql-r

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196022#comment-17196022 ] Apache Spark commented on SPARK-32887: -- User 'Udbhav30' has created a pull request

[jira] [Created] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Punit Shah (Jira)
Punit Shah created SPARK-32888: -- Summary: reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv Key: SPARK-32888 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Comment Edited] (SPARK-28210) Shuffle Storage API: Reads

2020-09-15 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196013#comment-17196013 ] Attila Zsolt Piros edited comment on SPARK-28210 at 9/15/20, 9:38 AM:

[jira] [Commented] (SPARK-28210) Shuffle Storage API: Reads

2020-09-15 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196013#comment-17196013 ] Attila Zsolt Piros commented on SPARK-28210: [~tianczha] [~devaraj] I would

[jira] [Commented] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195968#comment-17195968 ] Apache Spark commented on SPARK-32886: -- User 'zhli1142015' has created a pull reque

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: Apache Spark > '.../jobs/undefined' link from "Event Timeline" in jobs page > -

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: (was: Apache Spark) > '.../jobs/undefined' link from "Event Timeline" in jo

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: Apache Spark > '.../jobs/undefined' link from "Event Timeline" in jobs page > -

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Udbhav Agrawal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195965#comment-17195965 ] Udbhav Agrawal commented on SPARK-32887: Thanks for reporting, seems to be a doc

[jira] [Updated] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Chetan Bhat (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-32887: Description: In the link  [https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html

[jira] [Created] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Chetan Bhat (Jira)
Chetan Bhat created SPARK-32887: --- Summary: Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed Key: SPARK-32887 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Resolved] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-09-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32578. -- Resolution: Invalid > PageRank not sending the correct values in Pergel sendMessage >

[jira] [Commented] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-09-15 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17195948#comment-17195948 ] Shay Elbaz commented on SPARK-32578: It turned out the problem was in my benchmark,

[jira] [Updated] (SPARK-32886) '.../jobs/undefined' link from EvenTimeline view

2020-09-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-32886: Attachment: undefinedlink.JPG > '.../jobs/undefined' link from EvenTimeline view > ---

[jira] [Updated] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-32886: Summary: '.../jobs/undefined' link from "Event Timeline" in jobs page (was: '.../jobs/undefined' link fro

[jira] [Created] (SPARK-32886) '.../jobs/undefined' link from EvenTimeline view

2020-09-15 Thread Zhen Li (Jira)
Zhen Li created SPARK-32886: --- Summary: '.../jobs/undefined' link from EvenTimeline view Key: SPARK-32886 URL: https://issues.apache.org/jira/browse/SPARK-32886 Project: Spark Issue Type: Bug