[jira] [Created] (SPARK-32898) totalExecutorRunTimeMs is too big

2020-09-15 Thread Linhong Liu (Jira)
Linhong Liu created SPARK-32898: --- Summary: totalExecutorRunTimeMs is too big Key: SPARK-32898 URL: https://issues.apache.org/jira/browse/SPARK-32898 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196660#comment-17196660 ] Apache Spark commented on SPARK-32804: -- User 'KevinSmile' has created a pull request for this

[jira] [Commented] (SPARK-32804) run-example failed in standalone cluster mode

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196658#comment-17196658 ] Apache Spark commented on SPARK-32804: -- User 'KevinSmile' has created a pull request for this

[jira] [Commented] (SPARK-32894) Timestamp cast in exernal ocr table

2020-09-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196651#comment-17196651 ] Hyukjin Kwon commented on SPARK-32894: -- How did you create the Hive table? > Timestamp cast in

[jira] [Assigned] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32897: Assignee: Apache Spark > SparkSession.builder.getOrCreate should not show deprecation

[jira] [Assigned] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32897: Assignee: (was: Apache Spark) > SparkSession.builder.getOrCreate should not show

[jira] [Commented] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196648#comment-17196648 ] Apache Spark commented on SPARK-32897: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-32688) LiteralGenerator for float and double does not generate special values

2020-09-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32688. -- Fix Version/s: 3.1.0 3.02 Assignee: Tanel Kiis

[jira] [Assigned] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32896: Assignee: Apache Spark (was: Jungtaek Lim) > Add DataStreamWriter.table API >

[jira] [Commented] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196644#comment-17196644 ] Apache Spark commented on SPARK-32896: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32896: Assignee: Jungtaek Lim (was: Apache Spark) > Add DataStreamWriter.table API >

[jira] [Created] (SPARK-32897) SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext

2020-09-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-32897: Summary: SparkSession.builder.getOrCreate should not show deprecation warning of SQLContext Key: SPARK-32897 URL: https://issues.apache.org/jira/browse/SPARK-32897

[jira] [Commented] (SPARK-32187) User Guide - Shipping Python Package

2020-09-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196634#comment-17196634 ] Hyukjin Kwon commented on SPARK-32187: -- Thank you so much [~fhoering]! > User Guide - Shipping

[jira] [Created] (SPARK-32896) Add DataStreamWriter.table API

2020-09-15 Thread Jungtaek Lim (Jira)
Jungtaek Lim created SPARK-32896: Summary: Add DataStreamWriter.table API Key: SPARK-32896 URL: https://issues.apache.org/jira/browse/SPARK-32896 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-32704) Logging plan changes for execution

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196613#comment-17196613 ] Apache Spark commented on SPARK-32704: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32704) Logging plan changes for execution

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196612#comment-17196612 ] Apache Spark commented on SPARK-32704: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32888: Assignee: (was: Apache Spark) > reading a parallized rdd with two identical records

[jira] [Commented] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196591#comment-17196591 ] Apache Spark commented on SPARK-32888: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32888: Assignee: Apache Spark > reading a parallized rdd with two identical records results in

[jira] [Commented] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196590#comment-17196590 ] L. C. Hsieh commented on SPARK-32888: - This was documented in CSV related codes, although it seems

[jira] [Updated] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32888: Issue Type: Documentation (was: Bug) > reading a parallized rdd with two identical records

[jira] [Updated] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-32891: Description: It sounds like {{UTF8String.trim}} is not implemented well. We may need to look at

[jira] [Created] (SPARK-32895) DataSourceV2 allow ACCEPT_ANY_SCHEMA in write path

2020-09-15 Thread Sebastian Herold (Jira)
Sebastian Herold created SPARK-32895: Summary: DataSourceV2 allow ACCEPT_ANY_SCHEMA in write path Key: SPARK-32895 URL: https://issues.apache.org/jira/browse/SPARK-32895 Project: Spark

[jira] [Updated] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread L. C. Hsieh (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-32893: Priority: Major (was: Blocker) > Structured Streaming and Dynamic Allocation on

[jira] [Created] (SPARK-32894) Timestamp cast in exernal ocr table

2020-09-15 Thread Grigory Skvortsov (Jira)
Grigory Skvortsov created SPARK-32894: - Summary: Timestamp cast in exernal ocr table Key: SPARK-32894 URL: https://issues.apache.org/jira/browse/SPARK-32894 Project: Spark Issue Type:

[jira] [Updated] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread Duarte Ferreira (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duarte Ferreira updated SPARK-32893: Priority: Blocker (was: Major) > Structured Streaming and Dynamic Allocation on

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196433#comment-17196433 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196432#comment-17196432 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196300#comment-17196300 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Commented] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196309#comment-17196309 ] Apache Spark commented on SPARK-32738: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Resolved] (SPARK-32884) Mark TPCDSQuery*Suite as ExtendedSQLTest

2020-09-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-32884. --- Fix Version/s: 3.1.0 Assignee: Dongjoon Hyun Resolution: Fixed > Mark

[jira] [Resolved] (SPARK-32827) Add spark.sql.maxMetadataStringLength config

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32827. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29688

[jira] [Assigned] (SPARK-32827) Add spark.sql.maxMetadataStringLength config

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32827: --- Assignee: ulysses you > Add spark.sql.maxMetadataStringLength config >

[jira] [Created] (SPARK-32893) Structured Streaming and Dynamic Allocation on StandaloneCluster

2020-09-15 Thread Duarte Ferreira (Jira)
Duarte Ferreira created SPARK-32893: --- Summary: Structured Streaming and Dynamic Allocation on StandaloneCluster Key: SPARK-32893 URL: https://issues.apache.org/jira/browse/SPARK-32893 Project:

[jira] [Commented] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196168#comment-17196168 ] Apache Spark commented on SPARK-32892: -- User 'mundaym' has created a pull request for this issue:

[jira] [Commented] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196167#comment-17196167 ] Apache Spark commented on SPARK-32892: -- User 'mundaym' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32892: Assignee: Apache Spark > Murmur3 and xxHash64 implementations do not produce the correct

[jira] [Assigned] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32892: Assignee: (was: Apache Spark) > Murmur3 and xxHash64 implementations do not produce

[jira] [Created] (SPARK-32892) Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms

2020-09-15 Thread Michael Munday (Jira)
Michael Munday created SPARK-32892: -- Summary: Murmur3 and xxHash64 implementations do not produce the correct results on big-endian platforms Key: SPARK-32892 URL:

[jira] [Assigned] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-31448: Assignee: Abhishek Dixit > Difference in Storage Levels used in cache() and persist()

[jira] [Resolved] (SPARK-31448) Difference in Storage Levels used in cache() and persist() for pyspark dataframes

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31448. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29242

[jira] [Commented] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196157#comment-17196157 ] Sean R. Owen commented on SPARK-32891: -- Can you inline a basic description here? what are you

[jira] [Created] (SPARK-32891) Enhance UTF8String.trim

2020-09-15 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-32891: --- Summary: Enhance UTF8String.trim Key: SPARK-32891 URL: https://issues.apache.org/jira/browse/SPARK-32891 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196143#comment-17196143 ] Apache Spark commented on SPARK-32889: -- User 'jzc928' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32889: Assignee: (was: Apache Spark) > orc table column name doesn't support special

[jira] [Assigned] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32889: Assignee: Apache Spark > orc table column name doesn't support special characters. >

[jira] [Assigned] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32890: Assignee: Apache Spark > Pass all `sql/hive` module UTs in Scala 2.13 >

[jira] [Commented] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196132#comment-17196132 ] Apache Spark commented on SPARK-32890: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32890: Assignee: (was: Apache Spark) > Pass all `sql/hive` module UTs in Scala 2.13 >

[jira] [Resolved] (SPARK-32874) Enhance result set meta data check for execute statement operation for thrift server

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32874. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29746

[jira] [Assigned] (SPARK-32874) Enhance result set meta data check for execute statement operation for thrift server

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32874: --- Assignee: Kent Yao > Enhance result set meta data check for execute statement operation

[jira] [Created] (SPARK-32890) Pass all `sql/hive` module UTs in Scala 2.13

2020-09-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-32890: Summary: Pass all `sql/hive` module UTs in Scala 2.13 Key: SPARK-32890 URL: https://issues.apache.org/jira/browse/SPARK-32890 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-32889) orc table column name doesn't support special characters.

2020-09-15 Thread jason jin (Jira)
jason jin created SPARK-32889: - Summary: orc table column name doesn't support special characters. Key: SPARK-32889 URL: https://issues.apache.org/jira/browse/SPARK-32889 Project: Spark Issue

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196024#comment-17196024 ] Apache Spark commented on SPARK-32887: -- User 'Udbhav30' has created a pull request for this issue:

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196025#comment-17196025 ] Apache Spark commented on SPARK-32481: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32481) Support truncate table to move the data to trash

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196023#comment-17196023 ] Apache Spark commented on SPARK-32481: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196022#comment-17196022 ] Apache Spark commented on SPARK-32887: -- User 'Udbhav30' has created a pull request for this issue:

[jira] [Assigned] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32887: Assignee: (was: Apache Spark) > Example command in >

[jira] [Assigned] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32887: Assignee: Apache Spark > Example command in >

[jira] [Created] (SPARK-32888) reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv

2020-09-15 Thread Punit Shah (Jira)
Punit Shah created SPARK-32888: -- Summary: reading a parallized rdd with two identical records results in a zero count df when read via spark.read.csv Key: SPARK-32888 URL:

[jira] [Comment Edited] (SPARK-28210) Shuffle Storage API: Reads

2020-09-15 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196013#comment-17196013 ] Attila Zsolt Piros edited comment on SPARK-28210 at 9/15/20, 9:38 AM:

[jira] [Commented] (SPARK-28210) Shuffle Storage API: Reads

2020-09-15 Thread Attila Zsolt Piros (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196013#comment-17196013 ] Attila Zsolt Piros commented on SPARK-28210: [~tianczha] [~devaraj] I would like to work on

[jira] [Commented] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195968#comment-17195968 ] Apache Spark commented on SPARK-32886: -- User 'zhli1142015' has created a pull request for this

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: Apache Spark > '.../jobs/undefined' link from "Event Timeline" in jobs page >

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: (was: Apache Spark) > '.../jobs/undefined' link from "Event Timeline" in

[jira] [Assigned] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32886: Assignee: Apache Spark > '.../jobs/undefined' link from "Event Timeline" in jobs page >

[jira] [Commented] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Udbhav Agrawal (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195965#comment-17195965 ] Udbhav Agrawal commented on SPARK-32887: Thanks for reporting, seems to be a documenting typo

[jira] [Updated] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Chetan Bhat (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetan Bhat updated SPARK-32887: Description: In the link 

[jira] [Created] (SPARK-32887) Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed

2020-09-15 Thread Chetan Bhat (Jira)
Chetan Bhat created SPARK-32887: --- Summary: Example command in https://spark.apache.org/docs/latest/sql-ref-syntax-aux-show-table.html to be changed Key: SPARK-32887 URL:

[jira] [Resolved] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-09-15 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-32578. -- Resolution: Invalid > PageRank not sending the correct values in Pergel sendMessage >

[jira] [Commented] (SPARK-32578) PageRank not sending the correct values in Pergel sendMessage

2020-09-15 Thread Shay Elbaz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195948#comment-17195948 ] Shay Elbaz commented on SPARK-32578: It turned out the problem was in my benchmark, sorry about

[jira] [Updated] (SPARK-32886) '.../jobs/undefined' link from EvenTimeline view

2020-09-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-32886: Attachment: undefinedlink.JPG > '.../jobs/undefined' link from EvenTimeline view >

[jira] [Updated] (SPARK-32886) '.../jobs/undefined' link from "Event Timeline" in jobs page

2020-09-15 Thread Zhen Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhen Li updated SPARK-32886: Summary: '.../jobs/undefined' link from "Event Timeline" in jobs page (was: '.../jobs/undefined' link

[jira] [Created] (SPARK-32886) '.../jobs/undefined' link from EvenTimeline view

2020-09-15 Thread Zhen Li (Jira)
Zhen Li created SPARK-32886: --- Summary: '.../jobs/undefined' link from EvenTimeline view Key: SPARK-32886 URL: https://issues.apache.org/jira/browse/SPARK-32886 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-32738: --- Assignee: Zhenhua Wang > thread safe endpoints may hang due to fatal error >

[jira] [Resolved] (SPARK-32738) thread safe endpoints may hang due to fatal error

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32738. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29580

[jira] [Commented] (SPARK-32872) BytesToBytesMap at MAX_CAPACITY exceeds growth threshold

2020-09-15 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195907#comment-17195907 ] Dongjoon Hyun commented on SPARK-32872: --- Thank you for updating, [~ankurd]! > BytesToBytesMap at

[jira] [Resolved] (SPARK-32454) Fix HistoryServerSuite in Scala 2.13

2020-09-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32454. -- Resolution: Duplicate > Fix HistoryServerSuite in Scala 2.13 >

[jira] [Commented] (SPARK-32885) Add DataStreamReader.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17195904#comment-17195904 ] Apache Spark commented on SPARK-32885: -- User 'xuanyuanking' has created a pull request for this

[jira] [Assigned] (SPARK-32885) Add DataStreamReader.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32885: Assignee: (was: Apache Spark) > Add DataStreamReader.table API >

[jira] [Assigned] (SPARK-32885) Add DataStreamReader.table API

2020-09-15 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-32885: Assignee: Apache Spark > Add DataStreamReader.table API > --

[jira] [Resolved] (SPARK-32879) SessionStateBuilder should apply options set when creating the session state

2020-09-15 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-32879. - Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 29752

[jira] [Created] (SPARK-32885) Add DataStreamReader.table API

2020-09-15 Thread Yuanjian Li (Jira)
Yuanjian Li created SPARK-32885: --- Summary: Add DataStreamReader.table API Key: SPARK-32885 URL: https://issues.apache.org/jira/browse/SPARK-32885 Project: Spark Issue Type: New Feature