[jira] [Comment Edited] (SPARK-30443) "Managed memory leak detected" even with no calls to take() or limit()

2020-03-26 Thread Xiaoju Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068290#comment-17068290 ] Xiaoju Wu edited comment on SPARK-30443 at 3/27/20, 5:50 AM: - Also see this

[jira] [Commented] (SPARK-30443) "Managed memory leak detected" even with no calls to take() or limit()

2020-03-26 Thread Xiaoju Wu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068290#comment-17068290 ] Xiaoju Wu commented on SPARK-30443: --- Also see this kind of warning logs. SPARK-21492 may relate to

[jira] [Created] (SPARK-31280) Perform propagating empty relation after RewritePredicateSubquery

2020-03-26 Thread Kent Yao (Jira)
Kent Yao created SPARK-31280: Summary: Perform propagating empty relation after RewritePredicateSubquery Key: SPARK-31280 URL: https://issues.apache.org/jira/browse/SPARK-31280 Project: Spark

[jira] [Created] (SPARK-31279) Add version information to the configuration of Hive

2020-03-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31279: -- Summary: Add version information to the configuration of Hive Key: SPARK-31279 URL: https://issues.apache.org/jira/browse/SPARK-31279 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-31204) HiveResult compatibility for DatasourceV2 command

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31204: --- Assignee: Terry Kim > HiveResult compatibility for DatasourceV2 command >

[jira] [Resolved] (SPARK-31204) HiveResult compatibility for DatasourceV2 command

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31204. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28004

[jira] [Resolved] (SPARK-31170) Spark Cli does not respect hive-site.xml and spark.sql.warehouse.dir

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31170. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27969

[jira] [Resolved] (SPARK-31186) toPandas fails on simple query (collect() works)

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31186. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28025

[jira] [Assigned] (SPARK-31186) toPandas fails on simple query (collect() works)

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31186: Assignee: L. C. Hsieh > toPandas fails on simple query (collect() works) >

[jira] [Commented] (SPARK-25641) Change the spark.shuffle.server.chunkFetchHandlerThreadsPercent default to 100

2020-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068232#comment-17068232 ] Dongjoon Hyun commented on SPARK-25641: --- This commit is technically reverted via SPARK-30623 . >

[jira] [Commented] (SPARK-31191) Spark SQL and hive metastore are incompatible

2020-03-26 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068200#comment-17068200 ] Yuming Wang commented on SPARK-31191: - [~leishuiyu] Add spark.sql.hive.metastore.jars=maven? >

[jira] [Updated] (SPARK-31276) Contrived working example that works with multiple URI file storages for Spark cluster mode

2020-03-26 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31276: -- Description: This Spark SQL Guide --> Data sources --> Generic Load/Save Functions

[jira] [Updated] (SPARK-31262) Test case import another test case contains bracketed comments, can't display bracketed comments in golden files well.

2020-03-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31262: - Component/s: Tests > Test case import another test case contains bracketed comments,

[jira] [Resolved] (SPARK-31262) Test case import another test case contains bracketed comments, can't display bracketed comments in golden files well.

2020-03-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-31262. -- Fix Version/s: 3.0.0 Assignee: jiaan.geng Resolution: Fixed Resolved

[jira] [Assigned] (SPARK-31238) Incompatible ORC dates with Spark 2.4

2020-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31238: - Assignee: Maxim Gekk > Incompatible ORC dates with Spark 2.4 >

[jira] [Resolved] (SPARK-31238) Incompatible ORC dates with Spark 2.4

2020-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31238. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28016

[jira] [Commented] (SPARK-30320) Insert overwrite to DataSource table with dynamic partition error when running multiple task attempts

2020-03-26 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068005#comment-17068005 ] koert kuipers commented on SPARK-30320: --- i believe we are seeing this issue. it shows up in

[jira] [Comment Edited] (SPARK-30320) Insert overwrite to DataSource table with dynamic partition error when running multiple task attempts

2020-03-26 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17068005#comment-17068005 ] koert kuipers edited comment on SPARK-30320 at 3/26/20, 8:11 PM: - i

[jira] [Created] (SPARK-31278) numOutputRows shows value from last micro batch when there is no new data

2020-03-26 Thread Burak Yavuz (Jira)
Burak Yavuz created SPARK-31278: --- Summary: numOutputRows shows value from last micro batch when there is no new data Key: SPARK-31278 URL: https://issues.apache.org/jira/browse/SPARK-31278 Project:

[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-03-26 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067972#comment-17067972 ] koert kuipers edited comment on SPARK-29302 at 3/26/20, 7:23 PM: - i

[jira] [Created] (SPARK-31277) Migrate `DateTimeTestUtils` from `TimeZone` to `ZoneId`

2020-03-26 Thread Maxim Gekk (Jira)
Maxim Gekk created SPARK-31277: -- Summary: Migrate `DateTimeTestUtils` from `TimeZone` to `ZoneId` Key: SPARK-31277 URL: https://issues.apache.org/jira/browse/SPARK-31277 Project: Spark Issue

[jira] [Commented] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-03-26 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067972#comment-17067972 ] koert kuipers commented on SPARK-29302: --- i believe we are seeing this issue. it shows up in

[jira] [Comment Edited] (SPARK-29302) dynamic partition overwrite with speculation enabled

2020-03-26 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067972#comment-17067972 ] koert kuipers edited comment on SPARK-29302 at 3/26/20, 7:16 PM: - i

[jira] [Updated] (SPARK-31276) Contrived working example that works with multiple URI file storages for Spark cluster mode

2020-03-26 Thread Jim Huang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Huang updated SPARK-31276: -- Description: This Spark SQL Guide --> Data sources --> Generic Load/Save Functions

[jira] [Created] (SPARK-31276) Contrived working example that works with multiple URI file storages for Spark cluster mode

2020-03-26 Thread Jim Huang (Jira)
Jim Huang created SPARK-31276: - Summary: Contrived working example that works with multiple URI file storages for Spark cluster mode Key: SPARK-31276 URL: https://issues.apache.org/jira/browse/SPARK-31276

[jira] [Created] (SPARK-31275) Improve the metrics format in ExecutionPage for StageId

2020-03-26 Thread Kousuke Saruta (Jira)
Kousuke Saruta created SPARK-31275: -- Summary: Improve the metrics format in ExecutionPage for StageId Key: SPARK-31275 URL: https://issues.apache.org/jira/browse/SPARK-31275 Project: Spark

[jira] [Updated] (SPARK-31274) Support .r files in 2.x version

2020-03-26 Thread Gaurangi Saxena (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaurangi Saxena updated SPARK-31274: Priority: Minor (was: Trivial) > Support .r files in 2.x version >

[jira] [Updated] (SPARK-31274) Support .r files in 2.x version

2020-03-26 Thread Gaurangi Saxena (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gaurangi Saxena updated SPARK-31274: Issue Type: Question (was: Bug) > Support .r files in 2.x version >

[jira] [Created] (SPARK-31274) Support .r files in 2.x version

2020-03-26 Thread Gaurangi Saxena (Jira)
Gaurangi Saxena created SPARK-31274: --- Summary: Support .r files in 2.x version Key: SPARK-31274 URL: https://issues.apache.org/jira/browse/SPARK-31274 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-30095) create function syntax has to be enhance in Doc for multiple dependent jars

2020-03-26 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067892#comment-17067892 ] Huaxin Gao edited comment on SPARK-30095 at 3/26/20, 5:45 PM: -- I took a

[jira] [Commented] (SPARK-30095) create function syntax has to be enhance in Doc for multiple dependent jars

2020-03-26 Thread Huaxin Gao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067892#comment-17067892 ] Huaxin Gao commented on SPARK-30095: I took a look of the create function doc, it has the following

[jira] [Created] (SPARK-31273) Support for BEGIN/COMMIT/ROLLBACK TRANSACTION in SparkSQL

2020-03-26 Thread Sergio Sainz (Jira)
Sergio Sainz created SPARK-31273: Summary: Support for BEGIN/COMMIT/ROLLBACK TRANSACTION in SparkSQL Key: SPARK-31273 URL: https://issues.apache.org/jira/browse/SPARK-31273 Project: Spark

[jira] [Assigned] (SPARK-31259) Fix log error of curRequestSize in ShuffleBlockFetcherIterator

2020-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31259: - Assignee: wuyi > Fix log error of curRequestSize in ShuffleBlockFetcherIterator >

[jira] [Resolved] (SPARK-31259) Fix log error of curRequestSize in ShuffleBlockFetcherIterator

2020-03-26 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31259. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28028

[jira] [Created] (SPARK-31272) Support DB2 Kerberos login in JDBC connector

2020-03-26 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-31272: - Summary: Support DB2 Kerberos login in JDBC connector Key: SPARK-31272 URL: https://issues.apache.org/jira/browse/SPARK-31272 Project: Spark Issue Type:

[jira] [Commented] (SPARK-31272) Support DB2 Kerberos login in JDBC connector

2020-03-26 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067781#comment-17067781 ] Gabor Somogyi commented on SPARK-31272: --- Started to work on this. > Support DB2 Kerberos login in

[jira] [Reopened] (SPARK-31191) Spark SQL and hive metastore are incompatible

2020-03-26 Thread leishuiyu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leishuiyu reopened SPARK-31191: --- > Spark SQL and hive metastore are incompatible > - > >

[jira] [Resolved] (SPARK-29154) Update Spark scheduler for stage level scheduling

2020-03-26 Thread Thomas Graves (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-29154. --- Fix Version/s: 3.1.0 Assignee: Thomas Graves Resolution: Fixed > Update

[jira] [Resolved] (SPARK-31263) Enable yarn shuffle service close the idle connections

2020-03-26 Thread feiwang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] feiwang resolved SPARK-31263. - Resolution: Duplicate > Enable yarn shuffle service close the idle connections >

[jira] [Resolved] (SPARK-31201) add an individual config for skewed partition threshold

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31201. -- Target Version/s: 3.0.0 Resolution: Fixed Fixed in

[jira] [Created] (SPARK-31271) fix web ui for driver side SQL metrics

2020-03-26 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-31271: --- Summary: fix web ui for driver side SQL metrics Key: SPARK-31271 URL: https://issues.apache.org/jira/browse/SPARK-31271 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067661#comment-17067661 ] angerszhu commented on SPARK-31268: --- raise a pr soon > TaskEnd event with zero Executor Metrics when

[jira] [Commented] (SPARK-31270) Expose executor memory metrics at the task detal, in the Stages tab

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17067657#comment-17067657 ] angerszhu commented on SPARK-31270: --- Raise a pr soon > Expose executor memory metrics at the task

[jira] [Created] (SPARK-31270) Expose executor memory metrics at the task detal, in the Stages tab

2020-03-26 Thread angerszhu (Jira)
angerszhu created SPARK-31270: - Summary: Expose executor memory metrics at the task detal, in the Stages tab Key: SPARK-31270 URL: https://issues.apache.org/jira/browse/SPARK-31270 Project: Spark

[jira] [Created] (SPARK-31269) Supplement version for configuration only appear in configuration doc

2020-03-26 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-31269: -- Summary: Supplement version for configuration only appear in configuration doc Key: SPARK-31269 URL: https://issues.apache.org/jira/browse/SPARK-31269 Project: Spark

[jira] [Updated] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31268: -- Attachment: screenshot-1.png > TaskEnd event with zero Executor Metrics when task duration less then

[jira] [Created] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
angerszhu created SPARK-31268: - Summary: TaskEnd event with zero Executor Metrics when task duration less then poll interval Key: SPARK-31268 URL: https://issues.apache.org/jira/browse/SPARK-31268

[jira] [Updated] (SPARK-31268) TaskEnd event with zero Executor Metrics when task duration less then poll interval

2020-03-26 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31268: -- Description: TaskEnd event with zero Executor Metrics when task duration less then poll interval >

[jira] [Resolved] (SPARK-31228) Add version information to the configuration of Kafka

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31228. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27989

[jira] [Assigned] (SPARK-31228) Add version information to the configuration of Kafka

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31228: Assignee: jiaan.geng > Add version information to the configuration of Kafka >

[jira] [Resolved] (SPARK-31242) Clone SparkSession should respect spark.sql.legacy.sessionInitWithConfigDefaults

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31242. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28014

[jira] [Assigned] (SPARK-31242) Clone SparkSession should respect spark.sql.legacy.sessionInitWithConfigDefaults

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31242: --- Assignee: wuyi > Clone SparkSession should respect >

[jira] [Created] (SPARK-31267) Flaky test: WholeStageCodegenSparkSubmitSuite.Generated code on driver should not embed platform-specific constant

2020-03-26 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-31267: - Summary: Flaky test: WholeStageCodegenSparkSubmitSuite.Generated code on driver should not embed platform-specific constant Key: SPARK-31267 URL:

[jira] [Created] (SPARK-31266) Flaky test: KafkaDataConsumerSuite.SPARK-25151 Handles multiple tasks in executor fetching same (topic, partition) pair and same offset (edge-case) - data not in use

2020-03-26 Thread Gabor Somogyi (Jira)
Gabor Somogyi created SPARK-31266: - Summary: Flaky test: KafkaDataConsumerSuite.SPARK-25151 Handles multiple tasks in executor fetching same (topic, partition) pair and same offset (edge-case) - data not in use Key: SPARK-31266

[jira] [Updated] (SPARK-31234) ResetCommand should not wipe out all configs

2020-03-26 Thread Takeshi Yamamuro (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31234: - Issue Type: Bug (was: Improvement) > ResetCommand should not wipe out all configs >

[jira] [Resolved] (SPARK-31254) `HiveResult.toHiveString` does not use the current session time zone

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31254. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28024

[jira] [Assigned] (SPARK-31254) `HiveResult.toHiveString` does not use the current session time zone

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31254: --- Assignee: Maxim Gekk > `HiveResult.toHiveString` does not use the current session time

[jira] [Updated] (SPARK-31147) forbid CHAR type in non-Hive-Serde tables

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-31147: Fix Version/s: (was: 3.1.0) 3.0.0 > forbid CHAR type in non-Hive-Serde

[jira] [Resolved] (SPARK-31227) Non-nullable null type should not coerce to nullable type

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31227. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27991

[jira] [Assigned] (SPARK-31227) Non-nullable null type should not coerce to nullable type

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31227: --- Assignee: Hyukjin Kwon > Non-nullable null type should not coerce to nullable type >

[jira] [Resolved] (SPARK-31234) ResetCommand should not wipe out all configs

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31234. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28003

[jira] [Assigned] (SPARK-31234) ResetCommand should not wipe out all configs

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31234: --- Assignee: Kent Yao > ResetCommand should not wipe out all configs >

[jira] [Updated] (SPARK-31247) Flaky test: KafkaContinuousSourceSuite.assign from latest offsets (failOnDataLoss: false)

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31247: - Description:

[jira] [Updated] (SPARK-31252) Flaky test: ElementTrackingStoreSuite.asynchronous tracking single-fire

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31252: - Description: {code} Error Message org.scalatest.exceptions.TestFailedDueToTimeoutException: The

[jira] [Updated] (SPARK-31252) Flaky test: ElementTrackingStoreSuite.asynchronous tracking single-fire

2020-03-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31252: - Description:

[jira] [Created] (SPARK-31265) Add -XX:MaxDirectMemorySize jvm options in yarn mode

2020-03-26 Thread wangzhun (Jira)
wangzhun created SPARK-31265: Summary: Add -XX:MaxDirectMemorySize jvm options in yarn mode Key: SPARK-31265 URL: https://issues.apache.org/jira/browse/SPARK-31265 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-31237) Replace 3-letter time zones by zone offsets

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31237. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28001

[jira] [Assigned] (SPARK-31237) Replace 3-letter time zones by zone offsets

2020-03-26 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31237: --- Assignee: Maxim Gekk > Replace 3-letter time zones by zone offsets >