[jira] [Resolved] (SPARK-30846) Add AccumulatorV2 API in JavaSparkContext

[ https://issues.apache.org/jira/browse/SPARK-30846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-30846. -- Resolution: Won't Fix > Add AccumulatorV2 API in JavaSparkContext > --

[jira] [Assigned] (SPARK-30532) DataFrameStatFunctions.approxQuantile doesn't work with TABLE.COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-30532: --- Assignee: Oleksii Kachaiev > DataFrameStatFunctions.approxQuantile doesn't work with TABLE.

[jira] [Resolved] (SPARK-30532) DataFrameStatFunctions.approxQuantile doesn't work with TABLE.COLUMN syntax

[ https://issues.apache.org/jira/browse/SPARK-30532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30532. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 27916 [https://gith

[jira] [Assigned] (SPARK-31283) Simplify ChiSq by adding a common method

[ https://issues.apache.org/jira/browse/SPARK-31283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31283: Assignee: zhengruifeng > Simplify ChiSq by adding a common method > -

[jira] [Resolved] (SPARK-31283) Simplify ChiSq by adding a common method

[ https://issues.apache.org/jira/browse/SPARK-31283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31283. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28045 [https://gi

[jira] [Resolved] (SPARK-31286) Specify formats of time zone ID for JSON/CSV option and from/to_utc_timestamp

[ https://issues.apache.org/jira/browse/SPARK-31286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31286. - Resolution: Fixed Issue resolved by pull request 28051 [https://github.com/apache/spark/pull/280

[jira] [Commented] (SPARK-22231) Support of map, filter, withColumn, dropColumn in nested list of structures

[ https://issues.apache.org/jira/browse/SPARK-22231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070688#comment-17070688 ] Reynold Xin commented on SPARK-22231: - [~fqaiser94] thanks for your persistence and

[jira] [Updated] (SPARK-31291) SQLQueryTestSuite: Avoid load test data if test case not uses them.

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31291: --- Summary: SQLQueryTestSuite: Avoid load test data if test case not uses them. (was: SQLQueryTestSuit

[jira] [Updated] (SPARK-31291) SQLQueryTestSuiteAvoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-31291: --- Summary: SQLQueryTestSuiteAvoid load test data if test case not uses them (was: Avoid load test dat

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Priority: Minor (was: Major) > Avoid load test data if test case not uses them >

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Component/s: Tests > Avoid load test data if test case not uses them > ---

[jira] [Updated] (SPARK-31291) Avoid load test data if test case not uses them

[ https://issues.apache.org/jira/browse/SPARK-31291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31291: -- Parent: SPARK-25604 Issue Type: Sub-task (was: Improvement) > Avoid load test data if

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Fix Version/s: (was: 3.1.0) > Upgrade Janino to 3.0.16 > > >

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Fix Version/s: 2.4.6 3.0.0 > Upgrade Janino to 3.0.16 > ---

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Issue Type: Bug (was: Dependency upgrade) > Upgrade Janino to 3.0.16 > --

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Component/s: (was: SQL) Build > Upgrade Janino to 3.0.16 > --

[jira] [Updated] (SPARK-31101) Upgrade Janino to 3.0.16

[ https://issues.apache.org/jira/browse/SPARK-31101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31101: -- Affects Version/s: (was: 3.1.0) 3.0.0 > Upgrade Janino to 3.0.16 >

[jira] [Assigned] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31293: - Assignee: Kengo Seki > Fix wrong examples and help messages for Kinesis integration > -

[jira] [Resolved] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31293. --- Fix Version/s: 3.0.0 2.4.6 Resolution: Fixed Issue resolved by pul

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Affects Version/s: 2.4.5 > Fix wrong examples and help messages for Kinesis integration >

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Affects Version/s: 2.3.4 > Fix wrong examples and help messages for Kinesis integration >

[jira] [Updated] (SPARK-31293) Fix wrong examples and help messages for Kinesis integration

[ https://issues.apache.org/jira/browse/SPARK-31293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31293: -- Issue Type: Bug (was: Improvement) > Fix wrong examples and help messages for Kinesis integra

[jira] [Comment Edited] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070478#comment-17070478 ] Alfred Davidson edited comment on SPARK-31281 at 3/29/20, 6:54 PM: ---

[jira] [Comment Edited] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070478#comment-17070478 ] Alfred Davidson edited comment on SPARK-31281 at 3/29/20, 6:54 PM: ---

[jira] [Commented] (SPARK-31281) Hit OOM Error - GC Limit

[ https://issues.apache.org/jira/browse/SPARK-31281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070478#comment-17070478 ] Alfred Davidson commented on SPARK-31281: - The allocated driver memory will be s

[jira] [Resolved] (SPARK-31280) Perform propagating empty relation after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31280. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28043 [https://

[jira] [Assigned] (SPARK-31280) Perform propagating empty relation after RewritePredicateSubquery

[ https://issues.apache.org/jira/browse/SPARK-31280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31280: - Assignee: Kent Yao > Perform propagating empty relation after RewritePredicateSubquery

[jira] [Commented] (SPARK-31297) Speed-up date-time rebasing

[ https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070457#comment-17070457 ] Maxim Gekk commented on SPARK-31297: The rebasing of days doesn't depend on time zon

[jira] [Commented] (SPARK-30272) Remove usage of Guava that breaks in Guava 27

[ https://issues.apache.org/jira/browse/SPARK-30272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070391#comment-17070391 ] Sean R. Owen commented on SPARK-30272: -- The reason is simply that this is the versi

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict and External table also need to check non-empty

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict and External table also need to check

[jira] [Updated] (SPARK-31298) validate CTAS table path in SPARK-19724 seems conflict

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Summary: validate CTAS table path in SPARK-19724 seems conflict (was: validate External path in SPARK

[jira] [Updated] (SPARK-31298) validate External path in SPARK-19724 seems conflict

[ https://issues.apache.org/jira/browse/SPARK-31298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] angerszhu updated SPARK-31298: -- Description: In  SessionCatalog.validateTableLocation() {code:java} val tableLocation = new Path(ta

[jira] [Created] (SPARK-31298) validate External path in SPARK-19724 seems conflict

angerszhu created SPARK-31298: - Summary: validate External path in SPARK-19724 seems conflict Key: SPARK-31298 URL: https://issues.apache.org/jira/browse/SPARK-31298 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-31297) Speed-up date-time rebasing

[ https://issues.apache.org/jira/browse/SPARK-31297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070286#comment-17070286 ] Maxim Gekk commented on SPARK-31297: [~cloud_fan] [~hyukjin.kwon] [~dongjoon] WDYT?

[jira] [Created] (SPARK-31297) Speed-up date-time rebasing

Maxim Gekk created SPARK-31297: -- Summary: Speed-up date-time rebasing Key: SPARK-31297 URL: https://issues.apache.org/jira/browse/SPARK-31297 Project: Spark Issue Type: Improvement Com

[jira] [Commented] (SPARK-30272) Remove usage of Guava that breaks in Guava 27

[ https://issues.apache.org/jira/browse/SPARK-30272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17070255#comment-17070255 ] Jorge Machado commented on SPARK-30272: --- So I was able to fix it. I build it with

[jira] [Updated] (SPARK-31296) Benchmark date-time rebasing in Parquet datasource

[ https://issues.apache.org/jira/browse/SPARK-31296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-31296: --- Summary: Benchmark date-time rebasing in Parquet datasource (was: Benchmark date-time rebasing to/f

[jira] [Created] (SPARK-31296) Benchmark date-time rebasing to/from Julian calendar

Maxim Gekk created SPARK-31296: -- Summary: Benchmark date-time rebasing to/from Julian calendar Key: SPARK-31296 URL: https://issues.apache.org/jira/browse/SPARK-31296 Project: Spark Issue Type: