[jira] [Commented] (SPARK-21595) introduction of spark.sql.windowExec.buffer.spill.threshold in spark 2.2 breaks existing workflow

[ https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088302#comment-17088302 ] Rakesh Shah commented on SPARK-21595: - Hi [~sreiling] I am also facing same issue where my shuffle

[jira] [Updated] (SPARK-25390) Data source V2 API refactoring

[ https://issues.apache.org/jira/browse/SPARK-25390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-25390: Summary: Data source V2 API refactoring (was: data source V2 API refactoring) > Data source V2 API

[jira] [Assigned] (SPARK-31494) flatten the result dataframe of ANOVATest

[ https://issues.apache.org/jira/browse/SPARK-31494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31494: Assignee: zhengruifeng > flatten the result dataframe of ANOVATest >

[jira] [Resolved] (SPARK-31494) flatten the result dataframe of ANOVATest

[ https://issues.apache.org/jira/browse/SPARK-31494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31494. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28270

[jira] [Commented] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088284#comment-17088284 ] Wenchen Fan commented on SPARK-28554: - It still in progress at

[jira] [Resolved] (SPARK-30624) JDBCV2 with catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-30624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30624. - Assignee: (was: Wenchen Fan) Resolution: Duplicate > JDBCV2 with catalog

[jira] [Resolved] (SPARK-30949) Driver cores in kubernetes are coupled with container resources, not spark.driver.cores

[ https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-30949. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 27695

[jira] [Assigned] (SPARK-30949) Driver cores in kubernetes are coupled with container resources, not spark.driver.cores

[ https://issues.apache.org/jira/browse/SPARK-30949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-30949: - Assignee: Onur Satici > Driver cores in kubernetes are coupled with container

[jira] [Resolved] (SPARK-30420) Commands involved with namespace go thru the new resolution framework.

[ https://issues.apache.org/jira/browse/SPARK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-30420. - Fix Version/s: 3.0.0 Assignee: Terry Kim Resolution: Fixed > Commands involved

[jira] [Commented] (SPARK-30420) Commands involved with namespace go thru the new resolution framework.

[ https://issues.apache.org/jira/browse/SPARK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088281#comment-17088281 ] Wenchen Fan commented on SPARK-30420: - Yea we didn't revert this and we don't need to. Let me close

[jira] [Created] (SPARK-31502) document identifier in SQL Reference

Huaxin Gao created SPARK-31502: -- Summary: document identifier in SQL Reference Key: SPARK-31502 URL: https://issues.apache.org/jira/browse/SPARK-31502 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-31501) AQE update UI should not cause deadlock

[ https://issues.apache.org/jira/browse/SPARK-31501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31501: --- Assignee: Wei Xue > AQE update UI should not cause deadlock >

[jira] [Resolved] (SPARK-31501) AQE update UI should not cause deadlock

[ https://issues.apache.org/jira/browse/SPARK-31501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31501. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28275

[jira] [Assigned] (SPARK-31492) flatten the result dataframe of FValueTest

[ https://issues.apache.org/jira/browse/SPARK-31492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng reassigned SPARK-31492: Assignee: zhengruifeng > flatten the result dataframe of FValueTest >

[jira] [Resolved] (SPARK-31492) flatten the result dataframe of FValueTest

[ https://issues.apache.org/jira/browse/SPARK-31492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-31492. -- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28268

[jira] [Resolved] (SPARK-30661) KMeans blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng resolved SPARK-30661. -- Resolution: Not A Problem > KMeans blockify input vectors > - > >

[jira] [Resolved] (SPARK-31429) Add additional fields in ExpressionDescription for more granular category in documentation

[ https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-31429. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28224

[jira] [Assigned] (SPARK-31429) Add additional fields in ExpressionDescription for more granular category in documentation

[ https://issues.apache.org/jira/browse/SPARK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-31429: Assignee: Takeshi Yamamuro > Add additional fields in ExpressionDescription for more

[jira] [Resolved] (SPARK-28006) User-defined grouped transform pandas_udf for window operations

[ https://issues.apache.org/jira/browse/SPARK-28006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-28006. -- Resolution: Won't Fix Let me close this ticket for now as discussed in the PR because we can

[jira] [Updated] (SPARK-31481) Sprak 3.0 - Full List of Pod Template not available

[ https://issues.apache.org/jira/browse/SPARK-31481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Misra updated SPARK-31481: -- Component/s: Kubernetes > Sprak 3.0 - Full List of Pod Template not available >

[jira] [Commented] (SPARK-30420) Commands involved with namespace go thru the new resolution framework.

[ https://issues.apache.org/jira/browse/SPARK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088186#comment-17088186 ] Terry Kim commented on SPARK-30420: --- No, I don't think this is reverted. [~cloud_fan], does this need

[jira] [Updated] (SPARK-30162) Add PushedFilters to metadata in Parquet DSv2 implementation

[ https://issues.apache.org/jira/browse/SPARK-30162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30162: - Fix Version/s: (was: 3.0.0) > Add PushedFilters to metadata in Parquet DSv2 implementation

[jira] [Updated] (SPARK-23367) Include python document style checking

[ https://issues.apache.org/jira/browse/SPARK-23367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-23367: - Fix Version/s: (was: 3.0.0) > Include python document style checking >

[jira] [Commented] (SPARK-28554) implement basic catalog functionalities

[ https://issues.apache.org/jira/browse/SPARK-28554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088181#comment-17088181 ] Sean R. Owen commented on SPARK-28554: -- Is this still 'resolved' or (partly) 'reverted'? >

[jira] [Updated] (SPARK-30420) Commands involved with namespace go thru the new resolution framework.

[ https://issues.apache.org/jira/browse/SPARK-30420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30420: - Fix Version/s: (was: 3.0.0) This was reverted, right? > Commands involved with namespace

[jira] [Updated] (SPARK-29663) Support sum with interval type values

[ https://issues.apache.org/jira/browse/SPARK-29663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29663: - Fix Version/s: (was: 3.0.0) > Support sum with interval type values >

[jira] [Updated] (SPARK-29688) Support average with interval type values

[ https://issues.apache.org/jira/browse/SPARK-29688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-29688: - Fix Version/s: (was: 3.0.0) > Support average with interval type values >

[jira] [Updated] (SPARK-30659) LogisticRegression blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30659: - Fix Version/s: (was: 3.0.0) > LogisticRegression blockify input vectors >

[jira] [Updated] (SPARK-30642) LinearSVC blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30642: - Fix Version/s: (was: 3.0.0) > LinearSVC blockify input vectors >

[jira] [Updated] (SPARK-30535) Migrate ALTER TABLE commands to the new resolution framework

[ https://issues.apache.org/jira/browse/SPARK-30535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30535: - Fix Version/s: (was: 3.0.0) > Migrate ALTER TABLE commands to the new resolution framework

[jira] [Updated] (SPARK-30660) LinearRegression blockify input vectors

[ https://issues.apache.org/jira/browse/SPARK-30660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30660: - Fix Version/s: (was: 3.0.0) > LinearRegression blockify input vectors >

[jira] [Resolved] (SPARK-31158) Connect Spark Cluster Exception on IDEA develop

[ https://issues.apache.org/jira/browse/SPARK-31158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-31158. -- Resolution: Invalid This is also not enough information to evaluate the cause > Connect

[jira] [Updated] (SPARK-31158) Connect Spark Cluster Exception on IDEA develop

[ https://issues.apache.org/jira/browse/SPARK-31158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31158: - Fix Version/s: (was: 1.5.1) Labels: (was: test) Nor Fix version. We wouldn't

[jira] [Updated] (SPARK-31235) Separates different categories of applications

[ https://issues.apache.org/jira/browse/SPARK-31235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31235: - Fix Version/s: (was: 3.0.0) (Don't set Fix Version) > Separates different categories of

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: (was: improved_version.json) > Improve SQL Rest API >

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Attachment: improved_version.json > Improve SQL Rest API > > >

[jira] [Created] (SPARK-31501) AQE update UI should not cause deadlock

Wei Xue created SPARK-31501: --- Summary: AQE update UI should not cause deadlock Key: SPARK-31501 URL: https://issues.apache.org/jira/browse/SPARK-31501 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-31389) Add codegen-on test coverage for some tests in SQLMetricsSuite

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31389: -- Summary: Add codegen-on test coverage for some tests in SQLMetricsSuite (was: Ensure all

[jira] [Updated] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-31389: -- Issue Type: Improvement (was: Bug) > Ensure all tests in SQLMetricsSuite run with both

[jira] [Assigned] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31389: - Assignee: Srinivas Rishindra Pothireddi > Ensure all tests in SQLMetricsSuite run with

[jira] [Updated] (SPARK-31440) Improve SQL Rest API

[ https://issues.apache.org/jira/browse/SPARK-31440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-31440: --- Description: SQL Rest API exposes query execution metrics as Public API. This Jira

[jira] [Resolved] (SPARK-31389) Ensure all tests in SQLMetricsSuite run with both codegen on and off

[ https://issues.apache.org/jira/browse/SPARK-31389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31389. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28173

[jira] [Commented] (SPARK-28684) Hive module support JDK 11

[ https://issues.apache.org/jira/browse/SPARK-28684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088076#comment-17088076 ] Dongjoon Hyun commented on SPARK-28684: --- Thank you so much, [~yumwang]. I resolved this umbrella

[jira] [Resolved] (SPARK-28684) Hive module support JDK 11

[ https://issues.apache.org/jira/browse/SPARK-28684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-28684. --- Resolution: Done > Hive module support JDK 11 > -- > >

[jira] [Resolved] (SPARK-31452) Do not create partition spec for 0-size partitions

[ https://issues.apache.org/jira/browse/SPARK-31452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31452. --- Fix Version/s: 3.1.0 Resolution: Fixed Issue resolved by pull request 28226

[jira] [Resolved] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29245. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28148

[jira] [Resolved] (SPARK-31381) Upgrade built-in Hive 2.3.6 to 2.3.7

[ https://issues.apache.org/jira/browse/SPARK-31381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-31381. --- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28148

[jira] [Assigned] (SPARK-31381) Upgrade built-in Hive 2.3.6 to 2.3.7

[ https://issues.apache.org/jira/browse/SPARK-31381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-31381: - Assignee: Yuming Wang > Upgrade built-in Hive 2.3.6 to 2.3.7 >

[jira] [Assigned] (SPARK-29245) CCE during creating HiveMetaStoreClient

[ https://issues.apache.org/jira/browse/SPARK-29245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-29245: - Assignee: Yuming Wang > CCE during creating HiveMetaStoreClient >

[jira] [Resolved] (SPARK-31234) ResetCommand should not wipe out all configs

[ https://issues.apache.org/jira/browse/SPARK-31234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31234. - Resolution: Fixed > ResetCommand should not wipe out all configs >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated SPARK-31500: --- Affects Version/s: 2.4.5 > collect_set() of BinaryType returns duplicate elements >

[jira] [Updated] (SPARK-17636) Parquet predicate pushdown for nested fields

[ https://issues.apache.org/jira/browse/SPARK-17636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17636: Priority: Critical (was: Minor) > Parquet predicate pushdown for nested fields >

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated SPARK-31500: --- Description: The collect_set() aggregate function should produce a set of distinct

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated SPARK-31500: --- Description: The collect_set() aggregate function should produce a set of distinct

[jira] [Updated] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

[ https://issues.apache.org/jira/browse/SPARK-31500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Wasserman updated SPARK-31500: --- Description: The collect_set() aggregate function should produce a set of distinct

[jira] [Created] (SPARK-31500) collect_set() of BinaryType returns duplicate elements

Eric Wasserman created SPARK-31500: -- Summary: collect_set() of BinaryType returns duplicate elements Key: SPARK-31500 URL: https://issues.apache.org/jira/browse/SPARK-31500 Project: Spark

[jira] [Resolved] (SPARK-31475) Broadcast stage in AQE did not timeout

[ https://issues.apache.org/jira/browse/SPARK-31475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-31475. - Fix Version/s: 3.0.0 Assignee: Wei Xue Resolution: Fixed > Broadcast stage in AQE did

[jira] [Updated] (SPARK-31172) RecordBinaryComparator Tests failing on Big Endian Platform (s390x)

[ https://issues.apache.org/jira/browse/SPARK-31172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-31172: - Fix Version/s: (was: 2.4.6) (was: 3.1.0) (was:

[jira] [Updated] (SPARK-30975) Rename config for spark.<>.memoryOverhead

[ https://issues.apache.org/jira/browse/SPARK-30975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-30975: - Fix Version/s: (was: 2.4.6) > Rename config for spark.<>.memoryOverhead >

[jira] [Resolved] (SPARK-30975) Rename config for spark.<>.memoryOverhead

[ https://issues.apache.org/jira/browse/SPARK-30975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-30975. -- Resolution: Won't Fix > Rename config for spark.<>.memoryOverhead >

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087908#comment-17087908 ] nirav patel commented on SPARK-6305: I think spark should decouple logging and allow application

[jira] [Issue Comment Deleted] (SPARK-31431) CalendarInterval encoder support

[ https://issues.apache.org/jira/browse/SPARK-31431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amandeep updated SPARK-31431: - Comment: was deleted (was: Hi Team, I would like to work on this improvement, please let me know how

[jira] [Commented] (SPARK-31431) CalendarInterval encoder support

[ https://issues.apache.org/jira/browse/SPARK-31431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087881#comment-17087881 ] Amandeep commented on SPARK-31431: -- Hi Team, I would like to work on this improvement, please let me

[jira] [Commented] (SPARK-30055) Allow configurable restart policy of driver and executor pods

[ https://issues.apache.org/jira/browse/SPARK-30055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087857#comment-17087857 ] Ed Mitchell commented on SPARK-30055: - I agree with this. Having Never defaulted limits the

[jira] [Commented] (SPARK-31463) Enhance JsonDataSource by replacing jackson with simdjson

[ https://issues.apache.org/jira/browse/SPARK-31463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087836#comment-17087836 ] Shashanka Balakuntala Srinivasa commented on SPARK-31463: - Hi, Anyone working on

[jira] [Comment Edited] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087813#comment-17087813 ] Giri Dandu edited comment on SPARK-27913 at 4/20/20, 2:52 PM: --

[jira] [Comment Edited] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087813#comment-17087813 ] Giri Dandu edited comment on SPARK-27913 at 4/20/20, 2:52 PM: --

[jira] [Commented] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087813#comment-17087813 ] Giri Dandu commented on SPARK-27913: [~hyukjin.kwon]   with mergeSchema orc option it is still

[jira] [Commented] (SPARK-27913) Spark SQL's native ORC reader implements its own schema evolution

[ https://issues.apache.org/jira/browse/SPARK-27913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087740#comment-17087740 ] Hyukjin Kwon commented on SPARK-27913: -- [~giri.dandu] can you try {{mergeSchema}} option

[jira] [Updated] (SPARK-31499) Add more column entries in bulit-in function tables of SQL references

[ https://issues.apache.org/jira/browse/SPARK-31499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31499: - Summary: Add more column entries in bulit-in function tables of SQL references (was:

[jira] [Created] (SPARK-31499) Add more field entries in bulit-in function tables in SQL references

Takeshi Yamamuro created SPARK-31499: Summary: Add more field entries in bulit-in function tables in SQL references Key: SPARK-31499 URL: https://issues.apache.org/jira/browse/SPARK-31499

[jira] [Updated] (SPARK-31499) Add more field entries in bulit-in function tables of SQL references

[ https://issues.apache.org/jira/browse/SPARK-31499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-31499: - Summary: Add more field entries in bulit-in function tables of SQL references (was:

[jira] [Created] (SPARK-31498) Dump public static sql configurations through doc generation

Kent Yao created SPARK-31498: Summary: Dump public static sql configurations through doc generation Key: SPARK-31498 URL: https://issues.apache.org/jira/browse/SPARK-31498 Project: Spark Issue

[jira] [Assigned] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu reassigned SPARK-31497: -- Assignee: Weichen Xu > Pyspark CrossValidator/TrainValidationSplit with pipeline estimator

[jira] [Updated] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-31497: --- Description: Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and

[jira] [Updated] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-31497: --- Description: Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and

[jira] [Updated] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

[ https://issues.apache.org/jira/browse/SPARK-31497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weichen Xu updated SPARK-31497: --- Description: Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and

[jira] [Created] (SPARK-31497) Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model

Weichen Xu created SPARK-31497: -- Summary: Pyspark CrossValidator/TrainValidationSplit with pipeline estimator cannot save and load model Key: SPARK-31497 URL: https://issues.apache.org/jira/browse/SPARK-31497

[jira] [Updated] (SPARK-31496) Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-31496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomas Shestakov updated SPARK-31496: Description: Local spark with one core (local[1]) while trying to save Dataset to parquet

[jira] [Updated] (SPARK-31496) Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-31496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomas Shestakov updated SPARK-31496: Description: Local spark with one core (local[1]) while trying to save Dataset to parquet

[jira] [Updated] (SPARK-31496) Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-31496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomas Shestakov updated SPARK-31496: Description: Local spark with one core (local[1]) while trying to save Dataset to parquet

[jira] [Updated] (SPARK-31496) Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError

[ https://issues.apache.org/jira/browse/SPARK-31496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomas Shestakov updated SPARK-31496: Description: Local spark with one core (local[1]) while trying to save Dataset to parquet

[jira] [Created] (SPARK-31496) Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError

Tomas Shestakov created SPARK-31496: --- Summary: Exception in thread "dispatcher-event-loop-1" java.lang.OutOfMemoryError Key: SPARK-31496 URL: https://issues.apache.org/jira/browse/SPARK-31496

[jira] [Created] (SPARK-31495) Support formatted explain for Adaptive Query Execution

wuyi created SPARK-31495: Summary: Support formatted explain for Adaptive Query Execution Key: SPARK-31495 URL: https://issues.apache.org/jira/browse/SPARK-31495 Project: Spark Issue Type:

[jira] [Commented] (SPARK-28367) Kafka connector infinite wait because metadata never updated

[ https://issues.apache.org/jira/browse/SPARK-28367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087498#comment-17087498 ] Gabor Somogyi commented on SPARK-28367: --- It it unblocked and started to work on this... > Kafka

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17087451#comment-17087451 ] Shuai Ma commented on SPARK-24432: -- looking forward to seeing this feature come true... > Add support

[jira] [Resolved] (SPARK-31490) Benchmark conversions to/from Java 8 date-time types

[ https://issues.apache.org/jira/browse/SPARK-31490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31490. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28263

[jira] [Assigned] (SPARK-31490) Benchmark conversions to/from Java 8 date-time types

[ https://issues.apache.org/jira/browse/SPARK-31490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31490: --- Assignee: Maxim Gekk > Benchmark conversions to/from Java 8 date-time types >

[jira] [Assigned] (SPARK-31385) Results of Julian-Gregorian rebasing don't match to Gregorian-Julian rebasing

[ https://issues.apache.org/jira/browse/SPARK-31385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-31385: --- Assignee: Maxim Gekk > Results of Julian-Gregorian rebasing don't match to

[jira] [Resolved] (SPARK-31385) Results of Julian-Gregorian rebasing don't match to Gregorian-Julian rebasing

[ https://issues.apache.org/jira/browse/SPARK-31385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-31385. - Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 28253