[jira] [Assigned] (SPARK-35735) Take into account day-time interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35735: Assignee: (was: Apache Spark) > Take into account day-time interval fields in cast >

[jira] [Assigned] (SPARK-35770) Parse YearMonthIntervalType from JSON

[ https://issues.apache.org/jira/browse/SPARK-35770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-35770: Assignee: angerszhu > Parse YearMonthIntervalType from JSON > ---

[jira] [Resolved] (SPARK-35770) Parse YearMonthIntervalType from JSON

[ https://issues.apache.org/jira/browse/SPARK-35770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35770. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32929 [https://github.com

[jira] [Assigned] (SPARK-35735) Take into account day-time interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35735: Assignee: Apache Spark > Take into account day-time interval fields in cast > ---

[jira] [Commented] (SPARK-35735) Take into account day-time interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364721#comment-17364721 ] Apache Spark commented on SPARK-35735: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364715#comment-17364715 ] Apache Spark commented on SPARK-35378: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-35378) Eagerly execute commands in QueryExecution instead of caller sides

[ https://issues.apache.org/jira/browse/SPARK-35378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364714#comment-17364714 ] Apache Spark commented on SPARK-35378: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-35757) Add bitwise AND operation to BitArray and add intersect AND operation for bloom filters

[ https://issues.apache.org/jira/browse/SPARK-35757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35757: --- Assignee: Dhruv Kumar > Add bitwise AND operation to BitArray and add intersect AND operati

[jira] [Resolved] (SPARK-35757) Add bitwise AND operation to BitArray and add intersect AND operation for bloom filters

[ https://issues.apache.org/jira/browse/SPARK-35757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35757. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32907 [https://gith

[jira] [Commented] (SPARK-35728) Check multiply/divide of day-time intervals of any fields by numeric

[ https://issues.apache.org/jira/browse/SPARK-35728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364710#comment-17364710 ] PengLei commented on SPARK-35728: - working on this > Check multiply/divide of day-time

[jira] [Updated] (SPARK-35652) Different Behaviour join vs joinWith in self joining

[ https://issues.apache.org/jira/browse/SPARK-35652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-35652: Fix Version/s: 3.0.3 > Different Behaviour join vs joinWith in self joining >

[jira] [Assigned] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-35791: --- Assignee: Cheng Su > Release on-going map properly for NULL-aware ANTI join > -

[jira] [Resolved] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-35791. - Fix Version/s: 3.1.3 3.2.0 Resolution: Fixed Issue resolved by pull re

[jira] [Updated] (SPARK-35783) Set the list of read columns in the task configuration to reduce reading of ORC data.

[ https://issues.apache.org/jira/browse/SPARK-35783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35783: -- Affects Version/s: (was: 3.1.2) (was: 3.0.1)

[jira] [Updated] (SPARK-35783) Set the list of read columns in the task configuration to reduce reading of ORC data.

[ https://issues.apache.org/jira/browse/SPARK-35783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35783: -- Issue Type: Improvement (was: Bug) > Set the list of read columns in the task configuration t

[jira] [Assigned] (SPARK-35783) Set the list of read columns in the task configuration to reduce reading of ORC data.

[ https://issues.apache.org/jira/browse/SPARK-35783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-35783: - Assignee: weixiuli > Set the list of read columns in the task configuration to reduce r

[jira] [Resolved] (SPARK-35783) Set the list of read columns in the task configuration to reduce reading of ORC data.

[ https://issues.apache.org/jira/browse/SPARK-35783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-35783. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32923 [https://

[jira] [Assigned] (SPARK-34885) Port/integrate Koalas documentation into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34885: Assignee: Hyukjin Kwon > Port/integrate Koalas documentation into PySpark > -

[jira] [Resolved] (SPARK-35644) Merge contents and remove obsolete pages in Development section

[ https://issues.apache.org/jira/browse/SPARK-35644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35644. -- Fix Version/s: 3.2.0 Assignee: Hyukjin Kwon Resolution: Fixed Fixed in https:/

[jira] [Commented] (SPARK-35792) View should not capture configs used in `RelationConversions`

[ https://issues.apache.org/jira/browse/SPARK-35792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364679#comment-17364679 ] Apache Spark commented on SPARK-35792: -- User 'linhongliu-db' has created a pull req

[jira] [Assigned] (SPARK-35792) View should not capture configs used in `RelationConversions`

[ https://issues.apache.org/jira/browse/SPARK-35792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35792: Assignee: Apache Spark > View should not capture configs used in `RelationConversions` >

[jira] [Assigned] (SPARK-35792) View should not capture configs used in `RelationConversions`

[ https://issues.apache.org/jira/browse/SPARK-35792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35792: Assignee: (was: Apache Spark) > View should not capture configs used in `RelationConv

[jira] [Commented] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364662#comment-17364662 ] Apache Spark commented on SPARK-35768: -- User 'AngersZh' has created a pull requ

[jira] [Assigned] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35768: Assignee: Apache Spark > Take into account year-month interval fields in cast > -

[jira] [Assigned] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35768: Assignee: (was: Apache Spark) > Take into account year-month interval fields in cast

[jira] [Commented] (SPARK-35735) Take into account day-time interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364661#comment-17364661 ] angerszhu commented on SPARK-35735: --- Work on this > Take into account day-time interv

[jira] [Comment Edited] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364654#comment-17364654 ] zhengruifeng edited comment on SPARK-35596 at 6/17/21, 3:13 AM: --

[jira] [Comment Edited] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364654#comment-17364654 ] zhengruifeng edited comment on SPARK-35596 at 6/17/21, 3:12 AM: --

[jira] [Commented] (SPARK-35596) HighlyCompressedMapStatus should record accurately the size of skewed shuffle blocks

[ https://issues.apache.org/jira/browse/SPARK-35596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364654#comment-17364654 ] zhengruifeng commented on SPARK-35596: -- I think I encounted a similar case:   in

[jira] [Commented] (SPARK-35768) Take into account year-month interval fields in cast

[ https://issues.apache.org/jira/browse/SPARK-35768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364650#comment-17364650 ] angerszhu commented on SPARK-35768: --- Work on this > Take into account year-month inte

[jira] [Commented] (SPARK-33603) Group exception messages in execution/command

[ https://issues.apache.org/jira/browse/SPARK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364637#comment-17364637 ] jiaan.geng commented on SPARK-33603: [~pingsutw] Of course, you can finish it. > Gr

[jira] [Created] (SPARK-35792) View should not capture configs used in `RelationConversions`

Linhong Liu created SPARK-35792: --- Summary: View should not capture configs used in `RelationConversions` Key: SPARK-35792 URL: https://issues.apache.org/jira/browse/SPARK-35792 Project: Spark

[jira] [Commented] (SPARK-33603) Group exception messages in execution/command

[ https://issues.apache.org/jira/browse/SPARK-33603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364629#comment-17364629 ] dgd_contributor commented on SPARK-33603: - [~beliefer] can I work on this, if yo

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364627#comment-17364627 ] Hyukjin Kwon commented on SPARK-18673: -- [~nssalian] please file a JIRA and go ahead

[jira] [Commented] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364604#comment-17364604 ] Apache Spark commented on SPARK-35791: -- User 'c21' has created a pull request for t

[jira] [Assigned] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35791: Assignee: Apache Spark > Release on-going map properly for NULL-aware ANTI join > ---

[jira] [Assigned] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35791: Assignee: (was: Apache Spark) > Release on-going map properly for NULL-aware ANTI joi

[jira] [Commented] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

[ https://issues.apache.org/jira/browse/SPARK-35791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364603#comment-17364603 ] Apache Spark commented on SPARK-35791: -- User 'c21' has created a pull request for t

[jira] [Created] (SPARK-35791) Release on-going map properly for NULL-aware ANTI join

Cheng Su created SPARK-35791: Summary: Release on-going map properly for NULL-aware ANTI join Key: SPARK-35791 URL: https://issues.apache.org/jira/browse/SPARK-35791 Project: Spark Issue Type: Im

[jira] [Assigned] (SPARK-35763) Minor refactor of StateStoreCustomMetric

[ https://issues.apache.org/jira/browse/SPARK-35763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-35763: Assignee: Venki Korukanti > Minor refactor of StateStoreCustomMetric > --

[jira] [Resolved] (SPARK-35763) Minor refactor of StateStoreCustomMetric

[ https://issues.apache.org/jira/browse/SPARK-35763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-35763. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32914 [https://gi

[jira] [Resolved] (SPARK-29250) Upgrade to Hadoop 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-29250. --- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 30135 [https://

[jira] [Updated] (SPARK-29250) Upgrade to Hadoop 3.3.1

[ https://issues.apache.org/jira/browse/SPARK-29250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-29250: -- Labels: releasenotes (was: ) > Upgrade to Hadoop 3.3.1 > --- > >

[jira] [Updated] (SPARK-33828) SQL Adaptive Query Execution QA

[ https://issues.apache.org/jira/browse/SPARK-33828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-33828: -- Labels: releasenotes (was: ) > SQL Adaptive Query Execution QA >

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Description: Hello.   We had using spark 3.0.2 and query was executed in ~100 seco

[jira] [Commented] (SPARK-35789) Lateral join should only be used with subquery

[ https://issues.apache.org/jira/browse/SPARK-35789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364426#comment-17364426 ] Apache Spark commented on SPARK-35789: -- User 'allisonwang-db' has created a pull re

[jira] [Assigned] (SPARK-35789) Lateral join should only be used with subquery

[ https://issues.apache.org/jira/browse/SPARK-35789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35789: Assignee: Apache Spark > Lateral join should only be used with subquery > ---

[jira] [Assigned] (SPARK-35789) Lateral join should only be used with subquery

[ https://issues.apache.org/jira/browse/SPARK-35789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35789: Assignee: (was: Apache Spark) > Lateral join should only be used with subquery >

[jira] [Commented] (SPARK-35789) Lateral join should only be used with subquery

[ https://issues.apache.org/jira/browse/SPARK-35789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364425#comment-17364425 ] Apache Spark commented on SPARK-35789: -- User 'allisonwang-db' has created a pull re

[jira] [Commented] (SPARK-18673) Dataframes doesn't work on Hadoop 3.x; Hive rejects Hadoop version

[ https://issues.apache.org/jira/browse/SPARK-18673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364409#comment-17364409 ] Neelesh Srinivas Salian commented on SPARK-18673: - Hitting this in Spark

[jira] [Created] (SPARK-35790) Spark Package Python Import does not work for depenant jars

Mark Hamilton created SPARK-35790: - Summary: Spark Package Python Import does not work for depenant jars Key: SPARK-35790 URL: https://issues.apache.org/jira/browse/SPARK-35790 Project: Spark

[jira] [Commented] (SPARK-35720) Support casting of String to timestamp without time zone type

[ https://issues.apache.org/jira/browse/SPARK-35720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364390#comment-17364390 ] Apache Spark commented on SPARK-35720: -- User 'gengliangwang' has created a pull req

[jira] [Commented] (SPARK-35720) Support casting of String to timestamp without time zone type

[ https://issues.apache.org/jira/browse/SPARK-35720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364389#comment-17364389 ] Apache Spark commented on SPARK-35720: -- User 'gengliangwang' has created a pull req

[jira] [Created] (SPARK-35789) Lateral join should only be used with subquery

Allison Wang created SPARK-35789: Summary: Lateral join should only be used with subquery Key: SPARK-35789 URL: https://issues.apache.org/jira/browse/SPARK-35789 Project: Spark Issue Type: Ta

[jira] [Commented] (SPARK-35700) spark.sql.orc.filterPushdown not working with Spark 3.1.1 for tables with varchar data type

[ https://issues.apache.org/jira/browse/SPARK-35700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364371#comment-17364371 ] Arghya Saha commented on SPARK-35700: - Any update on this please? This is very commo

[jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively

[ https://issues.apache.org/jira/browse/SPARK-35781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-35781: -- Affects Version/s: (was: 3.1.2) 3.2.0 > Support Spark on Apple Sili

[jira] [Commented] (SPARK-34198) Add RocksDB StateStore implementation

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364361#comment-17364361 ] Yuanjian Li commented on SPARK-34198: - Based on the discussion in the community, I j

[jira] [Updated] (SPARK-34198) Add RocksDB StateStore implementation

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-34198: Summary: Add RocksDB StateStore implementation (was: Add RocksDB StateStore as external module)

[jira] [Updated] (SPARK-34198) Add RocksDB StateStore as external module

[ https://issues.apache.org/jira/browse/SPARK-34198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanjian Li updated SPARK-34198: Description: Currently Spark SS only has one built-in StateStore implementation HDFSBackedStateSt

[jira] [Resolved] (SPARK-35556) Remove the close HiveClient's SessionState

[ https://issues.apache.org/jira/browse/SPARK-35556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-35556. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32693 [https://gith

[jira] [Assigned] (SPARK-35556) Remove the close HiveClient's SessionState

[ https://issues.apache.org/jira/browse/SPARK-35556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-35556: --- Assignee: Yang Jie > Remove the close HiveClient's SessionState > -

[jira] [Assigned] (SPARK-35788) Metrics support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35788: Assignee: (was: Apache Spark) > Metrics support for RocksDB instance > --

[jira] [Commented] (SPARK-35788) Metrics support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364339#comment-17364339 ] Apache Spark commented on SPARK-35788: -- User 'xuanyuanking' has created a pull requ

[jira] [Assigned] (SPARK-35788) Metrics support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35788: Assignee: Apache Spark > Metrics support for RocksDB instance > -

[jira] [Commented] (SPARK-35788) Metrics support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364340#comment-17364340 ] Apache Spark commented on SPARK-35788: -- User 'xuanyuanking' has created a pull requ

[jira] [Updated] (SPARK-35556) Avoid log NoSuchMethodError when HiveClientImpl.state close

[ https://issues.apache.org/jira/browse/SPARK-35556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35556: Component/s: (was: Tests) > Avoid log NoSuchMethodError when HiveClientImpl.state close > ---

[jira] [Updated] (SPARK-35556) Remove the close HiveClient's SessionState

[ https://issues.apache.org/jira/browse/SPARK-35556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-35556: Summary: Remove the close HiveClient's SessionState (was: Avoid log NoSuchMethodError when HiveC

[jira] [Comment Edited] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364334#comment-17364334 ] Robert Joseph Evans edited comment on SPARK-35089 at 6/16/21, 2:54 PM: ---

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364334#comment-17364334 ] Robert Joseph Evans commented on SPARK-35089: - {quote}I understand ordering

[jira] [Commented] (SPARK-35733) Check all day-time interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364333#comment-17364333 ] angerszhu commented on SPARK-35733: --- Working on this > Check all day-time interval ty

[jira] [Commented] (SPARK-35772) Check all year-month interval types in HiveInspectors tests

[ https://issues.apache.org/jira/browse/SPARK-35772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364332#comment-17364332 ] angerszhu commented on SPARK-35772: --- Working on this  > Check all year-month interval

[jira] [Created] (SPARK-35788) Metrics support for RocksDB instance

Yuanjian Li created SPARK-35788: --- Summary: Metrics support for RocksDB instance Key: SPARK-35788 URL: https://issues.apache.org/jira/browse/SPARK-35788 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-35785) Cleanup support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35785: Assignee: Apache Spark > Cleanup support for RocksDB instance > -

[jira] [Assigned] (SPARK-35785) Cleanup support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35785: Assignee: (was: Apache Spark) > Cleanup support for RocksDB instance > --

[jira] [Commented] (SPARK-35785) Cleanup support for RocksDB instance

[ https://issues.apache.org/jira/browse/SPARK-35785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364318#comment-17364318 ] Apache Spark commented on SPARK-35785: -- User 'xuanyuanking' has created a pull requ

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Description: Hello.   We had using spark 3.0.2 and query was executed in ~100 seco

[jira] [Comment Edited] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364306#comment-17364306 ] Domagoj edited comment on SPARK-35089 at 6/16/21, 1:47 PM: --- [~

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364306#comment-17364306 ] Domagoj commented on SPARK-35089: - [~revans2], by error I mean result that is not correc

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Description: Currently, single unit field interval literals like `interval '1' year '2' mon

[jira] [Updated] (SPARK-35749) Parse multiple unit fields interval literals as year-month/day-time interval types

[ https://issues.apache.org/jira/browse/SPARK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-35749: --- Summary: Parse multiple unit fields interval literals as year-month/day-time interval types

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Attachment: spark_3.0_execution_plan_details_fast.txt spark_3.1_execu

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Attachment: Execution_plan_difference.png > Does anyone has performance issue after

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Attachment: spark_job_info_1.png spark_job_info_2.png > Does anyone

[jira] [Updated] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

[ https://issues.apache.org/jira/browse/SPARK-35787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vidmantas Drasutis updated SPARK-35787: --- Description: Hello.   We had using spark 3.0.2 and query was executed in ~100 seco

[jira] [Created] (SPARK-35787) Does anyone has performance issue after upgrade from 3.0 to 3.1?

Vidmantas Drasutis created SPARK-35787: -- Summary: Does anyone has performance issue after upgrade from 3.0 to 3.1? Key: SPARK-35787 URL: https://issues.apache.org/jira/browse/SPARK-35787 Project:

[jira] [Commented] (SPARK-35786) Support optimize repartition by expression in AQE

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364287#comment-17364287 ] Apache Spark commented on SPARK-35786: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-35786) Support optimize repartition by expression in AQE

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35786: Assignee: (was: Apache Spark) > Support optimize repartition by expression in AQE > -

[jira] [Commented] (SPARK-35786) Support optimize repartition by expression in AQE

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364286#comment-17364286 ] Apache Spark commented on SPARK-35786: -- User 'ulysses-you' has created a pull reque

[jira] [Assigned] (SPARK-35786) Support optimize repartition by expression in AQE

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35786: Assignee: Apache Spark > Support optimize repartition by expression in AQE >

[jira] [Updated] (SPARK-35786) Support optimize repartition by expression in AQE

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35786: -- Summary: Support optimize repartition by expression in AQE (was: Support adaptive repartition by expr

[jira] [Updated] (SPARK-35786) Support adaptive repartition by expression

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35786: -- Summary: Support adaptive repartition by expression (was: Support adaptive repartition with repartiti

[jira] [Updated] (SPARK-35786) Support adaptive repartition with repartition by expression

[ https://issues.apache.org/jira/browse/SPARK-35786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] XiDuo You updated SPARK-35786: -- Summary: Support adaptive repartition with repartition by expression (was: Support adaptive repartiti

[jira] [Created] (SPARK-35786) Support adaptive repartition

XiDuo You created SPARK-35786: - Summary: Support adaptive repartition Key: SPARK-35786 URL: https://issues.apache.org/jira/browse/SPARK-35786 Project: Spark Issue Type: Improvement Comp

[jira] [Commented] (SPARK-35089) non consistent results running count for same dataset after filter and lead window function

[ https://issues.apache.org/jira/browse/SPARK-35089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364277#comment-17364277 ] Robert Joseph Evans commented on SPARK-35089: - [~Tonzetic], I don't know wha

[jira] [Updated] (SPARK-35783) Set the list of read columns in the task configuration to reduce reading of ORC data.

[ https://issues.apache.org/jira/browse/SPARK-35783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weixiuli updated SPARK-35783: - Description: Now, the ORC reader will read all columns of the ORC table when the task configuration does

[jira] [Commented] (SPARK-33898) Support SHOW CREATE TABLE in v2

[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364251#comment-17364251 ] Apache Spark commented on SPARK-33898: -- User 'Peng-Lei' has created a pull request

[jira] [Assigned] (SPARK-33898) Support SHOW CREATE TABLE in v2

[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33898: Assignee: (was: Apache Spark) > Support SHOW CREATE TABLE in v2 > ---

[jira] [Assigned] (SPARK-33898) Support SHOW CREATE TABLE in v2

[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-33898: Assignee: Apache Spark > Support SHOW CREATE TABLE in v2 > --

[jira] [Commented] (SPARK-33898) Support SHOW CREATE TABLE in v2

[ https://issues.apache.org/jira/browse/SPARK-33898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364249#comment-17364249 ] Apache Spark commented on SPARK-33898: -- User 'Peng-Lei' has created a pull request

[jira] [Commented] (SPARK-35732) Parse DayTimeIntervalType from JSON

[ https://issues.apache.org/jira/browse/SPARK-35732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17364196#comment-17364196 ] PengLei commented on SPARK-35732: - [~angerszhu] That’s all right. > Parse DayTimeInterv

  1   2   >