[jira] [Updated] (SPARK-37960) A new framework to represent catalyst expressions in DS v2 APIs

[ https://issues.apache.org/jira/browse/SPARK-37960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37960: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > A new framework to represent

[jira] [Updated] (SPARK-37867) Compile aggregate functions of build-in JDBC dialect

[ https://issues.apache.org/jira/browse/SPARK-37867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37867: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Compile aggregate functions o

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > DS V2 supports partial aggreg

[jira] [Updated] (SPARK-37839) DS V2 supports partial aggregate push-down AVG

[ https://issues.apache.org/jira/browse/SPARK-37839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37839: --- Epic Link: (was: SPARK-38788) > DS V2 supports partial aggregate push-down AVG > ---

[jira] [Updated] (SPARK-37527) Translate more standard aggregate functions for pushdown

[ https://issues.apache.org/jira/browse/SPARK-37527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37527: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Translate more standard aggre

[jira] [Updated] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202

[ https://issues.apache.org/jira/browse/SPARK-37734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37734: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Dependency upgrade) > Upgrade h2 from 1.4.19

[jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite

[ https://issues.apache.org/jira/browse/SPARK-37732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37732: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Improve the implement of JDBC

[jira] [Updated] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37644: --- Epic Link: (was: SPARK-38788) > Support datasource v2 complete aggregate pushdown > ---

[jira] [Updated] (SPARK-37644) Support datasource v2 complete aggregate pushdown

[ https://issues.apache.org/jira/browse/SPARK-37644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37644: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Support datasource v2 complet

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Epic Link: (was: SPARK-38788) > Support push down top N to JDBC data source V2 > ---

[jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2

[ https://issues.apache.org/jira/browse/SPARK-37483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37483: --- Parent: SPARK-38852 Issue Type: Sub-task (was: New Feature) > Support push down top N to JD

[jira] [Updated] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect

[ https://issues.apache.org/jira/browse/SPARK-37286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37286: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Move compileAggregates from J

[jira] [Updated] (SPARK-37212) Improve the implement of aggregate pushdown.

[ https://issues.apache.org/jira/browse/SPARK-37212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-37212: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Improvement) > Improve the implement of aggr

[jira] [Updated] (SPARK-36574) pushDownPredicate=false should prevent push down filters to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-36574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-36574: --- Parent: SPARK-38852 Issue Type: Sub-task (was: Bug) > pushDownPredicate=false should preven

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. However, the

[jira] [Updated] (SPARK-38852) Better Data Source V2 operator pushdown framework

[ https://issues.apache.org/jira/browse/SPARK-38852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-38852: --- Description: Currently, Spark supports push down Filters and Aggregates to data source. But, the #

[jira] [Created] (SPARK-38852) Better Data Source V2 operator pushdown framework

jiaan.geng created SPARK-38852: -- Summary: Better Data Source V2 operator pushdown framework Key: SPARK-38852 URL: https://issues.apache.org/jira/browse/SPARK-38852 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-38678) Enable RocksDB tests on Apple Silicon on MacOS

[ https://issues.apache.org/jira/browse/SPARK-38678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520322#comment-17520322 ] Apache Spark commented on SPARK-38678: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38851) Refactor `HistoryServerSuite` to add UTs for RocksDB

[ https://issues.apache.org/jira/browse/SPARK-38851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38851: Assignee: Apache Spark > Refactor `HistoryServerSuite` to add UTs for RocksDB > -

[jira] [Assigned] (SPARK-38851) Refactor `HistoryServerSuite` to add UTs for RocksDB

[ https://issues.apache.org/jira/browse/SPARK-38851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38851: Assignee: (was: Apache Spark) > Refactor `HistoryServerSuite` to add UTs for RocksDB

[jira] [Commented] (SPARK-38851) Refactor `HistoryServerSuite` to add UTs for RocksDB

[ https://issues.apache.org/jira/browse/SPARK-38851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520314#comment-17520314 ] Apache Spark commented on SPARK-38851: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38761: --- Assignee: jiaan.geng > DS V2 supports push down misc non-aggregate functions >

[jira] [Created] (SPARK-38851) Refactor `HistoryServerSuite` to add UTs for RocksDB

Yang Jie created SPARK-38851: Summary: Refactor `HistoryServerSuite` to add UTs for RocksDB Key: SPARK-38851 URL: https://issues.apache.org/jira/browse/SPARK-38851 Project: Spark Issue Type: Impr

[jira] [Resolved] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38761. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36039 [https://gith

[jira] [Updated] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38837: - Fix Version/s: 3.3.0 > Implement `dropna` parameter of `SeriesGroupBy.value_counts` > --

[jira] [Assigned] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38837: Assignee: Xinrong Meng > Implement `dropna` parameter of `SeriesGroupBy.value_counts` > -

[jira] [Resolved] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38837. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36093 [https://gi

[jira] [Commented] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520299#comment-17520299 ] eugene commented on SPARK-38846: [~hyukjin.kwon]  Thanks, just tried with latest Spark v

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520297#comment-17520297 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request

[jira] [Assigned] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38829: Assignee: Apache Spark (was: Ivan Sadikov) > New configuration for controlling timestamp

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520296#comment-17520296 ] Ivan Sadikov commented on SPARK-38829: -- I opened [https://github.com/apache/spark/p

[jira] [Assigned] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38829: Assignee: Ivan Sadikov (was: Apache Spark) > New configuration for controlling timestamp

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520295#comment-17520295 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request

[jira] [Commented] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520274#comment-17520274 ] wangshengjie commented on SPARK-38845: -- Duplicate issue, close this issue > SparkC

[jira] [Resolved] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie resolved SPARK-38845. -- Resolution: Duplicate > SparkContext init before SparkSession will cause hive table not found

[jira] [Resolved] (SPARK-38708) Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1

[ https://issues.apache.org/jira/browse/SPARK-38708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38708. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36018 [https://

[jira] [Assigned] (SPARK-38708) Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1

[ https://issues.apache.org/jira/browse/SPARK-38708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38708: - Assignee: Yuming Wang > Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1 > -

[jira] [Updated] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38767: -- Affects Version/s: 3.4.0 (was: 3.2.1) > Support ignoreCorruptFiles

[jira] [Updated] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38767: -- Priority: Minor (was: Major) > Support ignoreCorruptFiles and ignoreMissingFiles in Data Sour

[jira] [Assigned] (SPARK-38850) Upgrade Kafka to 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38850: Assignee: (was: Apache Spark) > Upgrade Kafka to 3.1.1 > -- > >

[jira] [Commented] (SPARK-38850) Upgrade Kafka to 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520261#comment-17520261 ] Apache Spark commented on SPARK-38850: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-38850) Upgrade Kafka to 3.1.1

[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38850: Assignee: Apache Spark > Upgrade Kafka to 3.1.1 > -- > >

[jira] [Updated] (SPARK-38800) Explicitly document the supported pandas version.

[ https://issues.apache.org/jira/browse/SPARK-38800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38800: -- Fix Version/s: 3.3.0 (was: 3.4.0) > Explicitly document the supported p

[jira] [Created] (SPARK-38850) Upgrade Kafka to 3.1.1

Dongjoon Hyun created SPARK-38850: - Summary: Upgrade Kafka to 3.1.1 Key: SPARK-38850 URL: https://issues.apache.org/jira/browse/SPARK-38850 Project: Spark Issue Type: Bug Components

[jira] [Assigned] (SPARK-38830) Warn corrupted Netty RPC messages

[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38830: - Assignee: Dongjoon Hyun > Warn corrupted Netty RPC messages > -

[jira] [Resolved] (SPARK-38830) Warn corrupted Netty RPC messages

[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38830. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by pul

[jira] [Updated] (SPARK-38830) Warn on corrupted block messages

[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38830: -- Summary: Warn on corrupted block messages (was: Warn corrupted Netty RPC messages) > Warn on

[jira] [Updated] (SPARK-38830) Warn on corrupted block messages

[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38830: -- Affects Version/s: 3.2.1 > Warn on corrupted block messages >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520254#comment-17520254 ] Apache Spark commented on SPARK-36681: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520255#comment-17520255 ] Apache Spark commented on SPARK-36681: -- User 'HyukjinKwon' has created a pull reque

[jira] [Commented] (SPARK-38831) How to enable encryption for checkpoint data?

[ https://issues.apache.org/jira/browse/SPARK-38831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520251#comment-17520251 ] Hyukjin Kwon commented on SPARK-38831: -- [~zoli] Let's interact with Spark mailing l

[jira] [Resolved] (SPARK-38831) How to enable encryption for checkpoint data?

[ https://issues.apache.org/jira/browse/SPARK-38831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38831. -- Resolution: Invalid > How to enable encryption for checkpoint data? >

[jira] [Resolved] (SPARK-38839) Creating a struct with a float inside

[ https://issues.apache.org/jira/browse/SPARK-38839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38839. -- Resolution: Duplicate > Creating a struct with a float inside > -

[jira] [Commented] (SPARK-38839) Creating a struct with a float inside

[ https://issues.apache.org/jira/browse/SPARK-38839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520250#comment-17520250 ] Hyukjin Kwon commented on SPARK-38839: -- This is because by default the inner "{"MyI

[jira] [Commented] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520249#comment-17520249 ] Hyukjin Kwon commented on SPARK-38846: -- Spark 2.x is EOL. Mind trying Spark 3+ out?

[jira] [Commented] (SPARK-38849) How to do load balancing of spark thrift server ?

[ https://issues.apache.org/jira/browse/SPARK-38849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520248#comment-17520248 ] Hyukjin Kwon commented on SPARK-38849: -- For questions, let's interact Spark mailing

[jira] [Resolved] (SPARK-38849) How to do load balancing of spark thrift server ?

[ https://issues.apache.org/jira/browse/SPARK-38849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38849. -- Resolution: Invalid > How to do load balancing of spark thrift server ? >

[jira] [Created] (SPARK-38849) How to do load balancing of spark thrift server ?

ramakrishna chilaka created SPARK-38849: --- Summary: How to do load balancing of spark thrift server ? Key: SPARK-38849 URL: https://issues.apache.org/jira/browse/SPARK-38849 Project: Spark

[jira] [Commented] (SPARK-38807) Error when starting spark shell on Windows system

[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520187#comment-17520187 ] Apache Spark commented on SPARK-38807: -- User '1104056452' has created a pull reques

[jira] [Commented] (SPARK-38807) Error when starting spark shell on Windows system

[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520186#comment-17520186 ] Apache Spark commented on SPARK-38807: -- User '1104056452' has created a pull reques

[jira] [Assigned] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38848: Assignee: (was: Apache Spark) > Replcace all `@Test(expected = XXException)` with ass

[jira] [Commented] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520172#comment-17520172 ] Apache Spark commented on SPARK-38848: -- User 'LuciferYang' has created a pull reque

[jira] [Commented] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520173#comment-17520173 ] Apache Spark commented on SPARK-38848: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38848: Assignee: Apache Spark > Replcace all `@Test(expected = XXException)` with assertThrows >

[jira] [Updated] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38848: - Description: {{@Test}} no longer has {{expected parameters in Junit 5, use assertThrows}} instead (was:

[jira] [Created] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

Yang Jie created SPARK-38848: Summary: Replcace all `@Test(expected = XXException)` with assertThrows Key: SPARK-38848 URL: https://issues.apache.org/jira/browse/SPARK-38848 Project: Spark Issue

[jira] [Assigned] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38847: Assignee: (was: Apache Spark) > Introduce a `viewToSeq` function for `KVUtils` >

[jira] [Assigned] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38847: Assignee: Apache Spark > Introduce a `viewToSeq` function for `KVUtils` > ---

[jira] [Commented] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520171#comment-17520171 ] Apache Spark commented on SPARK-38847: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

Yang Jie created SPARK-38847: Summary: Introduce a `viewToSeq` function for `KVUtils` Key: SPARK-38847 URL: https://issues.apache.org/jira/browse/SPARK-38847 Project: Spark Issue Type: Improvemen

[jira] [Created] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

eugene created SPARK-38846: -- Summary: Teradata's Number is either converted to its floor value or ceiling value despite its fractional part. Key: SPARK-38846 URL: https://issues.apache.org/jira/browse/SPARK-38846

[jira] [Assigned] (SPARK-38565) Support Left Semi join in row level runtime filters

[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38565: Assignee: (was: Apache Spark) > Support Left Semi join in row level runtime filters >

[jira] [Commented] (SPARK-38565) Support Left Semi join in row level runtime filters

[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520167#comment-17520167 ] Apache Spark commented on SPARK-38565: -- User 'wangyum' has created a pull request f

[jira] [Assigned] (SPARK-38565) Support Left Semi join in row level runtime filters

[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38565: Assignee: Apache Spark > Support Left Semi join in row level runtime filters > --

[jira] [Commented] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation

[ https://issues.apache.org/jira/browse/SPARK-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520162#comment-17520162 ] Apache Spark commented on SPARK-3723: - User 'zero323' has created a pull request for

[jira] [Commented] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation

[ https://issues.apache.org/jira/browse/SPARK-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520161#comment-17520161 ] Apache Spark commented on SPARK-3723: - User 'zero323' has created a pull request for

[jira] [Resolved] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37234. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34513

[jira] [Assigned] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37234: -- Assignee: dch nguyen > Inline type hints for python/pyspark/mllib/stat/_stati

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38108: Assignee: huangtengfei > Use error classes in the compilation errors of UDF/UDAF > --

[jira] [Resolved] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38108. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36064 [https://github.com

[jira] [Assigned] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38845: Assignee: (was: Apache Spark) > SparkContext init before SparkSession will cause hive

[jira] [Assigned] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38845: Assignee: Apache Spark > SparkContext init before SparkSession will cause hive table not

[jira] [Commented] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520121#comment-17520121 ] Apache Spark commented on SPARK-38845: -- User 'wangshengjie123' has created a pull r

[jira] [Updated] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie updated SPARK-38845: - Environment: (was: If we init SparkContext before SparkSession when using DataFrame to query

[jira] [Created] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

wangshengjie created SPARK-38845: Summary: SparkContext init before SparkSession will cause hive table not found Key: SPARK-38845 URL: https://issues.apache.org/jira/browse/SPARK-38845 Project: Spark

[jira] [Updated] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie updated SPARK-38845: - Description: If we init SparkContext before SparkSession when using DataFrame to query hive tab

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520107#comment-17520107 ] Chandramouli Viswanathan commented on SPARK-19335: -- Hi Is the issue re