[jira] [Assigned] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

2022-04-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-38761: --- Assignee: jiaan.geng > DS V2 supports push down misc non-aggregate functions >

[jira] [Created] (SPARK-38851) Refactor `HistoryServerSuite` to add UTs for RocksDB

2022-04-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-38851: Summary: Refactor `HistoryServerSuite` to add UTs for RocksDB Key: SPARK-38851 URL: https://issues.apache.org/jira/browse/SPARK-38851 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-38761) DS V2 supports push down misc non-aggregate functions

2022-04-10 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-38761. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36039

[jira] [Updated] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-38837: - Fix Version/s: 3.3.0 > Implement `dropna` parameter of `SeriesGroupBy.value_counts` >

[jira] [Assigned] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38837: Assignee: Xinrong Meng > Implement `dropna` parameter of `SeriesGroupBy.value_counts` >

[jira] [Resolved] (SPARK-38837) Implement `dropna` parameter of `SeriesGroupBy.value_counts`

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38837. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36093

[jira] [Commented] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

2022-04-10 Thread eugene (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520299#comment-17520299 ] eugene commented on SPARK-38846: [~hyukjin.kwon]  Thanks, just tried with latest Spark version (Spark

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520297#comment-17520297 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38829: Assignee: Apache Spark (was: Ivan Sadikov) > New configuration for controlling

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

2022-04-10 Thread Ivan Sadikov (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520296#comment-17520296 ] Ivan Sadikov commented on SPARK-38829: -- I opened [https://github.com/apache/spark/pull/36137] to

[jira] [Assigned] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38829: Assignee: Ivan Sadikov (was: Apache Spark) > New configuration for controlling

[jira] [Commented] (SPARK-38829) New configuration for controlling timestamp inference of Parquet

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520295#comment-17520295 ] Apache Spark commented on SPARK-38829: -- User 'sadikovi' has created a pull request for this issue:

[jira] [Commented] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread wangshengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520274#comment-17520274 ] wangshengjie commented on SPARK-38845: -- Duplicate issue, close this issue > SparkContext init

[jira] [Resolved] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread wangshengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie resolved SPARK-38845. -- Resolution: Duplicate > SparkContext init before SparkSession will cause hive table not found

[jira] [Resolved] (SPARK-38708) Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38708. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36018

[jira] [Assigned] (SPARK-38708) Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38708: - Assignee: Yuming Wang > Upgrade Hive Metastore Client to the 3.1.3 for Hive 3.1 >

[jira] [Updated] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38767: -- Affects Version/s: 3.4.0 (was: 3.2.1) > Support ignoreCorruptFiles

[jira] [Updated] (SPARK-38767) Support ignoreCorruptFiles and ignoreMissingFiles in Data Source options

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38767: -- Priority: Minor (was: Major) > Support ignoreCorruptFiles and ignoreMissingFiles in Data

[jira] [Assigned] (SPARK-38850) Upgrade Kafka to 3.1.1

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38850: Assignee: (was: Apache Spark) > Upgrade Kafka to 3.1.1 > -- > >

[jira] [Commented] (SPARK-38850) Upgrade Kafka to 3.1.1

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520261#comment-17520261 ] Apache Spark commented on SPARK-38850: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-38850) Upgrade Kafka to 3.1.1

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38850: Assignee: Apache Spark > Upgrade Kafka to 3.1.1 > -- > >

[jira] [Updated] (SPARK-38800) Explicitly document the supported pandas version.

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38800: -- Fix Version/s: 3.3.0 (was: 3.4.0) > Explicitly document the supported

[jira] [Created] (SPARK-38850) Upgrade Kafka to 3.1.1

2022-04-10 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-38850: - Summary: Upgrade Kafka to 3.1.1 Key: SPARK-38850 URL: https://issues.apache.org/jira/browse/SPARK-38850 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-38830) Warn corrupted Netty RPC messages

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-38830: - Assignee: Dongjoon Hyun > Warn corrupted Netty RPC messages >

[jira] [Resolved] (SPARK-38830) Warn corrupted Netty RPC messages

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-38830. --- Fix Version/s: 3.3.0 3.2.2 Resolution: Fixed Issue resolved by

[jira] [Updated] (SPARK-38830) Warn on corrupted block messages

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38830: -- Summary: Warn on corrupted block messages (was: Warn corrupted Netty RPC messages) > Warn

[jira] [Updated] (SPARK-38830) Warn on corrupted block messages

2022-04-10 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-38830: -- Affects Version/s: 3.2.1 > Warn on corrupted block messages >

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520254#comment-17520254 ] Apache Spark commented on SPARK-36681: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-36681) Fail to load Snappy codec

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520255#comment-17520255 ] Apache Spark commented on SPARK-36681: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-38831) How to enable encryption for checkpoint data?

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520251#comment-17520251 ] Hyukjin Kwon commented on SPARK-38831: -- [~zoli] Let's interact with Spark mailing list for a

[jira] [Resolved] (SPARK-38831) How to enable encryption for checkpoint data?

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38831. -- Resolution: Invalid > How to enable encryption for checkpoint data? >

[jira] [Resolved] (SPARK-38839) Creating a struct with a float inside

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38839. -- Resolution: Duplicate > Creating a struct with a float inside >

[jira] [Commented] (SPARK-38839) Creating a struct with a float inside

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520250#comment-17520250 ] Hyukjin Kwon commented on SPARK-38839: -- This is because by default the inner "{"MyInt": 10,

[jira] [Commented] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520249#comment-17520249 ] Hyukjin Kwon commented on SPARK-38846: -- Spark 2.x is EOL. Mind trying Spark 3+ out? > Teradata's

[jira] [Commented] (SPARK-38849) How to do load balancing of spark thrift server ?

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520248#comment-17520248 ] Hyukjin Kwon commented on SPARK-38849: -- For questions, let's interact Spark mailing list before

[jira] [Resolved] (SPARK-38849) How to do load balancing of spark thrift server ?

2022-04-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38849. -- Resolution: Invalid > How to do load balancing of spark thrift server ? >

[jira] [Created] (SPARK-38849) How to do load balancing of spark thrift server ?

2022-04-10 Thread ramakrishna chilaka (Jira)
ramakrishna chilaka created SPARK-38849: --- Summary: How to do load balancing of spark thrift server ? Key: SPARK-38849 URL: https://issues.apache.org/jira/browse/SPARK-38849 Project: Spark

[jira] [Commented] (SPARK-38807) Error when starting spark shell on Windows system

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520187#comment-17520187 ] Apache Spark commented on SPARK-38807: -- User '1104056452' has created a pull request for this

[jira] [Commented] (SPARK-38807) Error when starting spark shell on Windows system

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520186#comment-17520186 ] Apache Spark commented on SPARK-38807: -- User '1104056452' has created a pull request for this

[jira] [Assigned] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38848: Assignee: (was: Apache Spark) > Replcace all `@Test(expected = XXException)` with

[jira] [Commented] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520172#comment-17520172 ] Apache Spark commented on SPARK-38848: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520173#comment-17520173 ] Apache Spark commented on SPARK-38848: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38848: Assignee: Apache Spark > Replcace all `@Test(expected = XXException)` with assertThrows

[jira] [Updated] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-38848: - Description: {{@Test}} no longer has {{expected parameters in Junit 5, use assertThrows}} instead

[jira] [Created] (SPARK-38848) Replcace all `@Test(expected = XXException)` with assertThrows

2022-04-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-38848: Summary: Replcace all `@Test(expected = XXException)` with assertThrows Key: SPARK-38848 URL: https://issues.apache.org/jira/browse/SPARK-38848 Project: Spark

[jira] [Assigned] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38847: Assignee: (was: Apache Spark) > Introduce a `viewToSeq` function for `KVUtils` >

[jira] [Assigned] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38847: Assignee: Apache Spark > Introduce a `viewToSeq` function for `KVUtils` >

[jira] [Commented] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520171#comment-17520171 ] Apache Spark commented on SPARK-38847: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-38847) Introduce a `viewToSeq` function for `KVUtils`

2022-04-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-38847: Summary: Introduce a `viewToSeq` function for `KVUtils` Key: SPARK-38847 URL: https://issues.apache.org/jira/browse/SPARK-38847 Project: Spark Issue Type:

[jira] [Created] (SPARK-38846) Teradata's Number is either converted to its floor value or ceiling value despite its fractional part.

2022-04-10 Thread eugene (Jira)
eugene created SPARK-38846: -- Summary: Teradata's Number is either converted to its floor value or ceiling value despite its fractional part. Key: SPARK-38846 URL: https://issues.apache.org/jira/browse/SPARK-38846

[jira] [Assigned] (SPARK-38565) Support Left Semi join in row level runtime filters

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38565: Assignee: (was: Apache Spark) > Support Left Semi join in row level runtime filters

[jira] [Commented] (SPARK-38565) Support Left Semi join in row level runtime filters

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520167#comment-17520167 ] Apache Spark commented on SPARK-38565: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-38565) Support Left Semi join in row level runtime filters

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38565: Assignee: Apache Spark > Support Left Semi join in row level runtime filters >

[jira] [Commented] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520162#comment-17520162 ] Apache Spark commented on SPARK-3723: - User 'zero323' has created a pull request for this issue:

[jira] [Commented] (SPARK-3723) DecisionTree, RandomForest: Add more instrumentation

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-3723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520161#comment-17520161 ] Apache Spark commented on SPARK-3723: - User 'zero323' has created a pull request for this issue:

[jira] [Resolved] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2022-04-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz resolved SPARK-37234. Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request

[jira] [Assigned] (SPARK-37234) Inline type hints for python/pyspark/mllib/stat/_statistics.py

2022-04-10 Thread Maciej Szymkiewicz (Jira)
[ https://issues.apache.org/jira/browse/SPARK-37234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Szymkiewicz reassigned SPARK-37234: -- Assignee: dch nguyen > Inline type hints for

[jira] [Assigned] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38108: Assignee: huangtengfei > Use error classes in the compilation errors of UDF/UDAF >

[jira] [Resolved] (SPARK-38108) Use error classes in the compilation errors of UDF/UDAF

2022-04-10 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38108. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36064

[jira] [Assigned] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38845: Assignee: (was: Apache Spark) > SparkContext init before SparkSession will cause

[jira] [Assigned] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38845: Assignee: Apache Spark > SparkContext init before SparkSession will cause hive table not

[jira] [Commented] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520121#comment-17520121 ] Apache Spark commented on SPARK-38845: -- User 'wangshengjie123' has created a pull request for this

[jira] [Updated] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread wangshengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie updated SPARK-38845: - Environment: (was: If we init SparkContext before SparkSession when using DataFrame to

[jira] [Created] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread wangshengjie (Jira)
wangshengjie created SPARK-38845: Summary: SparkContext init before SparkSession will cause hive table not found Key: SPARK-38845 URL: https://issues.apache.org/jira/browse/SPARK-38845 Project: Spark

[jira] [Updated] (SPARK-38845) SparkContext init before SparkSession will cause hive table not found

2022-04-10 Thread wangshengjie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangshengjie updated SPARK-38845: - Description: If we init SparkContext before SparkSession when using DataFrame to query hive

[jira] [Commented] (SPARK-19335) Spark should support doing an efficient DataFrame Upsert via JDBC

2022-04-10 Thread Chandramouli Viswanathan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-19335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520107#comment-17520107 ] Chandramouli Viswanathan commented on SPARK-19335: -- Hi Is the issue resolved? if yes,