[jira] [Resolved] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38748. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36400 [https://github.com

[jira] [Assigned] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38748: Assignee: panbingkun > Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH > ---

[jira] [Comment Edited] (SPARK-39064) FileNotFoundException while reading from Kafka

2022-04-28 Thread Sushmita chauhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529806#comment-17529806 ] Sushmita chauhan edited comment on SPARK-39064 at 4/29/22 6:30 AM: ---

[jira] [Comment Edited] (SPARK-39064) FileNotFoundException while reading from Kafka

2022-04-28 Thread Sushmita chauhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529806#comment-17529806 ] Sushmita chauhan edited comment on SPARK-39064 at 4/29/22 6:30 AM: ---

[jira] [Commented] (SPARK-39064) FileNotFoundException while reading from Kafka

2022-04-28 Thread Sushmita chauhan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529806#comment-17529806 ] Sushmita chauhan commented on SPARK-39064: -- Please Guys help to resolve the iss

[jira] [Created] (SPARK-39064) FileNotFoundException while reading from Kafka

2022-04-28 Thread Sushmita chauhan (Jira)
Sushmita chauhan created SPARK-39064: Summary: FileNotFoundException while reading from Kafka Key: SPARK-39064 URL: https://issues.apache.org/jira/browse/SPARK-39064 Project: Spark Issue

[jira] [Comment Edited] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529751#comment-17529751 ] Yikun Jiang edited comment on SPARK-39054 at 4/29/22 6:23 AM:

[jira] [Resolved] (SPARK-39050) Convert UNSUPPORTED_OPERATION to UNSUPPORTED_FEATURE

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-39050. -- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/36385 > Convert UNSUPPORTED_OPERAT

[jira] [Updated] (SPARK-39050) Convert UNSUPPORTED_OPERATION to UNSUPPORTED_FEATURE

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-39050: - Fix Version/s: 3.4.0 > Convert UNSUPPORTED_OPERATION to UNSUPPORTED_FEATURE > --

[jira] [Assigned] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39063: Assignee: Apache Spark > Remove `finalize()` from `LevelDB/RocksDBIterator` > ---

[jira] [Commented] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529779#comment-17529779 ] Apache Spark commented on SPARK-39063: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39063: Assignee: (was: Apache Spark) > Remove `finalize()` from `LevelDB/RocksDBIterator` >

[jira] [Commented] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529780#comment-17529780 ] Apache Spark commented on SPARK-39063: -- User 'LuciferYang' has created a pull reque

[jira] [Created] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-39063: Summary: Remove `finalize()` from `LevelDB/RocksDBIterator` Key: SPARK-39063 URL: https://issues.apache.org/jira/browse/SPARK-39063 Project: Spark Issue Type: Improv

[jira] [Commented] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529768#comment-17529768 ] Apache Spark commented on SPARK-38085: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-39040) Respect NaNvl in EquivalentExpressions for expression elimination

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39040: --- Assignee: XiDuo You > Respect NaNvl in EquivalentExpressions for expression elimination > -

[jira] [Resolved] (SPARK-39040) Respect NaNvl in EquivalentExpressions for expression elimination

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39040. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36376 [https://gith

[jira] [Resolved] (SPARK-38993) Impl DataFrame.boxplot and DataFrame.plot.box

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38993. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36317 [https://gi

[jira] [Assigned] (SPARK-38993) Impl DataFrame.boxplot and DataFrame.plot.box

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38993: Assignee: zhengruifeng > Impl DataFrame.boxplot and DataFrame.plot.box >

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529751#comment-17529751 ] Yikun Jiang commented on SPARK-39054: - [https://github.com/apache/spark/blob/973283c

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529750#comment-17529750 ] Yikun Jiang commented on SPARK-39054: - https://github.com/pandas-dev/pandas/issues/4

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529737#comment-17529737 ] Apache Spark commented on SPARK-39035: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39035: Assignee: (was: Apache Spark) > Add tests for options from `to_csv` and `from_csv`. >

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529736#comment-17529736 ] Apache Spark commented on SPARK-39035: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39035: Assignee: Apache Spark > Add tests for options from `to_csv` and `from_csv`. > --

[jira] [Assigned] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38748: Assignee: Apache Spark > Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH > -

[jira] [Assigned] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38748: Assignee: (was: Apache Spark) > Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

[jira] [Commented] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529726#comment-17529726 ] Apache Spark commented on SPARK-38748: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529725#comment-17529725 ] Apache Spark commented on SPARK-38748: -- User 'panbingkun' has created a pull reques

[jira] [Commented] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-04-28 Thread huangtengfei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529717#comment-17529717 ] huangtengfei commented on SPARK-39062: -- I am working on this. Thanks [~jiangxb1987]

[jira] [Created] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-04-28 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-39062: Summary: Add Standalone backend support for Stage Level Scheduling Key: SPARK-39062 URL: https://issues.apache.org/jira/browse/SPARK-39062 Project: Spark Iss

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Description: The following query returns incorrect results: {noformat} spark-sql> select inlin

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Affects Version/s: (was: 3.1.3) > Incorrect results or NPE when using Inline function agai

[jira] [Commented] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529703#comment-17529703 ] Weichen Xu commented on SPARK-39058: [~jasbali] volunteers to contribute this featur

[jira] [Comment Edited] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529702#comment-17529702 ] Bruce Robbins edited comment on SPARK-39061 at 4/29/22 12:33 AM: -

[jira] [Commented] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529702#comment-17529702 ] Bruce Robbins commented on SPARK-39061: --- Btw, dataframe example: {noformat} scala>

[jira] [Created] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39061: - Summary: Incorrect results or NPE when using Inline function against an array of dynamically created structs Key: SPARK-39061 URL: https://issues.apache.org/jira/browse/SPARK-39

[jira] [Resolved] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36343 [https://gi

[jira] [Assigned] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-35739: Assignee: Brandon Dahler > [Spark Sql] Add Java-comptable Dataset.join overloads > --

[jira] [Resolved] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38896. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36237 [https://gi

[jira] [Assigned] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38896: Assignee: Yang Jie > Use tryWithResource to recycling KVStoreIterator > -

[jira] [Assigned] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39042: Assignee: Yang Jie > Use `Map.values()` instead of `Map.entrySet()` in scenarios that do

[jira] [Updated] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39042: - Priority: Trivial (was: Minor) > Use `Map.values()` instead of `Map.entrySet()` in scenarios th

[jira] [Resolved] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39042. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36372 [https://gi

[jira] [Assigned] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39034: Assignee: (was: Apache Spark) > Add tests for options from `to_json` and `from_json`.

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529690#comment-17529690 ] Apache Spark commented on SPARK-39034: -- User 'itholic' has created a pull request f

[jira] [Assigned] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39034: Assignee: Apache Spark > Add tests for options from `to_json` and `from_json`. >

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529689#comment-17529689 ] Apache Spark commented on SPARK-39034: -- User 'itholic' has created a pull request f

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529688#comment-17529688 ] Haejoon Lee commented on SPARK-39035: - I'm working on this > Add tests for options

[jira] [Commented] (SPARK-38838) Support ALTER TABLE ALTER COLUMN commands with DEFAULT values

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529661#comment-17529661 ] Apache Spark commented on SPARK-38838: -- User 'dtenedor' has created a pull request

[jira] [Resolved] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38718. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36395 [https://github.com

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38718: Assignee: panbingkun > Test the error class: AMBIGUOUS_FIELD_NAME > -

[jira] [Updated] (SPARK-39045) INTERNAL_ERROR for "all" internal errors

2022-04-28 Thread Serge Rielau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-39045: - Description: We should be able to inject the  [INTERNAL_ERROR] class for most cases without wait

[jira] [Commented] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529620#comment-17529620 ] Apache Spark commented on SPARK-39060: -- User 'vli-databricks' has created a pull re

[jira] [Assigned] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39060: Assignee: Apache Spark > Typo in error messages of decimal overflow > ---

[jira] [Commented] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529619#comment-17529619 ] Apache Spark commented on SPARK-39060: -- User 'vli-databricks' has created a pull re

[jira] [Assigned] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39060: Assignee: (was: Apache Spark) > Typo in error messages of decimal overflow >

[jira] [Updated] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Vitalii Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-39060: --- Description:    org.apache.spark.SparkArithmeticException     Decimal(expanded,1000

[jira] [Created] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Vitalii Li (Jira)
Vitalii Li created SPARK-39060: -- Summary: Typo in error messages of decimal overflow Key: SPARK-39060 URL: https://issues.apache.org/jira/browse/SPARK-39060 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39059) When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session

2022-04-28 Thread Furcy Pin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Furcy Pin updated SPARK-39059: -- Description: We encountered unexpected error when using SparkSession.newSession and the "spark.sql.ca

[jira] [Created] (SPARK-39059) When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session

2022-04-28 Thread Furcy Pin (Jira)
Furcy Pin created SPARK-39059: - Summary: When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session Key: SPARK-39059 URL: https://issues.apache.org/jira/browse/SPARK-39059

[jira] [Resolved] (SPARK-38741) Test the error class: MAP_KEY_DOES_NOT_EXIST*

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38741. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36232 [https://github.com

[jira] [Assigned] (SPARK-38741) Test the error class: MAP_KEY_DOES_NOT_EXIST*

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38741: Assignee: panbingkun > Test the error class: MAP_KEY_DOES_NOT_EXIST* > --

[jira] [Commented] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529462#comment-17529462 ] Weichen Xu commented on SPARK-39058: CC [~ruifengz] Are you interested in contributi

[jira] [Created] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-39058: -- Summary: Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers Key: SPARK-39058 URL: https://issues.apache.org/jira/browse/SPARK-39058 Pr

[jira] [Resolved] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39056. -- Resolution: Won't Fix > Use `Collections.singletonList` instead of `Arrays.asList` when ther

[jira] [Commented] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529385#comment-17529385 ] Apache Spark commented on SPARK-38718: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38718: Assignee: (was: Apache Spark) > Test the error class: AMBIGUOUS_FIELD_NAME >

[jira] [Commented] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529384#comment-17529384 ] Apache Spark commented on SPARK-38718: -- User 'panbingkun' has created a pull reques

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38718: Assignee: Apache Spark > Test the error class: AMBIGUOUS_FIELD_NAME > ---

[jira] [Comment Edited] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529381#comment-17529381 ] Willi Raschkowski edited comment on SPARK-39044 at 4/28/22 11:29 AM: -

[jira] [Updated] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-39044: -- Attachment: aggregate.scala > AggregatingAccumulator with TypedImperativeAggregate thr

[jira] [Commented] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529381#comment-17529381 ] Willi Raschkowski commented on SPARK-39044: --- [~hyukjin.kwon], yes I know. But

[jira] [Commented] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529374#comment-17529374 ] Apache Spark commented on SPARK-39057: -- User 'beliefer' has created a pull request

[jira] [Commented] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529373#comment-17529373 ] Apache Spark commented on SPARK-39057: -- User 'beliefer' has created a pull request

[jira] [Assigned] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39057: Assignee: (was: Apache Spark) > Offset could work without Limit > ---

[jira] [Assigned] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39057: Assignee: Apache Spark > Offset could work without Limit > --

[jira] [Resolved] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39055. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36392 [https://gi

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39055: Assignee: Kent Yao > Fix documentation 404 page > -- > >

[jira] [Assigned] (SPARK-38870) SparkSession.builder returns a new builder in Scala, but not in Python

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38870: Assignee: Furcy Pin > SparkSession.builder returns a new builder in Scala, but not in Pyt

[jira] [Resolved] (SPARK-38870) SparkSession.builder returns a new builder in Scala, but not in Python

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38870. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36161 [https://gi

[jira] [Created] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39057: -- Summary: Offset could work without Limit Key: SPARK-39057 URL: https://issues.apache.org/jira/browse/SPARK-39057 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39056: Assignee: (was: Apache Spark) > Use `Collections.singletonList` instead of `Arrays.

[jira] [Commented] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529365#comment-17529365 ] Apache Spark commented on SPARK-39056: -- User 'LuciferYang' has created a pull reque

[jira] [Assigned] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39056: Assignee: Apache Spark > Use `Collections.singletonList` instead of `Arrays.asList` whe

[jira] [Created] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-39056: Summary: Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument Key: SPARK-39056 URL: https://issues.apache.org/jira/browse/SPARK-39056

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529305#comment-17529305 ] Yikun Jiang commented on SPARK-39054: - Related: https://github.com/pandas-dev/panda

[jira] [Updated] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39054: Description: {code:java} An error occurred while calling o27083.getResult. : org.apache.spark.Spar

[jira] [Updated] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39054: Description: {code:java} An error occurred while calling o27083.getResult. : org.apache.spark.Spar

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39055: Assignee: (was: Apache Spark) > Fix documentation 404 page >

[jira] [Commented] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529291#comment-17529291 ] Apache Spark commented on SPARK-39055: -- User 'yaooqinn' has created a pull request

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39055: Assignee: Apache Spark > Fix documentation 404 page > -- > >

[jira] [Updated] (SPARK-39045) INTERNAL_ERROR for "all" internal errors

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39045: Affects Version/s: 3.4.0 (was: 3.3.0) > INTERNAL_ERROR for "all" intern

[jira] [Commented] (SPARK-38819) Run Pandas on Spark with Pandas 1.4.x

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529283#comment-17529283 ] Yikun Jiang commented on SPARK-38819: - FYI, all issues of upgrading pandas 1.4.x has

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Summary: DS V2 Top N push-down supports order by expressions (was: DS V2 aggregate push-down suppor

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Description: Currently, Spark DS V2 Top N push-down only supports order by column. But the SQL show

[jira] [Created] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-39055: Summary: Fix documentation 404 page Key: SPARK-39055 URL: https://issues.apache.org/jira/browse/SPARK-39055 Project: Spark Issue Type: Bug Components: Docu

[jira] [Created] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39054: --- Summary: GroupByTest failed due to axis Length mismatch Key: SPARK-39054 URL: https://issues.apache.org/jira/browse/SPARK-39054 Project: Spark Issue Type: Sub-

[jira] [Commented] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529273#comment-17529273 ] Apache Spark commented on SPARK-39053: -- User 'Yikun' has created a pull request for

[jira] [Commented] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17529274#comment-17529274 ] Apache Spark commented on SPARK-39053: -- User 'Yikun' has created a pull request for

  1   2   >