[jira] [Assigned] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39063: Assignee: Apache Spark > Remove `finalize()` from `LevelDB/RocksDBIterator` >

[jira] [Commented] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529779#comment-17529779 ] Apache Spark commented on SPARK-39063: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39063: Assignee: (was: Apache Spark) > Remove `finalize()` from `LevelDB/RocksDBIterator` >

[jira] [Commented] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529780#comment-17529780 ] Apache Spark commented on SPARK-39063: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-39063) Remove `finalize()` from `LevelDB/RocksDBIterator`

2022-04-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-39063: Summary: Remove `finalize()` from `LevelDB/RocksDBIterator` Key: SPARK-39063 URL: https://issues.apache.org/jira/browse/SPARK-39063 Project: Spark Issue Type:

[jira] [Commented] (SPARK-38085) DataSource V2: Handle DELETE commands for group-based sources

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529768#comment-17529768 ] Apache Spark commented on SPARK-38085: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39040) Respect NaNvl in EquivalentExpressions for expression elimination

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39040: --- Assignee: XiDuo You > Respect NaNvl in EquivalentExpressions for expression elimination >

[jira] [Resolved] (SPARK-39040) Respect NaNvl in EquivalentExpressions for expression elimination

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39040. - Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36376

[jira] [Resolved] (SPARK-38993) Impl DataFrame.boxplot and DataFrame.plot.box

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38993. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36317

[jira] [Assigned] (SPARK-38993) Impl DataFrame.boxplot and DataFrame.plot.box

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38993: Assignee: zhengruifeng > Impl DataFrame.boxplot and DataFrame.plot.box >

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529751#comment-17529751 ] Yikun Jiang commented on SPARK-39054: -

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529750#comment-17529750 ] Yikun Jiang commented on SPARK-39054: - https://github.com/pandas-dev/pandas/issues/46893 >

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529737#comment-17529737 ] Apache Spark commented on SPARK-39035: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39035: Assignee: (was: Apache Spark) > Add tests for options from `to_csv` and `from_csv`.

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529736#comment-17529736 ] Apache Spark commented on SPARK-39035: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39035: Assignee: Apache Spark > Add tests for options from `to_csv` and `from_csv`. >

[jira] [Assigned] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38748: Assignee: Apache Spark > Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH >

[jira] [Assigned] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38748: Assignee: (was: Apache Spark) > Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

[jira] [Commented] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529726#comment-17529726 ] Apache Spark commented on SPARK-38748: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-38748) Test the error class: PIVOT_VALUE_DATA_TYPE_MISMATCH

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529725#comment-17529725 ] Apache Spark commented on SPARK-38748: -- User 'panbingkun' has created a pull request for this

[jira] [Commented] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-04-28 Thread huangtengfei (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529717#comment-17529717 ] huangtengfei commented on SPARK-39062: -- I am working on this. Thanks [~jiangxb1987] > Add

[jira] [Created] (SPARK-39062) Add Standalone backend support for Stage Level Scheduling

2022-04-28 Thread Xingbo Jiang (Jira)
Xingbo Jiang created SPARK-39062: Summary: Add Standalone backend support for Stage Level Scheduling Key: SPARK-39062 URL: https://issues.apache.org/jira/browse/SPARK-39062 Project: Spark

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Description: The following query returns incorrect results: {noformat} spark-sql> select

[jira] [Updated] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruce Robbins updated SPARK-39061: -- Affects Version/s: (was: 3.1.3) > Incorrect results or NPE when using Inline function

[jira] [Commented] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529703#comment-17529703 ] Weichen Xu commented on SPARK-39058: [~jasbali] volunteers to contribute this feature, so I would

[jira] [Comment Edited] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529702#comment-17529702 ] Bruce Robbins edited comment on SPARK-39061 at 4/29/22 12:33 AM: - Btw,

[jira] [Commented] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529702#comment-17529702 ] Bruce Robbins commented on SPARK-39061: --- Btw, dataframe example: {noformat} scala> val df =

[jira] [Created] (SPARK-39061) Incorrect results or NPE when using Inline function against an array of dynamically created structs

2022-04-28 Thread Bruce Robbins (Jira)
Bruce Robbins created SPARK-39061: - Summary: Incorrect results or NPE when using Inline function against an array of dynamically created structs Key: SPARK-39061 URL:

[jira] [Resolved] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-35739. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36343

[jira] [Assigned] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-35739: Assignee: Brandon Dahler > [Spark Sql] Add Java-comptable Dataset.join overloads >

[jira] [Resolved] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-38896. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36237

[jira] [Assigned] (SPARK-38896) Use tryWithResource to recycling KVStoreIterator

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-38896: Assignee: Yang Jie > Use tryWithResource to recycling KVStoreIterator >

[jira] [Assigned] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-39042: Assignee: Yang Jie > Use `Map.values()` instead of `Map.entrySet()` in scenarios that do

[jira] [Updated] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen updated SPARK-39042: - Priority: Trivial (was: Minor) > Use `Map.values()` instead of `Map.entrySet()` in scenarios

[jira] [Resolved] (SPARK-39042) Use `Map.values()` instead of `Map.entrySet()` in scenarios that do not use `keys`

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39042. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36372

[jira] [Assigned] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39034: Assignee: (was: Apache Spark) > Add tests for options from `to_json` and

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529690#comment-17529690 ] Apache Spark commented on SPARK-39034: -- User 'itholic' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39034: Assignee: Apache Spark > Add tests for options from `to_json` and `from_json`. >

[jira] [Commented] (SPARK-39034) Add tests for options from `to_json` and `from_json`.

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529689#comment-17529689 ] Apache Spark commented on SPARK-39034: -- User 'itholic' has created a pull request for this issue:

[jira] [Commented] (SPARK-39035) Add tests for options from `to_csv` and `from_csv`.

2022-04-28 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529688#comment-17529688 ] Haejoon Lee commented on SPARK-39035: - I'm working on this > Add tests for options from `to_csv`

[jira] [Commented] (SPARK-38838) Support ALTER TABLE ALTER COLUMN commands with DEFAULT values

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529661#comment-17529661 ] Apache Spark commented on SPARK-38838: -- User 'dtenedor' has created a pull request for this issue:

[jira] [Resolved] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38718. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36395

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38718: Assignee: panbingkun > Test the error class: AMBIGUOUS_FIELD_NAME >

[jira] [Updated] (SPARK-39045) INTERNAL_ERROR for "all" internal errors

2022-04-28 Thread Serge Rielau (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Serge Rielau updated SPARK-39045: - Description: We should be able to inject the  [INTERNAL_ERROR] class for most cases without

[jira] [Commented] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529620#comment-17529620 ] Apache Spark commented on SPARK-39060: -- User 'vli-databricks' has created a pull request for this

[jira] [Assigned] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39060: Assignee: Apache Spark > Typo in error messages of decimal overflow >

[jira] [Commented] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529619#comment-17529619 ] Apache Spark commented on SPARK-39060: -- User 'vli-databricks' has created a pull request for this

[jira] [Assigned] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39060: Assignee: (was: Apache Spark) > Typo in error messages of decimal overflow >

[jira] [Updated] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Vitalii Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vitalii Li updated SPARK-39060: --- Description:    org.apache.spark.SparkArithmeticException     

[jira] [Created] (SPARK-39060) Typo in error messages of decimal overflow

2022-04-28 Thread Vitalii Li (Jira)
Vitalii Li created SPARK-39060: -- Summary: Typo in error messages of decimal overflow Key: SPARK-39060 URL: https://issues.apache.org/jira/browse/SPARK-39060 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-39059) When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session

2022-04-28 Thread Furcy Pin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Furcy Pin updated SPARK-39059: -- Description: We encountered unexpected error when using SparkSession.newSession and the

[jira] [Created] (SPARK-39059) When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session

2022-04-28 Thread Furcy Pin (Jira)
Furcy Pin created SPARK-39059: - Summary: When using multiple SparkSessions, DataFrame.resolve uses configuration from the wrong session Key: SPARK-39059 URL: https://issues.apache.org/jira/browse/SPARK-39059

[jira] [Resolved] (SPARK-38741) Test the error class: MAP_KEY_DOES_NOT_EXIST*

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38741. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36232

[jira] [Assigned] (SPARK-38741) Test the error class: MAP_KEY_DOES_NOT_EXIST*

2022-04-28 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38741: Assignee: panbingkun > Test the error class: MAP_KEY_DOES_NOT_EXIST* >

[jira] [Commented] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529462#comment-17529462 ] Weichen Xu commented on SPARK-39058: CC [~ruifengz] Are you interested in contributing this feature

[jira] [Created] (SPARK-39058) Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers

2022-04-28 Thread Weichen Xu (Jira)
Weichen Xu created SPARK-39058: -- Summary: Add `getInputSignature` and `getOutputSignature` APIs for spark ML models/transformers Key: SPARK-39058 URL: https://issues.apache.org/jira/browse/SPARK-39058

[jira] [Resolved] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-39056. -- Resolution: Won't Fix > Use `Collections.singletonList` instead of `Arrays.asList` when

[jira] [Commented] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529385#comment-17529385 ] Apache Spark commented on SPARK-38718: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38718: Assignee: (was: Apache Spark) > Test the error class: AMBIGUOUS_FIELD_NAME >

[jira] [Commented] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529384#comment-17529384 ] Apache Spark commented on SPARK-38718: -- User 'panbingkun' has created a pull request for this

[jira] [Assigned] (SPARK-38718) Test the error class: AMBIGUOUS_FIELD_NAME

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-38718: Assignee: Apache Spark > Test the error class: AMBIGUOUS_FIELD_NAME >

[jira] [Comment Edited] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529381#comment-17529381 ] Willi Raschkowski edited comment on SPARK-39044 at 4/28/22 11:29 AM: -

[jira] [Updated] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-39044: -- Attachment: aggregate.scala > AggregatingAccumulator with TypedImperativeAggregate

[jira] [Commented] (SPARK-39044) AggregatingAccumulator with TypedImperativeAggregate throwing NullPointerException

2022-04-28 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529381#comment-17529381 ] Willi Raschkowski commented on SPARK-39044: --- [~hyukjin.kwon], yes I know. But I wasn't able to

[jira] [Commented] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529374#comment-17529374 ] Apache Spark commented on SPARK-39057: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529373#comment-17529373 ] Apache Spark commented on SPARK-39057: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39057: Assignee: Apache Spark > Offset could work without Limit >

[jira] [Assigned] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39057: Assignee: (was: Apache Spark) > Offset could work without Limit >

[jira] [Resolved] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-39055. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 36392

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-39055: Assignee: Kent Yao > Fix documentation 404 page > -- > >

[jira] [Assigned] (SPARK-38870) SparkSession.builder returns a new builder in Scala, but not in Python

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-38870: Assignee: Furcy Pin > SparkSession.builder returns a new builder in Scala, but not in

[jira] [Resolved] (SPARK-38870) SparkSession.builder returns a new builder in Scala, but not in Python

2022-04-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-38870. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36161

[jira] [Created] (SPARK-39057) Offset could work without Limit

2022-04-28 Thread jiaan.geng (Jira)
jiaan.geng created SPARK-39057: -- Summary: Offset could work without Limit Key: SPARK-39057 URL: https://issues.apache.org/jira/browse/SPARK-39057 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39056: Assignee: (was: Apache Spark) > Use `Collections.singletonList` instead of

[jira] [Commented] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529365#comment-17529365 ] Apache Spark commented on SPARK-39056: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39056: Assignee: Apache Spark > Use `Collections.singletonList` instead of `Arrays.asList`

[jira] [Created] (SPARK-39056) Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument

2022-04-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-39056: Summary: Use `Collections.singletonList` instead of `Arrays.asList` when there is only one argument Key: SPARK-39056 URL: https://issues.apache.org/jira/browse/SPARK-39056

[jira] [Commented] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529305#comment-17529305 ] Yikun Jiang commented on SPARK-39054: - Related:

[jira] [Updated] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39054: Description: {code:java} An error occurred while calling o27083.getResult. :

[jira] [Updated] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39054: Description: {code:java} An error occurred while calling o27083.getResult. :

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39055: Assignee: (was: Apache Spark) > Fix documentation 404 page >

[jira] [Commented] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529291#comment-17529291 ] Apache Spark commented on SPARK-39055: -- User 'yaooqinn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39055: Assignee: Apache Spark > Fix documentation 404 page > -- > >

[jira] [Updated] (SPARK-39045) INTERNAL_ERROR for "all" internal errors

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-39045: Affects Version/s: 3.4.0 (was: 3.3.0) > INTERNAL_ERROR for "all"

[jira] [Commented] (SPARK-38819) Run Pandas on Spark with Pandas 1.4.x

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529283#comment-17529283 ] Yikun Jiang commented on SPARK-38819: - FYI, all issues of upgrading pandas 1.4.x has been listed

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Summary: DS V2 Top N push-down supports order by expressions (was: DS V2 aggregate push-down

[jira] [Updated] (SPARK-39037) DS V2 Top N push-down supports order by expressions

2022-04-28 Thread jiaan.geng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiaan.geng updated SPARK-39037: --- Description: Currently, Spark DS V2 Top N push-down only supports order by column. But the SQL show

[jira] [Created] (SPARK-39055) Fix documentation 404 page

2022-04-28 Thread Kent Yao (Jira)
Kent Yao created SPARK-39055: Summary: Fix documentation 404 page Key: SPARK-39055 URL: https://issues.apache.org/jira/browse/SPARK-39055 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-39054) GroupByTest failed due to axis Length mismatch

2022-04-28 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39054: --- Summary: GroupByTest failed due to axis Length mismatch Key: SPARK-39054 URL: https://issues.apache.org/jira/browse/SPARK-39054 Project: Spark Issue Type:

[jira] [Commented] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529274#comment-17529274 ] Apache Spark commented on SPARK-39053: -- User 'Yikun' has created a pull request for this issue:

[jira] [Commented] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529273#comment-17529273 ] Apache Spark commented on SPARK-39053: -- User 'Yikun' has created a pull request for this issue:

[jira] [Assigned] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39053: Assignee: (was: Apache Spark) > test_multi_index_dtypes failed due to index mismatch

[jira] [Assigned] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39053: Assignee: Apache Spark > test_multi_index_dtypes failed due to index mismatch >

[jira] [Resolved] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-39037. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 36370

[jira] [Assigned] (SPARK-39037) DS V2 aggregate push-down supports order by expressions

2022-04-28 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-39037: --- Assignee: jiaan.geng > DS V2 aggregate push-down supports order by expressions >

[jira] [Commented] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529259#comment-17529259 ] Yikun Jiang commented on SPARK-39053: -

[jira] [Updated] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Yikun Jiang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yikun Jiang updated SPARK-39053: Parent: SPARK-38819 Issue Type: Sub-task (was: Bug) > test_multi_index_dtypes failed due

[jira] [Created] (SPARK-39053) test_multi_index_dtypes failed due to index mismatch

2022-04-28 Thread Yikun Jiang (Jira)
Yikun Jiang created SPARK-39053: --- Summary: test_multi_index_dtypes failed due to index mismatch Key: SPARK-39053 URL: https://issues.apache.org/jira/browse/SPARK-39053 Project: Spark Issue

[jira] [Commented] (SPARK-39047) Replace the error class ILLEGAL_SUBSTRING by INVALID_PARAMETER_VALUE

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529233#comment-17529233 ] Apache Spark commented on SPARK-39047: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-39047) Replace the error class ILLEGAL_SUBSTRING by INVALID_PARAMETER_VALUE

2022-04-28 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529232#comment-17529232 ] Apache Spark commented on SPARK-39047: -- User 'MaxGekk' has created a pull request for this issue:

  1   2   >