[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424294#comment-17424294 ] Apache Spark commented on SPARK-36926: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36926: Assignee: (was: Apache Spark) > Discrepancy in Q22 of TPCH for Spark 3.2 >

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424293#comment-17424293 ] Apache Spark commented on SPARK-36926: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36926: Assignee: Apache Spark > Discrepancy in Q22 of TPCH for Spark 3.2 >

[jira] [Assigned] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36930: Assignee: (was: Apache Spark) > Support ps.MultiIndex.dtypes >

[jira] [Assigned] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36930: Assignee: Apache Spark > Support ps.MultiIndex.dtypes > > >

[jira] [Commented] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424291#comment-17424291 ] Apache Spark commented on SPARK-36930: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36711) Support multi-index in new syntax

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-36711: Assignee: dch nguyen > Support multi-index in new syntax >

[jira] [Updated] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36930: --- Description: when MultiIndex.dtypes is supported, we can use: {code:java} >>> idx =

[jira] [Updated] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36930: --- Description: when MultiIndex.dtypes is supported, we can use: {code:java} >>> idx =

[jira] [Updated] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36930: --- Summary: Support ps.MultiIndex.dtypes (was: Support ps.DataFrame.dtypes) > Support

[jira] [Updated] (SPARK-36930) Support ps.MultiIndex.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36930: --- Description: (was: When DF.dtypes is supported, we can use   {code:java} >>> pdf =

[jira] [Commented] (SPARK-36930) Support ps.DataFrame.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424288#comment-17424288 ] dch nguyen commented on SPARK-36930: working on this. > Support ps.DataFrame.dtypes >

[jira] [Updated] (SPARK-36930) Support ps.DataFrame.dtypes

2021-10-04 Thread dch nguyen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dch nguyen updated SPARK-36930: --- Description: When DF.dtypes is supported, we can use   {code:java} >>> pdf = pd.DataFrame( ...

[jira] [Created] (SPARK-36930) Support ps.DataFrame.dtypes

2021-10-04 Thread dch nguyen (Jira)
dch nguyen created SPARK-36930: -- Summary: Support ps.DataFrame.dtypes Key: SPARK-36930 URL: https://issues.apache.org/jira/browse/SPARK-36930 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36292) Refactor third set of 20 query execution errors to use error classes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424285#comment-17424285 ] Apache Spark commented on SPARK-36292: -- User 'dchvn' has created a pull request for this issue:

[jira] [Resolved] (SPARK-36711) Support multi-index in new syntax

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36711. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34176

[jira] [Commented] (SPARK-36296) Refactor seventh set of 20 query execution errors to use error classes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424281#comment-17424281 ] Apache Spark commented on SPARK-36296: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36874) Ambiguous Self-Join detected only on right dataframe

2021-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-36874: --- Assignee: Kousuke Saruta > Ambiguous Self-Join detected only on right dataframe >

[jira] [Resolved] (SPARK-36874) Ambiguous Self-Join detected only on right dataframe

2021-10-04 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-36874. - Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 34172

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424265#comment-17424265 ] Venkata krishnan Sowrirajan commented on SPARK-36926: - This looks like a regression

[jira] [Commented] (SPARK-36711) Support multi-index in new syntax

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424261#comment-17424261 ] Apache Spark commented on SPARK-36711: -- User 'dchvn' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36929) Remove Unused Method EliminateSubqueryAliasesSuite#assertEquivalent

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36929: Assignee: (was: Apache Spark) > Remove Unused Method

[jira] [Assigned] (SPARK-36929) Remove Unused Method EliminateSubqueryAliasesSuite#assertEquivalent

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36929: Assignee: Apache Spark > Remove Unused Method

[jira] [Commented] (SPARK-36929) Remove Unused Method EliminateSubqueryAliasesSuite#assertEquivalent

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424260#comment-17424260 ] Apache Spark commented on SPARK-36929: -- User 'leesf' has created a pull request for this issue:

[jira] [Created] (SPARK-36929) Remove Unused Method EliminateSubqueryAliasesSuite#assertEquivalent

2021-10-04 Thread leesf (Jira)
leesf created SPARK-36929: - Summary: Remove Unused Method EliminateSubqueryAliasesSuite#assertEquivalent Key: SPARK-36929 URL: https://issues.apache.org/jira/browse/SPARK-36929 Project: Spark Issue

[jira] [Resolved] (SPARK-36925) Overriding parameters

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36925. -- Resolution: Invalid > Overriding parameters > - > > Key:

[jira] [Commented] (SPARK-36925) Overriding parameters

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424258#comment-17424258 ] Hyukjin Kwon commented on SPARK-36925: -- Let's ask questions in spark mailing list before filing it

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424256#comment-17424256 ] Hyukjin Kwon commented on SPARK-36926: -- Just to clarify, do you know if this is a regression or not

[jira] [Updated] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36926: - Priority: Critical (was: Major) > Discrepancy in Q22 of TPCH for Spark 3.2 >

[jira] [Resolved] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36920. -- Fix Version/s: 3.3.0 Resolution: Fixed Issue resolved by pull request 34169

[jira] [Resolved] (SPARK-36881) Inline type hints for python/pyspark/sql/catalog.py

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-36881. -- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-26786) Handle to treat escaped newline characters('\r','\n') in spark csv

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424241#comment-17424241 ] Hyukjin Kwon commented on SPARK-26786: -- It became a known limitation in universe. > Handle to

[jira] [Comment Edited] (SPARK-26786) Handle to treat escaped newline characters('\r','\n') in spark csv

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-26786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424241#comment-17424241 ] Hyukjin Kwon edited comment on SPARK-26786 at 10/5/21, 1:00 AM: It

[jira] [Commented] (SPARK-36600) Optimise speed and memory with Pyspark when create DataFrame (with patch)

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424240#comment-17424240 ] Hyukjin Kwon commented on SPARK-36600: -- You can just create a PR right away. Once that's fixed, it

[jira] [Updated] (SPARK-36802) Incorrect writing the string, containing symbols like "\" to Hive

2021-10-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-36802: - Affects Version/s: 3.1.2 > Incorrect writing the string, containing symbols like "\" to Hive >

[jira] [Commented] (SPARK-36910) Inline type hints for python/pyspark/sql/types.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424227#comment-17424227 ] Apache Spark commented on SPARK-36910: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36910) Inline type hints for python/pyspark/sql/types.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36910: Assignee: Apache Spark > Inline type hints for python/pyspark/sql/types.py >

[jira] [Assigned] (SPARK-36910) Inline type hints for python/pyspark/sql/types.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36910: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/sql/types.py >

[jira] [Commented] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424220#comment-17424220 ] Apache Spark commented on SPARK-36927: -- User 'xinrong-databricks' has created a pull request for

[jira] [Commented] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424218#comment-17424218 ] Apache Spark commented on SPARK-36927: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36927: Assignee: (was: Apache Spark) > Inline type hints for python/pyspark/sql/window.py >

[jira] [Assigned] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36927: Assignee: Apache Spark > Inline type hints for python/pyspark/sql/window.py >

[jira] [Resolved] (SPARK-36906) Inline type hints for conf.py and observation.py in python/pyspark/sql

2021-10-04 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-36906. --- Fix Version/s: 3.3.0 Assignee: Xinrong Meng Resolution: Fixed Issue

[jira] [Commented] (SPARK-36905) Reading Hive view without explicit column names fails in Spark

2021-10-04 Thread Erik Krogen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424183#comment-17424183 ] Erik Krogen commented on SPARK-36905: - cc also [~maropu] [~viirya] [~csun] > Reading Hive view

[jira] [Created] (SPARK-36928) Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36928: Summary: Handle ANSI intervals in ColumnarRow, ColumnarBatchRow and ColumnarArray Key: SPARK-36928 URL: https://issues.apache.org/jira/browse/SPARK-36928 Project: Spark

[jira] [Comment Edited] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424112#comment-17424112 ] Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 7:44 PM:

[jira] [Commented] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Xinrong Meng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424131#comment-17424131 ] Xinrong Meng commented on SPARK-36927: -- I'm working on this. > Inline type hints for

[jira] [Created] (SPARK-36927) Inline type hints for python/pyspark/sql/window.py

2021-10-04 Thread Xinrong Meng (Jira)
Xinrong Meng created SPARK-36927: Summary: Inline type hints for python/pyspark/sql/window.py Key: SPARK-36927 URL: https://issues.apache.org/jira/browse/SPARK-36927 Project: Spark Issue

[jira] [Assigned] (SPARK-36874) Ambiguous Self-Join detected only on right dataframe

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36874: Assignee: (was: Apache Spark) > Ambiguous Self-Join detected only on right dataframe

[jira] [Assigned] (SPARK-36874) Ambiguous Self-Join detected only on right dataframe

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36874: Assignee: Apache Spark > Ambiguous Self-Join detected only on right dataframe >

[jira] [Commented] (SPARK-36874) Ambiguous Self-Join detected only on right dataframe

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424113#comment-17424113 ] Apache Spark commented on SPARK-36874: -- User 'sarutak' has created a pull request for this issue:

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424112#comment-17424112 ] Venkata krishnan Sowrirajan commented on SPARK-36926: - I tried to get a simpler

[jira] [Comment Edited] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080 ] Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:53 PM:

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424097#comment-17424097 ] Mridul Muralidharan commented on SPARK-36926: - +CC [~gengliang], [~cloud_fan] > Discrepancy

[jira] [Comment Edited] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080 ] Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:05 PM:

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080 ] Venkata krishnan Sowrirajan commented on SPARK-36926: - The issue seems to be with

[jira] [Comment Edited] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424080#comment-17424080 ] Venkata krishnan Sowrirajan edited comment on SPARK-36926 at 10/4/21, 6:04 PM:

[jira] [Commented] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Aravind Patnam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424058#comment-17424058 ] Aravind Patnam commented on SPARK-36926: cc: [~vsowrirajan] [~mridulm80] > Discrepancy in Q22

[jira] [Comment Edited] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

2021-10-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424052#comment-17424052 ] Mridul Muralidharan edited comment on SPARK-36892 at 10/4/21, 5:26 PM:

[jira] [Commented] (SPARK-36892) Disable batch fetch for a shuffle when push based shuffle is enabled

2021-10-04 Thread Mridul Muralidharan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424052#comment-17424052 ] Mridul Muralidharan commented on SPARK-36892: - [~Gengliang.Wang] Thanks for holding the

[jira] [Updated] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Venkata krishnan Sowrirajan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkata krishnan Sowrirajan updated SPARK-36926: Description: When running TPCH scale 100 against 3.2, Query 22

[jira] [Created] (SPARK-36926) Discrepancy in Q22 of TPCH for Spark 3.2

2021-10-04 Thread Aravind Patnam (Jira)
Aravind Patnam created SPARK-36926: -- Summary: Discrepancy in Q22 of TPCH for Spark 3.2 Key: SPARK-36926 URL: https://issues.apache.org/jira/browse/SPARK-36926 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-36911) Add AQE Planning Times to SQL Metrics

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36911: Assignee: (was: Apache Spark) > Add AQE Planning Times to SQL Metrics >

[jira] [Assigned] (SPARK-36911) Add AQE Planning Times to SQL Metrics

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36911: Assignee: Apache Spark > Add AQE Planning Times to SQL Metrics >

[jira] [Commented] (SPARK-36911) Add AQE Planning Times to SQL Metrics

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424016#comment-17424016 ] Apache Spark commented on SPARK-36911: -- User 'ChenMichael' has created a pull request for this

[jira] [Updated] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36921: - Description: Extended the div function to support ANSI intervals. The operation should produce quotient

[jira] [Commented] (SPARK-36917) java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in i

2021-10-04 Thread Davide Benedetto (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423918#comment-17423918 ] Davide Benedetto commented on SPARK-36917: -- I have checked in other Jira but any of them

[jira] [Commented] (SPARK-36917) java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in i

2021-10-04 Thread Sean R. Owen (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423909#comment-17423909 ] Sean R. Owen commented on SPARK-36917: -- Search JIRA, there are related issues, some of which are

[jira] [Updated] (SPARK-36600) Optimise speed and memory with Pyspark when create DataFrame (with patch)

2021-10-04 Thread Philippe Prados (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Philippe Prados updated SPARK-36600: Summary: Optimise speed and memory with Pyspark when create DataFrame (with patch) (was:

[jira] [Commented] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423892#comment-17423892 ] Apache Spark commented on SPARK-36920: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36920: Assignee: Apache Spark (was: Max Gekk) > Support ANSI intervals by ABS >

[jira] [Assigned] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-36920: Assignee: Max Gekk (was: Apache Spark) > Support ANSI intervals by ABS >

[jira] [Updated] (SPARK-36925) Overriding parameters

2021-10-04 Thread Abhinav Kumar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Kumar updated SPARK-36925: -- Description: Hello team, One quick question. I read somewhere in the doc - Order of priority

[jira] [Created] (SPARK-36925) Overriding parameters

2021-10-04 Thread Abhinav Kumar (Jira)
Abhinav Kumar created SPARK-36925: - Summary: Overriding parameters Key: SPARK-36925 URL: https://issues.apache.org/jira/browse/SPARK-36925 Project: Spark Issue Type: Question

[jira] [Assigned] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-36920: Assignee: Max Gekk > Support ANSI intervals by ABS > - > >

[jira] [Commented] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423882#comment-17423882 ] Max Gekk commented on SPARK-36920: -- I am working on this. > Support ANSI intervals by ABS >

[jira] [Commented] (SPARK-36917) java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda to field org.apache.spark.rdd.MapPartitionsRDD.f of type scala.Function3 in i

2021-10-04 Thread Davide Benedetto (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423867#comment-17423867 ] Davide Benedetto commented on SPARK-36917: -- [~srowen] Can You Please help me with this issue?

[jira] [Created] (SPARK-36924) CAST between ANSI intervals and numerics

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36924: Summary: CAST between ANSI intervals and numerics Key: SPARK-36924 URL: https://issues.apache.org/jira/browse/SPARK-36924 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36923) Allow coercing of an interval expression to a specific interval type

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36923: Summary: Allow coercing of an interval expression to a specific interval type Key: SPARK-36923 URL: https://issues.apache.org/jira/browse/SPARK-36923 Project: Spark

[jira] [Updated] (SPARK-36922) The SIGN/SIGNUM functions should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36922: - Description: Extend the *sign/signum* functions to support ANSI intervals. (was: Extend the *sign*

[jira] [Updated] (SPARK-36922) The SIGN/SIGNUM functions should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-36922: - Summary: The SIGN/SIGNUM functions should support ANSI intervals (was: The sign function should

[jira] [Created] (SPARK-36922) The sign function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36922: Summary: The sign function should support ANSI intervals Key: SPARK-36922 URL: https://issues.apache.org/jira/browse/SPARK-36922 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36921) The DIV function should support ANSI intervals

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36921: Summary: The DIV function should support ANSI intervals Key: SPARK-36921 URL: https://issues.apache.org/jira/browse/SPARK-36921 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-36920) Support ANSI intervals by ABS

2021-10-04 Thread Max Gekk (Jira)
Max Gekk created SPARK-36920: Summary: Support ANSI intervals by ABS Key: SPARK-36920 URL: https://issues.apache.org/jira/browse/SPARK-36920 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423855#comment-17423855 ] Apache Spark commented on SPARK-36302: -- User 'dchvn' has created a pull request for this issue:

[jira] [Commented] (SPARK-36302) Refactor thirteenth set of 20 query execution errors to use error classes

2021-10-04 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-36302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423854#comment-17423854 ] Apache Spark commented on SPARK-36302: -- User 'dchvn' has created a pull request for this issue: