[jira] [Commented] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319916#comment-17319916 ] Apache Spark commented on SPARK-35043: -- User 'gengliangwang' has created a pull request for this

[jira] [Commented] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319915#comment-17319915 ] Apache Spark commented on SPARK-35043: -- User 'gengliangwang' has created a pull request for this

[jira] [Resolved] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-35037. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32134

[jira] [Created] (SPARK-35044) Support retrieve hadoop configurations via SET syntax

Kent Yao created SPARK-35044: Summary: Support retrieve hadoop configurations via SET syntax Key: SPARK-35044 URL: https://issues.apache.org/jira/browse/SPARK-35044 Project: Spark Issue Type:

[jira] [Commented] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319903#comment-17319903 ] Apache Spark commented on SPARK-35043: -- User 'sigmod' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35043: Assignee: Apache Spark > Support traversal pruning in resolve functions in

[jira] [Assigned] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35043: Assignee: (was: Apache Spark) > Support traversal pruning in resolve functions in

[jira] [Updated] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

[ https://issues.apache.org/jira/browse/SPARK-35043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingyi Bu updated SPARK-35043: -- Shepherd: Gengliang Wang > Support traversal pruning in resolve functions in AnalysisHelper >

[jira] [Created] (SPARK-35043) Support traversal pruning in resolve functions in AnalysisHelper

Yingyi Bu created SPARK-35043: - Summary: Support traversal pruning in resolve functions in AnalysisHelper Key: SPARK-35043 URL: https://issues.apache.org/jira/browse/SPARK-35043 Project: Spark

[jira] [Created] (SPARK-35042) Migrate eligible transform/resolve call sites to the version with traversal pruning

Yingyi Bu created SPARK-35042: - Summary: Migrate eligible transform/resolve call sites to the version with traversal pruning Key: SPARK-35042 URL: https://issues.apache.org/jira/browse/SPARK-35042

[jira] [Assigned] (SPARK-35041) Revise the overflow in UTF8String

[ https://issues.apache.org/jira/browse/SPARK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35041: Assignee: (was: Apache Spark) > Revise the overflow in UTF8String >

[jira] [Commented] (SPARK-35041) Revise the overflow in UTF8String

[ https://issues.apache.org/jira/browse/SPARK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319878#comment-17319878 ] Apache Spark commented on SPARK-35041: -- User 'ulysses-you' has created a pull request for this

[jira] [Assigned] (SPARK-35041) Revise the overflow in UTF8String

[ https://issues.apache.org/jira/browse/SPARK-35041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35041: Assignee: Apache Spark > Revise the overflow in UTF8String >

[jira] [Resolved] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-34996. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32117

[jira] [Assigned] (SPARK-34996) Port Koalas Series related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-34996: Assignee: Xinrong Meng > Port Koalas Series related unit tests into PySpark >

[jira] [Resolved] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35029. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32130

[jira] [Assigned] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35029: Assignee: Yang Jie > Extract a new method to eliminate duplicate code in >

[jira] [Created] (SPARK-35041) Revise the overflow in UTF8String

ulysses you created SPARK-35041: --- Summary: Revise the overflow in UTF8String Key: SPARK-35041 URL: https://issues.apache.org/jira/browse/SPARK-35041 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319866#comment-17319866 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request for this issue:

[jira] [Commented] (SPARK-32922) Add support for ShuffleBlockFetcherIterator to read from merged shuffle partitions and to fallback to original shuffle blocks if encountering failures

[ https://issues.apache.org/jira/browse/SPARK-32922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319865#comment-17319865 ] Apache Spark commented on SPARK-32922: -- User 'otterc' has created a pull request for this issue:

[jira] [Assigned] (SPARK-34944) Employ correct data type for web_returns and store_returns in TPCDS tests

[ https://issues.apache.org/jira/browse/SPARK-34944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-34944: Assignee: Kent Yao > Employ correct data type for web_returns and store_returns in TPCDS tests >

[jira] [Resolved] (SPARK-34944) Employ correct data type for web_returns and store_returns in TPCDS tests

[ https://issues.apache.org/jira/browse/SPARK-34944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-34944. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32037

[jira] [Commented] (SPARK-34916) Reduce tree traversals in transform/resolve function families

[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319839#comment-17319839 ] Gengliang Wang commented on SPARK-34916: [~buyingyi] could you create an umbrella Jira for this?

[jira] [Commented] (SPARK-35032) Port Koalas Index unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319837#comment-17319837 ] Apache Spark commented on SPARK-35032: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35032) Port Koalas Index unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35032: Assignee: Apache Spark > Port Koalas Index unit tests into PySpark >

[jira] [Assigned] (SPARK-35032) Port Koalas Index unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35032: Assignee: (was: Apache Spark) > Port Koalas Index unit tests into PySpark >

[jira] [Updated] (SPARK-35040) Remove Spark-version related codes from test codes.

[ https://issues.apache.org/jira/browse/SPARK-35040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-35040: -- Description: There are several places to check the PySpark version and switch the tests, but

[jira] [Created] (SPARK-35040) Remove Spark-version related codes from test codes.

Takuya Ueshin created SPARK-35040: - Summary: Remove Spark-version related codes from test codes. Key: SPARK-35040 URL: https://issues.apache.org/jira/browse/SPARK-35040 Project: Spark Issue

[jira] [Commented] (SPARK-35033) Port Koalas plot unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319834#comment-17319834 ] Xinrong Meng commented on SPARK-35033: -- I am working on this ticket. > Port Koalas plot unit tests

[jira] [Resolved] (SPARK-35028) ANSI mode: disallow group by aliases

[ https://issues.apache.org/jira/browse/SPARK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-35028. Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32129

[jira] [Commented] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319833#comment-17319833 ] Xinrong Meng commented on SPARK-35034: -- I would like to work on this ticket. > Port Koalas

[jira] [Commented] (SPARK-34995) Port/integrate Koalas remaining codes into PySpark

[ https://issues.apache.org/jira/browse/SPARK-34995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319830#comment-17319830 ] Haejoon Lee commented on SPARK-34995: - I'm working on this > Port/integrate Koalas remaining codes

[jira] [Resolved] (SPARK-28227) Spark can’t support TRANSFORM with aggregation

[ https://issues.apache.org/jira/browse/SPARK-28227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-28227. -- Fix Version/s: 3.2.0 Assignee: angerszhu Resolution: Fixed Resolved

[jira] [Commented] (SPARK-35039) Remove Spark-version related codes from main codes.

[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319826#comment-17319826 ] Apache Spark commented on SPARK-35039: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35039) Remove Spark-version related codes from main codes.

[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35039: Assignee: (was: Apache Spark) > Remove Spark-version related codes from main codes.

[jira] [Commented] (SPARK-35039) Remove Spark-version related codes from main codes.

[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319822#comment-17319822 ] Apache Spark commented on SPARK-35039: -- User 'ueshin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35039) Remove Spark-version related codes from main codes.

[ https://issues.apache.org/jira/browse/SPARK-35039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35039: Assignee: Apache Spark > Remove Spark-version related codes from main codes. >

[jira] [Resolved] (SPARK-35031) Port Koalas operations on different frames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35031. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32133

[jira] [Assigned] (SPARK-35031) Port Koalas operations on different frames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35031: Assignee: Xinrong Meng > Port Koalas operations on different frames tests into PySpark >

[jira] [Resolved] (SPARK-35019) Improve type hints on pyspark.sql.*

[ https://issues.apache.org/jira/browse/SPARK-35019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-35019. -- Fix Version/s: 3.1.2 3.2.0 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-35019) Improve type hints on pyspark.sql.*

[ https://issues.apache.org/jira/browse/SPARK-35019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-35019: Assignee: Yikun Jiang > Improve type hints on pyspark.sql.* >

[jira] [Commented] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319816#comment-17319816 ] Apache Spark commented on SPARK-35035: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35035: Assignee: Apache Spark > Port Koalas internal implementation unit tests into PySpark >

[jira] [Assigned] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35035: Assignee: (was: Apache Spark) > Port Koalas internal implementation unit tests into

[jira] [Created] (SPARK-35039) Remove Spark-version related codes from main codes.

Takuya Ueshin created SPARK-35039: - Summary: Remove Spark-version related codes from main codes. Key: SPARK-35039 URL: https://issues.apache.org/jira/browse/SPARK-35039 Project: Spark Issue

[jira] [Assigned] (SPARK-35022) Task Scheduling Plugin in Spark

[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35022: Assignee: L. C. Hsieh (was: Apache Spark) > Task Scheduling Plugin in Spark >

[jira] [Commented] (SPARK-35022) Task Scheduling Plugin in Spark

[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319760#comment-17319760 ] Apache Spark commented on SPARK-35022: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35022) Task Scheduling Plugin in Spark

[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35022: Assignee: Apache Spark (was: L. C. Hsieh) > Task Scheduling Plugin in Spark >

[jira] [Updated] (SPARK-35022) Task Scheduling Plugin in Spark

[ https://issues.apache.org/jira/browse/SPARK-35022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh updated SPARK-35022: Description: Spark scheduler schedules tasks to executors in an arbitrary way. The schedule

[jira] [Commented] (SPARK-34916) Reduce tree traversals in transform/resolve function families

[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319730#comment-17319730 ] Apache Spark commented on SPARK-34916: -- User 'sigmod' has created a pull request for this issue:

[jira] [Commented] (SPARK-34916) Reduce tree traversals in transform/resolve function families

[ https://issues.apache.org/jira/browse/SPARK-34916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319729#comment-17319729 ] Apache Spark commented on SPARK-34916: -- User 'sigmod' has created a pull request for this issue:

[jira] [Created] (SPARK-35038) org.apache.spark.sql.AnalysisException: Resolved attribute(s) colName#390 missing from listofcolumns

unical1988 created SPARK-35038: -- Summary: org.apache.spark.sql.AnalysisException: Resolved attribute(s) colName#390 missing from listofcolumns Key: SPARK-35038 URL: https://issues.apache.org/jira/browse/SPARK-35038

[jira] [Updated] (SPARK-35031) Port Koalas operations on different frames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35031: - Summary: Port Koalas operations on different frames tests into PySpark (was: Port Koalas

[jira] [Updated] (SPARK-35031) Port Koalas operations on different frames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng updated SPARK-35031: - Description: This JIRA aims to port Koalas operations on different frames related unit tests to 

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319700#comment-17319700 ] Herman van Hövell commented on SPARK-34989: --- We are seeing some pretty serious query

[jira] [Commented] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319698#comment-17319698 ] Apache Spark commented on SPARK-35037: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319696#comment-17319696 ] Apache Spark commented on SPARK-35037: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35037: Assignee: Max Gekk (was: Apache Spark) > Recognize sign before the interval string in

[jira] [Assigned] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35037: Assignee: Apache Spark (was: Max Gekk) > Recognize sign before the interval string in

[jira] [Updated] (SPARK-35037) Recognize sign before the interval string in literals

[ https://issues.apache.org/jira/browse/SPARK-35037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-35037: - Summary: Recognize sign before the interval string in literals (was: Recognize '-' before the interval

[jira] [Created] (SPARK-35037) Recognize '-' before the interval string in literals

Max Gekk created SPARK-35037: Summary: Recognize '-' before the interval string in literals Key: SPARK-35037 URL: https://issues.apache.org/jira/browse/SPARK-35037 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-35031) Port Koalas operations on different DataFrames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35031: Assignee: (was: Apache Spark) > Port Koalas operations on different DataFrames tests

[jira] [Assigned] (SPARK-35031) Port Koalas operations on different DataFrames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35031: Assignee: Apache Spark > Port Koalas operations on different DataFrames tests into

[jira] [Commented] (SPARK-35031) Port Koalas operations on different DataFrames tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319685#comment-17319685 ] Apache Spark commented on SPARK-35031: -- User 'xinrong-databricks' has created a pull request for

[jira] [Created] (SPARK-35036) Improve push based shuffle to work with AQE by fetching partial map indexes for a reduce partition

Venkata krishnan Sowrirajan created SPARK-35036: --- Summary: Improve push based shuffle to work with AQE by fetching partial map indexes for a reduce partition Key: SPARK-35036 URL:

[jira] [Commented] (SPARK-34989) Improve the performance of mapChildren and withNewChildren methods

[ https://issues.apache.org/jira/browse/SPARK-34989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319679#comment-17319679 ] Thomas Graves commented on SPARK-34989: --- I just saw this go, all the performance numbers here are

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319652#comment-17319652 ] Jean-Yves STEPHAN commented on SPARK-31923: --- After further investigation, I confirmed this is

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319631#comment-17319631 ] Shixiong Zhu commented on SPARK-31923: -- Do you have a reproduction? It's weird to see

[jira] [Comment Edited] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319622#comment-17319622 ] Jean-Yves STEPHAN edited comment on SPARK-31923 at 4/12/21, 6:01 PM: -

[jira] [Comment Edited] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319622#comment-17319622 ] Jean-Yves STEPHAN edited comment on SPARK-31923 at 4/12/21, 5:45 PM: -

[jira] [Commented] (SPARK-31923) Event log cannot be generated when some internal accumulators use unexpected types

[ https://issues.apache.org/jira/browse/SPARK-31923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319622#comment-17319622 ] Jean-Yves STEPHAN commented on SPARK-31923: --- Hi [~zsxwing] :)  Despite your patch, we're

[jira] [Created] (SPARK-35035) Port Koalas internal implementation unit tests into PySpark

Xinrong Meng created SPARK-35035: Summary: Port Koalas internal implementation unit tests into PySpark Key: SPARK-35035 URL: https://issues.apache.org/jira/browse/SPARK-35035 Project: Spark

[jira] [Created] (SPARK-35034) Port Koalas miscellaneous unit tests into PySpark

Xinrong Meng created SPARK-35034: Summary: Port Koalas miscellaneous unit tests into PySpark Key: SPARK-35034 URL: https://issues.apache.org/jira/browse/SPARK-35034 Project: Spark Issue

[jira] [Created] (SPARK-35033) Port Koalas plot unit tests into PySpark

Xinrong Meng created SPARK-35033: Summary: Port Koalas plot unit tests into PySpark Key: SPARK-35033 URL: https://issues.apache.org/jira/browse/SPARK-35033 Project: Spark Issue Type:

[jira] [Created] (SPARK-35032) Port Koalas Index unit tests into PySpark

Xinrong Meng created SPARK-35032: Summary: Port Koalas Index unit tests into PySpark Key: SPARK-35032 URL: https://issues.apache.org/jira/browse/SPARK-35032 Project: Spark Issue Type:

[jira] [Commented] (SPARK-34593) Preserve broadcast nested loop join output partitioning and ordering

[ https://issues.apache.org/jira/browse/SPARK-34593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319554#comment-17319554 ] Apache Spark commented on SPARK-34593: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Created] (SPARK-35031) Port Koalas operations on different DataFrames tests into PySpark

Xinrong Meng created SPARK-35031: Summary: Port Koalas operations on different DataFrames tests into PySpark Key: SPARK-35031 URL: https://issues.apache.org/jira/browse/SPARK-35031 Project: Spark

[jira] [Commented] (SPARK-34593) Preserve broadcast nested loop join output partitioning and ordering

[ https://issues.apache.org/jira/browse/SPARK-34593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319553#comment-17319553 ] Apache Spark commented on SPARK-34593: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319544#comment-17319544 ] Apache Spark commented on SPARK-35012: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35012: Assignee: (was: Apache Spark) > Port Koalas DataFrame related unit tests into

[jira] [Commented] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319542#comment-17319542 ] Apache Spark commented on SPARK-35012: -- User 'xinrong-databricks' has created a pull request for

[jira] [Assigned] (SPARK-35012) Port Koalas DataFrame related unit tests into PySpark

[ https://issues.apache.org/jira/browse/SPARK-35012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35012: Assignee: Apache Spark > Port Koalas DataFrame related unit tests into PySpark >

[jira] [Comment Edited] (SPARK-11844) can not read class org.apache.parquet.format.PageHeader: don't know what type: 13

[ https://issues.apache.org/jira/browse/SPARK-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317066#comment-17317066 ] Nick Hryhoriev edited comment on SPARK-11844 at 4/12/21, 3:05 PM: -- I

[jira] [Resolved] (SPARK-34562) Leverage parquet bloom filters

[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-34562. -- Fix Version/s: 3.2.0 Resolution: Fixed Issue resolved by pull request 32123

[jira] [Assigned] (SPARK-34562) Leverage parquet bloom filters

[ https://issues.apache.org/jira/browse/SPARK-34562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-34562: Assignee: Yuming Wang > Leverage parquet bloom filters > -- > >

[jira] [Updated] (SPARK-34926) PartitionUtils.getPathFragment should handle null value

[ https://issues.apache.org/jira/browse/SPARK-34926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34926: - Fix Version/s: 3.0.3 > PartitionUtils.getPathFragment should handle null value >

[jira] [Updated] (SPARK-34926) PartitionUtils.getPathFragment should handle null value

[ https://issues.apache.org/jira/browse/SPARK-34926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-34926: - Fix Version/s: 3.1.2 > PartitionUtils.getPathFragment should handle null value >

[jira] [Updated] (SPARK-35030) ANSI SQL compliance

[ https://issues.apache.org/jira/browse/SPARK-35030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35030: --- Description: Build an ANSI compliant dialect in Spark, for better data quality and easier

[jira] [Updated] (SPARK-35030) ANSI SQL compliance

[ https://issues.apache.org/jira/browse/SPARK-35030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang updated SPARK-35030: --- Summary: ANSI SQL compliance (was: ANSI SQL compliance dialect for better data quality and

[jira] [Created] (SPARK-35030) ANSI SQL compliance dialect for better data quality and easier migration from traditional DBMS to Spark

Gengliang Wang created SPARK-35030: -- Summary: ANSI SQL compliance dialect for better data quality and easier migration from traditional DBMS to Spark Key: SPARK-35030 URL:

[jira] [Assigned] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35029: Assignee: (was: Apache Spark) > Extract a new method to eliminate duplicate code in

[jira] [Commented] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319449#comment-17319449 ] Apache Spark commented on SPARK-35029: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35029: Assignee: Apache Spark > Extract a new method to eliminate duplicate code in >

[jira] [Commented] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319450#comment-17319450 ] Apache Spark commented on SPARK-35029: -- User 'LuciferYang' has created a pull request for this

[jira] [Updated] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35029: - Description: There are some duplicate code patterns in `BufferReleasingInputStream`, such as   

[jira] [Created] (SPARK-35029) Extract `tryOrFetchFailedException` method to eliminate duplicate code in `BufferReleasingInputStream`

Yang Jie created SPARK-35029: Summary: Extract `tryOrFetchFailedException` method to eliminate duplicate code in `BufferReleasingInputStream` Key: SPARK-35029 URL: https://issues.apache.org/jira/browse/SPARK-35029

[jira] [Updated] (SPARK-35029) Extract a new method to eliminate duplicate code in `BufferReleasingInputStream`

[ https://issues.apache.org/jira/browse/SPARK-35029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-35029: - Summary: Extract a new method to eliminate duplicate code in `BufferReleasingInputStream` (was:

[jira] [Commented] (SPARK-35028) ANSI mode: disallow group by aliases

[ https://issues.apache.org/jira/browse/SPARK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17319418#comment-17319418 ] Apache Spark commented on SPARK-35028: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-35028) ANSI mode: disallow group by aliases

[ https://issues.apache.org/jira/browse/SPARK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35028: Assignee: Apache Spark (was: Gengliang Wang) > ANSI mode: disallow group by aliases >

[jira] [Assigned] (SPARK-35028) ANSI mode: disallow group by aliases

[ https://issues.apache.org/jira/browse/SPARK-35028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-35028: Assignee: Gengliang Wang (was: Apache Spark) > ANSI mode: disallow group by aliases >

  1   2   >