[jira] [Assigned] (SPARK-40393) Refactor expanding and rolling test for function with input

[ https://issues.apache.org/jira/browse/SPARK-40393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40393: Assignee: Yikun Jiang > Refactor expanding and rolling test for function with input >

[jira] [Resolved] (SPARK-40393) Refactor expanding and rolling test for function with input

[ https://issues.apache.org/jira/browse/SPARK-40393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40393. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37835

[jira] [Resolved] (SPARK-40406) The default logging should go to stderr

[ https://issues.apache.org/jira/browse/SPARK-40406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh resolved SPARK-40406. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37854

[jira] [Assigned] (SPARK-40406) The default logging should go to stderr

[ https://issues.apache.org/jira/browse/SPARK-40406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L. C. Hsieh reassigned SPARK-40406: --- Assignee: Yang Jie > The default logging should go to stderr >

[jira] [Resolved] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-40386. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37829

[jira] [Assigned] (SPARK-40386) Implement `ddof` in `DataFrame.cov`

[ https://issues.apache.org/jira/browse/SPARK-40386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-40386: - Assignee: Ruifeng Zheng > Implement `ddof` in `DataFrame.cov` >

[jira] [Created] (SPARK-40412) limit(x,y) + 子查询 出现数据丢失和乱序问题

FengJia created SPARK-40412: --- Summary: limit(x,y) + 子查询 出现数据丢失和乱序问题 Key: SPARK-40412 URL: https://issues.apache.org/jira/browse/SPARK-40412 Project: Spark Issue Type: Bug Components:

[jira] [Resolved] (SPARK-40229) Re-enable excel I/O test for pandas API on Spark.

[ https://issues.apache.org/jira/browse/SPARK-40229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40229. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37671

[jira] [Assigned] (SPARK-40229) Re-enable excel I/O test for pandas API on Spark.

[ https://issues.apache.org/jira/browse/SPARK-40229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-40229: Assignee: Haejoon Lee > Re-enable excel I/O test for pandas API on Spark. >

[jira] [Assigned] (SPARK-40411) Refactor FlatMapGroupsWithStateExec to have a parent trait

[ https://issues.apache.org/jira/browse/SPARK-40411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40411: Assignee: Apache Spark > Refactor FlatMapGroupsWithStateExec to have a parent trait >

[jira] [Assigned] (SPARK-40411) Refactor FlatMapGroupsWithStateExec to have a parent trait

[ https://issues.apache.org/jira/browse/SPARK-40411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40411: Assignee: (was: Apache Spark) > Refactor FlatMapGroupsWithStateExec to have a parent

[jira] [Commented] (SPARK-40411) Refactor FlatMapGroupsWithStateExec to have a parent trait

[ https://issues.apache.org/jira/browse/SPARK-40411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603305#comment-17603305 ] Apache Spark commented on SPARK-40411: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-40411) Refactor FlatMapGroupsWithStateExec to have a parent trait

Hyukjin Kwon created SPARK-40411: Summary: Refactor FlatMapGroupsWithStateExec to have a parent trait Key: SPARK-40411 URL: https://issues.apache.org/jira/browse/SPARK-40411 Project: Spark

[jira] [Updated] (SPARK-40411) Refactor FlatMapGroupsWithStateExec to have a parent trait

[ https://issues.apache.org/jira/browse/SPARK-40411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40411: - Issue Type: Improvement (was: Bug) > Refactor FlatMapGroupsWithStateExec to have a parent

[jira] [Resolved] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

[ https://issues.apache.org/jira/browse/SPARK-40410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-40410. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37858

[jira] [Assigned] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen reassigned SPARK-40376: Assignee: Elhoussine Talab > `np.bool` will be deprecated >

[jira] [Resolved] (SPARK-40376) `np.bool` will be deprecated

[ https://issues.apache.org/jira/browse/SPARK-40376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean R. Owen resolved SPARK-40376. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37817

[jira] [Commented] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

[ https://issues.apache.org/jira/browse/SPARK-40410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603253#comment-17603253 ] Apache Spark commented on SPARK-40410: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

[ https://issues.apache.org/jira/browse/SPARK-40410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40410: Assignee: Gengliang Wang (was: Apache Spark) > Migrate trait QueryErrorsSuiteBase into

[jira] [Commented] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

[ https://issues.apache.org/jira/browse/SPARK-40410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603252#comment-17603252 ] Apache Spark commented on SPARK-40410: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

[ https://issues.apache.org/jira/browse/SPARK-40410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40410: Assignee: Apache Spark (was: Gengliang Wang) > Migrate trait QueryErrorsSuiteBase into

[jira] [Created] (SPARK-40410) Migrate trait QueryErrorsSuiteBase into SparkFunSuite

Gengliang Wang created SPARK-40410: -- Summary: Migrate trait QueryErrorsSuiteBase into SparkFunSuite Key: SPARK-40410 URL: https://issues.apache.org/jira/browse/SPARK-40410 Project: Spark

[jira] [Updated] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

[ https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40409: - Description: h3. Describe the bug We are trying to store a BYTE {{"-128"}} to a table created via Spark

[jira] [Resolved] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng resolved SPARK-40131. -- Resolution: Resolved > Support NumPy ndarray in built-in functions >

[jira] [Commented] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603201#comment-17603201 ] Xinrong Meng commented on SPARK-40131: -- Resolved by [https://github.com/apache/spark/pull/37635.]  

[jira] [Assigned] (SPARK-40131) Support NumPy ndarray in built-in functions

[ https://issues.apache.org/jira/browse/SPARK-40131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinrong Meng reassigned SPARK-40131: Assignee: Xinrong Meng > Support NumPy ndarray in built-in functions >

[jira] [Updated] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated SPARK-40407: Description: {code:scala} _val df = spark.range(0, 100, 1, 50).repartition(4)_ _val v =

[jira] [Commented] (SPARK-38734) Test the error class: INDEX_OUT_OF_BOUNDS

[ https://issues.apache.org/jira/browse/SPARK-38734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603167#comment-17603167 ] Apache Spark commented on SPARK-38734: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Commented] (SPARK-38734) Test the error class: INDEX_OUT_OF_BOUNDS

[ https://issues.apache.org/jira/browse/SPARK-38734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603164#comment-17603164 ] Apache Spark commented on SPARK-38734: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

[ https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40409: - Description: h2. Describe the bug We are trying to store a BYTE {{"-128"}} to a table created via Spark

[jira] [Updated] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

[ https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40409: - Description: h2. Describe the bug We are trying to store a BYTE {{"-128"}} to a table created via Spark

[jira] [Updated] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

[ https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40409: - Description: h3. Describe the bug We are trying to store a BYTE {{"-128"}} to a table created via Spark

[jira] [Updated] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

[ https://issues.apache.org/jira/browse/SPARK-40409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xsys updated SPARK-40409: - Description: h3. Describe the bug We are trying to store a BYTE {{"-128"}} to a table created via Spark

[jira] [Created] (SPARK-40409) IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql

xsys created SPARK-40409: Summary: IncompatibleSchemaException when BYTE stored from DataFrame to Avro is read using spark-sql Key: SPARK-40409 URL: https://issues.apache.org/jira/browse/SPARK-40409 Project:

[jira] [Commented] (SPARK-40107) Pull out empty2null conversion from FileFormatWriter

[ https://issues.apache.org/jira/browse/SPARK-40107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603118#comment-17603118 ] Apache Spark commented on SPARK-40107: -- User 'allisonwang-db' has created a pull request for this

[jira] [Commented] (SPARK-38734) Test the error class: INDEX_OUT_OF_BOUNDS

[ https://issues.apache.org/jira/browse/SPARK-38734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603087#comment-17603087 ] BingKun Pan commented on SPARK-38734: - [~maxgekk] Yes, I haven't found the path to trigger yet >

[jira] [Resolved] (SPARK-40392) Test the error class INDEX_OUT_OF_BOUNDS

[ https://issues.apache.org/jira/browse/SPARK-40392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40392. -- Assignee: Max Gekk Resolution: Duplicate > Test the error class INDEX_OUT_OF_BOUNDS >

[jira] [Commented] (SPARK-38734) Test the error class: INDEX_OUT_OF_BOUNDS

[ https://issues.apache.org/jira/browse/SPARK-38734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603042#comment-17603042 ] Max Gekk commented on SPARK-38734: -- [~panbingkun] INDEX_OUT_OF_BOUNDS has not been tested yet, correct?

[jira] [Resolved] (SPARK-40408) Test the error class CONCURRENT_QUERY

[ https://issues.apache.org/jira/browse/SPARK-40408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-40408. -- Assignee: Max Gekk Resolution: Duplicate > Test the error class CONCURRENT_QUERY >

[jira] [Created] (SPARK-40408) Test the error class CONCURRENT_QUERY

Max Gekk created SPARK-40408: Summary: Test the error class CONCURRENT_QUERY Key: SPARK-40408 URL: https://issues.apache.org/jira/browse/SPARK-40408 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-40408) Test the error class CONCURRENT_QUERY

[ https://issues.apache.org/jira/browse/SPARK-40408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk updated SPARK-40408: - Description: Add a test for the error class CONCURRENT_QUERY and place it to QueryExecutionErrorsSuite.

[jira] [Commented] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603002#comment-17603002 ] Apache Spark commented on SPARK-40407: -- User 'wbo4958' has created a pull request for this issue:

[jira] [Assigned] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40407: Assignee: (was: Apache Spark) > Repartition of DataFrame can result in severe data

[jira] [Assigned] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

[ https://issues.apache.org/jira/browse/SPARK-40407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-40407: Assignee: Apache Spark > Repartition of DataFrame can result in severe data skew in some

[jira] [Created] (SPARK-40407) Repartition of DataFrame can result in severe data skew in some special case

Bobby Wang created SPARK-40407: -- Summary: Repartition of DataFrame can result in severe data skew in some special case Key: SPARK-40407 URL: https://issues.apache.org/jira/browse/SPARK-40407 Project: