[jira] [Assigned] (SPARK-44267) Upgrade `pandas` to 2.0.3

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44267: Assignee: BingKun Pan > Upgrade `pandas` to 2.0.3 > - > >

[jira] [Resolved] (SPARK-44267) Upgrade `pandas` to 2.0.3

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44267. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41812 [https://gi

[jira] [Assigned] (SPARK-44337) Any fields set to Any.getDefaultInstance cause exceptions.

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44337: Assignee: Raghu Angadi > Any fields set to Any.getDefaultInstance cause exceptions. > ---

[jira] [Resolved] (SPARK-44337) Any fields set to Any.getDefaultInstance cause exceptions.

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44337. -- Fix Version/s: 3.5.0 (was: 3.4.2) Resolution: Fixed Issue resolv

[jira] [Created] (SPARK-44351) Make some syntactic simplification

2023-07-09 Thread Yang Jie (Jira)
Yang Jie created SPARK-44351: Summary: Make some syntactic simplification Key: SPARK-44351 URL: https://issues.apache.org/jira/browse/SPARK-44351 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-44350) Upgrade sbt to 1.9.2

2023-07-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44350: --- Summary: Upgrade sbt to 1.9.2 Key: SPARK-44350 URL: https://issues.apache.org/jira/browse/SPARK-44350 Project: Spark Issue Type: Improvement Componen

[jira] [Assigned] (SPARK-44328) Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328]

2023-07-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-44328: Assignee: jiaan.geng > Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328] > -

[jira] [Resolved] (SPARK-44328) Assign names to the error class _LEGACY_ERROR_TEMP_[2325-2328]

2023-07-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-44328. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41889 [https://github.com

[jira] [Commented] (SPARK-44348) Reenable Session-based artifact test cases

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741467#comment-17741467 ] Hyukjin Kwon commented on SPARK-44348: -- I am working on this. > Reenable Session-b

[jira] [Updated] (SPARK-44348) Reenable Session-based artifact test cases

2023-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-44348: - Summary: Reenable Session-based artifact test cases (was: Reeanble Session-based artifact test cases)

[jira] [Created] (SPARK-44349) Add math functions to SparkR

2023-07-09 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-44349: - Summary: Add math functions to SparkR Key: SPARK-44349 URL: https://issues.apache.org/jira/browse/SPARK-44349 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-44348) Reeanble Session-based artifact test cases

2023-07-09 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-44348: Summary: Reeanble Session-based artifact test cases Key: SPARK-44348 URL: https://issues.apache.org/jira/browse/SPARK-44348 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-44324) Move CaseInsensitiveMap to sql/api

2023-07-09 Thread Snoot.io (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741453#comment-17741453 ] Snoot.io commented on SPARK-44324: -- User 'amaliujia' has created a pull request for thi

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2023-07-09 Thread Sandish Kumar HN (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741449#comment-17741449 ] Sandish Kumar HN commented on SPARK-24815: -- [~pavan0831] I'm excited to see wha

[jira] [Commented] (SPARK-24815) Structured Streaming should support dynamic allocation

2023-07-09 Thread Pavan Kotikalapudi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741448#comment-17741448 ] Pavan Kotikalapudi commented on SPARK-24815: Hi, I added some features to tr

[jira] [Resolved] (SPARK-41651) Test parity: pyspark.sql.tests.test_dataframe

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41651. -- Resolution: Done > Test parity: pyspark.sql.tests.test_dataframe > ---

[jira] [Resolved] (SPARK-42018) Test parity: pyspark.sql.tests.test_types

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42018. -- Resolution: Done > Test parity: pyspark.sql.tests.test_types > ---

[jira] [Resolved] (SPARK-41652) Test parity: pyspark.sql.tests.test_functions

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41652. -- Resolution: Done > Test parity: pyspark.sql.tests.test_functions > ---

[jira] [Resolved] (SPARK-41997) Test parity: pyspark.sql.tests.test_readwriter

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41997. -- Resolution: Done > Test parity: pyspark.sql.tests.test_readwriter > --

[jira] [Resolved] (SPARK-42006) Test parity: pyspark.sql.tests.test_group, test_serde, test_datasources and test_column

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-42006. -- Resolution: Done > Test parity: pyspark.sql.tests.test_group, test_serde, test_datasources and

[jira] [Assigned] (SPARK-42006) Test parity: pyspark.sql.tests.test_group, test_serde, test_datasources and test_column

2023-07-09 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-42006: Assignee: Hyukjin Kwon > Test parity: pyspark.sql.tests.test_group, test_serde, test_data

[jira] [Resolved] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao resolved SPARK-44342. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41900 [https://github.com

[jira] [Assigned] (SPARK-44342) Replace SQLContext with SparkSession for GenTPCDSData

2023-07-09 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao reassigned SPARK-44342: Assignee: jiaan.geng > Replace SQLContext with SparkSession for GenTPCDSData > --

[jira] [Resolved] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44329. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41907 [https://

[jira] [Assigned] (SPARK-44329) Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44329: - Assignee: BingKun Pan > Add hll_sketch_agg, hll_union_agg, to_varchar, try_aes_decrypt

[jira] [Created] (SPARK-44347) Upgrade janino to 3.1.10

2023-07-09 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-44347: --- Summary: Upgrade janino to 3.1.10 Key: SPARK-44347 URL: https://issues.apache.org/jira/browse/SPARK-44347 Project: Spark Issue Type: Improvement Comp

[jira] [Assigned] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-44331: - Assignee: BingKun Pan > Add bitmap functions to Scala and Python >

[jira] [Resolved] (SPARK-44331) Add bitmap functions to Scala and Python

2023-07-09 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-44331. --- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41902 [https://

[jira] [Commented] (SPARK-44323) Scala None shows up as null for Aggregator BUF or OUT

2023-07-09 Thread koert kuipers (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741400#comment-17741400 ] koert kuipers commented on SPARK-44323: --- not sure why pullreq isnt getting linked

[jira] [Created] (SPARK-44346) Python worker exited unexpectedly - java.io.EOFException on DataInputStream.readInt - cluster doesn't terminate

2023-07-09 Thread Dmitry Goldenberg (Jira)
Dmitry Goldenberg created SPARK-44346: - Summary: Python worker exited unexpectedly - java.io.EOFException on DataInputStream.readInt - cluster doesn't terminate Key: SPARK-44346 URL: https://issues.apache.org/

[jira] [Resolved] (SPARK-38477) Use error classes in org.apache.spark.storage

2023-07-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-38477. -- Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41575 [https://github.com

[jira] [Assigned] (SPARK-38477) Use error classes in org.apache.spark.storage

2023-07-09 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-38477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-38477: Assignee: Bo Zhang > Use error classes in org.apache.spark.storage >

[jira] [Commented] (SPARK-43389) spark.read.csv throws NullPointerException when lineSep is set to None

2023-07-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17741360#comment-17741360 ] ASF GitHub Bot commented on SPARK-43389: User 'gdhuper' has created a pull reque