[jira] [Updated] (SPARK-47439) Document Python Data Source API in API reference page

2024-03-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47439: - Summary: Document Python Data Source API in API reference page (was: Document Python Data

[jira] [Created] (SPARK-47439) Document Python Data Source API

2024-03-18 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47439: Summary: Document Python Data Source API Key: SPARK-47439 URL: https://issues.apache.org/jira/browse/SPARK-47439 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47436) Fix docstring links and type hints in Python Data Source

2024-03-17 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47436: Summary: Fix docstring links and type hints in Python Data Source Key: SPARK-47436 URL: https://issues.apache.org/jira/browse/SPARK-47436 Project: Spark

[jira] [Resolved] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47374. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45494

[jira] [Assigned] (SPARK-47374) Fix connect-repl `usage prompt` & `docs link`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47374: Assignee: BingKun Pan > Fix connect-repl `usage prompt` & `docs link` >

[jira] [Assigned] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47377: Assignee: Ruifeng Zheng > Factor out tests from `SparkConnectSQLTestCase` >

[jira] [Resolved] (SPARK-47377) Factor out tests from `SparkConnectSQLTestCase`

2024-03-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47377. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45497

[jira] [Assigned] (SPARK-46761) quoted strings in a JSON path should support ? characters

2024-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46761: Assignee: Robert Joseph Evans > quoted strings in a JSON path should support ?

[jira] [Resolved] (SPARK-46761) quoted strings in a JSON path should support ? characters

2024-03-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46761. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45420

[jira] [Resolved] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47348. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45416

[jira] [Assigned] (SPARK-47348) Align the version of the ubuntu host machine where the GitHub workflow runs on

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47348: Assignee: BingKun Pan > Align the version of the ubuntu host machine where the GitHub

[jira] [Resolved] (SPARK-47347) Factor session-related tests out of test_connect_basic

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47347. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45472

[jira] [Assigned] (SPARK-47347) Factor session-related tests out of test_connect_basic

2024-03-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47347: Assignee: Ruifeng Zheng > Factor session-related tests out of test_connect_basic >

[jira] [Assigned] (SPARK-47327) Fix thread safety issue in ICU Collator

2024-03-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47327: Assignee: Stefan Kandic > Fix thread safety issue in ICU Collator >

[jira] [Resolved] (SPARK-47327) Fix thread safety issue in ICU Collator

2024-03-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47327. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45436

[jira] [Resolved] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47324. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45435

[jira] [Assigned] (SPARK-47324) Call convertJavaTimestampToTimeStamp in Array getter

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47324: Assignee: Kent Yao > Call convertJavaTimestampToTimeStamp in Array getter >

[jira] [Resolved] (SPARK-47334) Make `withColumnRenamed` reuse the implementation of `withColumnsRenamed`

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47334. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45450

[jira] [Assigned] (SPARK-47334) Make `withColumnRenamed` reuse the implementation of `withColumnsRenamed`

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47334: Assignee: Ruifeng Zheng > Make `withColumnRenamed` reuse the implementation of

[jira] [Assigned] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47325: Assignee: BingKun Pan > Use the latest buf-setup-action in github workflow >

[jira] [Resolved] (SPARK-47325) Use the latest buf-setup-action in github workflow

2024-03-10 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47325. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45433

[jira] [Resolved] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47322. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45431

[jira] [Assigned] (SPARK-47322) Make `withColumnsRenamed` duplicated column name handling consisten with `withColumnRenamed`

2024-03-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47322: Assignee: Ruifeng Zheng > Make `withColumnsRenamed` duplicated column name handling

[jira] [Resolved] (SPARK-47309) [XML] Add schema inference unit tests

2024-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47309. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45426

[jira] [Assigned] (SPARK-47309) [XML] Add schema inference unit tests

2024-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47309: Assignee: Shujing Yang > [XML] Add schema inference unit tests >

[jira] [Assigned] (SPARK-47078) Documentation for SparkSession-based Profilers

2024-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47078: Assignee: Xinrong Meng > Documentation for SparkSession-based Profilers >

[jira] [Resolved] (SPARK-47078) Documentation for SparkSession-based Profilers

2024-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47078. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45269

[jira] [Commented] (SPARK-47288) DataType __repr__ change breaks datatype checking (anit-)pattern

2024-03-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17824577#comment-17824577 ] Hyukjin Kwon commented on SPARK-47288: -- I agree in principle but my concern is more about backward

[jira] [Assigned] (SPARK-47155) Fix incorrect error class in create_data_source.py

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47155: Assignee: Chaoqin Li > Fix incorrect error class in create_data_source.py >

[jira] [Resolved] (SPARK-47155) Fix incorrect error class in create_data_source.py

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47155. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45306

[jira] [Resolved] (SPARK-47311) Suppress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47311. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45414

[jira] [Assigned] (SPARK-47311) Suppress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47311: Assignee: Hyukjin Kwon > Suppress Python exceptions where PySpark is not in the Python

[jira] [Updated] (SPARK-47311) Suppress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47311: - Description: {code} scala> sql("create table t(i int) using json") 24/03/06 16:09:44 WARN

[jira] [Updated] (SPARK-47311) Suppress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47311: - Summary: Suppress Python exceptions where PySpark is not in the Python path (was: Surpress

[jira] [Updated] (SPARK-47311) Surpress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47311: - Priority: Minor (was: Major) > Surpress Python exceptions where PySpark is not in the Python

[jira] [Created] (SPARK-47311) Surpress Python exceptions where PySpark is not in the Python path

2024-03-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47311: Summary: Surpress Python exceptions where PySpark is not in the Python path Key: SPARK-47311 URL: https://issues.apache.org/jira/browse/SPARK-47311 Project: Spark

[jira] [Assigned] (SPARK-47271) Explain importance of statistics on SQL performance tuning page

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47271: Assignee: Nicholas Chammas > Explain importance of statistics on SQL performance tuning

[jira] [Resolved] (SPARK-47271) Explain importance of statistics on SQL performance tuning page

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47271. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45374

[jira] [Assigned] (SPARK-47303) Restructuring MasterSuite

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47303: Assignee: Hyukjin Kwon > Restructuring MasterSuite > - > >

[jira] [Resolved] (SPARK-47303) Restructuring MasterSuite

2024-03-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47303. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45366

[jira] [Created] (SPARK-47303) Restructuring MasterSuite

2024-03-06 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47303: Summary: Restructuring MasterSuite Key: SPARK-47303 URL: https://issues.apache.org/jira/browse/SPARK-47303 Project: Spark Issue Type: Test

[jira] [Resolved] (SPARK-44746) Improve the documentation for TABLE input arguments for UDTFs

2024-03-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44746. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45375

[jira] [Assigned] (SPARK-44746) Improve the documentation for TABLE input arguments for UDTFs

2024-03-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44746: Assignee: Daniel > Improve the documentation for TABLE input arguments for UDTFs >

[jira] [Resolved] (SPARK-47277) PySpark util function assertDataFrameEqual should not support streaming DF

2024-03-05 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47277. -- Fix Version/s: 4.0.0 Resolution: Fixed Fixed in

[jira] [Resolved] (SPARK-47252) Clarify that pivot may trigger an eager computation

2024-03-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47252. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45363

[jira] [Assigned] (SPARK-47252) Clarify that pivot may trigger an eager computation

2024-03-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47252: Assignee: Nicholas Chammas > Clarify that pivot may trigger an eager computation >

[jira] [Resolved] (SPARK-47266) Make `ProtoUtils.abbreviate` return the same type as the input

2024-03-04 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47266. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45369

[jira] [Assigned] (SPARK-47244) SparkConnectPlanner make internal functions private

2024-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47244: Assignee: Ruifeng Zheng > SparkConnectPlanner make internal functions private >

[jira] [Resolved] (SPARK-47244) SparkConnectPlanner make internal functions private

2024-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47244. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45354

[jira] [Resolved] (SPARK-47251) Block invalid types from the `args` argument for `sql` command

2024-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47251. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45361

[jira] [Assigned] (SPARK-47251) Block invalid types from the `args` argument for `sql` command

2024-03-02 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47251: Assignee: Takuya Ueshin > Block invalid types from the `args` argument for `sql` command

[jira] [Resolved] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47218. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45325

[jira] [Assigned] (SPARK-47218) XML: Ignore commented Row Tags in XML tokenizer

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47218: Assignee: Yousof Hosny > XML: Ignore commented Row Tags in XML tokenizer >

[jira] [Assigned] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47211: Assignee: Nikola Mandic > Fix ignored PySpark Connect string collation >

[jira] [Resolved] (SPARK-47211) Fix ignored PySpark Connect string collation

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47211. -- Resolution: Fixed Issue resolved by pull request 45316

[jira] [Resolved] (SPARK-47224) Split `test_split_apply_basic`

2024-02-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47224. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45332

[jira] [Resolved] (SPARK-47147) Fix Pyspark collated string conversion error

2024-02-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47147. -- Resolution: Fixed Issue resolved by pull request 45257

[jira] [Assigned] (SPARK-47202) AttributeError: module 'pandas' has no attribute 'Timstamp'

2024-02-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47202: Assignee: Arzav Jain > AttributeError: module 'pandas' has no attribute 'Timstamp' >

[jira] [Resolved] (SPARK-47202) AttributeError: module 'pandas' has no attribute 'Timstamp'

2024-02-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47202. -- Fix Version/s: 3.5.2 4.0.0 Resolution: Fixed Issue resolved by pull

[jira] [Created] (SPARK-47199) Add prefix into TemporaryDirectory to avoid flakiness

2024-02-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47199: Summary: Add prefix into TemporaryDirectory to avoid flakiness Key: SPARK-47199 URL: https://issues.apache.org/jira/browse/SPARK-47199 Project: Spark Issue

[jira] [Created] (SPARK-47185) Increase timeout between actions in KafkaContinuousTest

2024-02-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47185: Summary: Increase timeout between actions in KafkaContinuousTest Key: SPARK-47185 URL: https://issues.apache.org/jira/browse/SPARK-47185 Project: Spark

[jira] [Updated] (SPARK-47185) Increase timeout between actions in KafkaContinuousTest

2024-02-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47185: - Priority: Minor (was: Major) > Increase timeout between actions in KafkaContinuousTest >

[jira] [Assigned] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47178: Assignee: Hyukjin Kwon > Add a test case for createDataFrame with dataclasses >

[jira] [Resolved] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47178. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45271

[jira] [Created] (SPARK-47178) Add a test case for createDataFrame with dataclasses

2024-02-26 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47178: Summary: Add a test case for createDataFrame with dataclasses Key: SPARK-47178 URL: https://issues.apache.org/jira/browse/SPARK-47178 Project: Spark Issue

[jira] [Resolved] (SPARK-47164) Make Default Value From Wider Type Narrow Literal of v2 behave the same as v1

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47164. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45254

[jira] [Resolved] (SPARK-44400) Improve Scala StreamingQueryListener to provide users a way to access the Spark session for Spark Connect

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44400. -- Resolution: Duplicate > Improve Scala StreamingQueryListener to provide users a way to access

[jira] [Resolved] (SPARK-44462) Fix the session passed to foreachBatch.

2024-02-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44462. -- Resolution: Duplicate > Fix the session passed to foreachBatch. >

[jira] [Created] (SPARK-47161) Uses hash key properly for SparkR build on Windows

2024-02-25 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47161: Summary: Uses hash key properly for SparkR build on Windows Key: SPARK-47161 URL: https://issues.apache.org/jira/browse/SPARK-47161 Project: Spark Issue

[jira] [Resolved] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47159. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45249

[jira] [Assigned] (SPARK-47159) Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS` GitHub Action Job

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47159: Assignee: Dongjoon Hyun > Set `OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES` in `MacOS`

[jira] [Resolved] (SPARK-47120) Null comparison push down data filter from subquery produces in NPE in Parquet filter

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47120. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45202

[jira] [Resolved] (SPARK-47157) Introduce abstraction that facilitates more flexible management of file listings within the system.

2024-02-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47157. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45224

[jira] [Resolved] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47140. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45227

[jira] [Created] (SPARK-47140) Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions

2024-02-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47140: Summary: Upgrade codecov/codecov-action from v2 to v4 in GitHub Actions Key: SPARK-47140 URL: https://issues.apache.org/jira/browse/SPARK-47140 Project: Spark

[jira] [Created] (SPARK-47139) Upgrade Python version used in coverage report

2024-02-22 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47139: Summary: Upgrade Python version used in coverage report Key: SPARK-47139 URL: https://issues.apache.org/jira/browse/SPARK-47139 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47123. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45209

[jira] [Assigned] (SPARK-47123) JDBCRDD does not correctly handle errors in getQueryOutputSchema

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47123: Assignee: Pablo Langa Blanco > JDBCRDD does not correctly handle errors in

[jira] [Reopened] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reopened SPARK-47115: -- Assignee: (was: Hyukjin Kwon) > Use larger memory for Maven builds >

[jira] [Updated] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47115: - Fix Version/s: (was: 4.0.0) > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

2024-02-22 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Resolution: Invalid it doesn't help. reverted > Use larger memory for Maven builds >

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.2 (was: 3.5.3) > Return null if Univocity never

[jira] [Updated] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47125: - Fix Version/s: 3.5.3 3.4.3 > Return null if Univocity never triggers parsing

[jira] [Assigned] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47125: Assignee: Hyukjin Kwon > Return null if Univocity never triggers parsing >

[jira] [Resolved] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47125. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45210

[jira] [Created] (SPARK-47125) Return null if Univocity never triggers parsing

2024-02-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47125: Summary: Return null if Univocity never triggers parsing Key: SPARK-47125 URL: https://issues.apache.org/jira/browse/SPARK-47125 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Priority: Minor (was: Major) > Skip scheduled SparkR on Windows in fork repositories by

[jira] [Updated] (SPARK-47124) Skip scheduled SparkR on Windows in fork repositories by default

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47124: - Summary: Skip scheduled SparkR on Windows in fork repositories by default (was: Skip SparkR on

[jira] [Created] (SPARK-47124) Skip SparkR on Windows in fork repositories

2024-02-21 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47124: Summary: Skip SparkR on Windows in fork repositories Key: SPARK-47124 URL: https://issues.apache.org/jira/browse/SPARK-47124 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-31745) Enable Hive related test cases of SparkR on Windows

2024-02-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-31745: - Summary: Enable Hive related test cases of SparkR on Windows (was: Enable Hive related test

[jira] [Assigned] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47112: Assignee: Hyukjin Kwon > Write logs into a file in SparkR Windows build >

[jira] [Resolved] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47112. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45192

[jira] [Created] (SPARK-47116) Install proper Python version in SparkR Windows build to avoid warnings

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47116: Summary: Install proper Python version in SparkR Windows build to avoid warnings Key: SPARK-47116 URL: https://issues.apache.org/jira/browse/SPARK-47116 Project:

[jira] [Assigned] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47115: Assignee: Hyukjin Kwon > Use larger memory for Maven builds >

[jira] [Resolved] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47115. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45195

[jira] [Created] (SPARK-47115) Use larger memory for Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47115: Summary: Use larger memory for Maven builds Key: SPARK-47115 URL: https://issues.apache.org/jira/browse/SPARK-47115 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-47112) Write logs into a file in SparkR Windows build

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47112: Summary: Write logs into a file in SparkR Windows build Key: SPARK-47112 URL: https://issues.apache.org/jira/browse/SPARK-47112 Project: Spark Issue Type:

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Description: Disabled in https://github.com/apache/spark/pull/45186 because of TTY issues. See

[jira] [Updated] (SPARK-47110) Reenble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-47110: - Summary: Reenble AmmoniteTest tests in Maven builds (was: Eanble AmmoniteTest tests in Maven

[jira] [Created] (SPARK-47110) Eanble AmmoniteTest tests in Maven builds

2024-02-20 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-47110: Summary: Eanble AmmoniteTest tests in Maven builds Key: SPARK-47110 URL: https://issues.apache.org/jira/browse/SPARK-47110 Project: Spark Issue Type:

<    1   2   3   4   5   6   7   8   9   10   >