[jira] [Updated] (SPARK-46555) Refine docstring for DataFrame.createTempView/createOrReplaceTempView

2024-01-01 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46555: - Summary: Refine docstring for DataFrame.createTempView/createOrReplaceTempView (was: Refine

[jira] [Created] (SPARK-46555) Refine docstring for DataFrame.registerTempTable/createTempView/createOrReplaceTempView

2024-01-01 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46555: Summary: Refine docstring for DataFrame.registerTempTable/createTempView/createOrReplaceTempView Key: SPARK-46555 URL: https://issues.apache.org/jira/browse/SPARK-46555

[jira] [Resolved] (SPARK-45914) Support `commit` and `abort` API for Python data source write

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45914. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44497

[jira] [Assigned] (SPARK-45914) Support `commit` and `abort` API for Python data source write

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45914: Assignee: Allison Wang > Support `commit` and `abort` API for Python data source write >

[jira] [Assigned] (SPARK-46382) XML: Capture values interspersed between elements

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46382: Assignee: Shujing Yang > XML: Capture values interspersed between elements >

[jira] [Resolved] (SPARK-46382) XML: Capture values interspersed between elements

2023-12-28 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46382. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44318

[jira] [Created] (SPARK-46530) Check Python executable when looking up available Data Sources

2023-12-27 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46530: Summary: Check Python executable when looking up available Data Sources Key: SPARK-46530 URL: https://issues.apache.org/jira/browse/SPARK-46530 Project: Spark

[jira] [Resolved] (SPARK-45917) Statically register Python Data Source

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45917. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44504

[jira] [Assigned] (SPARK-45917) Statically register Python Data Source

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45917: Assignee: Hyukjin Kwon > Statically register Python Data Source >

[jira] [Resolved] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46521. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44506

[jira] [Assigned] (SPARK-46521) Refine docstring of `array_compact/array_distinct/array_remove`

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46521: Assignee: Yang Jie > Refine docstring of `array_compact/array_distinct/array_remove` >

[jira] [Assigned] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46528: Assignee: Dongjoon Hyun > Upgrade zstd-jni to 1.5.5-11 > >

[jira] [Resolved] (SPARK-46528) Upgrade zstd-jni to 1.5.5-11

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46528. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44515

[jira] [Assigned] (SPARK-46520) Support overwrite mode for Python data source write

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46520: Assignee: Allison Wang > Support overwrite mode for Python data source write >

[jira] [Resolved] (SPARK-46520) Support overwrite mode for Python data source write

2023-12-27 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46520. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44505

[jira] [Resolved] (SPARK-46513) Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

2023-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46513. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44499

[jira] [Assigned] (SPARK-46513) Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

2023-12-26 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46513: Assignee: Ruifeng Zheng > Move `BasicIndexingTests` to `pyspark.pandas.tests.indexes.*`

[jira] [Resolved] (SPARK-45559) Support spark.read.schema(...) for Python data source API

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45559. -- Resolution: Invalid It is supported, and I see some test cases in `PythonDataSourceSuite` >

[jira] [Resolved] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46503. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44482

[jira] [Assigned] (SPARK-46503) Move test_default_index to `pyspark.pandas.tests.indexes.*`

2023-12-25 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46503: Assignee: Ruifeng Zheng > Move test_default_index to `pyspark.pandas.tests.indexes.*` >

[jira] [Resolved] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

2023-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46437. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44393

[jira] [Assigned] (SPARK-46437) Remove unnecessary cruft from SQL built-in functions docs

2023-12-21 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46437: Assignee: Nicholas Chammas > Remove unnecessary cruft from SQL built-in functions docs >

[jira] [Assigned] (SPARK-46465) Implement Column.isNaN

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46465: Assignee: Ruifeng Zheng > Implement Column.isNaN > -- > >

[jira] [Resolved] (SPARK-46465) Implement Column.isNaN

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46465. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44422

[jira] [Assigned] (SPARK-46462) Reorganize `OpsOnDiffFramesGroupByRollingTests`

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46462: Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesGroupByRollingTests` >

[jira] [Resolved] (SPARK-46462) Reorganize `OpsOnDiffFramesGroupByRollingTests`

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46462. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44420

[jira] [Resolved] (SPARK-46463) Reorganize `OpsOnDiffFramesGroupByExpandingTests`

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46463. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44421

[jira] [Assigned] (SPARK-46463) Reorganize `OpsOnDiffFramesGroupByExpandingTests`

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46463: Assignee: Ruifeng Zheng > Reorganize `OpsOnDiffFramesGroupByExpandingTests` >

[jira] [Resolved] (SPARK-46413) Validate returnType of Arrow Python UDF

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46413. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44362

[jira] [Resolved] (SPARK-46398) Test rangeBetween window function (pyspark.sql.window)

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46398. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44339

[jira] [Assigned] (SPARK-46398) Test rangeBetween window function (pyspark.sql.window)

2023-12-20 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46398: Assignee: Xinrong Meng > Test rangeBetween window function (pyspark.sql.window) >

[jira] [Assigned] (SPARK-46308) Forbid recursive error handling by adding recursion guards

2023-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46308: Assignee: Alice Sayutina > Forbid recursive error handling by adding recursion guards >

[jira] [Resolved] (SPARK-46308) Forbid recursive error handling by adding recursion guards

2023-12-18 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46308. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44210

[jira] [Resolved] (SPARK-46386) Improve assertions of observation (pyspark.sql.observation)

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46386. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44324

[jira] [Resolved] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46424. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44375

[jira] [Assigned] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-16 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46424: Assignee: Hyukjin Kwon > Support PythonSQLMetrics.pythonMetrics >

[jira] [Resolved] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44379

[jira] [Assigned] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46427: Assignee: Hyukjin Kwon > Change Python Data Source's description to be pretty in explain

[jira] [Created] (SPARK-46427) Change Python Data Source's description to be pretty in explain

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46427: Summary: Change Python Data Source's description to be pretty in explain Key: SPARK-46427 URL: https://issues.apache.org/jira/browse/SPARK-46427 Project: Spark

[jira] [Resolved] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46425. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44376

[jira] [Assigned] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46425: Assignee: Hyukjin Kwon > Pin the bundler version in CI > - >

[jira] [Resolved] (SPARK-46414) Use prependBaseUri to render javascript imports

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46414. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44363

[jira] [Deleted] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon deleted SPARK-46426: - > Uses sum metrics for number of output length > > >

[jira] [Updated] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46426: - Attachment: Screenshot 2023-12-15 at 3.23.09 PM.png > Uses sum metrics for number of output

[jira] [Updated] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46426: - Description: screenhot attached. it shouldn't look like bytes > Uses sum metrics for number of

[jira] [Created] (SPARK-46426) Uses sum metrics for number of output length

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46426: Summary: Uses sum metrics for number of output length Key: SPARK-46426 URL: https://issues.apache.org/jira/browse/SPARK-46426 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46423: Assignee: Hyukjin Kwon > Refactor Python Data Source instance loading >

[jira] [Resolved] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46423. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44374

[jira] [Created] (SPARK-46425) Pin the bundler version in CI

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46425: Summary: Pin the bundler version in CI Key: SPARK-46425 URL: https://issues.apache.org/jira/browse/SPARK-46425 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46424: - Summary: Support PythonSQLMetrics.pythonMetrics (was: Support PythonSQLMetrics.pythonMetrics

[jira] [Updated] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-46424: - Priority: Minor (was: Major) > Support PythonSQLMetrics.pythonMetrics via custom metrics API

[jira] [Created] (SPARK-46424) Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46424: Summary: Support PythonSQLMetrics.pythonMetrics via custom metrics API in DSv2 Key: SPARK-46424 URL: https://issues.apache.org/jira/browse/SPARK-46424 Project: Spark

[jira] [Assigned] (SPARK-46419) Reorganize `DatetimeIndexTests`: Factor out 3 slow tests

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46419: Assignee: Ruifeng Zheng > Reorganize `DatetimeIndexTests`: Factor out 3 slow tests >

[jira] [Resolved] (SPARK-46419) Reorganize `DatetimeIndexTests`: Factor out 3 slow tests

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46419. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44369

[jira] [Created] (SPARK-46423) Refactor Python Data Source instance loading

2023-12-15 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46423: Summary: Refactor Python Data Source instance loading Key: SPARK-46423 URL: https://issues.apache.org/jira/browse/SPARK-46423 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45597: Assignee: Hyukjin Kwon (was: Allison Wang) > Support creating table using a Python data

[jira] [Assigned] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-45597: Assignee: Allison Wang > Support creating table using a Python data source in SQL >

[jira] [Resolved] (SPARK-45597) Support creating table using a Python data source in SQL

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-45597. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44305

[jira] [Resolved] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46409. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44360

[jira] [Assigned] (SPARK-46409) Spark Connect Repl does not work with ClosureCleaner

2023-12-15 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46409: Assignee: Vsevolod Stepanov > Spark Connect Repl does not work with ClosureCleaner >

[jira] [Resolved] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46402. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44349

[jira] [Assigned] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-14 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46402: Assignee: Hyukjin Kwon > Add getMessageParameters and getQueryContext support >

[jira] [Created] (SPARK-46402) Add getMessageParameters and getQueryContext support

2023-12-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46402: Summary: Add getMessageParameters and getQueryContext support Key: SPARK-46402 URL: https://issues.apache.org/jira/browse/SPARK-46402 Project: Spark Issue

[jira] [Created] (SPARK-46397) sha2(df.a, 1024) throws a different exception in Spark Connect

2023-12-13 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46397: Summary: sha2(df.a, 1024) throws a different exception in Spark Connect Key: SPARK-46397 URL: https://issues.apache.org/jira/browse/SPARK-46397 Project: Spark

[jira] [Assigned] (SPARK-46385) Test aggregate functions for groups (pyspark.sql.group)

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46385: Assignee: Xinrong Meng > Test aggregate functions for groups (pyspark.sql.group) >

[jira] [Resolved] (SPARK-46385) Test aggregate functions for groups (pyspark.sql.group)

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46385. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44322

[jira] [Resolved] (SPARK-46153) XML: Add TimestampNTZType support

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46153. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44329

[jira] [Assigned] (SPARK-46153) XML: Add TimestampNTZType support

2023-12-13 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46153: Assignee: Sandip Agarwala > XML: Add TimestampNTZType support >

[jira] [Resolved] (SPARK-46379) Reorganize `FrameInterpolateTests`

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46379. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44313

[jira] [Assigned] (SPARK-46379) Reorganize `FrameInterpolateTests`

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46379: Assignee: Ruifeng Zheng > Reorganize `FrameInterpolateTests` >

[jira] [Assigned] (SPARK-46253) Plan Python data source read using mapInArrow

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46253: Assignee: Allison Wang > Plan Python data source read using mapInArrow >

[jira] [Resolved] (SPARK-46253) Plan Python data source read using mapInArrow

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46253. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44170

[jira] [Resolved] (SPARK-46075) Refactor SparkConnectSessionManager to not use guava cache

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46075. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43985

[jira] [Assigned] (SPARK-46075) Refactor SparkConnectSessionManager to not use guava cache

2023-12-12 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46075: Assignee: Juliusz Sompolski > Refactor SparkConnectSessionManager to not use guava cache

[jira] [Assigned] (SPARK-46360) Enhance error message debugging with new `getMessage` API

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46360: Assignee: Haejoon Lee > Enhance error message debugging with new `getMessage` API >

[jira] [Resolved] (SPARK-46360) Enhance error message debugging with new `getMessage` API

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46360. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44292

[jira] [Assigned] (SPARK-43427) Unsigned integer types are deserialized as signed numeric equivalents

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-43427: Assignee: Parth Upadhyay > Unsigned integer types are deserialized as signed numeric

[jira] [Resolved] (SPARK-43427) Unsigned integer types are deserialized as signed numeric equivalents

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-43427. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 43773

[jira] [Resolved] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46273. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44213

[jira] [Assigned] (SPARK-46273) Support INSERT INTO/OVERWRITE using DSv2 sources

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46273: Assignee: Allison Wang > Support INSERT INTO/OVERWRITE using DSv2 sources >

[jira] [Resolved] (SPARK-46347) Reorganize `RollingTests `

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46347. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44281

[jira] [Assigned] (SPARK-46347) Reorganize `RollingTests `

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46347: Assignee: Ruifeng Zheng > Reorganize `RollingTests ` > -- > >

[jira] [Resolved] (SPARK-46355) XML: Close InputStreamReader on read completion

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46355. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44287

[jira] [Assigned] (SPARK-46355) XML: Close InputStreamReader on read completion

2023-12-11 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46355: Assignee: Sandip Agarwala > XML: Close InputStreamReader on read completion >

[jira] [Resolved] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46337. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44268

[jira] [Assigned] (SPARK-46337) Make `CTESubstitution` retain the PLAN_ID_TAG

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46337: Assignee: Ruifeng Zheng > Make `CTESubstitution` retain the PLAN_ID_TAG >

[jira] [Resolved] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46327. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44257

[jira] [Assigned] (SPARK-46327) Reorganize `SeriesStringTests`

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46327: Assignee: Ruifeng Zheng > Reorganize `SeriesStringTests` >

[jira] [Assigned] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46326: Assignee: Hyukjin Kwon > Test missing cases for functions (pyspark.sql.functions) >

[jira] [Resolved] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46326. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44256

[jira] [Assigned] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46323: Assignee: Hyukjin Kwon > Fix the output name of pyspark.sql.functions.now >

[jira] [Resolved] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-08 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46323. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44252

[jira] [Resolved] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46275. -- Assignee: Raghu Angadi Resolution: Fixed Fixed in

[jira] [Created] (SPARK-46326) Test missing cases for functions (pyspark.sql.functions)

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46326: Summary: Test missing cases for functions (pyspark.sql.functions) Key: SPARK-46326 URL: https://issues.apache.org/jira/browse/SPARK-46326 Project: Spark

[jira] [Created] (SPARK-46324) Fix the output name of pyspark.sql.functions.user and session_user

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46324: Summary: Fix the output name of pyspark.sql.functions.user and session_user Key: SPARK-46324 URL: https://issues.apache.org/jira/browse/SPARK-46324 Project: Spark

[jira] [Created] (SPARK-46323) Fix the output name of pyspark.sql.functions.now

2023-12-07 Thread Hyukjin Kwon (Jira)
Hyukjin Kwon created SPARK-46323: Summary: Fix the output name of pyspark.sql.functions.now Key: SPARK-46323 URL: https://issues.apache.org/jira/browse/SPARK-46323 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46317. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44247

[jira] [Assigned] (SPARK-46317) Test missing cases for SparkSession (pyspark.sql.session)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46317: Assignee: Hyukjin Kwon > Test missing cases for SparkSession (pyspark.sql.session) >

[jira] [Assigned] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46315: Assignee: Hyukjin Kwon > Test invalid key for spark.conf.get (pyspark.sql.conf) >

[jira] [Resolved] (SPARK-46315) Test invalid key for spark.conf.get (pyspark.sql.conf)

2023-12-07 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46315. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44245

<    3   4   5   6   7   8   9   10   11   12   >