[jira] [Created] (SPARK-48253) Support default mode for Pandas API on Spark

2024-05-13 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-48253: --- Summary: Support default mode for Pandas API on Spark Key: SPARK-48253 URL: https://issues.apache.org/jira/browse/SPARK-48253 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-48183) Update error contribution guide to respect new error class file

2024-05-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-48183: --- Summary: Update error contribution guide to respect new error class file Key: SPARK-48183 URL: https://issues.apache.org/jira/browse/SPARK-48183 Project: Spark

[jira] [Created] (SPARK-47948) Bump Pandas to 2.0.0

2024-04-23 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47948: --- Summary: Bump Pandas to 2.0.0 Key: SPARK-47948 URL: https://issues.apache.org/jira/browse/SPARK-47948 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-47864) Enhance "Installation" page to cover all installable options

2024-04-15 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47864: --- Summary: Enhance "Installation" page to cover all installable options Key: SPARK-47864 URL: https://issues.apache.org/jira/browse/SPARK-47864 Project: Spark

[jira] [Created] (SPARK-47858) Refactoring the structure for DataFrame error context

2024-04-15 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47858: --- Summary: Refactoring the structure for DataFrame error context Key: SPARK-47858 URL: https://issues.apache.org/jira/browse/SPARK-47858 Project: Spark Issue

[jira] [Created] (SPARK-47852) Support DataFrameQueryContext for reverse operations

2024-04-14 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47852: --- Summary: Support DataFrameQueryContext for reverse operations Key: SPARK-47852 URL: https://issues.apache.org/jira/browse/SPARK-47852 Project: Spark Issue

[jira] [Created] (SPARK-47827) Missing warnings for deprecated features

2024-04-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47827: --- Summary: Missing warnings for deprecated features Key: SPARK-47827 URL: https://issues.apache.org/jira/browse/SPARK-47827 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-47591) Hive-thriftserver: Migrate logInfo with variables to structured logging framework

2024-04-08 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17834828#comment-17834828 ] Haejoon Lee commented on SPARK-47591: - I'm working on this :)  > Hive-thriftserver: Migrate logInfo

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

2024-04-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47737: Description: For more rich API support (was: Use the latest version for stability.) > Bump

[jira] [Updated] (SPARK-47737) Bump PyArrow to 10.0.0

2024-04-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47737: Summary: Bump PyArrow to 10.0.0 (was: Bump PyArrow to 15.0.2) > Bump PyArrow to 10.0.0 >

[jira] (SPARK-47580) SQL catalyst: Migrate logError with variables to structured logging framework

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47580 ] Haejoon Lee deleted comment on SPARK-47580: - was (Author: itholic): I'm working on this :)  > SQL catalyst: Migrate logError with variables to structured logging framework >

[jira] [Commented] (SPARK-47580) SQL catalyst: Migrate logError with variables to structured logging framework

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833368#comment-17833368 ] Haejoon Lee commented on SPARK-47580: - I'm working on this :)  > SQL catalyst: Migrate logError

[jira] [Commented] (SPARK-47240) SPIP: Structured Logging Framework for Apache Spark

2024-04-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17833367#comment-17833367 ] Haejoon Lee commented on SPARK-47240: - Thanks [~Gengliang.Wang] and [~panbingkun] for working on

[jira] [Created] (SPARK-47543) Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation.

2024-03-25 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47543: --- Summary: Inferring `dict` as `MapType` from Pandas DataFrame to allow DataFrame creation. Key: SPARK-47543 URL: https://issues.apache.org/jira/browse/SPARK-47543

[jira] [Commented] (SPARK-44101) Support pandas 2

2024-03-19 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-44101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828607#comment-17828607 ] Haejoon Lee commented on SPARK-44101: - Got it. Thanks for the notice, [~dongjoon] ! > Support

[jira] [Created] (SPARK-47338) Introduce `_LEGACY_ERROR_UNKNOWN` for default error class

2024-03-11 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47338: --- Summary: Introduce `_LEGACY_ERROR_UNKNOWN` for default error class Key: SPARK-47338 URL: https://issues.apache.org/jira/browse/SPARK-47338 Project: Spark

[jira] [Created] (SPARK-47274) Provide more useful context for PySpark DataFrame API errors

2024-03-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47274: --- Summary: Provide more useful context for PySpark DataFrame API errors Key: SPARK-47274 URL: https://issues.apache.org/jira/browse/SPARK-47274 Project: Spark

[jira] [Created] (SPARK-47179) Improve error message from SparkThrowableSuite for better debuggability

2024-02-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47179: --- Summary: Improve error message from SparkThrowableSuite for better debuggability Key: SPARK-47179 URL: https://issues.apache.org/jira/browse/SPARK-47179 Project: Spark

[jira] [Updated] (SPARK-47158) Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231

2024-02-25 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-47158: Summary: Assign proper name and sqlState to _LEGACY_ERROR_TEMP_2134 & 2231 (was: Assign proper

[jira] [Created] (SPARK-47158) Assign proper name to top LEGACY errors

2024-02-25 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-47158: --- Summary: Assign proper name to top LEGACY errors Key: SPARK-47158 URL: https://issues.apache.org/jira/browse/SPARK-47158 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-46809) Check error message parameter properly

2024-02-21 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-46809. - Resolution: Not A Bug Seems to be working fine > Check error message parameter properly >

[jira] [Created] (SPARK-46927) Make `assertDataFrameEqual` work properly without PyArrow

2024-01-30 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46927: --- Summary: Make `assertDataFrameEqual` work properly without PyArrow Key: SPARK-46927 URL: https://issues.apache.org/jira/browse/SPARK-46927 Project: Spark

[jira] [Created] (SPARK-46874) Remove pyspark.pandas dependency from assertDataFrameEqual

2024-01-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46874: --- Summary: Remove pyspark.pandas dependency from assertDataFrameEqual Key: SPARK-46874 URL: https://issues.apache.org/jira/browse/SPARK-46874 Project: Spark

[jira] [Created] (SPARK-46824) Enable test without optional dependency on PyPy

2024-01-23 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46824: --- Summary: Enable test without optional dependency on PyPy Key: SPARK-46824 URL: https://issues.apache.org/jira/browse/SPARK-46824 Project: Spark Issue Type:

[jira] [Updated] (SPARK-46820) Fix error message regression by restoring new_msg

2024-01-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46820: Description: >>> from pyspark.sql.types import StructType, StructField, StringType, >>>

[jira] [Updated] (SPARK-46820) Fix error message regression by restoring new_msg

2024-01-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46820: Summary: Fix error message regression by restoring new_msg (was: Improve error message when

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17810156#comment-17810156 ] Haejoon Lee commented on SPARK-46810: - cc [~maxgekk] who drives SQL side error message improvement

[jira] [Resolved] (SPARK-46821) Remove pandas dependency from assertDataFrameEqual properly

2024-01-23 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-46821. - Resolution: Fixed > Remove pandas dependency from assertDataFrameEqual properly >

[jira] [Created] (SPARK-46821) Remove pandas dependency from assertDataFrameEqual properly

2024-01-23 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46821: --- Summary: Remove pandas dependency from assertDataFrameEqual properly Key: SPARK-46821 URL: https://issues.apache.org/jira/browse/SPARK-46821 Project: Spark

[jira] [Created] (SPARK-46820) Improve error message when createDataFrame have illegal nullable

2024-01-23 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46820: --- Summary: Improve error message when createDataFrame have illegal nullable Key: SPARK-46820 URL: https://issues.apache.org/jira/browse/SPARK-46820 Project: Spark

[jira] [Updated] (SPARK-46809) Check error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46809: Description: If error message parameter from template is missing in actual usage or the name is

[jira] [Updated] (SPARK-46809) Check error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46809: Summary: Check error message parameter properly (was: Check missing error message parameter

[jira] [Created] (SPARK-46809) Check missing error message parameter properly

2024-01-22 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46809: --- Summary: Check missing error message parameter properly Key: SPARK-46809 URL: https://issues.apache.org/jira/browse/SPARK-46809 Project: Spark Issue Type:

[jira] [Created] (SPARK-46728) Check pandas installation properly

2024-01-15 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46728: --- Summary: Check pandas installation properly Key: SPARK-46728 URL: https://issues.apache.org/jira/browse/SPARK-46728 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46665) Remove assertPandasOnSparkEqual

2024-01-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46665: Summary: Remove assertPandasOnSparkEqual (was: Remove Pandas dependency for pyspark.testing) >

[jira] [Updated] (SPARK-46665) Remove assertPandasOnSparkEqual

2024-01-11 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46665: Description: Remove deprecated API (was: We should not make pyspark.testing depending on

[jira] [Resolved] (SPARK-46642) Add `getMessageTemplate` to PySpark error framework

2024-01-10 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee resolved SPARK-46642. - Resolution: Won't Fix > Add `getMessageTemplate` to PySpark error framework >

[jira] [Created] (SPARK-46665) Remove Pandas dependency for pyspark.testing

2024-01-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46665: --- Summary: Remove Pandas dependency for pyspark.testing Key: SPARK-46665 URL: https://issues.apache.org/jira/browse/SPARK-46665 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46642) Add `getMessageTemplate` to PySpark error framework

2024-01-09 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46642: --- Summary: Add `getMessageTemplate` to PySpark error framework Key: SPARK-46642 URL: https://issues.apache.org/jira/browse/SPARK-46642 Project: Spark Issue

[jira] [Created] (SPARK-46583) Refine getMessage for Spark Connect

2024-01-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46583: --- Summary: Refine getMessage for Spark Connect Key: SPARK-46583 URL: https://issues.apache.org/jira/browse/SPARK-46583 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46571) Re-enable TODOs that are resolved from recent Pandas

2024-01-02 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46571: --- Summary: Re-enable TODOs that are resolved from recent Pandas Key: SPARK-46571 URL: https://issues.apache.org/jira/browse/SPARK-46571 Project: Spark Issue

[jira] [Created] (SPARK-46553) FutureWarning for interpolate with object dtype

2024-01-01 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46553: --- Summary: FutureWarning for interpolate with object dtype Key: SPARK-46553 URL: https://issues.apache.org/jira/browse/SPARK-46553 Project: Spark Issue Type:

[jira] [Created] (SPARK-46360) Enhance error message debugging with new `getMessage` API

2023-12-10 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46360: --- Summary: Enhance error message debugging with new `getMessage` API Key: SPARK-46360 URL: https://issues.apache.org/jira/browse/SPARK-46360 Project: Spark

[jira] [Created] (SPARK-46338) Re-enable the get_item test for BasicIndexingTests

2023-12-08 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46338: --- Summary: Re-enable the get_item test for BasicIndexingTests Key: SPARK-46338 URL: https://issues.apache.org/jira/browse/SPARK-46338 Project: Spark Issue Type:

[jira] [Created] (SPARK-46322) Replace external link with internal link for error documentation

2023-12-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46322: --- Summary: Replace external link with internal link for error documentation Key: SPARK-46322 URL: https://issues.apache.org/jira/browse/SPARK-46322 Project: Spark

[jira] [Created] (SPARK-46321) Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug

2023-12-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46321: --- Summary: Re-ennable IndexesTests.test_asof that was skipped due to Pandas bug Key: SPARK-46321 URL: https://issues.apache.org/jira/browse/SPARK-46321 Project: Spark

[jira] [Created] (SPARK-46307) Enable `fill_value` tests for `GroupByTests.test_shift`

2023-12-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46307: --- Summary: Enable `fill_value` tests for `GroupByTests.test_shift` Key: SPARK-46307 URL: https://issues.apache.org/jira/browse/SPARK-46307 Project: Spark Issue

[jira] [Updated] (SPARK-46306) Fix `LocIndexer` to work properly when the key is missing

2023-12-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46306: Summary: Fix `LocIndexer` to work properly when the key is missing (was: Fix `LocIndexer` work

[jira] [Created] (SPARK-46306) Fix `LocIndexer` work properly when the key is missing

2023-12-07 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46306: --- Summary: Fix `LocIndexer` work properly when the key is missing Key: SPARK-46306 URL: https://issues.apache.org/jira/browse/SPARK-46306 Project: Spark Issue

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

2023-12-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Description: (was: Add missing required package for docs.) > Remove `protobuf` from required

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

2023-12-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Description: Remove `protobuf` from requirements.txt > Remove `protobuf` from required package. >

[jira] [Updated] (SPARK-46293) Remove `protobuf` from required package.

2023-12-07 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46293: Summary: Remove `protobuf` from required package. (was: Add protobuf to required dependency for

[jira] [Created] (SPARK-46293) Add protobuf to required dependency for Spark Connect

2023-12-06 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46293: --- Summary: Add protobuf to required dependency for Spark Connect Key: SPARK-46293 URL: https://issues.apache.org/jira/browse/SPARK-46293 Project: Spark Issue

[jira] [Updated] (SPARK-46112) Implement lint check for PySpark custom errors

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46112: Summary: Implement lint check for PySpark custom errors (was: Enforce usage of PySpark-specific

[jira] [Updated] (SPARK-46282) Create a Standalone Page for DataFrame API in PySpark Documentation

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46282: Summary: Create a Standalone Page for DataFrame API in PySpark Documentation (was: Create

[jira] [Updated] (SPARK-46282) Create a Standalone Page for DataFrame API in PySpark Documentation

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46282: Description: Previously, the DataFrame API content was nested under the Spark SQL section. This

[jira] [Created] (SPARK-46282) Create dedicated page for DataFrame API

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46282: --- Summary: Create dedicated page for DataFrame API Key: SPARK-46282 URL: https://issues.apache.org/jira/browse/SPARK-46282 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-46278) Re-organize `GroupByTests`

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46278: --- Summary: Re-organize `GroupByTests` Key: SPARK-46278 URL: https://issues.apache.org/jira/browse/SPARK-46278 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46269) Enable more NumPy compatibility function tests

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable more NumPy compatibility function tests (was: Enable more NumPy function tests)

[jira] [Updated] (SPARK-46269) Enable more NumPy function tests

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable more NumPy function tests (was: Enable NumPy function tests that marked as flaky

[jira] [Updated] (SPARK-46269) Enable NumPy function tests that marked as flaky before.

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46269: Summary: Enable NumPy function tests that marked as flaky before. (was: Enable more NumPy

[jira] [Created] (SPARK-46269) Enable more NumPy function tests

2023-12-05 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46269: --- Summary: Enable more NumPy function tests Key: SPARK-46269 URL: https://issues.apache.org/jira/browse/SPARK-46269 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46262) Enable test for np.left_shift for Pandas-on-Spark object.

2023-12-05 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46262: Summary: Enable test for np.left_shift for Pandas-on-Spark object. (was: Support `np.left_shift`

[jira] [Created] (SPARK-46262) Support `np.left_shift` for Pandas-on-Spark object.

2023-12-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46262: --- Summary: Support `np.left_shift` for Pandas-on-Spark object. Key: SPARK-46262 URL: https://issues.apache.org/jira/browse/SPARK-46262 Project: Spark Issue

[jira] [Created] (SPARK-46259) Add appropriate link for error class usage documentation.

2023-12-04 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46259: --- Summary: Add appropriate link for error class usage documentation. Key: SPARK-46259 URL: https://issues.apache.org/jira/browse/SPARK-46259 Project: Spark

[jira] [Updated] (SPARK-46213) Add PySparkImportError for error framework

2023-12-04 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46213: Parent: SPARK-45673 Issue Type: Sub-task (was: Bug) > Add PySparkImportError for error

[jira] [Updated] (SPARK-46226) Migrate all remaining RuntimeError into PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46226: Summary: Migrate all remaining RuntimeError into PySpark error framework (was: Migrate all

[jira] [Updated] (SPARK-46230) Migrate RetriesExceeded into PySpark error.

2023-12-03 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46230: Summary: Migrate RetriesExceeded into PySpark error. (was: Migrate RetriesExceeded and

[jira] [Created] (SPARK-46234) Introduce PySparkKeyError for PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46234: --- Summary: Introduce PySparkKeyError for PySpark error framework Key: SPARK-46234 URL: https://issues.apache.org/jira/browse/SPARK-46234 Project: Spark Issue

[jira] [Created] (SPARK-46233) Migrate all remaining ArrtibuteError into PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46233: --- Summary: Migrate all remaining ArrtibuteError into PySpark error framework Key: SPARK-46233 URL: https://issues.apache.org/jira/browse/SPARK-46233 Project: Spark

[jira] [Created] (SPARK-46232) Migrate all remaining ValueError into PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46232: --- Summary: Migrate all remaining ValueError into PySpark error framework Key: SPARK-46232 URL: https://issues.apache.org/jira/browse/SPARK-46232 Project: Spark

[jira] [Created] (SPARK-46231) Migrate all remaining NotImplementedError & TypeError into PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46231: --- Summary: Migrate all remaining NotImplementedError & TypeError into PySpark error framework Key: SPARK-46231 URL: https://issues.apache.org/jira/browse/SPARK-46231

[jira] [Created] (SPARK-46230) Migrate RetriesExceeded and RetryException into PySpark error.

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46230: --- Summary: Migrate RetriesExceeded and RetryException into PySpark error. Key: SPARK-46230 URL: https://issues.apache.org/jira/browse/SPARK-46230 Project: Spark

[jira] [Created] (SPARK-46226) Migrate all remaining RuntimeErrors into PySpark error framework

2023-12-03 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46226: --- Summary: Migrate all remaining RuntimeErrors into PySpark error framework Key: SPARK-46226 URL: https://issues.apache.org/jira/browse/SPARK-46226 Project: Spark

[jira] [Updated] (SPARK-46208) Adding a link for latest Pandas API specifications.

2023-12-02 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46208: Summary: Adding a link for latest Pandas API specifications. (was: Use specific Pandas version

[jira] [Created] (SPARK-46213) Add PySparkImportError for error framework

2023-12-02 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46213: --- Summary: Add PySparkImportError for error framework Key: SPARK-46213 URL: https://issues.apache.org/jira/browse/SPARK-46213 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-46208) Use specific Pandas version for API specifications

2023-12-01 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46208: Summary: Use specific Pandas version for API specifications (was: Use specific Pandas version

[jira] [Created] (SPARK-46208) Use specific Pandas version for API specifictations

2023-12-01 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46208: --- Summary: Use specific Pandas version for API specifictations Key: SPARK-46208 URL: https://issues.apache.org/jira/browse/SPARK-46208 Project: Spark Issue

[jira] [Created] (SPARK-46206) Use a narrower scope exception for SQL processor

2023-12-01 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46206: --- Summary: Use a narrower scope exception for SQL processor Key: SPARK-46206 URL: https://issues.apache.org/jira/browse/SPARK-46206 Project: Spark Issue Type:

[jira] [Created] (SPARK-46169) Assign appropriate JIRA numbers to unlabeled TODO items for DataFrame API.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46169: --- Summary: Assign appropriate JIRA numbers to unlabeled TODO items for DataFrame API. Key: SPARK-46169 URL: https://issues.apache.org/jira/browse/SPARK-46169 Project:

[jira] [Created] (SPARK-46168) Add axis parameter to DataFrame.idxmin & idxmax

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46168: --- Summary: Add axis parameter to DataFrame.idxmin & idxmax Key: SPARK-46168 URL: https://issues.apache.org/jira/browse/SPARK-46168 Project: Spark Issue Type:

[jira] [Created] (SPARK-46167) Add axis, pct and na_option parameter to DataFrame.rank

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46167: --- Summary: Add axis, pct and na_option parameter to DataFrame.rank Key: SPARK-46167 URL: https://issues.apache.org/jira/browse/SPARK-46167 Project: Spark Issue

[jira] [Created] (SPARK-46165) Improve axis parameter for DataFrame.all to support columns.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46165: --- Summary: Improve axis parameter for DataFrame.all to support columns. Key: SPARK-46165 URL: https://issues.apache.org/jira/browse/SPARK-46165 Project: Spark

[jira] [Created] (SPARK-46166) Add axis and skipna parameters to DataFrame.any

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46166: --- Summary: Add axis and skipna parameters to DataFrame.any Key: SPARK-46166 URL: https://issues.apache.org/jira/browse/SPARK-46166 Project: Spark Issue Type:

[jira] [Created] (SPARK-46164) Add include and exclude parameters for DataFrame.describe

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46164: --- Summary: Add include and exclude parameters for DataFrame.describe Key: SPARK-46164 URL: https://issues.apache.org/jira/browse/SPARK-46164 Project: Spark

[jira] [Created] (SPARK-46163) Add filter_func and errors parameter for DataFrame.update

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46163: --- Summary: Add filter_func and errors parameter for DataFrame.update Key: SPARK-46163 URL: https://issues.apache.org/jira/browse/SPARK-46163 Project: Spark

[jira] [Created] (SPARK-46160) Add freq and axis parameters to DataFrame.shift

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46160: --- Summary: Add freq and axis parameters to DataFrame.shift Key: SPARK-46160 URL: https://issues.apache.org/jira/browse/SPARK-46160 Project: Spark Issue Type:

[jira] [Created] (SPARK-46162) Improve axis parameter for DataFrame.nunique to support columns.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46162: --- Summary: Improve axis parameter for DataFrame.nunique to support columns. Key: SPARK-46162 URL: https://issues.apache.org/jira/browse/SPARK-46162 Project: Spark

[jira] [Created] (SPARK-46161) Improve axis parameter for DataFrame.diff to support columns.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46161: --- Summary: Improve axis parameter for DataFrame.diff to support columns. Key: SPARK-46161 URL: https://issues.apache.org/jira/browse/SPARK-46161 Project: Spark

[jira] [Created] (SPARK-46159) Improve axis parameter for DataFrame.at_time to support columns.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46159: --- Summary: Improve axis parameter for DataFrame.at_time to support columns. Key: SPARK-46159 URL: https://issues.apache.org/jira/browse/SPARK-46159 Project: Spark

[jira] [Created] (SPARK-46158) Improve axis parameter for DataFrame.xs to support columns.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46158: --- Summary: Improve axis parameter for DataFrame.xs to support columns. Key: SPARK-46158 URL: https://issues.apache.org/jira/browse/SPARK-46158 Project: Spark

[jira] [Created] (SPARK-46157) Add `axis` parameter for DataFrame.aggregate.

2023-11-28 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46157: --- Summary: Add `axis` parameter for DataFrame.aggregate. Key: SPARK-46157 URL: https://issues.apache.org/jira/browse/SPARK-46157 Project: Spark Issue Type:

[jira] [Created] (SPARK-46129) Add GitHub link icon to PySpark documentation header

2023-11-27 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46129: --- Summary: Add GitHub link icon to PySpark documentation header Key: SPARK-46129 URL: https://issues.apache.org/jira/browse/SPARK-46129 Project: Spark Issue

[jira] [Created] (SPARK-46123) Using brighter color for document title for better visibility

2023-11-27 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46123: --- Summary: Using brighter color for document title for better visibility Key: SPARK-46123 URL: https://issues.apache.org/jira/browse/SPARK-46123 Project: Spark

[jira] [Created] (SPARK-46117) Enhancing readability of PySpark API reference by hiding verbose typehints.

2023-11-26 Thread Haejoon Lee (Jira)
Haejoon Lee created SPARK-46117: --- Summary: Enhancing readability of PySpark API reference by hiding verbose typehints. Key: SPARK-46117 URL: https://issues.apache.org/jira/browse/SPARK-46117 Project:

[jira] [Updated] (SPARK-46116) Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage.

2023-11-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Description: It is aimed at improving user engagement and providing quick access to community

[jira] [Updated] (SPARK-46116) Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage.

2023-11-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Adding "Q Support" and "Mailing Lists" link into PySpark doc homepage. (was: Enriching

[jira] [Updated] (SPARK-46116) Enriching PySpark doc with "Useful links" including Q Support and Mailing Lists

2023-11-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching PySpark doc with "Useful links" including Q Support and Mailing Lists (was:

[jira] [Updated] (SPARK-46116) Enriching "Useful links" on PySpark docs including "Q Support" and "Mailing Lists"

2023-11-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching "Useful links" on PySpark docs including "Q Support" and "Mailing Lists"

[jira] [Updated] (SPARK-46116) Enriching PySpark doc with "Useful links" Including Q Support and Mailing Lists

2023-11-26 Thread Haejoon Lee (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haejoon Lee updated SPARK-46116: Summary: Enriching PySpark doc with "Useful links" Including Q Support and Mailing Lists (was:

  1   2   3   4   5   6   7   8   9   10   >