[jira] [Created] (SPARK-47867) Support Variant in JSON scan.

2024-04-15 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47867: -- Summary: Support Variant in JSON scan. Key: SPARK-47867 URL: https://issues.apache.org/jira/browse/SPARK-47867 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47803) Support cast to variant.

2024-04-10 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47803: -- Summary: Support cast to variant. Key: SPARK-47803 URL: https://issues.apache.org/jira/browse/SPARK-47803 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47775) Support remaining scalar types in the variant spec.

2024-04-08 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47775: -- Summary: Support remaining scalar types in the variant spec. Key: SPARK-47775 URL: https://issues.apache.org/jira/browse/SPARK-47775 Project: Spark Issue Type:

[jira] [Created] (SPARK-47769) Add schema_of_variant_agg expression.

2024-04-08 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47769: -- Summary: Add schema_of_variant_agg expression. Key: SPARK-47769 URL: https://issues.apache.org/jira/browse/SPARK-47769 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47681) Add schema_of_variant expression.

2024-04-02 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-47681: --- Summary: Add schema_of_variant expression. (was: Add variant_schema expression.) > Add

[jira] [Created] (SPARK-47682) Support cast from variant.

2024-04-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47682: -- Summary: Support cast from variant. Key: SPARK-47682 URL: https://issues.apache.org/jira/browse/SPARK-47682 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47681) Add variant_schema expression.

2024-04-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47681: -- Summary: Add variant_schema expression. Key: SPARK-47681 URL: https://issues.apache.org/jira/browse/SPARK-47681 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47572) Enforce Window partitionSpec is orderable.

2024-03-26 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47572: -- Summary: Enforce Window partitionSpec is orderable. Key: SPARK-47572 URL: https://issues.apache.org/jira/browse/SPARK-47572 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-47569) Disallow comparing variant.

2024-03-26 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47569: -- Summary: Disallow comparing variant. Key: SPARK-47569 URL: https://issues.apache.org/jira/browse/SPARK-47569 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47551) Add variant_get expression.

2024-03-25 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47551: -- Summary: Add variant_get expression. Key: SPARK-47551 URL: https://issues.apache.org/jira/browse/SPARK-47551 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-47451) Support to_json(variant)

2024-03-18 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47451: -- Summary: Support to_json(variant) Key: SPARK-47451 URL: https://issues.apache.org/jira/browse/SPARK-47451 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-47385) Tuple encoder produces wrong results with Option inputs

2024-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-47385: --- Summary: Tuple encoder produces wrong results with Option inputs (was: Tupled Encoders fail to

[jira] [Updated] (SPARK-47385) Tupled Encoders fail to handle Option parameters

2024-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-47385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-47385: --- Summary: Tupled Encoders fail to handle Option parameters (was: Tupled Encoders don't handle

[jira] [Created] (SPARK-47385) Tupled Encoders don't handle Option parameters

2024-03-13 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47385: -- Summary: Tupled Encoders don't handle Option parameters Key: SPARK-47385 URL: https://issues.apache.org/jira/browse/SPARK-47385 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-47366) Implement parse_json

2024-03-12 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-47366: -- Summary: Implement parse_json Key: SPARK-47366 URL: https://issues.apache.org/jira/browse/SPARK-47366 Project: Spark Issue Type: Sub-task Components:

[jira] [Updated] (SPARK-45827) Add Variant data type in Spark

2023-11-10 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-45827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-45827: --- Summary: Add Variant data type in Spark (was: Add variant data type in Spark) > Add Variant data

[jira] [Created] (SPARK-45891) Support Variant data type

2023-11-10 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-45891: -- Summary: Support Variant data type Key: SPARK-45891 URL: https://issues.apache.org/jira/browse/SPARK-45891 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-45827) Add variant data type in Spark

2023-11-07 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-45827: -- Summary: Add variant data type in Spark Key: SPARK-45827 URL: https://issues.apache.org/jira/browse/SPARK-45827 Project: Spark Issue Type: New Feature

[jira] [Updated] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42775: --- Description: In the {{approx_percentile}} expression, Spark casts decimal to double to update the

[jira] [Updated] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42775: --- Description: In the {{approx_percentile}} expression, Spark casts decimal to double to update the

[jira] [Created] (SPARK-42775) approx_percentile produces wrong results for large decimals.

2023-03-13 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42775: -- Summary: approx_percentile produces wrong results for large decimals. Key: SPARK-42775 URL: https://issues.apache.org/jira/browse/SPARK-42775 Project: Spark

[jira] [Updated] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42634: --- Description: (was: # When the time is close to daylight saving time transition, the result may

[jira] [Closed] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li closed SPARK-42634. -- This is a duplicate, created by mistake. > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Resolved] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li resolved SPARK-42634. Resolution: Fixed duplicate > Several counter-intuitive behaviours in the TimestampAdd

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: SQL (was: Spark Core) > Several counter-intuitive behaviours in

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Component/s: (was: SQL) > Several counter-intuitive behaviours in the TimestampAdd expression >

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Updated] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenhao Li updated SPARK-42635: --- Description: # When the time is close to daylight saving time transition, the result may be

[jira] [Created] (SPARK-42635) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42635: -- Summary: Several counter-intuitive behaviours in the TimestampAdd expression Key: SPARK-42635 URL: https://issues.apache.org/jira/browse/SPARK-42635 Project: Spark

[jira] [Created] (SPARK-42634) Several counter-intuitive behaviours in the TimestampAdd expression

2023-03-01 Thread Chenhao Li (Jira)
Chenhao Li created SPARK-42634: -- Summary: Several counter-intuitive behaviours in the TimestampAdd expression Key: SPARK-42634 URL: https://issues.apache.org/jira/browse/SPARK-42634 Project: Spark