[jira] [Updated] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46747: --- Labels: pull-request-available (was: ) > Too Many Shared Locks due to

[jira] [Resolved] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-46905. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44935

[jira] [Assigned] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-46905: --- Assignee: Wenchen Fan > Add dedicated class to keep column definition instead of

[jira] [Resolved] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46893. --- Fix Version/s: 3.4.3 3.5.1 4.0.0 Resolution:

[jira] [Assigned] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46893: - Assignee: Willi Raschkowski > Remove inline scripts from UI descriptions >

[jira] [Commented] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812165#comment-17812165 ] Dongjoon Hyun commented on SPARK-46893: --- Thank you for pinging me, [~rshkv]. > Remove inline

[jira] [Updated] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46876: --- Labels: pull-request-available (was: ) > Data is silently lost in Tab separated CSV with

[jira] [Resolved] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46914. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44944

[jira] [Assigned] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46914: - Assignee: Kent Yao > Shorten app name in the summary table on the History Page >

[jira] [Resolved] (SPARK-46916) Clean up the imports in pyspark.pandas.tests.indexes.*

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46916. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44945

[jira] [Updated] (SPARK-46916) Clean up the imports in pyspark.pandas.tests.indexes.*

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46916: --- Labels: pull-request-available (was: ) > Clean up the imports in

[jira] [Updated] (SPARK-46916) Clean up the imports in pyspark.pandas.tests.indexes.*

2024-01-29 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-46916: -- Summary: Clean up the imports in pyspark.pandas.tests.indexes.* (was:

[jira] [Updated] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-46914: - Priority: Minor (was: Major) > Shorten app name in the summary table on the History Page >

[jira] [Commented] (SPARK-46747) Too Many Shared Locks due to PostgresDialect.getTableExistsQuery - LIMIT 1

2024-01-29 Thread Kent Yao (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812135#comment-17812135 ] Kent Yao commented on SPARK-46747: -- It would be better if you could provide the stats of # of shared

[jira] [Updated] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46914: --- Labels: pull-request-available (was: ) > Shorten app name in the summary table on the

[jira] [Updated] (SPARK-46912) Spark-submit in cluster mode with standalone cluster uses wrong JAVA_HOME path

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46912: --- Labels: pull-request-available (was: ) > Spark-submit in cluster mode with standalone

[jira] [Updated] (SPARK-46915) Simplify `UnaryMinus` and align error class

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46915: --- Labels: pull-request-available (was: ) > Simplify `UnaryMinus` and align error class >

[jira] [Created] (SPARK-46915) Simplify `UnaryMinus` and align error class

2024-01-29 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-46915: --- Summary: Simplify `UnaryMinus` and align error class Key: SPARK-46915 URL: https://issues.apache.org/jira/browse/SPARK-46915 Project: Spark Issue Type:

[jira] [Created] (SPARK-46914) Shorten app name in the summary table on the History Page

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46914: Summary: Shorten app name in the summary table on the History Page Key: SPARK-46914 URL: https://issues.apache.org/jira/browse/SPARK-46914 Project: Spark Issue

[jira] [Comment Edited] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han edited comment on SPARK-46876 at 1/30/24 3:01 AM: -- {{The reason is that

[jira] [Comment Edited] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han edited comment on SPARK-46876 at 1/30/24 3:00 AM: -- {{The reason is that

[jira] [Comment Edited] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han edited comment on SPARK-46876 at 1/30/24 3:00 AM: -- {{The reason is that

[jira] [Created] (SPARK-46912) Spark-submit in cluster mode with standalone cluster uses wrong JAVA_HOME path

2024-01-29 Thread Danh Pham (Jira)
Danh Pham created SPARK-46912: - Summary: Spark-submit in cluster mode with standalone cluster uses wrong JAVA_HOME path Key: SPARK-46912 URL: https://issues.apache.org/jira/browse/SPARK-46912 Project:

[jira] [Comment Edited] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han edited comment on SPARK-46876 at 1/30/24 2:26 AM: -- {{The reason is that

[jira] [Resolved] (SPARK-46736) Retain empty protobuf message in schema for rpotobuf connector

2024-01-29 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-46736. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44643

[jira] [Assigned] (SPARK-46736) Retain empty protobuf message in schema for rpotobuf connector

2024-01-29 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-46736: Assignee: Chaoqin Li > Retain empty protobuf message in schema for rpotobuf connector >

[jira] [Commented] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han commented on SPARK-46876: - {{The reason is that before parsing the csv lines spark calls

[jira] [Comment Edited] (SPARK-46876) Data is silently lost in Tab separated CSV with empty (whitespace) rows

2024-01-29 Thread Jie Han (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812098#comment-17812098 ] Jie Han edited comment on SPARK-46876 at 1/30/24 1:24 AM: -- {{The reason is that

[jira] [Resolved] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-46910. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44940

[jira] [Assigned] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-46910: Assignee: Amanda Liu > Eliminate JDK Requirement in PySpark Installation >

[jira] [Created] (SPARK-46911) Add deleteIfExists operator to StatefulProcessorHandle

2024-01-29 Thread Eric Marnadi (Jira)
Eric Marnadi created SPARK-46911: Summary: Add deleteIfExists operator to StatefulProcessorHandle Key: SPARK-46911 URL: https://issues.apache.org/jira/browse/SPARK-46911 Project: Spark Issue

[jira] [Updated] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46910: --- Labels: pull-request-available (was: ) > Eliminate JDK Requirement in PySpark Installation

[jira] [Created] (SPARK-46910) Eliminate JDK Requirement in PySpark Installation

2024-01-29 Thread Amanda Liu (Jira)
Amanda Liu created SPARK-46910: -- Summary: Eliminate JDK Requirement in PySpark Installation Key: SPARK-46910 URL: https://issues.apache.org/jira/browse/SPARK-46910 Project: Spark Issue Type:

[jira] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890 ] Daniel deleted comment on SPARK-46890: was (Author: JIRAUSER285772): I think this `tokenIndexArr` within Spark's `UnivocityParser` class has different values in the passing and failing cases:

[jira] [Updated] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46890: --- Labels: pull-request-available (was: ) > CSV fails on a column with default and without

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812072#comment-17812072 ] Daniel commented on SPARK-46890: [~maxgekk] I created a bug fix here:

[jira] [Resolved] (SPARK-46907) Show driver log location in Spark History Server

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46907. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44936

[jira] [Comment Edited] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812059#comment-17812059 ] Daniel edited comment on SPARK-46890 at 1/29/24 9:27 PM: - I think this

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812059#comment-17812059 ] Daniel commented on SPARK-46890: I think this `tokenIndexArr` within Spark's `UnivocityParser` class has

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812058#comment-17812058 ] Daniel commented on SPARK-46890: The bug happens when the Univocity parser is converting the parsed

[jira] [Updated] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel updated SPARK-46890: --- Attachment: image-2024-01-29-13-22-05-326.png > CSV fails on a column with default and without enforcing

[jira] [Resolved] (SPARK-46687) Implement memory-profiler

2024-01-29 Thread Takuya Ueshin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-46687. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44775

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812051#comment-17812051 ] Daniel commented on SPARK-46890: The exception comes from here:

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812047#comment-17812047 ] Daniel commented on SPARK-46890: Thanks [~maxgekk] both of the above tests reproduce the bug now. I will

[jira] [Updated] (SPARK-46908) Extend SELECT * support outside of select list

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46908: --- Labels: SQL pull-request-available (was: SQL) > Extend SELECT * support outside of select

[jira] [Updated] (SPARK-46909) Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21

2024-01-29 Thread Johnny Sohn (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johnny Sohn updated SPARK-46909: Affects Version/s: 3.5.0 > Could not initialize class

[jira] [Created] (SPARK-46909) Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21

2024-01-29 Thread Johnny Sohn (Jira)
Johnny Sohn created SPARK-46909: --- Summary: Could not initialize class org.apache.spark.unsafe.array.ByteArrayMethods error in JDK 21 Key: SPARK-46909 URL: https://issues.apache.org/jira/browse/SPARK-46909

[jira] [Comment Edited] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812044#comment-17812044 ] Max Gekk edited comment on SPARK-46890 at 1/29/24 8:29 PM: --- [~dtenedor] Need

[jira] [Created] (SPARK-46908) Extend SELECT * support outside of select list

2024-01-29 Thread Serge Rielau (Jira)
Serge Rielau created SPARK-46908: Summary: Extend SELECT * support outside of select list Key: SPARK-46908 URL: https://issues.apache.org/jira/browse/SPARK-46908 Project: Spark Issue Type:

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812044#comment-17812044 ] Max Gekk commented on SPARK-46890: -- [~dtenedor] Need to trigger the column pruning feature but your

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812040#comment-17812040 ] Daniel commented on SPARK-46890: I tried the exact command in the bug description, and it doesn't cause

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812034#comment-17812034 ] Daniel commented on SPARK-46890: This unit test does not seem to reproduce the problem:   {code:java}

[jira] [Comment Edited] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812034#comment-17812034 ] Daniel edited comment on SPARK-46890 at 1/29/24 7:31 PM: - This unit test does

[jira] [Updated] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46905: --- Labels: pull-request-available (was: ) > Add dedicated class to keep column definition

[jira] [Assigned] (SPARK-46907) Show driver log location in Spark History Server

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46907: - Assignee: Dongjoon Hyun > Show driver log location in Spark History Server >

[jira] [Updated] (SPARK-46907) Show driver log location in Spark History Server

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46907: --- Labels: pull-request-available (was: ) > Show driver log location in Spark History Server

[jira] [Created] (SPARK-46907) Show driver log location in Spark History Server

2024-01-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46907: - Summary: Show driver log location in Spark History Server Key: SPARK-46907 URL: https://issues.apache.org/jira/browse/SPARK-46907 Project: Spark Issue

[jira] [Commented] (SPARK-46890) CSV fails on a column with default and without enforcing schema

2024-01-29 Thread Daniel (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17812002#comment-17812002 ] Daniel commented on SPARK-46890: Thanks [~maxgekk] for writing down the details here. It looks like this

[jira] [Created] (SPARK-46905) Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command

2024-01-29 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-46905: --- Summary: Add dedicated class to keep column definition instead of StructField in Create/ReplaceTable command Key: SPARK-46905 URL: https://issues.apache.org/jira/browse/SPARK-46905

[jira] [Resolved] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46904. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44934

[jira] [Assigned] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46904: - Assignee: Kent Yao > Fix wrong display of History UI summary >

[jira] [Updated] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46904: -- Parent: SPARK-46001 Issue Type: Sub-task (was: Bug) > Fix wrong display of History

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-29 Thread Nicholas Chammas (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811923#comment-17811923 ] Nicholas Chammas commented on SPARK-46810: -- I think Option 3 is a good compromise that lets us

[jira] [Assigned] (SPARK-46831) Extend StringType and PhysicalStringType with collation id

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-46831: Assignee: Aleksandar Tomic > Extend StringType and PhysicalStringType with collation id >

[jira] [Resolved] (SPARK-46831) Extend StringType and PhysicalStringType with collation id

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-46831. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44901

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811858#comment-17811858 ] Max Gekk commented on SPARK-46810: -- [~cloud_fan] [~LuciferYang] [~beliefer] [~dongjoon] WDYT? >

[jira] [Commented] (SPARK-46810) Clarify error class terminology

2024-01-29 Thread Max Gekk (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811856#comment-17811856 ] Max Gekk commented on SPARK-46810: -- Correct me if I am wrong but the SQL standard says about classes

[jira] [Comment Edited] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811850#comment-17811850 ] Willi Raschkowski edited comment on SPARK-46893 at 1/29/24 12:15 PM: -

[jira] [Commented] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17811850#comment-17811850 ] Willi Raschkowski commented on SPARK-46893: --- [~dongjoon], for your awareness as PMC who's

[jira] [Updated] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46904: --- Labels: pull-request-available (was: ) > Fix wrong display of History UI summary >

[jira] [Created] (SPARK-46904) Fix wrong display of History UI summary

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46904: Summary: Fix wrong display of History UI summary Key: SPARK-46904 URL: https://issues.apache.org/jira/browse/SPARK-46904 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-46903) Support Spark History Server Log UI

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46903. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44932

[jira] [Updated] (SPARK-46902) Fix Spark History Server UI for using un-exported setAppLimit

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-46902: -- Summary: Fix Spark History Server UI for using un-exported setAppLimit (was: Fix Spark

[jira] [Resolved] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-46902. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 44931

[jira] [Assigned] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46902: - Assignee: Kent Yao > Fix Spark History Server UI > > >

[jira] [Updated] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46893: --- Labels: pull-request-available (was: ) > Remove inline scripts from UI descriptions >

[jira] [Updated] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-46893: -- Description: Users can inject inline scripts (e.g. {{onclick}} or {{onmouseover}}

[jira] [Updated] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-46893: -- Description: Users can inject inline scripts (e.g. {{onclick}} or {{onmouseover}}

[jira] [Updated] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-46893: -- Attachment: Screenshot 2024-01-29 at 09.06.34.png > Remove inline scripts from UI

[jira] [Updated] (SPARK-46893) Remove inline scripts from UI descriptions

2024-01-29 Thread Willi Raschkowski (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Willi Raschkowski updated SPARK-46893: -- Summary: Remove inline scripts from UI descriptions (was: Sanitize UI descriptions

[jira] [Assigned] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46902: -- Assignee: (was: Apache Spark) > Fix Spark History Server UI >

[jira] [Assigned] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot reassigned SPARK-46902: -- Assignee: Apache Spark > Fix Spark History Server UI >

[jira] [Assigned] (SPARK-46903) Support Spark History Server Log UI

2024-01-29 Thread Dongjoon Hyun (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-46903: - Assignee: Dongjoon Hyun > Support Spark History Server Log UI >

[jira] [Updated] (SPARK-46903) Support Spark History Server Log UI

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46903: --- Labels: pull-request-available (was: ) > Support Spark History Server Log UI >

[jira] [Created] (SPARK-46903) Support Spark History Server Log UI

2024-01-29 Thread Dongjoon Hyun (Jira)
Dongjoon Hyun created SPARK-46903: - Summary: Support Spark History Server Log UI Key: SPARK-46903 URL: https://issues.apache.org/jira/browse/SPARK-46903 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-46902: --- Labels: pull-request-available (was: ) > Fix Spark History Server UI >

[jira] [Created] (SPARK-46902) Fix Spark History Server UI

2024-01-29 Thread Kent Yao (Jira)
Kent Yao created SPARK-46902: Summary: Fix Spark History Server UI Key: SPARK-46902 URL: https://issues.apache.org/jira/browse/SPARK-46902 Project: Spark Issue Type: Sub-task