[jira] [Resolved] (SPARK-47531) Upgrade Arrow to 15.0.2
[ https://issues.apache.org/jira/browse/SPARK-47531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47531. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45682 [https://github.com/apache/spark/pull/45682] > Upgrade Arrow to 15.0.2 > --- > > Key: SPARK-47531 > URL: https://issues.apache.org/jira/browse/SPARK-47531 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47497: - Assignee: BingKun Pan > Make `to_csv` support the output of `array/struct/map` as pretty strings > > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47497) Make `to_csv` support the output of `array/struct/map` as pretty strings
[ https://issues.apache.org/jira/browse/SPARK-47497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47497. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45657 [https://github.com/apache/spark/pull/45657] > Make `to_csv` support the output of `array/struct/map` as pretty strings > > > Key: SPARK-47497 > URL: https://issues.apache.org/jira/browse/SPARK-47497 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes
[
https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47503.
---
Fix Version/s: 4.0.0
Assignee: alexey
Resolution: Fixed
This is resolved via [https://github.com/apache/spark/pull/45640]
> Spark history sever fails to display query for cached JDBC relation named in
> quotes
> ---
>
> Key: SPARK-47503
> URL: https://issues.apache.org/jira/browse/SPARK-47503
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.2.1, 4.0.0
>Reporter: alexey
>Assignee: alexey
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: Screenshot_11.png, eventlog_v2_local-1711020585149.rar
>
>
> Spark history sever fails to display query for cached JDBC relation (or
> calculation derived from it) named in quotes
> (Screenshot and generated history in attachments)
> How to reproduce:
> {code:java}
> val ticketsDf = spark.read.jdbc("jdbc:postgresql://localhost:5432/demo", """
> "test-schema".tickets """.trim, properties)
> val bookingDf = spark.read.parquet("path/bookings")
> ticketsDf.cache().count()
> val resultDf = bookingDf.join(ticketsDf, Seq("book_ref"))
> resultDf.write.mode(SaveMode.Overwrite).parquet("path/result") {code}
>
> So the problem is in SparkPlanGraphNode class which creates a dot node. When
> there is no metrics to display it simply returns tagged name and in this case
> name contains quotes which corrupts dot file.
> Suggested solution is to escape name string
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47526: - Assignee: BingKun Pan > Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final > - > > Key: SPARK-47526 > URL: https://issues.apache.org/jira/browse/SPARK-47526 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47526) Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final
[ https://issues.apache.org/jira/browse/SPARK-47526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47526. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45676 [https://github.com/apache/spark/pull/45676] > Upgrade `netty` to 4.1.108.Final and `netty-tcnative` to 2.0.65.Final > - > > Key: SPARK-47526 > URL: https://issues.apache.org/jira/browse/SPARK-47526 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47528) Add UserDefinedType support to DataTypeUtils.canWrite
[ https://issues.apache.org/jira/browse/SPARK-47528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47528. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45678 [https://github.com/apache/spark/pull/45678] > Add UserDefinedType support to DataTypeUtils.canWrite > - > > Key: SPARK-47528 > URL: https://issues.apache.org/jira/browse/SPARK-47528 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: L. C. Hsieh >Assignee: L. C. Hsieh >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > Our customer hits an issue recently when they tries to save a DataFrame > containing some UDTs as table (`saveAsTable`). The error looks like: > ``` > - Cannot write 'xxx': struct<...> is incompatible with struct<...> > ``` > The catalog strings between two sides are actually same which makes the > customer confused. > It is because `DataTypeUtils.canWrite` doesn't handle `UserDefinedType`. If > the `UserDefinedType`'s underlying sql type is same as read side, `canWrite` > should return true for two sides. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-47489) Action performed on Dataset is triggering an error as "The Spark SQL phase planning failed with an internal error."
[ https://issues.apache.org/jira/browse/SPARK-47489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830286#comment-17830286 ] Jagadeesh Marada commented on SPARK-47489: -- Hi Team, Can anyone check on this issue with priority please ? > Action performed on Dataset is triggering an error as "The Spark SQL phase > planning failed with an internal error." > --- > > Key: SPARK-47489 > URL: https://issues.apache.org/jira/browse/SPARK-47489 > Project: Spark > Issue Type: Bug > Components: k8s, Spark Core, Spark Submit >Affects Versions: 3.4.2 >Reporter: Jagadeesh Marada >Priority: Major > Attachments: code snippet.jpeg, exception_stack_trace.txt, jars added > to spark_submit.jpeg, spark-submit cmd.txt > > > Hi team, > We are upgrading to spark 3.4.2 from 3.3.2 and facing issue in the spark > driver as below. > "org.apache.spark.SparkException: [INTERNAL_ERROR] The Spark SQL phase > planning failed with an internal error. You hit a bug in Spark or the Spark > plugins you use. Please, report this bug to the corresponding communities or > vendors, and provide the full stack trace." > > Complete stack trace is as attached. > After analysing further , found that when we try to perform any actions on > the dataset, spark is unable to plan its actions, results in this exception. > Attaching a Exception stack trace & code snippet where exactly we are > trigging an action to convert it as java RDD. > > Attaching the spark submit command as well for your reference. > Can you please check this issue let us know if any fix available for this > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47503) Spark history sever fails to display query for cached JDBC relation named in quotes
[
https://issues.apache.org/jira/browse/SPARK-47503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47503:
--
Fix Version/s: 3.5.2
> Spark history sever fails to display query for cached JDBC relation named in
> quotes
> ---
>
> Key: SPARK-47503
> URL: https://issues.apache.org/jira/browse/SPARK-47503
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 3.2.1, 4.0.0
>Reporter: alexey
>Assignee: alexey
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0, 3.5.2
>
> Attachments: Screenshot_11.png, eventlog_v2_local-1711020585149.rar
>
>
> Spark history sever fails to display query for cached JDBC relation (or
> calculation derived from it) named in quotes
> (Screenshot and generated history in attachments)
> How to reproduce:
> {code:java}
> val ticketsDf = spark.read.jdbc("jdbc:postgresql://localhost:5432/demo", """
> "test-schema".tickets """.trim, properties)
> val bookingDf = spark.read.parquet("path/bookings")
> ticketsDf.cache().count()
> val resultDf = bookingDf.join(ticketsDf, Seq("book_ref"))
> resultDf.write.mode(SaveMode.Overwrite).parquet("path/result") {code}
>
> So the problem is in SparkPlanGraphNode class which creates a dot node. When
> there is no metrics to display it simply returns tagged name and in this case
> name contains quotes which corrupts dot file.
> Suggested solution is to escape name string
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47533) Migrate scalafmt dialect to scala213
BingKun Pan created SPARK-47533: --- Summary: Migrate scalafmt dialect to scala213 Key: SPARK-47533 URL: https://issues.apache.org/jira/browse/SPARK-47533 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47533) Migrate scalafmt dialect to scala213
[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47533: --- Labels: pull-request-available (was: ) > Migrate scalafmt dialect to scala213 > - > > Key: SPARK-47533 > URL: https://issues.apache.org/jira/browse/SPARK-47533 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual
[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-44708. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45629 [https://github.com/apache/spark/pull/45629] > Migrate test_reset_index assert_eq to use assertDataFrameEqual > -- > > Key: SPARK-44708 > URL: https://issues.apache.org/jira/browse/SPARK-44708 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.5.0 >Reporter: Amanda Liu >Assignee: Amanda Liu >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > Migrate assert_eq to assertDataFrameEqual in this file: > [python/pyspark/pandas/tests/indexes/test_reset_index.py|https://github.com/apache/spark/blob/42e5daddf3ba16ff7d08e82e51cd8924cc56e180/python/pyspark/pandas/tests/indexes/test_reset_index.py#L46] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-44708) Migrate test_reset_index assert_eq to use assertDataFrameEqual
[ https://issues.apache.org/jira/browse/SPARK-44708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-44708: Assignee: Amanda Liu > Migrate test_reset_index assert_eq to use assertDataFrameEqual > -- > > Key: SPARK-44708 > URL: https://issues.apache.org/jira/browse/SPARK-44708 > Project: Spark > Issue Type: Sub-task > Components: PySpark >Affects Versions: 3.5.0 >Reporter: Amanda Liu >Assignee: Amanda Liu >Priority: Major > Labels: pull-request-available > > Migrate assert_eq to assertDataFrameEqual in this file: > [python/pyspark/pandas/tests/indexes/test_reset_index.py|https://github.com/apache/spark/blob/42e5daddf3ba16ff7d08e82e51cd8924cc56e180/python/pyspark/pandas/tests/indexes/test_reset_index.py#L46] -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47533) Migrate scalafmt dialect to scala213
[ https://issues.apache.org/jira/browse/SPARK-47533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47533. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45683 [https://github.com/apache/spark/pull/45683] > Migrate scalafmt dialect to scala213 > - > > Key: SPARK-47533 > URL: https://issues.apache.org/jira/browse/SPARK-47533 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-47516. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45659 [https://github.com/apache/spark/pull/45659] > Move `remove unused installation package logic` from `each test job` to > `create the docker image` > - > > Key: SPARK-47516 > URL: https://issues.apache.org/jira/browse/SPARK-47516 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > > When creating the docker image, remove unused installation packages. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47516) Move `remove unused installation package logic` from `each test job` to `create the docker image`
[ https://issues.apache.org/jira/browse/SPARK-47516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-47516: Assignee: BingKun Pan > Move `remove unused installation package logic` from `each test job` to > `create the docker image` > - > > Key: SPARK-47516 > URL: https://issues.apache.org/jira/browse/SPARK-47516 > Project: Spark > Issue Type: Improvement > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Assignee: BingKun Pan >Priority: Minor > Labels: pull-request-available > > When creating the docker image, remove unused installation packages. -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`
[
https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47534:
--
Description:
{code}
-package org.apache.spark.variant;
+package org.apache.spark.types.variant;
{code}
{code:java}
-package org.apache.spark.sql.catalyst.expressions
+package org.apache.spark.sql.catalyst.expressions.variant
{code}
was:
{code:java}
-package org.apache.spark.sql.catalyst.expressions
+package org.apache.spark.sql.catalyst.expressions.variant {code}
> Move `o.a.s.variant` to `o.a.s.types.variant`
> -
>
> Key: SPARK-47534
> URL: https://issues.apache.org/jira/browse/SPARK-47534
> Project: Spark
> Issue Type: Task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Priority: Major
>
> {code}
> -package org.apache.spark.variant;
> +package org.apache.spark.types.variant;
> {code}
>
> {code:java}
> -package org.apache.spark.sql.catalyst.expressions
> +package org.apache.spark.sql.catalyst.expressions.variant
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`
[
https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-47534:
---
Labels: pull-request-available (was: )
> Move `o.a.s.variant` to `o.a.s.types.variant`
> -
>
> Key: SPARK-47534
> URL: https://issues.apache.org/jira/browse/SPARK-47534
> Project: Spark
> Issue Type: Task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Priority: Major
> Labels: pull-request-available
>
> {code}
> -package org.apache.spark.variant;
> +package org.apache.spark.types.variant;
> {code}
>
> {code:java}
> -package org.apache.spark.sql.catalyst.expressions
> +package org.apache.spark.sql.catalyst.expressions.variant
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`
[
https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-47534:
-
Assignee: Dongjoon Hyun
> Move `o.a.s.variant` to `o.a.s.types.variant`
> -
>
> Key: SPARK-47534
> URL: https://issues.apache.org/jira/browse/SPARK-47534
> Project: Spark
> Issue Type: Task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
> Labels: pull-request-available
>
> {code}
> -package org.apache.spark.variant;
> +package org.apache.spark.types.variant;
> {code}
>
> {code:java}
> -package org.apache.spark.sql.catalyst.expressions
> +package org.apache.spark.sql.catalyst.expressions.variant
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`
[
https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-47534:
--
Parent: SPARK-44111
Issue Type: Sub-task (was: Task)
> Move `o.a.s.variant` to `o.a.s.types.variant`
> -
>
> Key: SPARK-47534
> URL: https://issues.apache.org/jira/browse/SPARK-47534
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
> Labels: pull-request-available
>
> {code}
> -package org.apache.spark.variant;
> +package org.apache.spark.types.variant;
> {code}
>
> {code:java}
> -package org.apache.spark.sql.catalyst.expressions
> +package org.apache.spark.sql.catalyst.expressions.variant
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47534) Move `o.a.s.variant` to `o.a.s.types.variant`
[
https://issues.apache.org/jira/browse/SPARK-47534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-47534.
---
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 45685
[https://github.com/apache/spark/pull/45685]
> Move `o.a.s.variant` to `o.a.s.types.variant`
> -
>
> Key: SPARK-47534
> URL: https://issues.apache.org/jira/browse/SPARK-47534
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Dongjoon Hyun
>Assignee: Dongjoon Hyun
>Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
>
> {code}
> -package org.apache.spark.variant;
> +package org.apache.spark.types.variant;
> {code}
>
> {code:java}
> -package org.apache.spark.sql.catalyst.expressions
> +package org.apache.spark.sql.catalyst.expressions.variant
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day
Dongjoon Hyun created SPARK-47535: - Summary: Update `publish_snapshot.yml` to publish twice per day Key: SPARK-47535 URL: https://issues.apache.org/jira/browse/SPARK-47535 Project: Spark Issue Type: Task Components: Project Infra Affects Versions: 4.0.0 Reporter: Dongjoon Hyun -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47535: --- Labels: pull-request-available (was: ) > Update `publish_snapshot.yml` to publish twice per day > -- > > Key: SPARK-47535 > URL: https://issues.apache.org/jira/browse/SPARK-47535 > Project: Spark > Issue Type: Task > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47527) Cache miss for queries using With expressions
[
https://issues.apache.org/jira/browse/SPARK-47527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bruce Robbins resolved SPARK-47527.
---
Resolution: Duplicate
> Cache miss for queries using With expressions
> -
>
> Key: SPARK-47527
> URL: https://issues.apache.org/jira/browse/SPARK-47527
> Project: Spark
> Issue Type: Bug
> Components: SQL
>Affects Versions: 4.0.0
>Reporter: Bruce Robbins
>Priority: Major
> Labels: pull-request-available
>
> For example:
> {noformat}
> create or replace temp view v1 as
> select id from range(10);
> create or replace temp view q1 as
> select * from v1
> where id between 2 and 4;
> cache table q1;
> explain select * from q1;
> == Physical Plan ==
> *(1) Filter ((id#51L >= 2) AND (id#51L <= 4))
> +- *(1) Range (0, 10, step=1, splits=8)
> {noformat}
> Similarly:
> {noformat}
> create or replace temp view q2 as
> select count_if(id > 3) as cnt
> from v1;
> cache table q2;
> explain select * from q2;
> == Physical Plan ==
> AdaptiveSparkPlan isFinalPlan=false
> +- HashAggregate(keys=[], functions=[count(if (NOT _common_expr_0#88) null
> else _common_expr_0#88)])
>+- Exchange SinglePartition, ENSURE_REQUIREMENTS, [plan_id=182]
> +- HashAggregate(keys=[], functions=[partial_count(if (NOT
> _common_expr_0#88) null else _common_expr_0#88)])
> +- Project [(id#86L > 3) AS _common_expr_0#88]
> +- Range (0, 10, step=1, splits=8)
> {noformat}
> In the output of the above explain commands, neither include an
> {{InMemoryRelation}} node.
> The culprit seems to be the common expression ids in the {{With}} expressions
> used in runtime replacements for {{between}} and {{{}count_if{}}}, e.g. [this
> code|https://github.com/apache/spark/blob/39500a315166d8e342b678ef3038995a03ce84d6/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Between.scala#L43].
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47535: - Assignee: Dongjoon Hyun > Update `publish_snapshot.yml` to publish twice per day > -- > > Key: SPARK-47535 > URL: https://issues.apache.org/jira/browse/SPARK-47535 > Project: Spark > Issue Type: Task > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1
Yang Jie created SPARK-47536: Summary: Upgrade jmock-junit5 to 2.13.1 Key: SPARK-47536 URL: https://issues.apache.org/jira/browse/SPARK-47536 Project: Spark Issue Type: Improvement Components: Build Affects Versions: 4.0.0 Reporter: Yang Jie https://github.com/jmock-developers/jmock-library/releases/tag/2.13.1 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47535) Update `publish_snapshot.yml` to publish twice per day
[ https://issues.apache.org/jira/browse/SPARK-47535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47535. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45686 [https://github.com/apache/spark/pull/45686] > Update `publish_snapshot.yml` to publish twice per day > -- > > Key: SPARK-47535 > URL: https://issues.apache.org/jira/browse/SPARK-47535 > Project: Spark > Issue Type: Task > Components: Project Infra >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Minor > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47536: --- Labels: pull-request-available (was: ) > Upgrade jmock-junit5 to 2.13.1 > -- > > Key: SPARK-47536 > URL: https://issues.apache.org/jira/browse/SPARK-47536 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Priority: Major > Labels: pull-request-available > > https://github.com/jmock-developers/jmock-library/releases/tag/2.13.1 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47536. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45669 [https://github.com/apache/spark/pull/45669] > Upgrade jmock-junit5 to 2.13.1 > -- > > Key: SPARK-47536 > URL: https://issues.apache.org/jira/browse/SPARK-47536 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > https://github.com/jmock-developers/jmock-library/releases/tag/2.13.1 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-47536: -- Parent: SPARK-47046 Issue Type: Sub-task (was: Improvement) > Upgrade jmock-junit5 to 2.13.1 > -- > > Key: SPARK-47536 > URL: https://issues.apache.org/jira/browse/SPARK-47536 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > > https://github.com/jmock-developers/jmock-library/releases/tag/2.13.1 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47536) Upgrade jmock-junit5 to 2.13.1
[ https://issues.apache.org/jira/browse/SPARK-47536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47536: - Assignee: Yang Jie > Upgrade jmock-junit5 to 2.13.1 > -- > > Key: SPARK-47536 > URL: https://issues.apache.org/jira/browse/SPARK-47536 > Project: Spark > Issue Type: Improvement > Components: Build >Affects Versions: 4.0.0 >Reporter: Yang Jie >Assignee: Yang Jie >Priority: Major > Labels: pull-request-available > > https://github.com/jmock-developers/jmock-library/releases/tag/2.13.1 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kent Yao updated SPARK-47537: - Parent: SPARK-47361 Issue Type: Sub-task (was: Bug) > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J > -- > > Key: SPARK-47537 > URL: https://issues.apache.org/jira/browse/SPARK-47537 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.1, 4.0.0, 3.5.2 >Reporter: Kent Yao >Priority: Major > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
Kent Yao created SPARK-47537: Summary: Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J Key: SPARK-47537 URL: https://issues.apache.org/jira/browse/SPARK-47537 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 3.4.1, 4.0.0, 3.5.2 Reporter: Kent Yao -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47538) Remove `commons-logging` dependency
Dongjoon Hyun created SPARK-47538: - Summary: Remove `commons-logging` dependency Key: SPARK-47538 URL: https://issues.apache.org/jira/browse/SPARK-47538 Project: Spark Issue Type: Sub-task Components: Build Affects Versions: 4.0.0 Reporter: Dongjoon Hyun -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47537: --- Labels: pull-request-available (was: ) > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J > -- > > Key: SPARK-47537 > URL: https://issues.apache.org/jira/browse/SPARK-47537 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.1, 4.0.0, 3.5.2 >Reporter: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47538) Remove `commons-logging` dependency
[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47538: --- Labels: pull-request-available (was: ) > Remove `commons-logging` dependency > --- > > Key: SPARK-47538 > URL: https://issues.apache.org/jira/browse/SPARK-47538 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47506) Support all file source formats for collated data types
[ https://issues.apache.org/jira/browse/SPARK-47506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-47506: Assignee: Stefan Kandic > Support all file source formats for collated data types > --- > > Key: SPARK-47506 > URL: https://issues.apache.org/jira/browse/SPARK-47506 > Project: Spark > Issue Type: Improvement > Components: Spark Core, SQL >Affects Versions: 4.0.0 >Reporter: Stefan Kandic >Assignee: Stefan Kandic >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47506) Support all file source formats for collated data types
[ https://issues.apache.org/jira/browse/SPARK-47506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-47506. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45641 [https://github.com/apache/spark/pull/45641] > Support all file source formats for collated data types > --- > > Key: SPARK-47506 > URL: https://issues.apache.org/jira/browse/SPARK-47506 > Project: Spark > Issue Type: Improvement > Components: Spark Core, SQL >Affects Versions: 4.0.0 >Reporter: Stefan Kandic >Assignee: Stefan Kandic >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-47537: - Assignee: Kent Yao > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J > -- > > Key: SPARK-47537 > URL: https://issues.apache.org/jira/browse/SPARK-47537 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.1, 4.0.0, 3.5.2 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
[ https://issues.apache.org/jira/browse/SPARK-47537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47537. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45689 [https://github.com/apache/spark/pull/45689] > Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J > -- > > Key: SPARK-47537 > URL: https://issues.apache.org/jira/browse/SPARK-47537 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 3.4.1, 4.0.0, 3.5.2 >Reporter: Kent Yao >Assignee: Kent Yao >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47538) Remove `commons-logging` dependency
[ https://issues.apache.org/jira/browse/SPARK-47538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-47538. --- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45687 [https://github.com/apache/spark/pull/45687] > Remove `commons-logging` dependency > --- > > Key: SPARK-47538 > URL: https://issues.apache.org/jira/browse/SPARK-47538 > Project: Spark > Issue Type: Sub-task > Components: Build >Affects Versions: 4.0.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47539) Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.
BingKun Pan created SPARK-47539: --- Summary: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`. Key: SPARK-47539 URL: https://issues.apache.org/jira/browse/SPARK-47539 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 4.0.0 Reporter: BingKun Pan -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47539) Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.
[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated SPARK-47539: --- Labels: pull-request-available (was: ) > Make the method `castToString(from: DataType): Any => Any` to > `castToString(from: DataType): Any => UTF8String` in `ToStringBase`. > -- > > Key: SPARK-47539 > URL: https://issues.apache.org/jira/browse/SPARK-47539 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Updated] (SPARK-47539) Make the return value of method `castToString` be `Any => UTF8String`
[ https://issues.apache.org/jira/browse/SPARK-47539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BingKun Pan updated SPARK-47539: Summary: Make the return value of method `castToString` be `Any => UTF8String` (was: Make the method `castToString(from: DataType): Any => Any` to `castToString(from: DataType): Any => UTF8String` in `ToStringBase`.) > Make the return value of method `castToString` be `Any => UTF8String` > - > > Key: SPARK-47539 > URL: https://issues.apache.org/jira/browse/SPARK-47539 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 4.0.0 >Reporter: BingKun Pan >Priority: Minor > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-47540) SPIP: Pure Python Package (Spark Connect)
Hyukjin Kwon created SPARK-47540: Summary: SPIP: Pure Python Package (Spark Connect) Key: SPARK-47540 URL: https://issues.apache.org/jira/browse/SPARK-47540 Project: Spark Issue Type: Bug Components: Connect, PySpark Affects Versions: 4.0.0 Reporter: Hyukjin Kwon -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-47451) Support to_json(variant)
[ https://issues.apache.org/jira/browse/SPARK-47451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-47451: --- Assignee: Chenhao Li > Support to_json(variant) > > > Key: SPARK-47451 > URL: https://issues.apache.org/jira/browse/SPARK-47451 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Chenhao Li >Assignee: Chenhao Li >Priority: Major > Labels: pull-request-available > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Resolved] (SPARK-47451) Support to_json(variant)
[ https://issues.apache.org/jira/browse/SPARK-47451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-47451. - Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 45575 [https://github.com/apache/spark/pull/45575] > Support to_json(variant) > > > Key: SPARK-47451 > URL: https://issues.apache.org/jira/browse/SPARK-47451 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 4.0.0 >Reporter: Chenhao Li >Assignee: Chenhao Li >Priority: Major > Labels: pull-request-available > Fix For: 4.0.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
