[jira] [Commented] (SPARK-43592) NoSuchMethodError in Spark 3.4 with JDK8u362 & JDK8u372

2023-05-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724772#comment-17724772 ] Yuming Wang commented on SPARK-43592: - Do you mean build your project through Java 11 and run your

[jira] [Commented] (SPARK-43592) NoSuchMethodError in Spark 3.4 with JDK8u362 & JDK8u372

2023-05-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724767#comment-17724767 ] Yuming Wang commented on SPARK-43592: - Did you build your project through Java 9+? >

[jira] [Commented] (SPARK-43592) NoSuchMethodError in Spark 3.4 with JDK8u362 & JDK8u372

2023-05-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724291#comment-17724291 ] Yuming Wang commented on SPARK-43592: - Maybe same issue: SPARK-32475? > NoSuchMethodError in Spark

[jira] [Updated] (SPARK-43592) NoSuchMethodError in Spark 3.4 with JDK8u362 & JDK8u372

2023-05-19 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43592: Target Version/s: (was: 3.4.0) > NoSuchMethodError in Spark 3.4 with JDK8u362 & JDK8u372 >

[jira] [Resolved] (SPARK-43572) Add a test for scrollable result set through thrift server

2023-05-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43572. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 41213

[jira] [Assigned] (SPARK-43572) Add a test for scrollable result set through thrift server

2023-05-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43572: --- Assignee: Kent Yao > Add a test for scrollable result set through thrift server >

[jira] [Commented] (SPARK-43526) when shuffle hash join is enabled, q95 performance deteriorates

2023-05-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17724099#comment-17724099 ] Yuming Wang commented on SPARK-43526: - [~caican] Thank you for investigation. > when shuffle hash

[jira] [Resolved] (SPARK-43577) Upgrade cyclonedx-maven-plugin to 2.7.9

2023-05-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43577. - Resolution: Won't Fix > Upgrade cyclonedx-maven-plugin to 2.7.9 >

[jira] [Commented] (SPARK-43577) Upgrade cyclonedx-maven-plugin to 2.7.9

2023-05-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723957#comment-17723957 ] Yuming Wang commented on SPARK-43577: - https://github.com/apache/spark/pull/41219 > Upgrade

[jira] [Created] (SPARK-43577) Upgrade cyclonedx-maven-plugin to 2.7.9

2023-05-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43577: --- Summary: Upgrade cyclonedx-maven-plugin to 2.7.9 Key: SPARK-43577 URL: https://issues.apache.org/jira/browse/SPARK-43577 Project: Spark Issue Type:

[jira] [Comment Edited] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723433#comment-17723433 ] Yuming Wang edited comment on SPARK-43538 at 5/17/23 12:36 PM: --- Yes. I

[jira] [Commented] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723433#comment-17723433 ] Yuming Wang commented on SPARK-43538: - Yes. I think so. > Spark Homebrew Formulae currently depends

[jira] [Commented] (SPARK-43538) Spark Homebrew Formulae currently depends on non-officially-supported Java 20

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723429#comment-17723429 ] Yuming Wang commented on SPARK-43538: - We have not tested on Java 20, because Java 20 is not LTS. >

[jira] [Commented] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723373#comment-17723373 ] Yuming Wang commented on SPARK-43534: - https://github.com/apache/spark/pull/41195 > Add

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Attachment: hadoop log jars.png > Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Description: Build Spark: {code:sh} ./dev/make-distribution.sh --name default --tgz -Phive

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Description: Build Spark: {code:sh} ./dev/make-distribution.sh --name default --tgz -Phive

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Attachment: log4j-slf4j2-impl-2.20.0.jar > Add log4j-1.2-api and log4j-slf4j2-impl to classpath

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Attachment: log4j-1.2-api-2.20.0.jar > Add log4j-1.2-api and log4j-slf4j2-impl to classpath if

[jira] [Updated] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43534: Description: Build Spark: {code:sh} ./dev/make-distribution.sh --name provided --tgz -Phive

[jira] [Created] (SPARK-43534) Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided

2023-05-17 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43534: --- Summary: Add log4j-1.2-api and log4j-slf4j2-impl to classpath if active hadoop-provided Key: SPARK-43534 URL: https://issues.apache.org/jira/browse/SPARK-43534

[jira] [Commented] (SPARK-43526) when shuffle hash join is enabled, q95 performance deteriorates

2023-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17723338#comment-17723338 ] Yuming Wang commented on SPARK-43526: - Why do you prefer shuffle hash join? > when shuffle hash

[jira] [Updated] (SPARK-43461) Skip compiling useless files when making distribution

2023-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Fix Version/s: 3.5.0 > Skip compiling useless files when making distribution >

[jira] [Resolved] (SPARK-43524) Memory leak in Spark UI

2023-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43524. - Resolution: Duplicate > Memory leak in Spark UI > --- > >

[jira] [Updated] (SPARK-43521) Support CREATE TABLE LIKE FILE for PARQUET

2023-05-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43521: Issue Type: New Feature (was: Bug) > Support CREATE TABLE LIKE FILE for PARQUET >

[jira] [Updated] (SPARK-43461) Skip compiling useless files when making distribution

2023-05-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Summary: Skip compiling useless files when making distribution (was: Skip compiling javadoc.jar

[jira] [Updated] (SPARK-43488) bitmap function

2023-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43488: Fix Version/s: (was: 3.4.1) > bitmap function > --- > > Key:

[jira] [Commented] (SPARK-43486) number of files read is incorrect if it is bucket table

2023-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722313#comment-17722313 ] Yuming Wang commented on SPARK-43486: - [~panbingkun] Yes, please. > number of files read is

[jira] [Updated] (SPARK-43486) number of files read is incorrect if it is bucket table

2023-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43486: Description: !screenshot-1.png! > number of files read is incorrect if it is bucket table >

[jira] [Created] (SPARK-43486) number of files read is incorrect if it is bucket table

2023-05-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43486: --- Summary: number of files read is incorrect if it is bucket table Key: SPARK-43486 URL: https://issues.apache.org/jira/browse/SPARK-43486 Project: Spark Issue

[jira] [Updated] (SPARK-43486) number of files read is incorrect if it is bucket table

2023-05-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43486: Attachment: screenshot-1.png > number of files read is incorrect if it is bucket table >

[jira] [Updated] (SPARK-43461) Skip compiling javadoc.jar and sources.jar when making distribution

2023-05-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Description: -Dmaven.javadoc.skip=true to skip java doc -Dskip=true to skip scala doc. Please

[jira] [Updated] (SPARK-43461) Skip compiling javadoc.jar and sources.jar when making distribution

2023-05-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Summary: Skip compiling javadoc.jar and sources.jar when making distribution (was: Skip

[jira] [Updated] (SPARK-43461) Skip compiling javadoc.jar, sources.jar and test-jar when making distribution

2023-05-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Summary: Skip compiling javadoc.jar, sources.jar and test-jar when making distribution (was:

[jira] [Updated] (SPARK-43461) Skip make javadoc.jar, sources.jar and test-jar when making distribution

2023-05-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43461: Summary: Skip make javadoc.jar, sources.jar and test-jar when making distribution (was: Skip

[jira] [Created] (SPARK-43461) Skip make javadoc.jar, sources.jar and test-jar when make distribution

2023-05-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43461: --- Summary: Skip make javadoc.jar, sources.jar and test-jar when make distribution Key: SPARK-43461 URL: https://issues.apache.org/jira/browse/SPARK-43461 Project: Spark

[jira] [Updated] (SPARK-43425) Add TimestampNTZType to ColumnarBatchRow

2023-05-09 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43425: Fix Version/s: (was: 3.5.0) (was: 3.4.1) > Add TimestampNTZType to

[jira] [Updated] (SPARK-43383) Add statistics rowCount for LocalRelation

2023-05-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43383: Fix Version/s: (was: 3.5.0) > Add statistics rowCount for LocalRelation >

[jira] [Assigned] (SPARK-43174) Fix SparkSQLCLIDriver completer

2023-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43174: --- Assignee: Yuming Wang > Fix SparkSQLCLIDriver completer > ---

[jira] [Resolved] (SPARK-43174) Fix SparkSQLCLIDriver completer

2023-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43174. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40838

[jira] [Updated] (SPARK-43142) DSL expressions fail on attribute with special characters

2023-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43142: Fix Version/s: (was: 3.5.0) > DSL expressions fail on attribute with special characters >

[jira] [Reopened] (SPARK-43142) DSL expressions fail on attribute with special characters

2023-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-43142: - > DSL expressions fail on attribute with special characters >

[jira] [Commented] (SPARK-43228) Join keys also match PartitioningCollection

2023-04-21 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17714907#comment-17714907 ] Yuming Wang commented on SPARK-43228: - https://github.com/apache/spark/pull/40897 > Join keys also

[jira] [Created] (SPARK-43228) Join keys also match PartitioningCollection

2023-04-21 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43228: --- Summary: Join keys also match PartitioningCollection Key: SPARK-43228 URL: https://issues.apache.org/jira/browse/SPARK-43228 Project: Spark Issue Type:

[jira] [Updated] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution

2023-04-20 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43225: Summary: Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution (was: Change

[jira] [Created] (SPARK-43225) Change the scope of jackson-mapper-asl from compile to test

2023-04-20 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43225: --- Summary: Change the scope of jackson-mapper-asl from compile to test Key: SPARK-43225 URL: https://issues.apache.org/jira/browse/SPARK-43225 Project: Spark

[jira] [Resolved] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43170. - Resolution: Not A Bug > The spark sql like statement is pushed down to parquet for execution,

[jira] [Updated] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43170: Attachment: screenshot-1.png > The spark sql like statement is pushed down to parquet for

[jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713861#comment-17713861 ] Yuming Wang commented on SPARK-43170: - Maybe your partition exists, but there is no data under the

[jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713858#comment-17713858 ] Yuming Wang commented on SPARK-43170: - I can't reproduce this issue:

[jira] [Updated] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43170: Attachment: image-2023-04-19-10-59-44-118.png > The spark sql like statement is pushed down to

[jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713576#comment-17713576 ] Yuming Wang commented on SPARK-43170: - Why it is {{CachedRDDBuilder}}? {noformat} (2)

[jira] [Created] (SPARK-43174) Fix SparkSQLCLIDriver completer

2023-04-18 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43174: --- Summary: Fix SparkSQLCLIDriver completer Key: SPARK-43174 URL: https://issues.apache.org/jira/browse/SPARK-43174 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried

2023-04-18 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713503#comment-17713503 ] Yuming Wang commented on SPARK-43170: - Have you cached dwm_user_app_action_sum_all? > The spark sql

[jira] [Commented] (SPARK-43163) An exception occurred while hive table join tidb table

2023-04-17 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17713069#comment-17713069 ] Yuming Wang commented on SPARK-43163: - It seems like TiSpark issue. > An exception occurred while

[jira] [Commented] (SPARK-43154) Pyspark 3.4 fails when running "pivot" function on a dataframe using the values arguement

2023-04-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712774#comment-17712774 ] Yuming Wang commented on SPARK-43154: - cc [~gurwls223] > Pyspark 3.4 fails when running "pivot"

[jira] [Resolved] (SPARK-43139) Bug in INSERT INTO documentation

2023-04-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43139. - Fix Version/s: 3.5.0 3.4.1 Resolution: Fixed Issue resolved by pull

[jira] [Assigned] (SPARK-43139) Bug in INSERT INTO documentation

2023-04-16 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43139: --- Assignee: Yuming Wang > Bug in INSERT INTO documentation >

[jira] [Commented] (SPARK-43139) Bug in INSERT INTO documentation

2023-04-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712743#comment-17712743 ] Yuming Wang commented on SPARK-43139: - https://github.com/apache/spark/pull/40807 > Bug in INSERT

[jira] [Commented] (SPARK-40609) Casts types according to bucket info for Equality expression

2023-04-15 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712663#comment-17712663 ] Yuming Wang commented on SPARK-40609: - https://github.com/apache/spark/pull/40805 > Casts types

[jira] [Resolved] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43050. - Fix Version/s: 3.3.3 3.4.1 3.5.0 Assignee: Yuming

[jira] [Resolved] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43095. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40742

[jira] [Assigned] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43095: --- Assignee: Yuming Wang > Avoid Once strategy's idempotence is broken for batch: Infer

[jira] [Resolved] (SPARK-42926) Upgrade Parquet to 1.13.0

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42926. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40555

[jira] [Assigned] (SPARK-42926) Upgrade Parquet to 1.13.0

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-42926: --- Assignee: Yuming Wang > Upgrade Parquet to 1.13.0 > - > >

[jira] [Resolved] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43107. - Fix Version/s: 3.5.0 Resolution: Fixed Issue resolved by pull request 40756

[jira] [Assigned] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reassigned SPARK-43107: --- Assignee: Yuming Wang > Coalesce buckets in join applied on broadcast join stream side >

[jira] [Commented] (SPARK-43140) Override computeStats in DummyLeafNode

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712315#comment-17712315 ] Yuming Wang commented on SPARK-43140: - https://github.com/apache/spark/pull/40791 > Override

[jira] [Created] (SPARK-43140) Override computeStats in DummyLeafNode

2023-04-14 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43140: --- Summary: Override computeStats in DummyLeafNode Key: SPARK-43140 URL: https://issues.apache.org/jira/browse/SPARK-43140 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-43138) ClassNotFound during RDD block replication/migration

2023-04-14 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17712212#comment-17712212 ] Yuming Wang commented on SPARK-43138: - Did you set some config to

[jira] [Resolved] (SPARK-43135) Remove `branch-3.2` from `publish_snapshot` GitHub Action job

2023-04-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43135. - Fix Version/s: 3.5.0 Assignee: Dongjoon Hyun Resolution: Fixed Issue resolved

[jira] [Resolved] (SPARK-42975) Cast result type to timestamp type for string +/- interval

2023-04-13 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42975. - Resolution: Won't Fix Disable it in ANSI mode. > Cast result type to timestamp type for string

[jira] [Updated] (SPARK-43116) Fix Cast.forceNullable

2023-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43116: Description:

[jira] [Updated] (SPARK-43116) Fix Cast.forceNullable

2023-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43116: Description:

[jira] [Created] (SPARK-43116) Fix Cast.forceNullable

2023-04-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43116: --- Summary: Fix Cast.forceNullable Key: SPARK-43116 URL: https://issues.apache.org/jira/browse/SPARK-43116 Project: Spark Issue Type: Bug Components:

[jira] [Updated] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side

2023-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43107: Summary: Coalesce buckets in join applied on broadcast join stream side (was: Coalesce applied

[jira] [Commented] (SPARK-43107) Coalesce applied on broadcast join stream side

2023-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711605#comment-17711605 ] Yuming Wang commented on SPARK-43107: - https://github.com/apache/spark/pull/40756 > Coalesce

[jira] [Commented] (SPARK-43114) Add interval types to TypeCoercionSuite

2023-04-12 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17711604#comment-17711604 ] Yuming Wang commented on SPARK-43114: - https://github.com/apache/spark/pull/40763 > Add interval

[jira] [Created] (SPARK-43114) Add interval types to TypeCoercionSuite

2023-04-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43114: --- Summary: Add interval types to TypeCoercionSuite Key: SPARK-43114 URL: https://issues.apache.org/jira/browse/SPARK-43114 Project: Spark Issue Type:

[jira] [Created] (SPARK-43107) Coalesce applied on broadcast join stream side

2023-04-12 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43107: --- Summary: Coalesce applied on broadcast join stream side Key: SPARK-43107 URL: https://issues.apache.org/jira/browse/SPARK-43107 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-43087) Support coalesce buckets in join in AQE

2023-04-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-43087. - Resolution: Duplicate > Support coalesce buckets in join in AQE >

[jira] [Created] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters

2023-04-11 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43095: --- Summary: Avoid Once strategy's idempotence is broken for batch: Infer Filters Key: SPARK-43095 URL: https://issues.apache.org/jira/browse/SPARK-43095 Project: Spark

[jira] [Commented] (SPARK-43087) Support coalesce buckets in join in AQE

2023-04-11 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17710952#comment-17710952 ] Yuming Wang commented on SPARK-43087: - https://github.com/apache/spark/pull/40731 > Support

[jira] [Created] (SPARK-43087) Support coalesce buckets in join in AQE

2023-04-10 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43087: --- Summary: Support coalesce buckets in join in AQE Key: SPARK-43087 URL: https://issues.apache.org/jira/browse/SPARK-43087 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40609) Casts types according to bucket info for Equality expression

2023-04-10 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17710080#comment-17710080 ] Yuming Wang commented on SPARK-40609: - {code:scala} import org.apache.spark.benchmark.Benchmark val

[jira] [Updated] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions

2023-04-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-43050: Description: {code:sql} CREATE TEMPORARY VIEW grouping AS SELECT * FROM VALUES ("1", "2", "3",

[jira] [Commented] (SPARK-43053) Possible logic issue

2023-04-06 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17709536#comment-17709536 ] Yuming Wang commented on SPARK-43053: - It's not a issue. > Possible logic issue >

[jira] [Created] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions

2023-04-06 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43050: --- Summary: Fix construct aggregate expressions by replacing grouping functions Key: SPARK-43050 URL: https://issues.apache.org/jira/browse/SPARK-43050 Project: Spark

[jira] [Updated] (SPARK-42926) Upgrade Parquet to 1.13.0

2023-04-02 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42926: Summary: Upgrade Parquet to 1.13.0 (was: Upgrade Parquet to 1.12.4) > Upgrade Parquet to 1.13.0

[jira] [Created] (SPARK-43000) Do not cast to double type if one side is AnsiIntervalType in BinaryArithmetic

2023-04-01 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-43000: --- Summary: Do not cast to double type if one side is AnsiIntervalType in BinaryArithmetic Key: SPARK-43000 URL: https://issues.apache.org/jira/browse/SPARK-43000

[jira] [Updated] (SPARK-42991) Disable string type +/- interval in ANSI mode

2023-03-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42991: Summary: Disable string type +/- interval in ANSI mode (was: Disable string +/- interval in ANSI

[jira] [Commented] (SPARK-42991) Disable string +/- interval in ANSI mode

2023-03-31 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707158#comment-17707158 ] Yuming Wang commented on SPARK-42991: - https://github.com/apache/spark/pull/40616 > Disable string

[jira] [Created] (SPARK-42991) Disable string +/- interval in ANSI mode

2023-03-31 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-42991: --- Summary: Disable string +/- interval in ANSI mode Key: SPARK-42991 URL: https://issues.apache.org/jira/browse/SPARK-42991 Project: Spark Issue Type:

[jira] [Created] (SPARK-42975) Cast result type to timestamp type for string +/- interval

2023-03-30 Thread Yuming Wang (Jira)
Yuming Wang created SPARK-42975: --- Summary: Cast result type to timestamp type for string +/- interval Key: SPARK-42975 URL: https://issues.apache.org/jira/browse/SPARK-42975 Project: Spark

[jira] [Commented] (SPARK-42932) Spark 3.3.2, with hadoop3, Error with java.io.IOException: Mkdirs failed to create file

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706702#comment-17706702 ] Yuming Wang commented on SPARK-42932: - I can't reproduce this issue. Maybe it's your disk issue? >

[jira] [Resolved] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-40610. - Resolution: Won't Fix > Spark fall back to use getPartitions instead of getPartitionsByFilter

[jira] [Commented] (SPARK-40610) Spark fall back to use getPartitions instead of getPartitionsByFilter when date_add functions used in where clause

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706665#comment-17706665 ] Yuming Wang commented on SPARK-40610: - Users canĀ {{set

[jira] [Reopened] (SPARK-42832) Remove repartition if it is the child of LocalLimit

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang reopened SPARK-42832: - Assignee: (was: Yuming Wang) > Remove repartition if it is the child of LocalLimit >

[jira] [Updated] (SPARK-42832) Remove repartition if it is the child of LocalLimit

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-42832: Fix Version/s: (was: 3.5.0) > Remove repartition if it is the child of LocalLimit >

[jira] [Resolved] (SPARK-42832) Remove repartition if it is the child of LocalLimit

2023-03-29 Thread Yuming Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-42832. - Resolution: Won't Do > Remove repartition if it is the child of LocalLimit >

<    1   2   3   4   5   6   7   8   9   10   >