[jira] [Created] (SPARK-43023) Enhanced CatalogMetadata API test

2023-04-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-43023: Summary: Enhanced CatalogMetadata API test Key: SPARK-43023 URL: https://issues.apache.org/jira/browse/SPARK-43023 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43022) protobuf functions

2023-04-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-43022: Summary: protobuf functions Key: SPARK-43022 URL: https://issues.apache.org/jira/browse/SPARK-43022 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-43008) Upgrade jodatime to 2.12.5

2023-04-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-43008: Summary: Upgrade jodatime to 2.12.5 Key: SPARK-43008 URL: https://issues.apache.org/jira/browse/SPARK-43008 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-43007) Upgrade rocksdbjni to 8.0.0

2023-04-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-43007: Summary: Upgrade rocksdbjni to 8.0.0 Key: SPARK-43007 URL: https://issues.apache.org/jira/browse/SPARK-43007 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42974) Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup tempDir

2023-03-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42974: - Issue Type: Improvement (was: Bug) > Restore `Utils#createTempDir` use >

[jira] [Updated] (SPARK-42974) Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup tempDir

2023-03-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42974: - Summary: Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup

[jira] [Created] (SPARK-42974) Restoring `Utils#createTempDir` using `ShutdownHookManager.registerShutdownDeleteDir` cleanup temporary files

2023-03-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-42974: Summary: Restoring `Utils#createTempDir` using `ShutdownHookManager.registerShutdownDeleteDir` cleanup temporary files Key: SPARK-42974 URL:

[jira] [Created] (SPARK-42971) When processing the WorkDirCleanup event, if appDirs is empty, should print workdir

2023-03-29 Thread Yang Jie (Jira)
Yang Jie created SPARK-42971: Summary: When processing the WorkDirCleanup event, if appDirs is empty, should print workdir Key: SPARK-42971 URL: https://issues.apache.org/jira/browse/SPARK-42971

[jira] [Comment Edited] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706248#comment-17706248 ] Yang Jie edited comment on SPARK-41359 at 3/29/23 7:14 AM: --- [~cloud_fan] this

[jira] [Commented] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2023-03-29 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706248#comment-17706248 ] Yang Jie commented on SPARK-41359: -- [~cloud_fan] this ticket is created by me, but not resoloved by me,

[jira] [Created] (SPARK-42958) Refactor `CheckConnectJvmClientCompatibility` to compare client and avro

2023-03-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-42958: Summary: Refactor `CheckConnectJvmClientCompatibility` to compare client and avro Key: SPARK-42958 URL: https://issues.apache.org/jira/browse/SPARK-42958 Project: Spark

[jira] [Created] (SPARK-42956) avro functions

2023-03-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-42956: Summary: avro functions Key: SPARK-42956 URL: https://issues.apache.org/jira/browse/SPARK-42956 Project: Spark Issue Type: Improvement Components: Connect

[jira] [Commented] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.5

2023-03-28 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17705862#comment-17705862 ] Yang Jie commented on SPARK-42382: -- OK > Upgrade `cyclonedx-maven-plugin` to 2.7.5 >

[jira] [Created] (SPARK-42934) Testing OrcEncryptionSuite using maven is always skipped

2023-03-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42934: Summary: Testing OrcEncryptionSuite using maven is always skipped Key: SPARK-42934 URL: https://issues.apache.org/jira/browse/SPARK-42934 Project: Spark Issue Type:

[jira] [Created] (SPARK-42930) Change the access scope of `ProtobufSerDe` related implementations to `private[spark]`

2023-03-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42930: Summary: Change the access scope of `ProtobufSerDe` related implementations to `private[spark]` Key: SPARK-42930 URL: https://issues.apache.org/jira/browse/SPARK-42930

[jira] [Created] (SPARK-42927) Make `o.a.spark.util.Iterators#size` as `private[spark]`

2023-03-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-42927: Summary: Make `o.a.spark.util.Iterators#size` as `private[spark]` Key: SPARK-42927 URL: https://issues.apache.org/jira/browse/SPARK-42927 Project: Spark Issue Type:

[jira] [Updated] (SPARK-42921) SQLQueryTestSuite test failed with `SPARK_ANSI_SQL_MODE=true`

2023-03-24 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42921: - Issue Type: Bug (was: Improvement) > SQLQueryTestSuite test failed with `SPARK_ANSI_SQL_MODE=true` >

[jira] [Created] (SPARK-42921) SQLQueryTestSuite test failed with `SPARK_ANSI_SQL_MODE=true`

2023-03-24 Thread Yang Jie (Jira)
Yang Jie created SPARK-42921: Summary: SQLQueryTestSuite test failed with `SPARK_ANSI_SQL_MODE=true` Key: SPARK-42921 URL: https://issues.apache.org/jira/browse/SPARK-42921 Project: Spark Issue

[jira] [Created] (SPARK-42913) Upgrade Hadoop to 3.3.5

2023-03-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-42913: Summary: Upgrade Hadoop to 3.3.5 Key: SPARK-42913 URL: https://issues.apache.org/jira/browse/SPARK-42913 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` to a separate file (was: Should move

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` into a separate file (was: Should move

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from into a separate file (was: Should move StorageLevel

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Description: [https://github.com/apache/spark/pull/40510] introduce `message StorageLevel` to

[jira] [Updated] (SPARK-42901) Should move message StorageLevel from `base.proto` to a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move message StorageLevel from `base.proto` to a separate file (was: Should move

[jira] [Updated] (SPARK-42901) Should move StorageLevel into a separate file

2023-03-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42901: - Summary: Should move StorageLevel into a separate file (was: Move StorageLevel into a separate file to

[jira] [Created] (SPARK-42901) Move StorageLevel into a separate file to avoid potential file recursively imports

2023-03-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-42901: Summary: Move StorageLevel into a separate file to avoid potential file recursively imports Key: SPARK-42901 URL: https://issues.apache.org/jira/browse/SPARK-42901 Project:

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Affects Version/s: (was: 3.4.0) > Implement cache, persist, unpersist, and storageLevel >

[jira] [Updated] (SPARK-42894) Implement cache, persist, unpersist, and storageLevel

2023-03-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42894: - Summary: Implement cache, persist, unpersist, and storageLevel (was: Implement cache, persist,

[jira] [Created] (SPARK-42894) Implement cache, persist, unpersist

2023-03-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-42894: Summary: Implement cache, persist, unpersist Key: SPARK-42894 URL: https://issues.apache.org/jira/browse/SPARK-42894 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-03-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42536: - Description: [https://logging.apache.org/log4j/2.x/release-notes/2.20.0.html] (was: Need wait upgrade

[jira] [Created] (SPARK-42871) Upgrade slf4j to 2.0.7

2023-03-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42871: Summary: Upgrade slf4j to 2.0.7 Key: SPARK-42871 URL: https://issues.apache.org/jira/browse/SPARK-42871 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-42827) Support `functions#array_prepend`

2023-03-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-42827: Summary: Support `functions#array_prepend` Key: SPARK-42827 URL: https://issues.apache.org/jira/browse/SPARK-42827 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42814) Upgrade some maven-plugins

2023-03-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42814: - Description: maven-enforcer-plugin 3.0.0-M2 -> 3.2.1 -

[jira] [Created] (SPARK-42814) Upgrade some maven-plugins

2023-03-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42814: Summary: Upgrade some maven-plugins Key: SPARK-42814 URL: https://issues.apache.org/jira/browse/SPARK-42814 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel`

2023-03-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42811: - Epic Link: SPARK-42554 > Make proto message `CacheTable` support `StorageLevel` >

[jira] [Created] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel`

2023-03-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42811: Summary: Make proto message `CacheTable` support `StorageLevel` Key: SPARK-42811 URL: https://issues.apache.org/jira/browse/SPARK-42811 Project: Spark Issue Type:

[jira] [Created] (SPARK-42810) Add a test catalog like InMemoryTableCatalog for SimpleSparkConnectService

2023-03-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42810: Summary: Add a test catalog like InMemoryTableCatalog for SimpleSparkConnectService Key: SPARK-42810 URL: https://issues.apache.org/jira/browse/SPARK-42810 Project: Spark

[jira] [Updated] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-15 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42767: - Epic Link: SPARK-42554 > Add check condition to start connect server fallback with `in-memory` and >

[jira] [Created] (SPARK-42806) Add Catalog

2023-03-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-42806: Summary: Add Catalog Key: SPARK-42806 URL: https://issues.apache.org/jira/browse/SPARK-42806 Project: Spark Issue Type: Improvement Components: Connect

[jira] [Updated] (SPARK-42798) Upgrade protobuf-java to 3.22.2

2023-03-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42798: - Description: * [https://github.com/protocolbuffers/protobuf/releases/tag/v22.1] *

[jira] [Updated] (SPARK-42798) Upgrade protobuf-java to 3.22.2

2023-03-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42798: - Environment: (was: * [https://github.com/protocolbuffers/protobuf/releases/tag/v22.1] *

[jira] [Created] (SPARK-42798) Upgrade protobuf-java to 3.22.2

2023-03-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-42798: Summary: Upgrade protobuf-java to 3.22.2 Key: SPARK-42798 URL: https://issues.apache.org/jira/browse/SPARK-42798 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699490#comment-17699490 ] Yang Jie commented on SPARK-42770: -- Maybe it can only be reproduced on Linux   >

[jira] [Created] (SPARK-42770) SQLImplicitsTestSuite test failed with Java 17

2023-03-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-42770: Summary: SQLImplicitsTestSuite test failed with Java 17 Key: SPARK-42770 URL: https://issues.apache.org/jira/browse/SPARK-42770 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-42767) Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive

2023-03-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-42767: Summary: Add check condition to start connect server fallback with `in-memory` and auto ignored some tests strongly depend on hive Key: SPARK-42767 URL:

[jira] [Resolved] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42759. -- Resolution: Not A Problem > Avoid duplicated `build/apache-maven` install when target already exists

[jira] [Updated] (SPARK-42759) Avoid duplicated `build/apache-maven` install when target already exists

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42759: - Summary: Avoid duplicated `build/apache-maven` install when target already exists (was: Avoid repeated

[jira] [Reopened] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-42759: -- > Avoid repeated install of `build/apache-maven` > -- > >

[jira] [Resolved] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-42759. -- Resolution: Not A Problem > Avoid repeated install of `build/apache-maven` >

[jira] [Updated] (SPARK-42759) Avoid repeated install of `build/apache-maven`

2023-03-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42759: - Summary: Avoid repeated install of `build/apache-maven` (was: Avoid repeated downloads of

[jira] [Created] (SPARK-42759) Avoid repeated downloads of maven.tar.gz

2023-03-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-42759: Summary: Avoid repeated downloads of maven.tar.gz Key: SPARK-42759 URL: https://issues.apache.org/jira/browse/SPARK-42759 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42554) Spark Connect Scala Client

2023-03-08 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698216#comment-17698216 ] Yang Jie commented on SPARK-42554: -- Friendly ping [~ivoson] , [~hvanhovell] has created some tickets

[jira] [Created] (SPARK-42718) Upgrade rocksdbjni to 7.10.2

2023-03-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-42718: Summary: Upgrade rocksdbjni to 7.10.2 Key: SPARK-42718 URL: https://issues.apache.org/jira/browse/SPARK-42718 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42690) Implement CSV/JSON parsing funcions

2023-03-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697489#comment-17697489 ] Yang Jie commented on SPARK-42690: -- {code:java} message Parse { // (Required) Input relation to

[jira] [Commented] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-07 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697426#comment-17697426 ] Yang Jie commented on SPARK-42579: -- [~hvanhovell] should we make this one as `Fixed`,  Other work

[jira] [Created] (SPARK-42700) Add h2 as test dependency of connect-server module

2023-03-07 Thread Yang Jie (Jira)
Yang Jie created SPARK-42700: Summary: Add h2 as test dependency of connect-server module Key: SPARK-42700 URL: https://issues.apache.org/jira/browse/SPARK-42700 Project: Spark Issue Type: Bug

[jira] [Comment Edited] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697216#comment-17697216 ] Yang Jie edited comment on SPARK-42579 at 3/7/23 3:22 AM: -- [~hvanhovell]  In

[jira] [Updated] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42579: - Attachment: (was: image-2023-03-07-11-00-39-429.png) > Extend function.lit() to match

[jira] [Updated] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42579: - Attachment: (was: image-2023-03-07-11-00-49-379.png) > Extend function.lit() to match

[jira] [Comment Edited] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697216#comment-17697216 ] Yang Jie edited comment on SPARK-42579 at 3/7/23 3:09 AM: -- [~hvanhovell]  In

[jira] [Commented] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697216#comment-17697216 ] Yang Jie commented on SPARK-42579: -- [~hvanhovell]  In fact, if we compare

[jira] [Updated] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42579: - Attachment: image-2023-03-07-11-00-49-379.png > Extend function.lit() to match Literal.apply() >

[jira] [Updated] (SPARK-42579) Extend function.lit() to match Literal.apply()

2023-03-06 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42579: - Attachment: image-2023-03-07-11-00-39-429.png > Extend function.lit() to match Literal.apply() >

[jira] [Updated] (SPARK-42673) Make build/mvn build Spark only with the verified maven version

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Summary: Make build/mvn build Spark only with the verified maven version (was: Ban maven 3.9.x for

[jira] [Created] (SPARK-42675) Should clean up temp view after test

2023-03-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42675: Summary: Should clean up temp view after test Key: SPARK-42675 URL: https://issues.apache.org/jira/browse/SPARK-42675 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Description: GA  (was: {code:java} [ERROR] An error occurred attempting to read POM

[jira] [Updated] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42673: - Description: {code:java} [ERROR] An error occurred attempting to read POM

[jira] [Created] (SPARK-42673) Ban maven 3.9.x for Spark Build

2023-03-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-42673: Summary: Ban maven 3.9.x for Spark Build Key: SPARK-42673 URL: https://issues.apache.org/jira/browse/SPARK-42673 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42665) `simple udf` test failed using Maven

2023-03-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42665: - Description: {code:java} simple udf *** FAILED ***   io.grpc.StatusRuntimeException: INTERNAL:

[jira] [Updated] (SPARK-42665) `simple udf` test failed using Maven

2023-03-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42665: - Attachment: (was: image-2023-03-04-01-41-51-522.png) > `simple udf` test failed using Maven >

[jira] [Updated] (SPARK-42665) `simple udf` test failed using Maven

2023-03-03 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42665: - Attachment: image-2023-03-04-01-41-51-522.png > `simple udf` test failed using Maven >

[jira] [Created] (SPARK-42665) `simple udf` test failed using Maven

2023-03-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-42665: Summary: `simple udf` test failed using Maven Key: SPARK-42665 URL: https://issues.apache.org/jira/browse/SPARK-42665 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-42664) Support bloomFilter for DataFrameStatFunctions

2023-03-03 Thread Yang Jie (Jira)
Yang Jie created SPARK-42664: Summary: Support bloomFilter for DataFrameStatFunctions Key: SPARK-42664 URL: https://issues.apache.org/jira/browse/SPARK-42664 Project: Spark Issue Type:

[jira] [Created] (SPARK-42654) Upgrade dropwizard metrics 4.2.17

2023-03-02 Thread Yang Jie (Jira)
Yang Jie created SPARK-42654: Summary: Upgrade dropwizard metrics 4.2.17 Key: SPARK-42654 URL: https://issues.apache.org/jira/browse/SPARK-42654 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-42558) Implement DataFrameStatFunctions

2023-03-02 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695706#comment-17695706 ] Yang Jie commented on SPARK-42558: -- Seems DataFrameStatFunctions can only be partially implemented. 

[jira] [Created] (SPARK-42648) Upgrade versions-maven-plugin to 2.15.0

2023-03-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-42648: Summary: Upgrade versions-maven-plugin to 2.15.0 Key: SPARK-42648 URL: https://issues.apache.org/jira/browse/SPARK-42648 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42599) Make `CompatibilitySuite` as a tool like `dev/mima`

2023-02-27 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42599: - Description: Using maven to test `CompatibilitySuite` requires some pre-work(need maven build sql & 

[jira] [Created] (SPARK-42599) Make `CompatibilitySuite` as a tool like `dev/mima`

2023-02-27 Thread Yang Jie (Jira)
Yang Jie created SPARK-42599: Summary: Make `CompatibilitySuite` as a tool like `dev/mima` Key: SPARK-42599 URL: https://issues.apache.org/jira/browse/SPARK-42599 Project: Spark Issue Type:

[jira] [Commented] (SPARK-42538) `functions#lit` support more types

2023-02-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693770#comment-17693770 ] Yang Jie commented on SPARK-42538: -- Got it > `functions#lit` support more types >

[jira] [Commented] (SPARK-42538) `functions#lit` support more types

2023-02-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17693757#comment-17693757 ] Yang Jie commented on SPARK-42538: -- [~hvanhovell]  Should fix version be 3.4.0? It hasn't been

[jira] [Created] (SPARK-42538) `functions#lit` support more types

2023-02-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-42538: Summary: `functions#lit` support more types Key: SPARK-42538 URL: https://issues.apache.org/jira/browse/SPARK-42538 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42536) Upgrade log4j2 to 2.20.0

2023-02-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-42536: Summary: Upgrade log4j2 to 2.20.0 Key: SPARK-42536 URL: https://issues.apache.org/jira/browse/SPARK-42536 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42527) Scala Client add Window functions

2023-02-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42527: - Issue Type: Improvement (was: Bug) > Scala Client add Window functions >

[jira] [Created] (SPARK-42527) Scala Client add Window functions

2023-02-22 Thread Yang Jie (Jira)
Yang Jie created SPARK-42527: Summary: Scala Client add Window functions Key: SPARK-42527 URL: https://issues.apache.org/jira/browse/SPARK-42527 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

2023-02-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691877#comment-17691877 ] Yang Jie commented on SPARK-40278: -- OK, I change the status to `RESOLVED` > Used databricks

[jira] [Resolved] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

2023-02-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-40278. -- Resolution: Duplicate > Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed >

[jira] [Commented] (SPARK-42515) ClientE2ETestSuite local test failed

2023-02-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691702#comment-17691702 ] Yang Jie commented on SPARK-42515: -- will fix this later > ClientE2ETestSuite local test failed >

[jira] [Created] (SPARK-42515) ClientE2ETestSuite local test failed

2023-02-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-42515: Summary: ClientE2ETestSuite local test failed Key: SPARK-42515 URL: https://issues.apache.org/jira/browse/SPARK-42515 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-42514) Scala Client add partition transforms functions

2023-02-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-42514: Summary: Scala Client add partition transforms functions Key: SPARK-42514 URL: https://issues.apache.org/jira/browse/SPARK-42514 Project: Spark Issue Type:

[jira] [Commented] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

2023-02-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395 ] Yang Jie commented on SPARK-40278: -- SQL not failed, UI may break. [~ulysses] explained this at

[jira] [Comment Edited] (SPARK-40278) Used databricks spark-sql-pref with Spark 3.3 to run 3TB tpcds test failed

2023-02-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691395#comment-17691395 ] Yang Jie edited comment on SPARK-40278 at 2/21/23 5:49 AM: --- SQL not failed, UI

[jira] [Commented] (SPARK-41324) Follow-up on JDK-8180450

2023-02-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691072#comment-17691072 ] Yang Jie commented on SPARK-41324: -- >From the affected versions of

[jira] [Commented] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690877#comment-17690877 ] Yang Jie commented on SPARK-42491: -- it has not been published to the central repository > Upgrade

[jira] [Created] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42491: Summary: Upgrade jetty to 9.4.51.v20230217 Key: SPARK-42491 URL: https://issues.apache.org/jira/browse/SPARK-42491 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42491) Upgrade jetty to 9.4.51.v20230217

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42491: - Description: https://github.com/eclipse/jetty.project/releases/tag/jetty-9.4.51.v20230217 > Upgrade

[jira] [Updated] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42490: - Description: https://github.com/protocolbuffers/protobuf/releases/tag/v22.0 > Upgrade protobuf-java to

[jira] [Created] (SPARK-42490) Upgrade protobuf-java to 3.22.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42490: Summary: Upgrade protobuf-java to 3.22.0 Key: SPARK-42490 URL: https://issues.apache.org/jira/browse/SPARK-42490 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42489) Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42489: Summary: Upgrdae scala-parser-combinators from 2.1.1 to 2.2.0 Key: SPARK-42489 URL: https://issues.apache.org/jira/browse/SPARK-42489 Project: Spark Issue Type:

[jira] [Created] (SPARK-42488) Upgrade commons-crypto from 1.1.0 to 1.2.0

2023-02-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42488: Summary: Upgrade commons-crypto from 1.1.0 to 1.2.0 Key: SPARK-42488 URL: https://issues.apache.org/jira/browse/SPARK-42488 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42487) Upgrade Netty to 4.1.89

2023-02-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42487: - Summary: Upgrade Netty to 4.1.89 (was: Upgrade Netty from 4.1.89) > Upgrade Netty to 4.1.89 >

<    7   8   9   10   11   12   13   14   15   16   >