[jira] [Reopened] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie reopened SPARK-41677: -- Restore this one > Protobuf serializer for StreamingQueryProgressWrapper >

[jira] [Updated] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42144: - Summary: Handle null string values in StageData/StreamBlockData/StreamingQueryData (was: Handle null

[jira] [Updated] (SPARK-42144) Handle null string values in StageData/StreamBlockData/StreamingQueryData

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42144: - Component/s: SQL Web UI > Handle null string values in

[jira] [Created] (SPARK-42144) Handle null string values in StageData/StreamBlockData

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42144: Summary: Handle null string values in StageData/StreamBlockData Key: SPARK-42144 URL: https://issues.apache.org/jira/browse/SPARK-42144 Project: Spark Issue Type:

[jira] [Created] (SPARK-42143) Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42143: Summary: Handle null string values in RDDStorageInfo/RDDDataDistribution/RDDPartitionInfo Key: SPARK-42143 URL: https://issues.apache.org/jira/browse/SPARK-42143 Project:

[jira] [Created] (SPARK-42142) Handle null string values in CachedQuantile/ExecutorSummary/PoolData

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42142: Summary: Handle null string values in CachedQuantile/ExecutorSummary/PoolData Key: SPARK-42142 URL: https://issues.apache.org/jira/browse/SPARK-42142 Project: Spark

[jira] [Created] (SPARK-42141) Handle null string values in ApplicationInfo/ApplicationAttemptInfo

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42141: Summary: Handle null string values in ApplicationInfo/ApplicationAttemptInfo Key: SPARK-42141 URL: https://issues.apache.org/jira/browse/SPARK-42141 Project: Spark

[jira] [Commented] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest

2023-01-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17679374#comment-17679374 ] Yang Jie commented on SPARK-42140: -- RuntimeInfo and PairStrings should not be null String,  can they be

[jira] [Created] (SPARK-42140) Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42140: Summary: Handle null string values in ApplicationEnvironmentInfo/RuntimeInfo/PairStrings/ExecutorResourceRequest/TaskResourceRequest Key: SPARK-42140 URL:

[jira] [Created] (SPARK-42139) Handle null string values in SQLExecutionUIData/SQLPlanMetric

2023-01-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-42139: Summary: Handle null string values in SQLExecutionUIData/SQLPlanMetric Key: SPARK-42139 URL: https://issues.apache.org/jira/browse/SPARK-42139 Project: Spark Issue

[jira] [Created] (SPARK-42129) Upgrade rocksdbjni to 7.9.2

2023-01-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42129: Summary: Upgrade rocksdbjni to 7.9.2 Key: SPARK-42129 URL: https://issues.apache.org/jira/browse/SPARK-42129 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-42112) Add null check before `ContinuousWriteRDD#compute` method close dataWriter

2023-01-19 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42112: - Description: Run    mvn clean test -pl sql/core -Dtest=none

[jira] [Created] (SPARK-42112) Add null check before `ContinuousWriteRDD#compute` method close dataWriter

2023-01-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-42112: Summary: Add null check before `ContinuousWriteRDD#compute` method close dataWriter Key: SPARK-42112 URL: https://issues.apache.org/jira/browse/SPARK-42112 Project: Spark

[jira] [Resolved] (SPARK-41485) Unify the environment variable of *_PROTOC_EXEC_PATH

2023-01-17 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie resolved SPARK-41485. -- Fix Version/s: 3.4.0 Target Version/s: 3.4.0 Resolution: Fixed

[jira] [Updated] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

2023-01-16 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-42100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-42100: - Description: export LIVE_UI_LOCAL_STORE_DIR = /tmp/spark-ui mvn clean install -pl sql/core

[jira] [Created] (SPARK-42100) Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer`

2023-01-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-42100: Summary: Protect null `SQLExecutionUIData#description` in `SQLExecutionUIDataSerializer` Key: SPARK-42100 URL: https://issues.apache.org/jira/browse/SPARK-42100 Project:

[jira] [Created] (SPARK-42096) Code cleanup for connect module

2023-01-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-42096: Summary: Code cleanup for connect module Key: SPARK-42096 URL: https://issues.apache.org/jira/browse/SPARK-42096 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42092) Upgrade RoaringBitmap to 0.9.38

2023-01-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-42092: Summary: Upgrade RoaringBitmap to 0.9.38 Key: SPARK-42092 URL: https://issues.apache.org/jira/browse/SPARK-42092 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42091) Upgrade jetty to 9.4.50.v20221201

2023-01-16 Thread Yang Jie (Jira)
Yang Jie created SPARK-42091: Summary: Upgrade jetty to 9.4.50.v20221201 Key: SPARK-42091 URL: https://issues.apache.org/jira/browse/SPARK-42091 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-42031) Clean up remove methods that do not need override

2023-01-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-42031: Summary: Clean up remove methods that do not need override Key: SPARK-42031 URL: https://issues.apache.org/jira/browse/SPARK-42031 Project: Spark Issue Type:

[jira] [Created] (SPARK-42030) Remove unused Constructor from RocksDB.TypeAliases and LevelDB.TypeAliases

2023-01-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-42030: Summary: Remove unused Constructor from RocksDB.TypeAliases and LevelDB.TypeAliases Key: SPARK-42030 URL: https://issues.apache.org/jira/browse/SPARK-42030 Project: Spark

[jira] [Created] (SPARK-42026) Protobuf serializer for AppSummary and PoolData

2023-01-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-42026: Summary: Protobuf serializer for AppSummary and PoolData Key: SPARK-42026 URL: https://issues.apache.org/jira/browse/SPARK-42026 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41968) Refactor ProtobufSerDe to ProtobufSerDe[T]

2023-01-10 Thread Yang Jie (Jira)
Yang Jie created SPARK-41968: Summary: Refactor ProtobufSerDe to ProtobufSerDe[T] Key: SPARK-41968 URL: https://issues.apache.org/jira/browse/SPARK-41968 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41941) Upgrade scalatest related test dependencies to 3.2.15

2023-01-08 Thread Yang Jie (Jira)
Yang Jie created SPARK-41941: Summary: Upgrade scalatest related test dependencies to 3.2.15 Key: SPARK-41941 URL: https://issues.apache.org/jira/browse/SPARK-41941 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41894) sql/core module mvn clean failed

2023-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654823#comment-17654823 ] Yang Jie commented on SPARK-41894: -- The running environment is linux,  I haven't found the specific

[jira] [Created] (SPARK-41894) sql/core module mvn clean failed

2023-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-41894: Summary: sql/core module mvn clean failed Key: SPARK-41894 URL: https://issues.apache.org/jira/browse/SPARK-41894 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-41890) Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/SparkPlanGraphWrapperSerializer` for Scala 2.13

2023-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41890: - Description: Similar work to SPARK-41709 (was: Similar work as SPARK-41709) > Reduce `toSeq` in >

[jira] [Updated] (SPARK-41890) Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/SparkPlanGraphWrapperSerializer` for Scala 2.13

2023-01-04 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41890: - Summary: Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/SparkPlanGraphWrapperSerializer` for

[jira] [Created] (SPARK-41890) Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/`sql/core/src/main/scala/org/apache/spark/status/protobuf/sql/SparkPlanGraphWrapperSerializer` for Scala 2.13

2023-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-41890: Summary: Reduce `toSeq` in `RDDOperationGraphWrapperSerializer`/`sql/core/src/main/scala/org/apache/spark/status/protobuf/sql/SparkPlanGraphWrapperSerializer` for Scala 2.13 Key: SPARK-41890

[jira] [Created] (SPARK-41883) Upgrade dropwizard metrics 4.2.15

2023-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-41883: Summary: Upgrade dropwizard metrics 4.2.15 Key: SPARK-41883 URL: https://issues.apache.org/jira/browse/SPARK-41883 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41882) Add tests for SQLAppStatusStore with RocksDB Backend

2023-01-04 Thread Yang Jie (Jira)
Yang Jie created SPARK-41882: Summary: Add tests for SQLAppStatusStore with RocksDB Backend Key: SPARK-41882 URL: https://issues.apache.org/jira/browse/SPARK-41882 Project: Spark Issue Type:

[jira] [Created] (SPARK-41802) Upgrade Apache httpcore to 4.4.16

2022-12-31 Thread Yang Jie (Jira)
Yang Jie created SPARK-41802: Summary: Upgrade Apache httpcore to 4.4.16 Key: SPARK-41802 URL: https://issues.apache.org/jira/browse/SPARK-41802 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41750) Upgrade dev.ludovic.netlib to 3.0.3

2022-12-28 Thread Yang Jie (Jira)
Yang Jie created SPARK-41750: Summary: Upgrade dev.ludovic.netlib to 3.0.3 Key: SPARK-41750 URL: https://issues.apache.org/jira/browse/SPARK-41750 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41729: - Parent: SPARK-37935 Issue Type: Sub-task (was: Improvement) > Assign name to

[jira] [Created] (SPARK-41729) Assign name to _LEGACY_ERROR_TEMP_0011

2022-12-26 Thread Yang Jie (Jira)
Yang Jie created SPARK-41729: Summary: Assign name to _LEGACY_ERROR_TEMP_0011 Key: SPARK-41729 URL: https://issues.apache.org/jira/browse/SPARK-41729 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41711) Upgrade protobuf-java to 3.21.12

2022-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-41711: Summary: Upgrade protobuf-java to 3.21.12 Key: SPARK-41711 URL: https://issues.apache.org/jira/browse/SPARK-41711 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41709) Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13

2022-12-25 Thread Yang Jie (Jira)
Yang Jie created SPARK-41709: Summary: Explicitly define `Seq` as `collection.Seq` to reduce `toSeq` when create ui objects from protobuf objects for Scala 2.13 Key: SPARK-41709 URL:

[jira] [Created] (SPARK-41694) Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop()

2022-12-23 Thread Yang Jie (Jira)
Yang Jie created SPARK-41694: Summary: Add new config to clean up `spark.ui.store.path` directory when SparkContext.stop() Key: SPARK-41694 URL: https://issues.apache.org/jira/browse/SPARK-41694 Project:

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651481#comment-17651481 ] Yang Jie commented on SPARK-41053: -- {quote}For example we can have protobuf serializer support for all

[jira] [Commented] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651478#comment-17651478 ] Yang Jie commented on SPARK-41676: -- {code:java} private[sql] class StreamingQueryData( val name:

[jira] [Commented] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2022-12-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651476#comment-17651476 ] Yang Jie commented on SPARK-41677: --   {code:java} private[sql] class StreamingQueryProgressWrapper(val

[jira] [Commented] (SPARK-41678) Protobuf serializer for LogInfo

2022-12-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651166#comment-17651166 ] Yang Jie commented on SPARK-41678: -- Yes, I see,  Thanks [~Gengliang.Wang]    > Protobuf serializer

[jira] [Commented] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo

2022-12-22 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651165#comment-17651165 ] Yang Jie commented on SPARK-41682: -- OK > Protobuf serializer for ApplicationStoreInfo >

[jira] [Comment Edited] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651121#comment-17651121 ] Yang Jie edited comment on SPARK-41053 at 12/22/22 7:51 AM:

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651121#comment-17651121 ] Yang Jie commented on SPARK-41053: -- [~Gengliang.Wang] I have created some more tickets. Please check

[jira] [Created] (SPARK-41682) Protobuf serializer for ApplicationStoreInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41682: Summary: Protobuf serializer for ApplicationStoreInfo Key: SPARK-41682 URL: https://issues.apache.org/jira/browse/SPARK-41682 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-41679) Protobuf serializer for StreamBlockData

2022-12-21 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41679: - Summary: Protobuf serializer for StreamBlockData (was: Protobuf serializer for LogInfo) > Protobuf

[jira] [Created] (SPARK-41680) Protobuf serializer for CachedQuantile

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41680: Summary: Protobuf serializer for CachedQuantile Key: SPARK-41680 URL: https://issues.apache.org/jira/browse/SPARK-41680 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41679) Protobuf serializer for LogInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41679: Summary: Protobuf serializer for LogInfo Key: SPARK-41679 URL: https://issues.apache.org/jira/browse/SPARK-41679 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41678) Protobuf serializer for LogInfo

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41678: Summary: Protobuf serializer for LogInfo Key: SPARK-41678 URL: https://issues.apache.org/jira/browse/SPARK-41678 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41677) Protobuf serializer for StreamingQueryProgressWrapper

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41677: Summary: Protobuf serializer for StreamingQueryProgressWrapper Key: SPARK-41677 URL: https://issues.apache.org/jira/browse/SPARK-41677 Project: Spark Issue Type:

[jira] [Created] (SPARK-41676) Protobuf serializer for StreamingQueryData

2022-12-21 Thread Yang Jie (Jira)
Yang Jie created SPARK-41676: Summary: Protobuf serializer for StreamingQueryData Key: SPARK-41676 URL: https://issues.apache.org/jira/browse/SPARK-41676 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41644) Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer

2022-12-20 Thread Yang Jie (Jira)
Yang Jie created SPARK-41644: Summary: Introducing SPI mechanism to make it easy for other modules to register ProtoBufSerializer Key: SPARK-41644 URL: https://issues.apache.org/jira/browse/SPARK-41644

[jira] [Commented] (SPARK-41431) Protobuf serializer for SQLExecutionUIData

2022-12-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17649691#comment-17649691 ] Yang Jie commented on SPARK-41431: -- hmm... both `SparkPlanGraphWrapper` and  `SQLExecutionUIData` both

[jira] [Comment Edited] (SPARK-41431) Protobuf serializer for SQLExecutionUIData

2022-12-20 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17649691#comment-17649691 ] Yang Jie edited comment on SPARK-41431 at 12/20/22 11:11 AM: - hmm... both

[jira] [Created] (SPARK-41587) Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7

2022-12-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-41587: Summary: Upgrade org.scalatestplus:selenium-4-4 to org.scalatestplus:selenium-4-7 Key: SPARK-41587 URL: https://issues.apache.org/jira/browse/SPARK-41587 Project: Spark

[jira] [Created] (SPARK-41584) Upgrade RoaringBitmap to 0.9.36

2022-12-19 Thread Yang Jie (Jira)
Yang Jie created SPARK-41584: Summary: Upgrade RoaringBitmap to 0.9.36 Key: SPARK-41584 URL: https://issues.apache.org/jira/browse/SPARK-41584 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41582) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022`

2022-12-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-41582: Summary: Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0022` Key: SPARK-41582 URL: https://issues.apache.org/jira/browse/SPARK-41582 Project: Spark

[jira] [Created] (SPARK-41569) Upgrade rocksdbjni to 7.8.3

2022-12-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-41569: Summary: Upgrade rocksdbjni to 7.8.3 Key: SPARK-41569 URL: https://issues.apache.org/jira/browse/SPARK-41569 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41567) Move configuration of `versions-maven-plugin` to parent pom

2022-12-18 Thread Yang Jie (Jira)
Yang Jie created SPARK-41567: Summary: Move configuration of `versions-maven-plugin` to parent pom Key: SPARK-41567 URL: https://issues.apache.org/jira/browse/SPARK-41567 Project: Spark Issue

[jira] [Created] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

2022-12-15 Thread Yang Jie (Jira)
Yang Jie created SPARK-41544: Summary: Upgrade `versions-maven-plugin` to 2.14.1 Key: SPARK-41544 URL: https://issues.apache.org/jira/browse/SPARK-41544 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-41522) GA dependencies test faild

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647846#comment-17647846 ] Yang Jie commented on SPARK-41522: -- also cc [~dongjoon]  > GA dependencies test faild >

[jira] [Updated] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41523: - Attachment: image-2022-12-15-12-53-02-818.png > `protoc-jar-maven-plugin` should uniformly use >

[jira] [Updated] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41523: - Description:

[jira] [Created] (SPARK-41523) `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version

2022-12-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-41523: Summary: `protoc-jar-maven-plugin` should uniformly use `protoc-jar-maven-plugin.version` as the version Key: SPARK-41523 URL: https://issues.apache.org/jira/browse/SPARK-41523

[jira] [Updated] (SPARK-41522) GA dependencies test faild

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41522: - Description: {code:java} Error: ] Some problems were encountered while processing the POMs: 58[FATAL]

[jira] [Commented] (SPARK-41522) GA dependencies test faild

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647831#comment-17647831 ] Yang Jie commented on SPARK-41522: -- cc [~gurwls223]  > GA dependencies test faild >

[jira] [Updated] (SPARK-41522) GA dependencies test faild

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41522: - Description: {code:java} Error: ] Some problems were encountered while processing the POMs: 58[FATAL]

[jira] [Created] (SPARK-41522) GA dependencies test faild

2022-12-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-41522: Summary: GA dependencies test faild Key: SPARK-41522 URL: https://issues.apache.org/jira/browse/SPARK-41522 Project: Spark Issue Type: Bug Components:

[jira] [Comment Edited] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647097#comment-17647097 ] Yang Jie edited comment on SPARK-41517 at 12/14/22 1:15 PM: cc [~gurwls223]

[jira] [Commented] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation

2022-12-14 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17647097#comment-17647097 ] Yang Jie commented on SPARK-41517: -- cc [~gurwls223]  > Failed to find name hashes for

[jira] [Created] (SPARK-41517) Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation

2022-12-14 Thread Yang Jie (Jira)
Yang Jie created SPARK-41517: Summary: Failed to find name hashes for org.apache.spark.connect.proto.LocalRelation Key: SPARK-41517 URL: https://issues.apache.org/jira/browse/SPARK-41517 Project: Spark

[jira] [Created] (SPARK-41508) assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable

2022-12-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-41508: Summary: assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable Key: SPARK-41508 URL: https://issues.apache.org/jira/browse/SPARK-41508 Project:

[jira] [Updated] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable

2022-12-13 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41508: - Summary: Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable (was: assign

[jira] [Created] (SPARK-41507) Correct group of collection_funcs

2022-12-13 Thread Yang Jie (Jira)
Yang Jie created SPARK-41507: Summary: Correct group of collection_funcs Key: SPARK-41507 URL: https://issues.apache.org/jira/browse/SPARK-41507 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41505) Assign name to _LEGACY_ERROR_TEMP_1179

2022-12-12 Thread Yang Jie (Jira)
Yang Jie created SPARK-41505: Summary: Assign name to _LEGACY_ERROR_TEMP_1179 Key: SPARK-41505 URL: https://issues.apache.org/jira/browse/SPARK-41505 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41482) Upgrade dropwizard metrics 4.2.13

2022-12-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-41482: Summary: Upgrade dropwizard metrics 4.2.13 Key: SPARK-41482 URL: https://issues.apache.org/jira/browse/SPARK-41482 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0020`

2022-12-11 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41481: - Summary: Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_0020` (was: Reuse

[jira] [Created] (SPARK-41481) Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_1020`

2022-12-11 Thread Yang Jie (Jira)
Yang Jie created SPARK-41481: Summary: Reuse `INVALID_TYPED_LITERAL` instead of `_LEGACY_ERROR_TEMP_1020` Key: SPARK-41481 URL: https://issues.apache.org/jira/browse/SPARK-41481 Project: Spark

[jira] [Created] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41435: Summary: Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null Key: SPARK-41435 URL: https://issues.apache.org/jira/browse/SPARK-41435

[jira] [Created] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41417: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_0019 Key: SPARK-41417 URL: https://issues.apache.org/jira/browse/SPARK-41417 Project: Spark Issue Type:

[jira] [Created] (SPARK-41409) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043`

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41409: Summary: Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` Key: SPARK-41409 URL: https://issues.apache.org/jira/browse/SPARK-41409 Project: Spark Issue

[jira] [Created] (SPARK-41408) Upgrade scala-maven-plugin to 4.8.0

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41408: Summary: Upgrade scala-maven-plugin to 4.8.0 Key: SPARK-41408 URL: https://issues.apache.org/jira/browse/SPARK-41408 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-41404) Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41404: Summary: Support `ColumnarBatchSuite#testRandomRows` to test more primitive dataType Key: SPARK-41404 URL: https://issues.apache.org/jira/browse/SPARK-41404 Project: Spark

[jira] [Commented] (SPARK-41392) spark builds against hadoop trunk/3.4.0-SNAPSHOT fail in scala-maven plugin

2022-12-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643414#comment-17643414 ] Yang Jie commented on SPARK-41392: -- Can you give the complete compilation command and the compilation

[jira] [Created] (SPARK-41393) Upgrade slf4j to 2.0.5

2022-12-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-41393: Summary: Upgrade slf4j to 2.0.5 Key: SPARK-41393 URL: https://issues.apache.org/jira/browse/SPARK-41393 Project: Spark Issue Type: Improvement Components:

[jira] [Created] (SPARK-41390) Update the script used to generate register function in UDFRegistration

2022-12-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-41390: Summary: Update the script used to generate register function in UDFRegistration Key: SPARK-41390 URL: https://issues.apache.org/jira/browse/SPARK-41390 Project: Spark

[jira] [Updated] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1044`

2022-12-05 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41389: - Summary: Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1044` (was: Reuse `WRONG_NUM_ARGS`

[jira] [Created] (SPARK-41389) Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` and `_LEGACY_ERROR_TEMP_1044`

2022-12-05 Thread Yang Jie (Jira)
Yang Jie created SPARK-41389: Summary: Reuse `WRONG_NUM_ARGS` instead of `_LEGACY_ERROR_TEMP_1043` and `_LEGACY_ERROR_TEMP_1044` Key: SPARK-41389 URL: https://issues.apache.org/jira/browse/SPARK-41389

[jira] [Created] (SPARK-41359) Use `PhysicalDataType` instead of DataType in UnsafeRow

2022-12-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-41359: Summary: Use `PhysicalDataType` instead of DataType in UnsafeRow Key: SPARK-41359 URL: https://issues.apache.org/jira/browse/SPARK-41359 Project: Spark Issue Type:

[jira] [Updated] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

2022-12-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41358: - Parent: SPARK-41356 Issue Type: Sub-task (was: Improvement) > Use `PhysicalDataType` instead

[jira] [Created] (SPARK-41358) Use `PhysicalDataType` instead of DataType in ColumnVectorUtils

2022-12-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-41358: Summary: Use `PhysicalDataType` instead of DataType in ColumnVectorUtils Key: SPARK-41358 URL: https://issues.apache.org/jira/browse/SPARK-41358 Project: Spark

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

2022-12-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Description: SPARK-41226 Introduce physical data types, and the use  PhysicalDataType replace DataType

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

2022-12-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Issue Type: Umbrella (was: Improvement) > Find and refactor all cases suitable for using

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

2022-12-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Priority: Major (was: Minor) > Find and refactor all cases suitable for using `PhysicalDataType`

[jira] [Updated] (SPARK-41356) Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType`

2022-12-01 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Jie updated SPARK-41356: - Summary: Find and refactor all cases suitable for using `PhysicalDataType` instead of `DataType` (was:

[jira] [Created] (SPARK-41356) Refactor `ColumnVectorUtils#populate` method to use physical types

2022-12-01 Thread Yang Jie (Jira)
Yang Jie created SPARK-41356: Summary: Refactor `ColumnVectorUtils#populate` method to use physical types Key: SPARK-41356 URL: https://issues.apache.org/jira/browse/SPARK-41356 Project: Spark

[jira] [Created] (SPARK-41348) Refactor `UnsafeArrayWriterSuite` to check error class

2022-11-30 Thread Yang Jie (Jira)
Yang Jie created SPARK-41348: Summary: Refactor `UnsafeArrayWriterSuite` to check error class Key: SPARK-41348 URL: https://issues.apache.org/jira/browse/SPARK-41348 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2022-11-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641425#comment-17641425 ] Yang Jie commented on SPARK-41233: -- Please go ahead ~ Thanks ~ > High-order function: array_prepend >

[jira] [Commented] (SPARK-41232) High-order function: array_append

2022-11-30 Thread Yang Jie (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17641426#comment-17641426 ] Yang Jie commented on SPARK-41232: -- [~senthh] Sure, please go ahead. > High-order function:

<    9   10   11   12   13   14   15   16   17   18   >