[GitHub] [spark] zsxwing commented on a change in pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-12-02 Thread GitBox
zsxwing commented on a change in pull request #24173: URL: https://github.com/apache/spark/pull/24173#discussion_r534679600 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateSchemaCompatibilityChecker.scala ## @@ -0,0 +1,142 @@ +/* + * L

[GitHub] [spark] zsxwing commented on a change in pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-12-02 Thread GitBox
zsxwing commented on a change in pull request #24173: URL: https://github.com/apache/spark/pull/24173#discussion_r534677982 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -391,10 +399,18 @@ object StateStore extends

[GitHub] [spark] zsxwing commented on a change in pull request #24173: [SPARK-27237][SS] Introduce State schema validation among query restart

2020-11-23 Thread GitBox
zsxwing commented on a change in pull request #24173: URL: https://github.com/apache/spark/pull/24173#discussion_r528908515 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateSchemaCompatibilityChecker.scala ## @@ -0,0 +1,120 @@ +/* + * L