[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-10-29 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r514429039 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -36,10 +36,14 @@ import org.apache.spark.sql.t

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-10-17 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r507022428 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -36,10 +36,14 @@ import org.apache.spark.sql.t

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-10-01 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r498629306 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStoreRDD.scala ## @@ -29,6 +29,57 @@ import org.apache.spark.sql

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-21 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r491744046 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -81,6 +74,42 @@ trait StateStore { iterat

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-20 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r491747706 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -81,6 +74,42 @@ trait StateStore { iterat

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-20 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r491744046 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -81,6 +74,42 @@ trait StateStore { iterat

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-18 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r491243565 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala ## @@ -253,7 +253,8 @@ case class StateStoreRestore

[GitHub] [spark] viirya commented on a change in pull request #26935: [SPARK-30294][SS] Explicitly defines read-only StateStore and optimize for HDFSBackedStateStore

2020-09-18 Thread GitBox
viirya commented on a change in pull request #26935: URL: https://github.com/apache/spark/pull/26935#discussion_r491241918 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/state/StateStore.scala ## @@ -109,6 +109,41 @@ trait StateStore { def ha