This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 17a5007 [SPARK-30865][SQL][SS] Refactor DateTimeUtils
add 86b54f3 [SPARK-31894][SS] Introduce UnsafeRow format validation for
streaming state store
No new revisions were added by this update.
Summary of changes:
.../spark/sql/catalyst/util/UnsafeRowUtils.scala | 86 ++++++++++++++++++++++
.../org/apache/spark/sql/internal/SQLConf.scala | 16 +++-
.../sql/catalyst/util/UnsafeRowUtilsSuite.scala | 55 ++++++++++++++
.../state/HDFSBackedStateStoreProvider.scala | 13 ++++
.../sql/execution/streaming/state/StateStore.scala | 33 ++++++++-
.../execution/streaming/state/StateStoreConf.scala | 19 ++++-
.../execution/streaming/state/StateStoreRDD.scala | 5 +-
.../sql/execution/streaming/state/package.scala | 6 +-
.../execution/streaming/statefulOperators.scala | 6 +-
9 files changed, 228 insertions(+), 11 deletions(-)
create mode 100644
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtils.scala
create mode 100644
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/UnsafeRowUtilsSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
