ericm-db commented on code in PR #45991:
URL: https://github.com/apache/spark/pull/45991#discussion_r1569209877
##########
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TTLState.scala:
##########
@@ -59,23 +75,6 @@ trait TTLState {
* @return number of values cleaned up.
*/
def clearExpiredState(): Long
-
- /**
- * Clears the user state associated with this grouping key
- * if it has expired. This function is called by Spark to perform
- * cleanup at the end of transformWithState processing.
- *
- * Spark uses a secondary index to determine if the user state for
- * this grouping key has expired. However, its possible that the user
- * has updated the TTL and secondary index is out of date. Implementations
- * must validate that the user State has actually expired before cleanup
based
- * on their own State data.
- *
- * @param groupingKey grouping key for which cleanup should be performed.
- *
- * @return how many state objects were cleaned up.
- */
- def clearIfExpired(groupingKey: Array[Byte]): Long
Review Comment:
We removed it from the TTLState because it only applies to SingleKeyStateTTL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
