[ https://issues.apache.org/jira/browse/SPARK-20714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16007306#comment-16007306 ]
Apache Spark commented on SPARK-20714: -------------------------------------- User 'tdas' has created a pull request for this issue: https://github.com/apache/spark/pull/17954 > Fix match error when watermark is set with timeout = no timeout / processing > timeout > ------------------------------------------------------------------------------------ > > Key: SPARK-20714 > URL: https://issues.apache.org/jira/browse/SPARK-20714 > Project: Spark > Issue Type: Sub-task > Components: Structured Streaming > Affects Versions: 2.2.0 > Reporter: Tathagata Das > Assignee: Tathagata Das > Fix For: 2.2.0 > > > When watermark is set, and timeout conf is NoTimeout or ProcessingTimeTimeout > (both do not need the watermark), the query fails at runtime with the > following exception. > {code} > MatchException: > Some(org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificPredicate@1a9b798e) > (of class scala.Some) > > org.apache.spark.sql.execution.streaming.FlatMapGroupsWithStateExec$$anonfun$doExecute$1.apply(FlatMapGroupsWithStateExec.scala:120) > > org.apache.spark.sql.execution.streaming.FlatMapGroupsWithStateExec$$anonfun$doExecute$1.apply(FlatMapGroupsWithStateExec.scala:116) > > org.apache.spark.sql.execution.streaming.state.package$StateStoreOps$$anonfun$1.apply(package.scala:70) > > org.apache.spark.sql.execution.streaming.state.package$StateStoreOps$$anonfun$1.apply(package.scala:65) > > org.apache.spark.sql.execution.streaming.state.StateStoreRDD.compute(StateStoreRDD.scala:64) > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org