Shixiong Zhu created SPARK-31245: ------------------------------------ Summary: Document the backward incompatibility issue for Encoders.kryo and Encoders.javaSerialization Key: SPARK-31245 URL: https://issues.apache.org/jira/browse/SPARK-31245 Project: Spark Issue Type: Documentation Components: Structured Streaming Affects Versions: 3.0.0 Reporter: Shixiong Zhu
We should document that when a user uses Encoders.kryo or Encoders.javaSerialization for state store, we don't guarantee binary compatibility across different Spark versions because these two types of encoders can be broken easily. Maybe add a new section after http://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#recovery-semantics-after-changes-in-a-streaming-query -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org