Shixiong Zhu created SPARK-30936:
------------------------------------

             Summary: Fix the broken forwards-compatibility in JsonProtocol
                 Key: SPARK-30936
                 URL: https://issues.apache.org/jira/browse/SPARK-30936
             Project: Spark
          Issue Type: Improvement
          Components: Spark Core
    Affects Versions: 3.0.0
            Reporter: Shixiong Zhu


JsonProtocol is supposed to provide strong backwards-compatibility and 
forwards-compatibility guarantees: any version of Spark should be able to read 
JSON output written by any other version, including newer versions.

However, the forwards-compatibility guarantee is broken for events parsed by 
"ObjectMapper". If a new field is added to an event parsed by "ObjectMapper" 
(e.g., 
https://github.com/apache/spark/commit/6dc5921e66d56885b95c07e56e687f9f6c1eaca7#diff-dc5c7a41fbb7479cef48b67eb41ad254R33),
 this event cannot be parsed by an old version of Spark History Server.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to