Gengliang Wang created SPARK-22763:
--------------------------------------
Summary: SHS: Ignore unknown events and parse through the file
Key: SPARK-22763
URL: https://issues.apache.org/jira/browse/SPARK-22763
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 2.2.1
Reporter: Gengliang Wang
While spark code changes, there are new events in event log:
https://github.com/apache/spark/pull/19649
And we used to maintain a whitelist to avoid exceptions:
https://github.com/apache/spark/pull/15663/files
Currently Spark history server will stop parsing on unknown events or
unrecognized properties. We may still see part of the UI data.
For better compatibility, we can ignore unknown events and parse through the
log file.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
