Hi All, I've been trying to debug the Spark UI source code to replicate the same Metric monitoring mechanism in my application.
I've found a KVStore wrapper which stores all the metrics in a LevelDb store. This KVStore wrapper is available as a spark-dependency but we cannot access the metrics directly from spark since they are all private. Can we use this store to store our own metrics? Also can we retrieve these metrics based on timestamp? Thanks and Regards, Anshi -- * * *DISCLAIMER:* All the content in email is intended for the recipient and not to be published elsewhere without Exadatum consent. And attachments shall be send only if required and with ownership of the sender. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. Email transmission cannot be guaranteed to be secure or error-free, as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender, therefore, does not accept liability for any errors or omissions in the contents of this message which arise as a result of email transmission. If verification is required, please request a hard-copy version.
