How reproducible is this problem / how often does it occur?
How is the cluster deployed?
Is anything else happening to the cluster around that that time (like a JobMaster failure)?

On 24/07/2020 13:28, Tomasz Dudziak wrote:

Hi,

I have come across an issue related to GET /job/:jobId endpoint from monitoring REST API in Flink 1.9.0. A few seconds after successfully starting a job and confirming its status as RUNNING, that endpoint would return 404 (Not Found). Interestingly, querying immediately again (literally a millisecond later) would return a valid result. I later noticed a similar behaviour in regard to a finished job as well. At certain points in time that endpoint would arbitrarily return 404, but similarly querying again would succeed. I saw this strange behaviour only recently and it used to work fine before.

Do you know what could be the root cause of this? At the moment, as a workaround I just query a job a couple of times in a row to ensure whether it definitely does not exist or it is just being misreported as non-existent, but this feels a bit like cottage industry…

Kind regards,

Tomasz

*Tomasz Dudziak *| Marshall Wace LLP, George House, 131 Sloane Street, London, SW1X 9AT |**E-mail: t.dudz...@mwam.com <mailto:t.dudz...@mwam.com>| Tel: +44 207 024 7061

This e-mail and any attachments are confidential to the addressee(s) and may contain information that is legally privileged and/or confidential. Please refer to http://www.mwam.com/email-disclaimer-uk for important disclosures regarding this email. If we collect and use your personal data we will use it in accordance with our privacy policy, which can be reviewed at https://www.mwam.com/privacy-policy.

Marshall Wace LLP is authorised and regulated by the Financial Conduct Authority. Marshall Wace LLP is a limited liability partnership registered in England and Wales with registered number OC302228 and registered office at George House, 131 Sloane Street, London, SW1X 9AT. If you are receiving this e-mail as a client, or an investor in an investment vehicle, managed or advised by Marshall Wace North America L.P., the sender of this e-mail is communicating with you in the sender's capacity as an associated or related person of Marshall Wace North America L.P., which is registered with the US Securities and Exchange Commission as an investment adviser.


Reply via email to