How reproducible is this problem / how often does it occur?
How is the cluster deployed?
Is anything else happening to the cluster around that that time (like a
JobMaster failure)?
On 24/07/2020 13:28, Tomasz Dudziak wrote:
Hi,
I have come across an issue related to GET /job/:jobId endpoint from
monitoring REST API in Flink 1.9.0. A few seconds after successfully
starting a job and confirming its status as RUNNING, that endpoint
would return 404 (Not Found). Interestingly, querying immediately
again (literally a millisecond later) would return a valid result. I
later noticed a similar behaviour in regard to a finished job as well.
At certain points in time that endpoint would arbitrarily return 404,
but similarly querying again would succeed. I saw this strange
behaviour only recently and it used to work fine before.
Do you know what could be the root cause of this? At the moment, as a
workaround I just query a job a couple of times in a row to ensure
whether it definitely does not exist or it is just being misreported
as non-existent, but this feels a bit like cottage industry…
Kind regards,
Tomasz
*Tomasz Dudziak *| Marshall Wace LLP, George House, 131 Sloane Street,
London, SW1X 9AT |**E-mail: t.dudz...@mwam.com
<mailto:t.dudz...@mwam.com>| Tel: +44 207 024 7061
This e-mail and any attachments are confidential to the addressee(s)
and may contain information that is legally privileged and/or
confidential. Please refer to http://www.mwam.com/email-disclaimer-uk
for important disclosures regarding this email. If we collect and use
your personal data we will use it in accordance with our privacy
policy, which can be reviewed at https://www.mwam.com/privacy-policy.
Marshall Wace LLP is authorised and regulated by the Financial Conduct
Authority. Marshall Wace LLP is a limited liability partnership
registered in England and Wales with registered number OC302228 and
registered office at George House, 131 Sloane Street, London, SW1X
9AT. If you are receiving this e-mail as a client, or an investor in
an investment vehicle, managed or advised by Marshall Wace North
America L.P., the sender of this e-mail is communicating with you in
the sender's capacity as an associated or related person of Marshall
Wace North America L.P., which is registered with the US Securities
and Exchange Commission as an investment adviser.