Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
Thanks for sharing this information. I verified that it's a bug in Flink. The issue is that the Exceptions you're observing are happening while the job is initialized. We're not setting the exception history properly in that case. Matthias On Mon, Nov 29, 2021 at 2:08 PM Mahima Agarwal wrote: > Hi Matthias, > > We have created a JIRA ticket for this issue. Please find the jira id below > > https://issues.apache.org/jira/browse/FLINK-25096 > > Thanks > Mahima > > On Mon, Nov 29, 2021 at 2:24 PM Matthias Pohl > wrote: > >> Thanks Mahima, >> could you create a Jira ticket and, if possible, add the Flink logs? That >> would make it easier to investigate the problem. >> >> Best, >> Matthias >> >> On Sun, Nov 28, 2021 at 7:29 AM Mahima Agarwal >> wrote: >> >>> Thanks Matthias >>> >>> But we have observed the below 2 exceptions are coming in >>> root-exceptions but not in exceptionHistory: >>> >>> caused by: java.util.concurrent.CompletionException: >>> java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find >>> checkpoint or savepoint file/directory >>> 'C:\Users\abc\Documents\checkpoints\a737088e21206281db87f6492bcba074' on >>> file system 'file'. >>> >>> Caused by: java.lang.IllegalStateException: Failed to rollback to >>> checkpoint/savepoint >>> file:/mnt/c/Users/abc/Documents/checkpoints/a737088e21206281db87f6492bcba074/chk-144. >>> Thanks and Regards >>> Mahima Agarwal >>> >>> >>> On Fri, Nov 26, 2021, 13:19 Matthias Pohl >>> wrote: >>> Just to add a bit of context: The first-level members all-exceptions, root-exceptions, truncated and timestamp have been around for a longer time. The exceptionHistory was added in Flink 1.13. As part of this change, the aforementioned members were deprecated (see [1]). We kept them for backwards-compatibility reasons. That said, root-exception and all-exceptions are also represented in the exceptionHistory. Matthias [1] https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-exceptions On Thu, Nov 25, 2021 at 12:14 PM Chesnay Schepler wrote: > root-exception: The last exception that caused a job to fail. > all-exceptions: All exceptions that occurred the last time a job > failed. This is primarily useful for completed jobs. > exception-history: Exceptions that previously caused a job to fail. > > On 25/11/2021 11:52, Mahima Agarwal wrote: > > Hi Team, > > Please find the query below regarding exceptions > API(/jobs/:jobid/exceptions) > > > In response of above rest api: > > > Users are getting 3 types of exceptions: > 1. exceptionHistory > 2. all-exceptions > 3. root-exception > > > What is the purpose of the above 3 exceptions? > > > Any leads would be appreciated. > > Thanks > Mahima > >
Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
Hi Matthias, We have created a JIRA ticket for this issue. Please find the jira id below https://issues.apache.org/jira/browse/FLINK-25096 Thanks Mahima On Mon, Nov 29, 2021 at 2:24 PM Matthias Pohl wrote: > Thanks Mahima, > could you create a Jira ticket and, if possible, add the Flink logs? That > would make it easier to investigate the problem. > > Best, > Matthias > > On Sun, Nov 28, 2021 at 7:29 AM Mahima Agarwal > wrote: > >> Thanks Matthias >> >> But we have observed the below 2 exceptions are coming in root-exceptions >> but not in exceptionHistory: >> >> caused by: java.util.concurrent.CompletionException: >> java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find >> checkpoint or savepoint file/directory >> 'C:\Users\abc\Documents\checkpoints\a737088e21206281db87f6492bcba074' on >> file system 'file'. >> >> Caused by: java.lang.IllegalStateException: Failed to rollback to >> checkpoint/savepoint >> file:/mnt/c/Users/abc/Documents/checkpoints/a737088e21206281db87f6492bcba074/chk-144. >> Thanks and Regards >> Mahima Agarwal >> >> >> On Fri, Nov 26, 2021, 13:19 Matthias Pohl wrote: >> >>> Just to add a bit of context: The first-level members all-exceptions, >>> root-exceptions, truncated and timestamp have been around for a longer >>> time. The exceptionHistory was added in Flink 1.13. As part of this change, >>> the aforementioned members were deprecated (see [1]). We kept them for >>> backwards-compatibility reasons. >>> >>> That said, root-exception and all-exceptions are also represented in the >>> exceptionHistory. >>> >>> Matthias >>> >>> [1] >>> https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-exceptions >>> >>> On Thu, Nov 25, 2021 at 12:14 PM Chesnay Schepler >>> wrote: >>> root-exception: The last exception that caused a job to fail. all-exceptions: All exceptions that occurred the last time a job failed. This is primarily useful for completed jobs. exception-history: Exceptions that previously caused a job to fail. On 25/11/2021 11:52, Mahima Agarwal wrote: Hi Team, Please find the query below regarding exceptions API(/jobs/:jobid/exceptions) In response of above rest api: Users are getting 3 types of exceptions: 1. exceptionHistory 2. all-exceptions 3. root-exception What is the purpose of the above 3 exceptions? Any leads would be appreciated. Thanks Mahima
Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
Thanks Mahima, could you create a Jira ticket and, if possible, add the Flink logs? That would make it easier to investigate the problem. Best, Matthias On Sun, Nov 28, 2021 at 7:29 AM Mahima Agarwal wrote: > Thanks Matthias > > But we have observed the below 2 exceptions are coming in root-exceptions > but not in exceptionHistory: > > caused by: java.util.concurrent.CompletionException: > java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find > checkpoint or savepoint file/directory > 'C:\Users\abc\Documents\checkpoints\a737088e21206281db87f6492bcba074' on > file system 'file'. > > Caused by: java.lang.IllegalStateException: Failed to rollback to > checkpoint/savepoint > file:/mnt/c/Users/abc/Documents/checkpoints/a737088e21206281db87f6492bcba074/chk-144. > Thanks and Regards > Mahima Agarwal > > > On Fri, Nov 26, 2021, 13:19 Matthias Pohl wrote: > >> Just to add a bit of context: The first-level members all-exceptions, >> root-exceptions, truncated and timestamp have been around for a longer >> time. The exceptionHistory was added in Flink 1.13. As part of this change, >> the aforementioned members were deprecated (see [1]). We kept them for >> backwards-compatibility reasons. >> >> That said, root-exception and all-exceptions are also represented in the >> exceptionHistory. >> >> Matthias >> >> [1] >> https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-exceptions >> >> On Thu, Nov 25, 2021 at 12:14 PM Chesnay Schepler >> wrote: >> >>> root-exception: The last exception that caused a job to fail. >>> all-exceptions: All exceptions that occurred the last time a job failed. >>> This is primarily useful for completed jobs. >>> exception-history: Exceptions that previously caused a job to fail. >>> >>> On 25/11/2021 11:52, Mahima Agarwal wrote: >>> >>> Hi Team, >>> >>> Please find the query below regarding exceptions >>> API(/jobs/:jobid/exceptions) >>> >>> >>> In response of above rest api: >>> >>> >>> Users are getting 3 types of exceptions: >>> 1. exceptionHistory >>> 2. all-exceptions >>> 3. root-exception >>> >>> >>> What is the purpose of the above 3 exceptions? >>> >>> >>> Any leads would be appreciated. >>> >>> Thanks >>> Mahima >>> >>>
Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
Thanks Matthias But we have observed the below 2 exceptions are coming in root-exceptions but not in exceptionHistory: caused by: java.util.concurrent.CompletionException: java.lang.RuntimeException: java.io.FileNotFoundException: Cannot find checkpoint or savepoint file/directory 'C:\Users\abc\Documents\checkpoints\a737088e21206281db87f6492bcba074' on file system 'file'. Caused by: java.lang.IllegalStateException: Failed to rollback to checkpoint/savepoint file:/mnt/c/Users/abc/Documents/checkpoints/a737088e21206281db87f6492bcba074/chk-144. Thanks and Regards Mahima Agarwal On Fri, Nov 26, 2021, 13:19 Matthias Pohl wrote: > Just to add a bit of context: The first-level members all-exceptions, > root-exceptions, truncated and timestamp have been around for a longer > time. The exceptionHistory was added in Flink 1.13. As part of this change, > the aforementioned members were deprecated (see [1]). We kept them for > backwards-compatibility reasons. > > That said, root-exception and all-exceptions are also represented in the > exceptionHistory. > > Matthias > > [1] > https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-exceptions > > On Thu, Nov 25, 2021 at 12:14 PM Chesnay Schepler > wrote: > >> root-exception: The last exception that caused a job to fail. >> all-exceptions: All exceptions that occurred the last time a job failed. >> This is primarily useful for completed jobs. >> exception-history: Exceptions that previously caused a job to fail. >> >> On 25/11/2021 11:52, Mahima Agarwal wrote: >> >> Hi Team, >> >> Please find the query below regarding exceptions >> API(/jobs/:jobid/exceptions) >> >> >> In response of above rest api: >> >> >> Users are getting 3 types of exceptions: >> 1. exceptionHistory >> 2. all-exceptions >> 3. root-exception >> >> >> What is the purpose of the above 3 exceptions? >> >> >> Any leads would be appreciated. >> >> Thanks >> Mahima >> >> >>
Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
Just to add a bit of context: The first-level members all-exceptions, root-exceptions, truncated and timestamp have been around for a longer time. The exceptionHistory was added in Flink 1.13. As part of this change, the aforementioned members were deprecated (see [1]). We kept them for backwards-compatibility reasons. That said, root-exception and all-exceptions are also represented in the exceptionHistory. Matthias [1] https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-jobid-exceptions On Thu, Nov 25, 2021 at 12:14 PM Chesnay Schepler wrote: > root-exception: The last exception that caused a job to fail. > all-exceptions: All exceptions that occurred the last time a job failed. > This is primarily useful for completed jobs. > exception-history: Exceptions that previously caused a job to fail. > > On 25/11/2021 11:52, Mahima Agarwal wrote: > > Hi Team, > > Please find the query below regarding exceptions > API(/jobs/:jobid/exceptions) > > > In response of above rest api: > > > Users are getting 3 types of exceptions: > 1. exceptionHistory > 2. all-exceptions > 3. root-exception > > > What is the purpose of the above 3 exceptions? > > > Any leads would be appreciated. > > Thanks > Mahima > > >
Re: Query regarding exceptions API(/jobs/:jobid/exceptions)
root-exception: The last exception that caused a job to fail. all-exceptions: All exceptions that occurred the last time a job failed. This is primarily useful for completed jobs. exception-history: Exceptions that previously caused a job to fail. On 25/11/2021 11:52, Mahima Agarwal wrote: Hi Team, Please find the query below regarding exceptions API(/jobs/:jobid/exceptions) In response of above rest api: Users are getting 3 types of exceptions: 1. exceptionHistory 2. all-exceptions 3. root-exception What is the purpose of the above 3 exceptions? Any leads would be appreciated. Thanks Mahima
Query regarding exceptions API(/jobs/:jobid/exceptions)
Hi Team, Please find the query below regarding exceptions API(/jobs/:jobid/exceptions) In response of above rest api: Users are getting 3 types of exceptions: 1. exceptionHistory 2. all-exceptions 3. root-exception What is the purpose of the above 3 exceptions? Any leads would be appreciated. Thanks Mahima
