Re: What happens when: high-availability.storageDir: is not available?
Except job graph and completed checkpoint, high availability storage directory would also store blob data which would be accessed from both jobmanager and taskmanager nodes, you could refer to [1] to view the BLOB storage architecture. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-19%3A+Improved+BLOB+storage+architecture Best Yun Tang From: John Smith Sent: Thursday, June 13, 2019 21:18 To: Yun Tang Cc: user Subject: Re: What happens when: high-availability.storageDir: is not available? Thanks. Does this folder need to available for task nodes as well? Or just job nodes? On Wed., Jun. 12, 2019, 11:56 p.m. Yun Tang, mailto:myas...@live.com>> wrote: High availability storage directory would store completed checkpoint and submitted job graph and completed checkpoint. If this directory is unavailable when initialization, job would be submitted well. If this directory is unavailable when creating checkpoints, that checkpoint would finally failed. The frequency of this directory updated mainly depends on the checkpoint interval. Best Yun Tang From: John Smith mailto:java.dev@gmail.com>> Sent: Monday, June 10, 2019 23:55 To: user Subject: Re: What happens when: high-availability.storageDir: is not available? Or even how often do the master write there? On Fri, 7 Jun 2019 at 16:16, John Smith mailto:java.dev@gmail.com>> wrote: In HA setup what would happen if high-availability.storageDir: was unavailable?
Re: What happens when: high-availability.storageDir: is not available?
Thanks. Does this folder need to available for task nodes as well? Or just job nodes? On Wed., Jun. 12, 2019, 11:56 p.m. Yun Tang, wrote: > High availability storage directory would store completed checkpoint and > submitted job graph and completed checkpoint. If this directory is > unavailable when initialization, job would be submitted well. If this > directory is unavailable when creating checkpoints, that checkpoint would > finally failed. The frequency of this directory updated mainly depends on > the checkpoint interval. > > Best > Yun Tang > -- > *From:* John Smith > *Sent:* Monday, June 10, 2019 23:55 > *To:* user > *Subject:* Re: What happens when: high-availability.storageDir: is not > available? > > Or even how often do the master write there? > > On Fri, 7 Jun 2019 at 16:16, John Smith wrote: > > In HA setup what would happen if high-availability.storageDir: was > unavailable? > >
Re: What happens when: high-availability.storageDir: is not available?
High availability storage directory would store completed checkpoint and submitted job graph and completed checkpoint. If this directory is unavailable when initialization, job would be submitted well. If this directory is unavailable when creating checkpoints, that checkpoint would finally failed. The frequency of this directory updated mainly depends on the checkpoint interval. Best Yun Tang From: John Smith Sent: Monday, June 10, 2019 23:55 To: user Subject: Re: What happens when: high-availability.storageDir: is not available? Or even how often do the master write there? On Fri, 7 Jun 2019 at 16:16, John Smith mailto:java.dev@gmail.com>> wrote: In HA setup what would happen if high-availability.storageDir: was unavailable?
Re: What happens when: high-availability.storageDir: is not available?
Or even how often do the master write there? On Fri, 7 Jun 2019 at 16:16, John Smith wrote: > In HA setup what would happen if high-availability.storageDir: was > unavailable? >
What happens when: high-availability.storageDir: is not available?
In HA setup what would happen if high-availability.storageDir: was unavailable?
