Hi Ram, Thanks for that. We configure a path with ABFSS scheme in the following settings:
- state.checkpoints.dir - state.savepoints.dir - high-availability.storageDir We use RocksDB with incremental checkpointing every minute. I found the metrics from Azure in the storage account under Monitoring, Insights, Failures, scrolling down. I'll attach a screenshot here, although I'm not sure that works well with the distribution list. Regards, Alexis. Am Do., 28. Sept. 2023 um 07:28 Uhr schrieb ramkrishna vasudevan < ramvasu.fl...@gmail.com>: > Can you help with more info here? > The RocksDB backend itself is in ABFS instead of local? Or you mean the > checkpoint is in ABFS but local dir for RocksDB is in local storage? > > GetPathSTatus is done by your monitoring pages? We run Flink on ABFS so we > would like to see if we can help you out. > > Regards > Ram > > On Thu, Sep 28, 2023 at 2:06 AM Alexis Sarda-Espinosa < > sarda.espin...@gmail.com> wrote: > >> Hello, >> >> We are using ABFSS for RocksDB's backend as well as the storage dir >> required for Kubernetes HA. In the Azure Portal's monitoring insights I see >> that every single operation contains failing transactions for the >> GetPathStatus API. Unfortunately I don't see any additional details, but I >> know the storage account is only used by Flink. Checkpointing isn't >> failing, but I wonder if this could be an issue in the long term? >> >> Regards, >> Alexis. >> >>
