Would HDFS-6584 help with your use case ? On Wed, Aug 23, 2017 at 11:00 AM, Vijay Srinivasaraghavan < vijikar...@yahoo.com.invalid> wrote:
> Hello, > Is it possible for a Flink cluster to use multiple HDFS repository (HDFS-1 > for managing Flink state backend, HDFS-2 for syncing results from user > job)? > The scenario can be viewed in the context of running some jobs that are > meant to push the results to an archive repository (cold storage). > Since the hadoop configuration is static, I am thinking it is hard to > achieve this but I could be wrong. > Please share any thoughts. > RegardsVijay
