Re: Router using Key-Value Store for Mount table

2024-05-10 Thread Ayush Saxena
Hi Fengnan, Not sure if I am catching you right, but did you explore: HDFS-16943 There are other impl I believe as well as mentioned over here [1], can explore that. or did I catch the question wrong -Ayush [1] https://github.com/apache/hadoop/blob/700b3e4800b074c94c2d48ed61cb0880fe3b408d/hado

Router using Key-Value Store for Mount table

2024-05-10 Thread Fengnan Li
Hi community, Router uses Zookeeper to its MountTable, which is the key dataset to make the component function. Over time more and more entries are added into the Mount table. The current Router in memory cache from ZK often takes a lot of time to sync. (10-15 mins to download 1Million entries in