Hi, I'm just working on this situation you described, with millions of small files sized around 10KB. My idea is to compact this files into big ones and create indexes for them. This is a file system over file system and support append update, lazy delete. May this help .
-- [EMAIL PROTECTED] Institute of Computing Technology, Chinese Academy of Sciences, Beijing.