Hi > > In current topology setup with 3 bolts, reading from kafka spout, the > config is such that there are multiple tasks within a worker. > > So 1 kafka spout + 3 bolts = min 4 executers in a worker and then each > executer has multiple tasks. (Please correct me if my understanding is > wrong here) > > Now multiple tasks (bolts) within an executer are of the same type. In > this scenario a certain bolt tasks are supposed to upload files from a > common directory. This uploading takes place initially inside prepare > method. > > Almost all the time file not found errors show up but the files get > uploaded. I suspect this is due to use of common uploading directory. where > one task uploads the file but other one just knew abt its presence and at > the actual upload time it was gone. > > 1. Is it a good idea to share resources across storm tasks ? Are there any > guidelines as to whether and how to use resource sharing across the tasks > if required ? > 2. Will making method uploading files initially synchronized, help here ? > 3. Any other suggestion ? > > > > > > > > > > > > >
