Github user arunmahadevan commented on the pull request:
https://github.com/apache/storm/pull/1044#issuecomment-198255363
@dossett I went through the patch again and I have one question regarding
the writer key. I see that you maintain a separate writer per writer key. In
the docs you mention "The avro bolt will write records to separate files based
on the schema of the record being processed. In other words, if the bolt
receives records with two different schemas, it will write to two separate
files."
Is each writer expected to write to a separate file ? If so I dont see that
happening because in `getBasePathForNextFile` the file name is based on the
partition path and rotation id alone and then this path is passed to
`makeNewWriter`. So there could be multiple writers writing to the same file
and infact at overlapping offsets based on that writer's offset and may be
corrupt the file. Can you help me understand if each writer can write to the
same file or is it always supposed to write to different files?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
