Hi, My team was exploring changes to the HDFS bolts that would allow for partitioning the output, for example into directories corresponding to day. This is different that the existing functionality to rotate files based on a set length of time. For unrelated reasons, we are probably not going to pursue this further. However, I have some code changes that implement most of this functionality for at least some partitioning use cases. If there is interest from the user or developer community for this feature, I could get in shape for a PR to get feedback about our implementation approach.
Any feedback on this idea is welcome. Thanks! -Aaron
