may be you are experiencing problem with FileOutputCommiter vs
DirectCommiter while working with s3? do you have hdfs so you can try it to
verify?
committing in s3 will copy 1-by-1 all partitions to your final destination
bucket from _temporary, so this stage might become a bottleneck(so reducing
We just deployed our first streaming apps. The next step is running them so
they run reliably
We have spend a lot of time reading the various prog guides looking at the
standalone cluster manager app performance web pages.
Looking at the streaming tab and the stages tab have been the most
