On Wed, Jul 29, 2020 at 9:36 AM Ivo Galic <[email protected]> wrote: > Hi everyone, > > Some of my customers asked me about target file size when outputting > Parquet and Avro files. Do you think it makes sense to create a feature > request with buffer target size with some timeout (for performance) so > number of shards get automatically calculated? > > Similar post > > https://lists.apache.org/thread.html/r5620e4ad469a206eb9c04bbd7cafa436b9746caa6a49e311ef474628%40%3Cuser.beam.apache.org%3E
It's not clear to me what the feature request is. Is it to limit the size of output files ? If so see here: https://lists.apache.org/thread.html/r3f5083f2975762709a56d7a0f5a46b92b94174dc31326bd3dfea9d93%40%3Cdev.beam.apache.org%3E > > > Thank you, > Ivo >
