Hi, Wang Mengxi, You should use the file compaction feature[1] to compact the small files.
Best, Hang [1] https://nightlies.apache.org/flink/flink-docs-release-1.17/docs/connectors/datastream/filesystem/#compaction Wang, Mengxi X via user <user@flink.apache.org> 于2023年7月4日周二 22:44写道： > Hi, > > > > We want to process one 2GB file and the output should also be a single 2GB > file, but after we enabled reactive mode it generated several hundred small > output files instead of one 2GB file. Can anybody help please? > > > > Best wishes, > > Mengxi Wang > > > > This message is confidential and subject to terms at: > https://www.jpmorgan.com/emaildisclaimer including on confidential, > privileged or legal entity information, malicious content and monitoring of > electronic messages. If you are not the intended recipient, please delete > this message and notify the sender immediately. Any unauthorized use is > strictly prohibited. >
