Hi experts, We have a storage engine that needs to manage large set of data (PB level) . Currently we store it as a single parquet file. After some searching, It seems the data should be cut into multiple parquet files for further reading/writing/managing. But I don't know whether there is already opensource solution to read/write/manage multiple parquet files. Our programming language is cpp. Any comments/suggestions are welcomed. Thanks!
Regards, Lizhou