Hello Ivo,
Le 27/08/2020 à 07:02, Ivo Jimenez a écrit : > > Our main concern is that this new arrow::dataset::RadosFormat class will be > deriving from the arrow::dataset::FileFormat class, which seems to raise a > conceptual mismatch as there isn’t really a RADOS format but rather a > formatting/serialization deferral that will be taking place, effectively > introducing a new client-server layer in the Dataset API. So, RadosFormat would ultimately redirect to another dataset format (e.g. ParquetFormat) when it comes to actually understanding the data? Regards Antoine.