Hello, I’ve managed to implement ADLFS/gen2 filesystem with reader/writers. I’m also able to read through data from ADLFS via parquet reader using my implementation. It is modeled like the s3fs implementation.
Question. - Is way to parallelize the column read operation using multiple threads in parquet/reader. - Can someone point to code in parquet subsystem where the final call is dispatched to the underlying random access file object. Thank you Yesh
