Hi, We are using HUDI 0.6 and noticed that some hudi tables are very slow to read specially with large number of partitions, probably due to S3 listing. I know in later versions of HUDI we have fixed some of the issues but it will take us some time to migrate . Is there anything in 0.6 I can leverage ?
I also dont understand what ./aux does as these folders are empty for us. We sometimes do S3 to S3 copy and read HUDI tables from the new copied location and able to read without .aux/ folders. When S3 copy works it doesnt copy empty folders. Thnaks, Tanu
