bvaradar commented on issue #1981: URL: https://github.com/apache/hudi/issues/1981#issuecomment-678134623
Do you don't see a solution for this in a near future? @rubenssoto : We do. We have been working to avoid listing with the consolidated metadata (https://cwiki.apache.org/confluence/display/HUDI/RFC+-+15%3A+HUDI+File+Listing+and+Query+Planning+Improvements). This is the comprehensive way to fix the listing issues in S3. We are aiming to have this feature in the next major release in 1 or 2 months timeframe. cc @prashantwason @n3nash ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
