prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-712708891
Moved to rfc-15 branch with another PR.
This is an automated message from the Apache Git Service.
To respond
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-701026945
> I instrumented the code to track writeConfig.useFileListingMetadata. It
looks like it is being disabled for a dataset that has the metadata dataset
>
> 20/09/26
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-700996406
> Also see a lot of this polluting the test logs. can we remove or avoid
them on travis
Filed https://github.com/apache/hudi/pull/2132 for this issue.
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-698099305
@umehrot2 Directly using hudi datasource or delta streamer for testing
should work too. I haven't testing this yet so please let me know if that
doesn't work.
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-698099305
@umehrot2 Directly using hudi datasource or delta streamer for testing
should work too. I haven't testing this yet so please let me know if that
doesn't work.
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-697235280
>> Can all compaction strategies work off of metadata table itself? Does it
have all the data
Yes. Compaction Strategies are based on the sizes of the base and log
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-695076015
@umehrot2 I have updated the RFC doc with [details on how to test
prashantwason commented on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-686688968
Remaining work items:
1. Support for rollbacks in MOR Table
2. Rollback of metadata if commit eventually fails on dataset
3. HUDI-CLI extensions for metadata
