asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-736998571
Thanks @bvaradar. Would you know when 0.7.0 is slated for release as the S3
listing time will continue to grow for us as we add more partitions even with
cleaning turned off? Als
asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-734453893
Is there a downside to keeping hoodie.clean.automatic=false?
This is an automated message from the Apache Git Ser
asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-734450744
Thanks @bvaradar . Setting the value hoodie.clean.automatic=false has helped
in reducing the processing time significantly. Now the 5 records got inserted
in less than a minute.
asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-733323629
Yes this is a COW table.
This is an automated message from the Apache Git Service.
To respond to the message, ple
asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-733174238
Thanks @bvaradar. I tried to insert just 5 records to the existing table
with ~300K partitions and it took close to ~5 hrs. If I insert ~5 records in a
new table it takes less th
asharma4-lucid commented on issue #2269:
URL: https://github.com/apache/hudi/issues/2269#issuecomment-731908622
Thanks @bvaradar for your response. I have a few more questions:
1) The reason we have kept the partition key that we are using is, because
we wanted to gain O(1) read perf
