[GitHub] [hudi] nsivabalan commented on issue #2743: Do we have any TTL mechanism in Hudi?

2021-04-07 Thread GitBox
nsivabalan commented on issue #2743: URL: https://github.com/apache/hudi/issues/2743#issuecomment-815015923 @lw309637554 @satishkotha : fyi we are yet to add spark ds support for this "delete_partition" operation. -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [hudi] nsivabalan commented on issue #2743: Do we have any TTL mechanism in Hudi?

2021-04-06 Thread GitBox
nsivabalan commented on issue #2743: URL: https://github.com/apache/hudi/issues/2743#issuecomment-814143042 @n3nash @vinothchandar @bvaradar : any thoughts here or workarounds until we have per record support for TTL. -- This is an automated message from the Apache Git Service. To respo

[GitHub] [hudi] nsivabalan commented on issue #2743: Do we have any TTL mechanism in Hudi?

2021-04-04 Thread GitBox
nsivabalan commented on issue #2743: URL: https://github.com/apache/hudi/issues/2743#issuecomment-813194180 Yeah, we don't recommend deleting partitions outside of hudi. Hudi support insert_override operation. But not sure if it can just delete partition w/o ingesting any data. @satish

[GitHub] [hudi] nsivabalan commented on issue #2743: Do we have any TTL mechanism in Hudi?

2021-03-30 Thread GitBox
nsivabalan commented on issue #2743: URL: https://github.com/apache/hudi/issues/2743#issuecomment-810738337 @aditiwari01 : if you are not running a continuous job (deltastreamer), is it possible to trigger a job at regular cadence to fetch records from hudi that are > 1 month old and issue