#general
@robeng962: Hi all, is there a way to specify retention for old updates when using upsert tables? My understanding from the docs is that upserts are still append only just that querying shows the newest one. I want to config it such that all updates are deleted after 180 days except the newest one even if it's older than 180 days, thus if no new upserts come in within 180 days only the last upsert will exist. Use case is as a serving layer as described in the enterprise application development section of the docs. Thanks
@mayanks: What's the retention of your data? Can this be achieved by explicit time filter in the query?
@mayanks: cc: @yupeng
@robeng962: Yeah it could, just that we don't want to keep old upserts around when we don't need them
@mayanks: So is your data retention time > 180 (upsert retention time that you'd like)?
@mapshen: +1 on this. We have a similar use case. @mayanks that’s why i asked you if materialized view is supported the other day.
@mayanks: I see, in that case, lets create a github issue? Or if one already exists, lets add your requirements there @robeng962, and bump it up?
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@pinot.apache.org For additional commands, e-mail: dev-h...@pinot.apache.org
