Best data structure for tracking most recent updates.

2013-11-08 Thread Jacob Rhoden
I need to be able to show the most recent changes that have occurred in a system, I understand inserting every update into a tracking table and deleting old updates may not be great, as I may end up creating millions of tombstones. i.e. don't do this:create table recent_updates(uuid timeuuid

Re: Best data structure for tracking most recent updates.

2013-11-08 Thread Laing, Michael
Here are a couple ideas: 1. You can rotate tables and truncate to avoid deleting. 2. You can shard your tables (partition key) to mitigate hotspots. 3. You can use a column key to store rows in timeuuid sequence. create table recent_updates_00 (shard text, uuid timeuuid, message text, primary