I would like to see something similar to this existing in the solr world or I could gladly help create this:
https://github.com/karussell/elasticsearch-rollindex We are evaluating both elasticsearch and our current solr architecture and need to manage write heavy use-cases within a rolling window. > Date: Fri, 24 May 2013 09:07:38 -0600 > From: elyog...@elyograg.org > To: solr-user@lucene.apache.org > Subject: Re: Keeping a rolling window of indexes around solr > > On 5/24/2013 8:56 AM, Shawn Heisey wrote: > > On 5/24/2013 8:25 AM, Saikat Kanjilal wrote: > >> Anyways would love to hear thoughts and usecases that are similar from the > >> community. > > > > Your use-case sounds a lot like what loggly was doing back in 2010. > > > > http://loggly.com/videos/lucene-revolution-2010/ > > While I was writing that, I accidentally pressed the key combination > that told my mail client to send the message before I was done. > > Loggly created a new shard every five minutes, and merged older shards > to longer time intervals. I personally don't need this capability, but > it is a useful pattern. I was wondering recently whether a custom > document router could be built for SolrCloud that automatically manages > time-divided shards - creating, merging, and if you're not keeping the > data forever, deleting. > > Thanks, > Shawn >
