Re: Time Routed Alias

2021-08-24 Thread Matt Kuiper
Thanks Gus! I appreciate this information. It is very helpful. From my POC, I can see that TRAs are very powerful and very helpful. I am excited to build out a more full implementation within our use case which is right in line with the boundaries you set for standard TRA use. Matt On Sat, Au

Re: Time Routed Alias

2021-08-21 Thread Gus Heck
Hi Matt, TRA's were put into use almost immediately by at least one organization as soon as Dave and I implemented them, and the CRA and DRA's followed because the same organization wanted to further subdivide their data. They have been around for a while, and I'm currently helping a client move t

Re: Time Routed Alias

2021-08-20 Thread Matt Kuiper
Sending this question out again to learn about how well Time Routed Aliases have worked out for others. Would like to know if a number of others have used this approach successfully as our team is planning for the use of TRAs in a very large SolrCloud deployment. Thanks, Matt On Fri, Aug 13, 202

Re: Time Routed Alias

2021-08-13 Thread Matt Kuiper
Thanks David, this test link is helpful. @David @Gus - From your viewpoint do you see TRAs as an accepted/proven technique within SolrCloud? My small POC works great. Would like to hear if others are using TRA in production deployments successfully at scale. Thanks, Matt On Wed, Aug 11, 2021 a

Re: Time Routed Alias

2021-08-11 Thread David Smiley
I hope you have success with TRAs! You can delete some number of collections from the rear of the chain, but you must first update the TRA to exclude these collections. This is tested: https://github.com/apache/solr/blob/f6c4f8a755603c3049e48eaf9511041252f2dbad/solr/core/src/test/org/apache/solr/

Re: Time Routed Alias

2021-08-10 Thread Matt Kuiper
I found some helpful information while testing TRAs: For our use-case I am hesitant to set up an autoDeleteAge (unless it can be modified - still need to test). So I wondered about a little more manual delete management approach. I confirmed that I cannot simply delete a collection that is regis

Re: Time Routed Alias

2021-08-09 Thread Matt Kuiper
Hi Gus, Jan, I am considering implementing TRA for a large-scale Solr deployment. Your Q&A is helpful! I am curious if you have experience/ideas regarding modifying the TR Alias when one desires to manually delete old collections or modify the router.autoDeleteAge to shorten or extend the delete

Re: Time Routed Alias

2021-08-06 Thread Gus Heck
Hi Jan, The key thing to remember about TRA's (or any Routed Alias) is that it only actively does two things: 1) Routes document updates to the correct collection by inspecting the routed field in the document 2) Detects when a new collection is required and creates it. If you don't send it data

Time Routed Alias

2021-08-06 Thread Jan Høydahl
Hi, I have never used TRA, but a client of mine is considering it. A few questions. A) Do you have links to talks (slides/video) on the feature? Or blog posts going into more detail than the RefGuide? B) For ingestion performance, sharding may make sense. But only for the current collection. Ha

SolrCloud Time Routed Alias Architecture

2021-03-31 Thread Nahian-Al Hasan
To whom it may concern, This is a broader question around building the architecture for SolrCloud Time Routed Alias application. I'm using SolrCloud to ingest time-series data on a regular basis and have SolrCloud running in a Kubernetes Cluster. A Solr node gets attached every time we add