Re: Need guidance solrcloud shardings with date interval
Hi Sir Walter, Ya, you are right, i am trying to create a structure like oracle partitioning. each day partition like each day shard. already creted date wise shards and loading time using specific shard name to load data. but my R&D is to find a way, not to use shard name using loading time,solrcloud automatically load data into predefined shard/date specific shard. Is there any way to perfome this? Once again thanks Sir. -- View this message in context: http://lucene.472066.n3.nabble.com/Need-guidance-solrcloud-shardings-with-date-interval-tp4346936p4347250.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Need guidance solrcloud shardings with date interval
Thanks for your response, actually my per day data size is too big, round 400gb, so thats why my plan to use date interval ,each shard will represent to pre defined date. delete will not possible. i am looking for some way, to perform automatically, loading time not give any shard name, document automatially load with respect to its date. thanks, waiting still guidance -- View this message in context: http://lucene.472066.n3.nabble.com/Need-guidance-solrcloud-shardings-with-date-interval-tp4346936p4347249.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Need guidance solrcloud shardings with date interval
blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px
#715FFA solid !important; padding-left:1ex !important; background-color:white
!important; } Hi Eric,
Thank you very much for your guidance.
No sir that is our requirmnt to load data into specific shard and later after
rentention time we will delete that shard.
Please share if you have any manual sharding exercise dicument.
2nd is it posible data automatically load into specific shard without using
shard name during loading.
Is there any solr file where i mentioned all my shards name with specific date.
When data come automTically load dara into alredy mentioned shard?
Once again Thank you very much.
Kind regards,Muhammad rehman kahloon
Sent from Yahoo Mail for iPhone
On Thursday, July 20, 2017, 19:57, Erick Erickson
wrote:
Use the "implicit" router (being renamed "manual". that takes the
value of a particular field (_route_ by default) and sends docs to
that exact shard.
But I also question whether sharding on this schema is a good idea. If
you have an access pattern where most queries are for, say, the last
two days then all the work will be done on only 2 machines and all the
rest will be idle. You should at least consider just using normal
routing that distributes the data across all shards and then use
delete-by-query to delete the data older than 10 days.
Best,
Erick
On Thu, Jul 20, 2017 at 12:51 AM, rehman kahloon
wrote:
>
> Hi Sir,
> Taken your id from your document on SlideShare.
> Need your guidance on my plan ,My target is to create sub-collection/shards
> within a collection.
> e.g
> Currently 1 have 10 days data and want to store data against each
>date in separate partitions. like oracle partition concepts (one table can
>have many partitions)
> Plan is to store each date data with in separate node, Total physical nodes
> are 10 and after 10 days, 11th date data load in node1 and existing data
> backup (oldest date data with purge and backed up).
> Please guide me how can i perform that using SolrCloud. 1 collection with
> unlimited sub collection.
>
> Thank you very much in advanced.
>
> Kind Regards,Muhammad Rehman Kahloon.
Need guidance solrcloud shardings with date interval
Hi Sir, Taken your id from your document on SlideShare. Need your guidance on my plan ,My target is to create sub-collection/shards within a collection. e.g Currently 1 have 10 days data and want to store data against each date in separate partitions. like oracle partition concepts (one table can have many partitions) Plan is to store each date data with in separate node, Total physical nodes are 10 and after 10 days, 11th date data load in node1 and existing data backup (oldest date data with purge and backed up). Please guide me how can i perform that using SolrCloud. 1 collection with unlimited sub collection. Thank you very much in advanced. Kind Regards,Muhammad Rehman Kahloon.
Need guidance for distributing data base on date interval in a collection
Hello Sir/Madam I am new to SolrCloud, Having ORACLE technologies experience. Now a days , i am comparing oracle and solrcloud using bigdata. So i want to know how can i create time interval sharding. e.g i have 10 machines, each machine for one shard and one date data, So how can i fix next day data go to next shard and so on? search too much but not found any command/way, that handle it from some core/shard file. So i request you please guide me. thanks in advanced. Kind Regards,Muhammad Rehman kahloonmrehman_kahl...@yahoo.com
