Re: (solrcloud) Importing documents into "implicit" router
Which link are you talking about? On Friday, October 21, 2016 8:09 PM, Customer wrote: Useless shit which should be deleted from the Internet, because this confuses people instead of helping them. On 21/10/16 09:46, hairymccla...@yahoo.com.INVALID wrote: > Couple more good links for this: > https://lucidworks.com/blog/2013/06/13/solr-cloud-document-routing/ > > and > http://stackoverflow.com/questions/15678142/how-to-add-shards-dynamically-to-collection-in-solr > > (see Jay's answer about implicit routers - it's a better explanation than the > docs in my view!) > > > > > > On Thursday, October 20, 2016 8:09 PM, Customer > wrote: > > > Hey, > > I hope you all are doing well.. > > I got a router with "router.name=implicit" with couple of shards (lets > call them shardA and shardB) and got a mysql table ready to import for > testing purposes. So for example I want to load half of the data to > shardA and the rest - to the shardB. Question is - how I can do that ? I > thought this is something to add to the RESTful call when doing import > for example like curl -m 9 > "http://localhost:8983/solr/testIMPLICIT2/dataimport?=command=full-import&implicit=shardA > , but looks like I was wrong. > > Thanks > > >
Re: (solrcloud) Importing documents into "implicit" router
Useless shit which should be deleted from the Internet, because this confuses people instead of helping them. On 21/10/16 09:46, hairymccla...@yahoo.com.INVALID wrote: Couple more good links for this: https://lucidworks.com/blog/2013/06/13/solr-cloud-document-routing/ and http://stackoverflow.com/questions/15678142/how-to-add-shards-dynamically-to-collection-in-solr (see Jay's answer about implicit routers - it's a better explanation than the docs in my view!) On Thursday, October 20, 2016 8:09 PM, Customer wrote: Hey, I hope you all are doing well.. I got a router with "router.name=implicit" with couple of shards (lets call them shardA and shardB) and got a mysql table ready to import for testing purposes. So for example I want to load half of the data to shardA and the rest - to the shardB. Question is - how I can do that ? I thought this is something to add to the RESTful call when doing import for example like curl -m 9 "http://localhost:8983/solr/testIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks like I was wrong. Thanks
Re: (solrcloud) Importing documents into "implicit" router
Thanks John. I got it sorted, but that part you pointed still looks confusing. Imho it should be "You could also use the _route_ parameter to name a specific shard*when ingesting documents, so Solrcloud will route your document to specific shard.*" Cheers. On 20/10/16 19:14, John Bickerstaff wrote: more specifically, this bit from that page seems like it might be of interest: If you created the collection and defined the "implicit" router at the time of creation, you can additionally define a router.field parameter to use a field from each document to identify a shard where the document belongs. If the field specified is missing in the document, however, the document will be rejected. You could also use the _route_ parameter to name a specific shard. On Thu, Oct 20, 2016 at 12:12 PM, John Bickerstaff wrote: This may help? https://cwiki.apache.org/confluence/display/solr/ Shards+and+Indexing+Data+in+SolrCloud On Thu, Oct 20, 2016 at 12:09 PM, Customer wrote: Hey, I hope you all are doing well.. I got a router with "router.name=implicit" with couple of shards (lets call them shardA and shardB) and got a mysql table ready to import for testing purposes. So for example I want to load half of the data to shardA and the rest - to the shardB. Question is - how I can do that ? I thought this is something to add to the RESTful call when doing import for example like curl -m 9 "http://localhost:8983/solr/te stIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks like I was wrong. Thanks
Re: (solrcloud) Importing documents into "implicit" router
Couple more good links for this: https://lucidworks.com/blog/2013/06/13/solr-cloud-document-routing/ and http://stackoverflow.com/questions/15678142/how-to-add-shards-dynamically-to-collection-in-solr (see Jay's answer about implicit routers - it's a better explanation than the docs in my view!) On Thursday, October 20, 2016 8:09 PM, Customer wrote: Hey, I hope you all are doing well.. I got a router with "router.name=implicit" with couple of shards (lets call them shardA and shardB) and got a mysql table ready to import for testing purposes. So for example I want to load half of the data to shardA and the rest - to the shardB. Question is - how I can do that ? I thought this is something to add to the RESTful call when doing import for example like curl -m 9 "http://localhost:8983/solr/testIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks like I was wrong. Thanks
Re: (solrcloud) Importing documents into "implicit" router
This may help? https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud On Thu, Oct 20, 2016 at 12:09 PM, Customer wrote: > Hey, > > I hope you all are doing well.. > > I got a router with "router.name=implicit" with couple of shards (lets > call them shardA and shardB) and got a mysql table ready to import for > testing purposes. So for example I want to load half of the data to shardA > and the rest - to the shardB. Question is - how I can do that ? I thought > this is something to add to the RESTful call when doing import for example > like curl -m 9 "http://localhost:8983/solr/te > stIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks > like I was wrong. > > Thanks >
Re: (solrcloud) Importing documents into "implicit" router
more specifically, this bit from that page seems like it might be of interest: If you created the collection and defined the "implicit" router at the time of creation, you can additionally define a router.field parameter to use a field from each document to identify a shard where the document belongs. If the field specified is missing in the document, however, the document will be rejected. You could also use the _route_ parameter to name a specific shard. On Thu, Oct 20, 2016 at 12:12 PM, John Bickerstaff wrote: > This may help? https://cwiki.apache.org/confluence/display/solr/ > Shards+and+Indexing+Data+in+SolrCloud > > On Thu, Oct 20, 2016 at 12:09 PM, Customer > wrote: > >> Hey, >> >> I hope you all are doing well.. >> >> I got a router with "router.name=implicit" with couple of shards (lets >> call them shardA and shardB) and got a mysql table ready to import for >> testing purposes. So for example I want to load half of the data to shardA >> and the rest - to the shardB. Question is - how I can do that ? I thought >> this is something to add to the RESTful call when doing import for example >> like curl -m 9 "http://localhost:8983/solr/te >> stIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks >> like I was wrong. >> >> Thanks >> > >
(solrcloud) Importing documents into "implicit" router
Hey, I hope you all are doing well.. I got a router with "router.name=implicit" with couple of shards (lets call them shardA and shardB) and got a mysql table ready to import for testing purposes. So for example I want to load half of the data to shardA and the rest - to the shardB. Question is - how I can do that ? I thought this is something to add to the RESTful call when doing import for example like curl -m 9 "http://localhost:8983/solr/testIMPLICIT2/dataimport?=command=full-import&implicit=shardA , but looks like I was wrong. Thanks
