Adding to what Georgi wrote, es-hadoop does not create the shards for you - that's up to you or index templates (which I highly recommend). However es-hadoop is aware of the target shards and will use them to parallelize the reads/writes (such as one task per shard).
On Fri, Jun 6, 2014 at 2:45 PM, Georgi Ivanov <georgi.r.iva...@gmail.com> wrote: > and i don't think this anyhow related with number of shards and nodes > > > On Thursday, June 5, 2014 7:41:34 PM UTC+2, ES USER wrote: > >> Try as I might and I have read all the stuff I can find on ES' website >> about this I understand somewhat how the integration works but not the >> actual nuts and bolts of it. >> >> For example: >> >> Is Hadoop just storing the files that would normally be stored in the >> local filesystem for the ES indexes or is it storing the data that would >> normally be in those indexes and just accessed through es-hadoop? >> >> If it is the latter how do you go about determining whatto set for the >> number of nodes and shards. >> >> >> If anyone has any information on this or even better yet a place to point >> me to that has better references so that I can research this on my own it >> would be much appreciated. >> >> Thanks. >> > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/90662a91-1557-4f61-86a2-bd2e620aec6f%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/90662a91-1557-4f61-86a2-bd2e620aec6f%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAJogdmeDzSDrBLfpTQ3hGxOh1PN4przGkth2-M_oLdN7VjKYPg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
