Using TransportClient has just solved the problem.I bulk 40000 docs per seconds but loadaverage,searching,everything is perfect.
On Wed, Jan 21, 2015 at 8:25 PM, Hajime <placeofnomemor...@gmail.com> wrote: > Yes, it is round robin. > > On Wed, Jan 21, 2015 at 4:14 PM, David Pilato <da...@pilato.fr> wrote: > >> But on different nodes? >> >> -- >> David ;-) >> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs >> >> Le 21 janv. 2015 à 07:28, Hajime <placeofnomemor...@gmail.com> a écrit : >> >> I run on parallel using REST API >> >> On Wed, Jan 21, 2015 at 2:42 PM, David Pilato <da...@pilato.fr> wrote: >> >>> Did you try to send each bulk request on different nodes in parallel? >>> Or does only one node get the BULK request? >>> >>> David >>> >>> Le 21 janv. 2015 à 05:47, Hajime <placeofnomemor...@gmail.com> a écrit : >>> >>> I have 440 cores in my cluster and I find that having 100 shards are >>> much more faster in searching compare to 20 shards. >>> Does having many shards per index too costly, even I have so much cores? >>> >>> >>> >>> On Wed, Jan 21, 2015 at 12:12 PM, Mark Walkom <markwal...@gmail.com> >>> wrote: >>> >>>> Is that 100 shards per index? If to it's too many and you should drop >>>> that to 10-20 per index. >>>> >>>> Check your hot threads, it might show something. >>>> >>>> On 21 January 2015 at 15:09, Hajime <placeofnomemor...@gmail.com> >>>> wrote: >>>> >>>>> Hi, >>>>> >>>>> I have a 10 indexes with 100 shards using 10 nodes which have 40 cores >>>>> each. >>>>> >>>>> I have a problem when indexing 1000~2000/doc or 2M~4M per sec in new >>>>> index, searching to the other old indexes happen to be very slow. >>>>> >>>>> How can I prevent from indexing to interfere the searching activity? >>>>> >>>>> >>>>> Additional info: >>>>> /_cat/thread_pool is almost 0 in every column. >>>>> load average / cpu usage / memory usage /reading usage is low and >>>>> stable. >>>>> I use bulk api of rest client not transport client. >>>>> My version is 1.4.0 >>>>> >>>>> thanks, >>>>> >>>>> hajime >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups "elasticsearch" group. >>>>> To unsubscribe from this group and stop receiving emails from it, send >>>>> an email to elasticsearch+unsubscr...@googlegroups.com. >>>>> To view this discussion on the web visit >>>>> https://groups.google.com/d/msgid/elasticsearch/CAHm3Zso%2Bu0H_uG3Dw33Ubk7OxJYU8CLdypmASPZJiwto5CM_0w%40mail.gmail.com >>>>> <https://groups.google.com/d/msgid/elasticsearch/CAHm3Zso%2Bu0H_uG3Dw33Ubk7OxJYU8CLdypmASPZJiwto5CM_0w%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>>> . >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elasticsearch" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to elasticsearch+unsubscr...@googlegroups.com. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-7TG5sxuCxnEjyWRWTb%2BUs9SXcREtSe-seT068L9wGmg%40mail.gmail.com >>>> <https://groups.google.com/d/msgid/elasticsearch/CAEYi1X-7TG5sxuCxnEjyWRWTb%2BUs9SXcREtSe-seT068L9wGmg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/CAHm3ZsopXSg6k_-iygZMRSrkx5x5c-u8bbLtrk_uxYp24Og%2B-A%40mail.gmail.com >>> <https://groups.google.com/d/msgid/elasticsearch/CAHm3ZsopXSg6k_-iygZMRSrkx5x5c-u8bbLtrk_uxYp24Og%2B-A%40mail.gmail.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/7499EC08-36D4-4419-A1A7-1ED63F90C5DA%40pilato.fr >>> <https://groups.google.com/d/msgid/elasticsearch/7499EC08-36D4-4419-A1A7-1ED63F90C5DA%40pilato.fr?utm_medium=email&utm_source=footer> >>> . >>> >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAHm3ZspteZhmpf1fSo_ZcGnh_sQ%3DaoMfMqksEM8GWU674XYM-Q%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAHm3ZspteZhmpf1fSo_ZcGnh_sQ%3DaoMfMqksEM8GWU674XYM-Q%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/A28CFA07-BD50-433B-B87B-32379ABD0042%40pilato.fr >> <https://groups.google.com/d/msgid/elasticsearch/A28CFA07-BD50-433B-B87B-32379ABD0042%40pilato.fr?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAHm3ZsppFBEamdR_B2LZCY3ye1yCyq_fadzo_kqqj_5yp0AmVw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
