Re: Benefits of using bulk with node client?

[Rotem Hermon]

Makes sense. Thanks! On 11/10/2014 10:15, joergpra...@gmail.com wrote: The node does not parse the bulk, only part of it (the metadata lines for hashing and routing). The benefit of bulk requests are simple to see on the network layer. Assume 1000 docs: - without bulk, send a request per doc, and wait for response each doc: client must submit 1000 packets on the wire, and server must submit 1000 responses on the wire back, and  for each doc on inner shard level send/receive cycle, there are also another 1000 send/receive. Makes around 4000 packets on the wire (worst case is the connected server node does not hold a shard of the index), with all the delays. - with bulk, client submits 1 request, server submits subpackets to each node that holds a shard of the index and submits 1 response back. Makes around 1 + (2 * n) + 1 packets where n is the number of nodes. With 3 nodes, you have 8 packets instead of 4000. Same holds for both HTTP and transport protocol, HTTP is only used for accepting client requests. Jörg On Mon, Nov 10, 2014 at 7:34 AM, Rotem <rotem.her...@gmail.com> wrote: I can definitely see the point of using the bulk API when indexing via HTTP. But is there an advantage of using bulk instead of individual index request when using the client node? Since the node parses the bulk and routes each request to its proper destination - and it's basically doing the same when you submit individual requests - what is the benefit of doing a bulk request in this case? -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/28d54f90-f6b8-449a-806f-e873600dfdd5%40googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to a topic in the Google Groups "elasticsearch" group. To unsubscribe from this topic, visit https://groups.google.com/d/topic/elasticsearch/rnusTTvNTfg/unsubscribe. To unsubscribe from this group and all its topics, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoHwtoUKSN%2B-D0jiPrVHaMoUygWTtgR-%3Di84Mn0jPCZSYw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/546077D8.6020409%40gmail.com. For more options, visit https://groups.google.com/d/optout.