I know from the FAST Search engine ten years ago there was a two-phase commit for distributed search and indexing. One server could listen on the API and keep the (compressed) input stored, and all the other indexing servers were supplied by this input in another phase to create binary indexes, either automatically, or by manual operation, called "suspend/resume indexing API".
The advantage was that data could be received permanently via API while FAST indexing could be stopped temporarily in order to balance between indexing and search performance on limited hardware. Do you think of something like that also for Elasticsearch? This architecture is possible to implement by a plugin. Jörg On Mon, Nov 10, 2014 at 10:13 PM, Amish Asthana <asthanaam...@gmail.com> wrote: > Hi > Is there a way we can decouple data and associated mapping/indexing in > Elasticsearch itself. > Basically store the raw data as source( json or some other format) and > various mapping/index can be used on top of that. > I understand that one can use an outside database or file system, but can > it be natively achieved in ES itself. > > Basically we are trying to see how our ES instance will work when we have > to change mapping of existing and continuously incoming data without any > downtime for the end user. > We have an added wrinkle that our indexing has to be edit aware for > versioning purpose; unlike ES where each edit is a new record. > regards and thanks > amish > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/0bb1f5ef-3991-4568-9891-018baf79ebae%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/0bb1f5ef-3991-4568-9891-018baf79ebae%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoE%3D-qMjEUp%2Br0mmL1dTH9ZeXa8Y%2BtNT7m8v%2BF_xQxfoNQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
