[
https://issues.apache.org/jira/browse/USERGRID-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
David Johnson updated USERGRID-255:
-----------------------------------
Description:
The two-dot-o Query Index module currently stores both document source and
fields in ElasticSearch. Since we only ever retrieve ID numbers from ES, there
is no need for us to store source and it is a waste of resources.
This is what we need:
1) A way to configure Usergrid to either store source or not store source.
2) An index-rebuild "Tool" (implemented as a REST end-point) that either remove
source, or add source depending on how the system in configured to operate. The
Tool must allow us to re-index without downtime. Possible approach:
For each application:
a) Tool creates a new index and adds that index to the application's read
and write alias.
b) Tool removes the old index from the application's write alias so it is
no longer written to.
c) Tool deletes the mappings for each newly added index, then re-creates
them with the new store-source settings.
d) Tool re-indexes the application's collections.
e) Once re-index is complete, Tool deletes the old index
was:
The two-dot-o Query Index module currently stores both document source and
fields in ElasticSearch. Since we only ever retrieve ID numbers from ES, there
is no need for us to store source and it is a waste of resources.
This is what we need:
1) A way to configure Usergrid to either store source or not store source.
2) An index-rebuild "Tool" (implemented as a REST end-point) that either remove
source, or add source depending on how the system in configured to operate. The
Tool must allow us to re-index without downtime. Possible approach:
For each application:
a) Tool creates a new index and adds that index to the application's read and
write alias.
b) Tool removes the old index from the application's write alias so it is no
longer written to.
b) Tool deletes the mappings for each newly added index, then re-creates them
with the new store-source settings.
c) Tool re-indexes the application's collections.
d) Once re-index is complete, Tool deletes the old index.
> Re-indexer That Removes Source from ES
> --------------------------------------
>
> Key: USERGRID-255
> URL: https://issues.apache.org/jira/browse/USERGRID-255
> Project: Usergrid
> Issue Type: Story
> Components: Stack
> Reporter: Todd Nine
> Assignee: David Johnson
>
> The two-dot-o Query Index module currently stores both document source and
> fields in ElasticSearch. Since we only ever retrieve ID numbers from ES,
> there is no need for us to store source and it is a waste of resources.
> This is what we need:
> 1) A way to configure Usergrid to either store source or not store source.
> 2) An index-rebuild "Tool" (implemented as a REST end-point) that either
> remove source, or add source depending on how the system in configured to
> operate. The Tool must allow us to re-index without downtime. Possible
> approach:
> For each application:
> a) Tool creates a new index and adds that index to the application's read
> and write alias.
> b) Tool removes the old index from the application's write alias so it is
> no longer written to.
> c) Tool deletes the mappings for each newly added index, then re-creates
> them with the new store-source settings.
> d) Tool re-indexes the application's collections.
> e) Once re-index is complete, Tool deletes the old index
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
