hi, I am new to Elasticsearch and researching on to see if it can fit my needs.
Requirement - To be able to log data into datastore and generate metrics out of it. The data would be huge around 50K recrods per hour (each row of few hundred bytes/KB). We are seeing how we can utilize elasticsearch for this. By going over various threads, looks like this is possible to use elastic search for this need and also use it as a datastore, however could not clarify few items given below : 1. Can we use Elasticsearch to only for search capabilities while the actual data is stored in another database? (i.e., Elasticsearch shall maintain only 'indexed' (index in Database terminology) data which are searchable while the actual data would be stored in different store..say mongodb.). So if have 50K records (~ 5GB) of data, of which there are 10-20 properties of interest in each record which we expect elasticsearch to search/index. Then can we make elasticsearch to store only these searchable properties in its index (size of which we expect to be around few MBs), while the actual data is stored in a separate store and then link it somehow? (In otherwords, elasticsearch just has the properties data which is searchable (nothing more) and has a pointer to actual data in Mongo). 2. What are the memory requirements of elasticsearch? (From what i understood, elasticsearch loads all relevant indexed data into memory while searching. So in my earlier example, if i want 20 properties (each 50 bytes approx) in each record to be searchable, then for searching 50K records, elasticsearch approximately would need 1.2GB of RAM to search over a days data) Is my understanding correct? thanks Sandesh -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f82df903-0fb7-4eaa-9fd2-4d990f8685d2%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
