Re: Elasticsearch : Need advice on architectural design of my cluster

2014-12-31 Thread Mark Walkom
You don't put all your data into one massive table in a single database do you? There's data structure, sizing, performance and more that you need to take into account, irrespective of what data store you use. On 31 December 2014 at 18:37, Mandeep Gulati wrote: > Thanks for the response Mark! >

Re: Elasticsearch : Need advice on architectural design of my cluster

2014-12-30 Thread Mandeep Gulati
Thanks for the response Mark! However, I am trying to understand how massive index can be a problem if everytime I know which type to query ? Any explanation or link to some documentation regarding this ? On Tuesday, December 30, 2014 3:42:20 AM UTC+5:30, Mark Walkom wrote: > > Ideally you want

Re: Elasticsearch : Need advice on architectural design of my cluster

2014-12-29 Thread Mark Walkom
Ideally you want to keep different types in different indexes. And you definitely don't want everything in one massive index as that won't scale well. On 28 December 2014 at 22:41, Mandeep Gulati wrote: > I am quite new to elasticsearch. I need to build a search system using the > data from Mong

Elasticsearch : Need advice on architectural design of my cluster

2014-12-28 Thread Mandeep Gulati
I am quite new to elasticsearch. I need to build a search system using the data from MongoDB. So, here is a high level overview of my application: - There are different users belonging to different organizations - A User can upload multiple datasets. Each dataset is stored as a single