Re: Multi Tenant DB and JDBC River

2014-08-31 Thread joergpra...@gmail.com
Since rivers are just a style of execution of ES plugins, I am sure there will be replacements at the plugin level, after rivers are officially deprecated. Logstash or custom middleware, or the JDBC feed mode, are push-style applications, which can ingest data into ES, without the requirement of a

Re: Multi Tenant DB and JDBC River

2014-08-30 Thread Lukáš Vlček
Nitin, If I am not mistaken rivers in ES will be deprecated. So in any case river is not a good way to go for design of future application. We are using rivers quite a lot in our project and we will be moving the functionality to middleware layer. Regards, Lukáš Dne 31.8.2014 3:58 "Nitin Maheshwa

Re: Multi Tenant DB and JDBC River

2014-08-30 Thread Nitin Maheshwari
Thanks for the reference, its helpful. On Thu, Aug 28, 2014 at 12:33 PM, joergpra...@gmail.com < joergpra...@gmail.com> wrote: > I work on such a component which can handle jobs and delegate them to > other nodes but no working implementation available yet. > > For a service component that is ab

Re: Multi Tenant DB and JDBC River

2014-08-28 Thread joergpra...@gmail.com
I work on such a component which can handle jobs and delegate them to other nodes but no working implementation available yet. For a service component that is able to maintain state in the cluster state, see RiverState class in JDBC plugin. Jörg On Thu, Aug 28, 2014 at 8:08 AM, Nitin Maheshwari

Re: Multi Tenant DB and JDBC River

2014-08-27 Thread Nitin Maheshwari
Thanks Jörg for your quick and timely response. I am new to ES, can you point me to any reference implementation for the ES service component? Once again thanks for the help. Nitin On Tuesday, 26 August 2014 15:07:05 UTC+5:30, Jörg Prante wrote: > > For multi tenant, the river concept is awk

Re: Multi Tenant DB and JDBC River

2014-08-26 Thread joergpra...@gmail.com
For multi tenant, the river concept is awkward. River is a singleton and is bound to single user execution, and you are right, creating river instances per DB and per index does not scale. There are several options: - write a more sophisticated plugin which acts as a service and not as a singleto

Multi Tenant DB and JDBC River

2014-08-26 Thread Nitin Maheshwari
Hi Jörg, I am working on a multi tenant application where each tenant has its own database. I am planning to use ES for indexing the data, and JDBC river for doing periodic bulk indexing. I do not want to create one river per DB per object type. This will lead to too many rivers. I wanted to