Re: How to do incremental indexing in ElasticSearch?

2014-02-21 Thread Daniel Guo
David, thanks for your answer. You mean that I have to control what to send to elasticsearch by myself ?! I heard that solr can configure delta index, so I'm just looking for a similar mechanism in elasicsearch. Thank you one more time. On Friday, February 21, 2014 2:32:42 PM UTC+8, David

Re: How to do incremental indexing in ElasticSearch?

2014-02-21 Thread David Pilato
Yes. But you can look at JDBC river although I won't use it in a production env such as all other rivers. I prefer to push docs from my legacy application (in real time that is) -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 21 févr. 2014 à 10:12, Daniel Guo

Re: How to do incremental indexing in ElasticSearch?

2014-02-21 Thread Daniel Guo
Ok, got it. Thank you. On Friday, February 21, 2014 6:29:35 PM UTC+8, David Pilato wrote: Yes. But you can look at JDBC river although I won't use it in a production env such as all other rivers. I prefer to push docs from my legacy application (in real time that is) -- David ;-)

How to do incremental indexing in ElasticSearch?

2014-02-20 Thread Daniel Guo
Here is my problem: I query some data from MySql, and then index those data to ElasticSearch. While the data in MySql is updating (update and insert) all the time, so I have to update ElasticSearch index accordingly. I cannot afford to do full index (data is huge), and I should not do that

Re: How to do incremental indexing in ElasticSearch?

2014-02-20 Thread David Pilato
Elasticsearch will index or update any document you will send to it. So get the delta on your side and send documents you want to update to elasticsearch. Did I misunderstand the question? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 21 févr. 2014 à 03:04, Daniel Guo