Re: how to migrate lucene index into elasticsearch

2014-11-27 Thread Gaurav gupta
Thanks Jorg but I didn't able to migrate the lucene indexes to ES even after trying what you have suggested. Maybe, I need to follow some more steps. I am not getting any error but the search is not showing any docs/records. While comparing the files, I found that "segments.gen" are identical but t

Re: how to migrate lucene index into elasticsearch

2014-11-27 Thread Gaurav gupta
Otis, I am not sure how many of our customers will accept to re-index the whole data as they are using it since long, although I am trying to convince my Senior Product Management to keep both Lucene and ES. Some old customers can think to migrate to ES if they need better real-time performance thr

Re: how to migrate lucene index into elasticsearch

2014-11-22 Thread joergpra...@gmail.com
I can not tell if it will work, but if you could translate your xml mapping into an Elasticsearch mapping it would be great. The next steps would be to create an empty index with the mapping, using 1 shard and no replica, _source and _all disabled. Then you could index one test doc over the ES API

Re: how to migrate lucene index into elasticsearch

2014-11-22 Thread Otis Gospodnetic
You didn't say why you can't just reindex data from original source, but that would be the cleanest way and likely the fastest in terms of human time (and $) you'll *likely* spend if you try using a "shortcut". Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr &

Re: how to migrate lucene index into elasticsearch

2014-11-20 Thread Gaurav gupta
Thanks Jorg for the guidance and I have am trying the suggested approach #1 and I have further question on it. As you mentioned - *"- a custom written tool could traverse the segments and extract field information and build a rudimentary mapping (without analyzer, without info about _all and _sour

Re: how to migrate lucene index into elasticsearch

2014-11-13 Thread joergpra...@gmail.com
It is almost impossible to use just binary-only Lucene index for migration, because Elasticsearch needs additional info which is not available in Lucene. The only method is to reindex data over the Elasticsearch API. There is a bumpy road but I don't know if one ever tried that: - a custom writte

how to migrate lucene index into elasticsearch

2014-11-13 Thread Gaurav gupta
Hi All, I have an embedded Search Engine in our product which is based on Lucene 4.8.1 and now I would like to migrate it to latest ElasticSearch 1.4 for better distributed support (sharding and replication, mainly). Could you guide me how one should migrate the existing indexes created by Luce