How to update/delete indexed documents from ES index using mysql jdbc river

2014-08-07 Thread coder
Hi, I'm using jdbc mysql river plugin https://github.com/jprante/elasticsearch-river-jdbc for creating ES index. I have been able to index my documents successfully but I'm facing issues in updating/deleting indexed documents. My jdbc river is used with a sql query that uses multiple joins on

Re: How to update/delete indexed documents from ES index using mysql jdbc river

2014-08-07 Thread coder
also consider to write a middleware app with specific logic that controls the deletions in the DB and after that deletes docs in ES. Jörg On Thu, Aug 7, 2014 at 10:44 AM, coder mukul...@gmail.com javascript: wrote: Hi, I'm using jdbc mysql river plugin https://github.com/jprante

How to improve search performance in ES ?

2014-07-11 Thread coder
Hi, I'm working on improving the search response of ES but not able to do anything. My scenario is something like this: I'm using 3 ES queries to get relevant results for my autocompleter. 1. A function score query with a match query ( To get a correct match if user typed query is available

Re: How to improve search performance in ES ?

2014-07-11 Thread coder
11, 2014 at 8:11 PM, coder mukul...@gmail.com javascript: wrote: Hi, I'm working on improving the search response of ES but not able to do anything. My scenario is something like this: I'm using 3 ES queries to get relevant results for my autocompleter. 1. A function score query

How to index documents without location field ?

2014-07-08 Thread coder
HI, I need to index a mix of documents, some of which needs to be indexed using geo_point with a location fields but there are some other documents which don't contain location field. Whenever I do indexing, I keep getting Mapper parsing exception with location={} during indexing and

Re: How to index documents without location field ?

2014-07-08 Thread coder
8, 2014 at 9:16 AM, coder mukul...@gmail.com javascript: wrote: HI, I need to index a mix of documents, some of which needs to be indexed using geo_point with a location fields but there are some other documents which don't contain location field. Whenever I do indexing, I keep getting

Re: How to index documents without location field ?

2014-07-08 Thread coder
is only used on fields that exist. If this is not the case, can you provide a sample document? -- Ivan On Tue, Jul 8, 2014 at 10:52 AM, coder mukul...@gmail.com javascript: wrote: Yes, I can index the documents which contain location field but not those documents which don't contain

ElasticSearch 1.1.0 is slower compared to ES 0.90.3 ?

2014-06-09 Thread coder
Hi, I was using ES 0.90.3 in production earlier but after moving to ES 1.1.0, it is taking a longer time for a search query to fetch results ? I'm using same mapping and same search query. The only difference is that I'm using jdk 1.6. Should I migrate to 1.7 ? Also, how does sharding and

Re: ElasticSearch 1.1.0 is slower compared to ES 0.90.3 ?

2014-06-09 Thread coder
to at least 1.7u25, preferably 1.7u55, and Oracle not OpenJDK. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com javascript: web: www.campaignmonitor.com On 10 June 2014 02:34, coder mukul...@gmail.com javascript: wrote: Hi, I was using ES

Re: Need suggestions on type of query to be used for a given analysis for better results?

2014-05-31 Thread coder
I'll be thankful if someone can give me idea about this. Thanks On Saturday, 31 May 2014 00:45:21 UTC+5:30, coder wrote: Hi, I'm using following analyzers for indexing my documents in ES: analysis : { analyzer : { str_search_analyzer

How does ES multi match query with a type cross_field do analsis of given string ?

2014-05-31 Thread coder
Hi, I was reading ES docs on multi-match query with a type cross_field but a bit confused on how it does analysis of given input string. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-multi-match-query.html#type-cross-fields The cross_field type tries to solve

Need suggestions on type of query to be used for a given analysis for better results?

2014-05-30 Thread coder
Hi, I'm using following analyzers for indexing my documents in ES: analysis : { analyzer : { str_search_analyzer : { tokenizer : standard, filter : [lowercase,asciifolding] },

ElasticSearch 1.1.0 equivalent to field query filter

2014-05-21 Thread coder
Hi, I recently migrated from ES 0.90.3 to ES 1.1.0 but facing few issues while migration. 1. I was earlier using a field query filter based on the value of a field which is present in my document. Now, in ES 1.1.0 there is no such filter. Can anyone tell me what equivalent filter can be used.

Re: ElasticSearch 1.1.0 equivalent to field query filter

2014-05-21 Thread coder
for the Java API is to look at the unit tests and the equivalent REST API classes. For example, RestSearchAction, RestIndexAction, RestClusterHealthAction, etc. Cheers, Ivan On Wed, May 21, 2014 at 10:46 AM, coder mukul...@gmail.com javascript:wrote: Hi, I recently migrated from ES 0.90.3

How to create ES index with a mapping and data from Mysql ?

2014-05-17 Thread coder
Hi, I'm using ES for creating an index with a mapping and data from Mysql. I'm able to create an empty idex along with mappings and settings but I'm not able to import data from Mysql into that index. I'm using https://github.com/jprante/elasticsearch-river-jdbc this plugin with ES 1.1.0

ElasticSearch Version problem

2014-05-16 Thread coder
Hi, I need to index documents from mysql to ES. I read about jdbc river but it is compatible for ES 1.1.0. My problem is I'm using mongodb also for indexing some documents and that too with ES version 0.90.3. I know it's bit of a older version but that why I want to upgrade to newer version

query_string bug in Elasticsearch-0.90.3, please tell me if it really is a bug ?

2014-02-04 Thread coder
I started using explain api for query_string but I guess in process I found a bug (don't know if it really is a bug or intended behaviour of query_string). This is going to be a long post, please be patient with me. I'm using a doc:{name:new delhi to goa,st:goa} On using analyzer api for

What is the difference between query_string and multi-match for querying docs ?

2014-02-03 Thread coder
Hi, Can anyone please tell me a detailed difference between these two queries. I studied the documentation but not able to figure out the difference between two. Can anyone please explain it with some examples in a more detailed fashion. I expect query string to give me docs which matches

What is the meaning of field^4 from scoring perspective ?

2014-02-03 Thread coder
Hi, I was going through the documentation of ES where they have mentioned that we can use boost for a certain field. Boosting Use the *boost* operator ^ to make one term more relevant than another. For instance, if we want to find all documents about foxes, but we are especially interested

Need help with ES Query

2014-02-02 Thread coder
Hi, I'm using an analyzer which includes a standard tokenizer and lowercase,asciifolding,suggestions_shingle and edgengrams as token filters in it. The analyzer is same for both indexing and searching. So, for a text like delhi to goa will be analyzed like: { tokens : [ { token : de,

What are good combinations of search analyzer, index analyzer and query for implementing an effective autocompleter using ElasticSearch ?

2014-02-01 Thread coder
Hi, Elasticsearch is a powerful tool, no doubt but sometimes it can really make you cry when you are not able to find out a good combination of index and search analyzers along with a good query type for implementing an autocompleter. I have read and searched on Internet that this combination

Re: What are good combinations of search analyzer, index analyzer and query for implementing an effective autocompleter using ElasticSearch ?

2014-02-01 Thread coder
Jorg The second link is not working. Completion suggester is a good thing but it is restricted to prefix queries only I guess. You will have to give every possible combination of a user typed query for a document to be matched. Please correct me if I;m wrong Thanks On Sunday, 2 February 2014

Which query type gives me docs which contains maximum number of user typed terms ?

2014-02-01 Thread coder
Hi, I want to use a query type which gives me docs with maximum number of matching terms with user typed terms. I'm using standard tokenizer along with lowercase,asciifolding,suggestions_shingle and edgengrams token filters for both index and search analyzer. Right now I'm using custom score

ElasticSearch not able to find documents which contains the searched text.

2014-01-31 Thread coder
Hi, I have following mapping: curl -XPUT 'http://localhost:9200/acqindex/' -d '{ settings : { index : { number_of_shards : 1, number_of_replicas : 1, analysis : { analyzer : { str_search_analyzer : {

What will be the equivalent query of the following java api ?

2014-01-31 Thread coder
Hi, I have following java code which query for search results. String script = _score * (doc['po'].empty ? 1 : doc['po'].value == 0.0 ? 1 : doc['po'].value); QueryBuilder queryBuilder = QueryBuilders.customScoreQuery( QueryBuilders.queryString(query)

Custom Score Query not working in elasticsearch-0.90.3

2014-01-30 Thread coder
Hi, I'm facing an issue in Elasticsearch-0.90.3 in my java code. I'm writing following query: String script = _score * (doc['po'].empty ? 1 : doc['po'].value == 0.0 ? 1 : doc['po'].value); QueryBuilder queryBuilder = QueryBuilders. customScoreQuery(QueryBuilders.queryString(query)

Need some help with Custom Score Query

2014-01-29 Thread coder
Hi, I'm using a custom score query for fetching my results from elasticsearch. I used a popularity po field for modifying _script parameter but somehow it's not working. I used explain parameter to see how the score is getting caluclated but my problem is it doesn't seem to take po into

Can anyone please explain the mapping in Elasticsearch ?

2014-01-29 Thread coder
Hi, I have an existing mapping with me but I'm not able to understand it fully. curl -XPUT 'http://localhost:9200/auto_index/http://localhost:9200/acqindex/' -d '{ settings : { index : { number_of_shards : 1, number_of_replicas : 1, analysis : {

fs river giving error on reading large text file.

2014-01-25 Thread coder . ajit
Hello All, I have tried Elasticsearch + fs-river plugin to read the local directory and file system. I have a file about 2.5 gb text file. While reading this file, it gives error and dump the heap to elastic search folder. I have started the es server with 6gb memory as given in elastic search

How to configure elasticsearch to sort the scored documents on a field after score for documents is calculated ?

2014-01-21 Thread coder
Hi, I want to configure the ElasticSearch so that it after calculating the score of each document corresponding to a user query, it sorts those score documents by some other field and then give the response. There may be a case in which some documents have same score. I want Elasticsearch to

How to use ElasticSearch Custom Similarity provider classes ?

2014-01-16 Thread coder
Hi, I'm using the following two java files for overriding the Default Similarity of ElasticSearch 0.90.3 but it's not working for me. https://github.com/awnuxkjy/es-custom-similarity-provider/tree/master/src/main/java/org/elasticsearch/index/similarity I have complied the two java files and

How can we use elasticsearch custom similarity plugin in mapping ?

2014-01-15 Thread coder
Hi, I need to override Lucene Default Similarity Class which is used by Elasticsearch for indexing and searching. On searching net, I found some similar implementations which are doing similar things. My difficulty is that I have no idea of how to actually implement this in my code. I found