TML - Text Mining Library for LSA (Latent Semantic Analysis) implemetation

2014-04-14 Thread Navneet Mathpal
Hi,

does anyone knows about how to implement TML in elasticsearch with the help 
of java ?

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/f740d37a-5792-47bf-a175-e361326b64a3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Use LSI with elasticsearch

2014-04-07 Thread Navneet Mathpal
Hi,

i want to use LSI with elastic search, is there any tutorial for starting 
it ? how can i do this ? 

thanks,
Navneet

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/90154d03-d140-4e61-8772-d803f239b777%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


query related to explain api

2014-02-11 Thread Navneet Mathpal
hi,


 what is queryWeight and fieldWeight value which we get as an output of 
explain api, and how is it calculated?

Thanks
Navneet Mathpal
 

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/a4778f52-a2b0-4dd3-8709-b2035b967c8f%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


query related to explain api

2014-02-11 Thread Navneet Mathpal
hi,

what is the queryWeight and fieldweight and how does it calculated.I  am 
getting the follwing results.

Thanks
Navneet Mathpal


-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/b0a2fffe-01c5-4c6b-9e44-552e49de8e0c%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


how elasticsearch calculate the score corresponding to the document

2014-02-11 Thread Navneet Mathpal
HOW DOES ELASTICSEARCH CALCULATE THE SCORE  FOR THE FOLLWING AND WHAT THIS 
SCORE  MEANS.

hits: [ 
   
   - { 
  - _shard: 3
  - _node: k8BXmkARRsaaYlUJTRpIqQ
  - _index: phone
  - _type: iphone
  - _id: 2
  - *_score: 0.2712221*
  - _source: { 
 - title: iphone update
 - description: this section shows how to update yopur iphone to 
 work smoothly in your iphone
  

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/5f1cbc15-f2a5-455d-87f5-acec655e4b43%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


discription about explain api

2014-02-11 Thread Navneet Mathpal
hi ,

I want to know about follwing things about the explain api,

description: score(doc=0,freq=1.0 = termFreq=1.0 )  what does mean of 
freq=0 and docs=0

description: idf(docFreq=1, maxDocs=1)   value: 2.304384  what is the 
docFreq and how it calculated and what is the maxdocs and how does it 
calculated.

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/840249ae-fc9c-450e-aebf-0f96c2142902%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: calculation of whymatch in elasticsearch

2014-02-10 Thread Navneet Mathpal
Hi Britta Weber ,

I wanted to extract the total number of times a search term occurs..in a 
particular field..
Even if the search term is a  phrase,the query should return the total 
number of times that phrase 
occurs and also the frequency of individual term of that phrase in each 
field.

Thanks
Navneet Mathpal















On Friday, 7 February 2014 12:05:33 UTC+5:30, usha...@gmail.com wrote:
>
> Hi,
>  
> How do we implement whymatch concept in elasticsearch by finding the total 
> number of fields in which the search term occurs and the frequency of that 
> search term??
>  
>  
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/14c0ce29-5e02-462b-802f-8d131b371b1f%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Highlight the matched word in elasticsearch

2014-02-10 Thread Navneet Mathpal
Hi ,

how to highlight the matched word in elastic search if i am  firing a query 
like 

{
  "explain": true,
  "query": {
"match": {
  "name": "age of kamal"
}
  }
}


how to highlight the result which contained "age of kamal"


Thanks 
Navneet Mathpal

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/db2d03d8-0951-424b-8705-80e449bc91b4%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


whymatch in elasticsearch pharse query

2014-02-10 Thread Navneet Mathpal
Hi,

I am trying to match a phrase "repair iphone",

with the help of explain i am getting it but not getting how many times the 
hole phrase is occurring and in which field. 

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/891f46ba-988b-4601-ab54-faeca24bf312%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


how to implement whymatch in elastic search

2014-02-06 Thread Navneet Mathpal
Hi,

how to implement whymatch in elastic search, Is there is any procedure to 
calculate the term frequency for particular word.
 
for example :

search query- google founder

results are :- g123,g456,g789  (these are the docId corresponding to 
results )

In g123  google is in title field 3 times.

 so how to calculate them.

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/0e2d9c72-ccbb-45cc-ab65-4899905487e3%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: how to find precision

2014-02-05 Thread Navneet Mathpal

Ivan what I am doing is we have a set of good results and best results,if 
our output is coming from those good or best result will be consider as 
relevant record,

but what about those results which are not in good or best but can be 
relevant, how can we calculate the relevancy to find the rest of the 
result..?




On Wednesday, 5 February 2014 19:02:05 UTC+5:30, Navneet Mathpal wrote:
>
> Hi,
>
> This is actually not very related to elasticsearch, if i want to calculate 
> the precision and recall how can i do it .following is the scenario.
>
> the formula for precision is :- No of  relevant document retrieved / 
> total no of document retrieved
>
> how can we know that which of retrieved are relevant.
>
> Is there is any approach we can follow to calculate which are relevant 
> result.
>
>  
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/dfc2abe4-5822-46d0-ab3f-089338d9d02b%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


how to find precision

2014-02-05 Thread Navneet Mathpal
Hi,

This is actually not very related to elasticsearch, if i want to calculate 
the precision and recall how can i do it .following is the scenario.

the formula for precision is :- No of  relevant document retrieved / total 
no of document retrieved

how can we know that which of retrieved are relevant.

Is there is any approach we can follow to calculate which are relevant 
result.

 

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/7e93ee11-79b0-44c3-862f-15b71aeabb5e%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: how to calculate relevancy by the help of precision and recall

2014-02-04 Thread Navneet Mathpal

Ivan but
On Wednesday, 5 February 2014 11:36:50 UTC+5:30, Navneet Mathpal wrote:
>
> Hi,
>
> I want to know how do we calculate relevancy with the help of precision 
> and reacall,
>
> for example:-
> A = The number of relevant records retrieved, 
> B = The number of relevantrecords not retrieved, and 
> C = The number of irrelevant records retrieved. 
> In this example A = 45, B = 35(80-45)and C = 15(60-45)
> Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
> Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%
>
>
> what would be its relevancy how how ?
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/a3fff8c4-c80b-4b78-9f3b-0ee38dd9b6b5%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: how to calculate relevancy by the help of precision and recall

2014-02-04 Thread Navneet Mathpal
hey thanks ivan :)

On Wednesday, 5 February 2014 12:44:46 UTC+5:30, Ivan Brusic wrote:
>
> Interesting topic. Not elasticsearch specific, but nevertheless 
> interesting. One method to calculate relevancy given the precision and 
> recall of a query is by using the F1 score: 
> http://en.wikipedia.org/wiki/F1_score
>
> F1 would be equal to 2 * (P * R) / (P + R), where P is the precision and R 
> is the recall.
>
> I am glad someone is using elasticsearch as a search engine. Lately it 
> feels like it is mainly an analytical tool. :)
>
> Cheers,
>
> Ivan
>
>
> On Tue, Feb 4, 2014 at 10:06 PM, Navneet Mathpal 
> 
> > wrote:
>
>> Hi,
>>
>> I want to know how do we calculate relevancy with the help of precision 
>> and reacall,
>>
>> for example:-
>> A = The number of relevant records retrieved, 
>> B = The number of relevantrecords not retrieved, and 
>> C = The number of irrelevant records retrieved. 
>> In this example A = 45, B = 35(80-45)and C = 15(60-45)
>>  Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
>> Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%
>>
>>
>> what would be its relevancy how how ?
>>
>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "elasticsearch" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to elasticsearc...@googlegroups.com .
>> To view this discussion on the web visit 
>> https://groups.google.com/d/msgid/elasticsearch/0c5e3d1e-b58b-4ff1-a893-0cfbaef87aa8%40googlegroups.com
>> .
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/ec8db27b-761b-4af5-a59b-fbd7901c5d8c%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


how to calculate relevancy by the help of precision and recall

2014-02-04 Thread Navneet Mathpal
Hi,

I want to know how do we calculate relevancy with the help of precision and 
reacall,

for example:-
A = The number of relevant records retrieved, 
B = The number of relevantrecords not retrieved, and 
C = The number of irrelevant records retrieved. 
In this example A = 45, B = 35(80-45)and C = 15(60-45)
Recall =(45 / (45 + 35)) * 100% => 45/80 * 100% =56%
Precision =(45 / (45 + 15)) * 100% => 45/60 * 100% =75%


what would be its relevancy how how ?

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/0c5e3d1e-b58b-4ff1-a893-0cfbaef87aa8%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: boosting in es

2014-02-04 Thread Navneet Mathpal

if I am running the above command it is showing SearchPhaseExecutionException 
error ... but the command you have suggested working fine.
Thanks.







On Tuesday, 4 February 2014 14:24:39 UTC+5:30, Jayesh Bhoyar wrote:
>
> Hi Navneet,
>
> What error you are getting while running above command?
>
> Try following Query:
> curl -XPOST "localhost:9200/indexName/indexType/_search?pretty=true" -d ' 
> { 
>   "query" : { 
> "boosting" : { 
> "positive" : { 
> "term" : { 
> "name" : "kamal" 
> } 
> }, 
> "negative" : { 
> "term" : { 
> "email" : "abc"
> } 
> }, 
> "negative_boost" : 0.5 
> } 
>   } 
> } 
>
> ---
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/429f456d-787c-4e28-b70f-e45022d308c3%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


boosting in es

2014-02-04 Thread Navneet Mathpal
I  am trying to do the follwing query but it is showing error



{
  "query": {
"boosting": {
  "positive": {
"term": {
  "name": "kamal"
}
  },
  "negative": {
"term": {
  "email": "abc"
}
  }
}
  }
}

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/764af94e-0ff3-4993-a0ec-df0b02444619%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


Re: elasticsearch how to display the csv data

2014-01-28 Thread Navneet Mathpal
it was a csv file and i have imported it.there is field called first_name.

it showing the correct result in cygwin:- $  curl -XGET 
'http://localhost:9200/my_csv_data/csv_row/_search?q=first_name:Aaron' but 
not in head-master

On Wednesday, 29 January 2014 12:09:30 UTC+5:30, David Pilato wrote:
>
> How does your document look like?
> How did you index it?
>
> --
> David ;-)
> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs
>
>
> Le 29 janv. 2014 à 07:29, Navneet Mathpal 
> > 
> a écrit :
>
> hi,
>
> I an doing query like this 
>
> my_csv_data/csv_row/_search
>
> {
>   "field": {
> "first_name": "Aaron"
>   }
> }
>
>
>
> the name Aaron are not getting diplayed?? why?
>
> -- 
> You received this message because you are subscribed to the Google Groups 
> "elasticsearch" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to elasticsearc...@googlegroups.com .
> To view this discussion on the web visit 
> https://groups.google.com/d/msgid/elasticsearch/8ec59e3a-85fd-4487-8b7b-3eaf2d9528da%40googlegroups.com
> .
> For more options, visit https://groups.google.com/groups/opt_out.
>

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/f4999a9d-1f64-4fad-a946-982b700716ae%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.


elasticsearch how to display the csv data

2014-01-28 Thread Navneet Mathpal
hi,

I an doing query like this 

my_csv_data/csv_row/_search

{
  "field": {
"first_name": "Aaron"
  }
}



the name Aaron are not getting diplayed?? why?

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/8ec59e3a-85fd-4487-8b7b-3eaf2d9528da%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.