Phonetic Search

[PAVAN]

Hi,

I am trying to implement phonetic search in my application. Below are
indexed terms in solr. 

"satpura private limited"

when user search with "satpuda"  it has to display the above result. Below
is the configuration








 

Please help me how to implement phonetic search.






--
View this message in context: 
http://lucene.472066.n3.nabble.com/Phonetic-Search-tp4314828.html
Sent from the Solr - User mailing list archive at Nabble.com.

Query on SuggestComponent in SolrCloud(6.2.1).

[Pavan Kumar VVR]

Hi,

We are in process of migrating our solr environment from standalone Solr(4.9) 
to SolrCloud(6.2.1).
During this process we facing issues with solr.SuggestComponent, which is 
working fine earlier in 4.9 with solr.TermsComponent

PFB detailed description for same and kindly assistance.
Let us know if any additional details are required

Collection Name: Al_prnt_grp
Shards  : IN_39_SWG and IN_40_SWG(dynamically created using 
implicit router)
Document indexed into IN_39_SWG shared(which has words like company, computer, 
compare with etc.)


* Using below entries/configuration in solrconfig.xml and 
managed-schema.xml I have uploaded the configsets to zookeeper.

* And reloaded the collection using collection api.


* Finally when I was running below query for auto-complete, it was not 
displaying 0 suggestions found.
http://:/solr/Al_prnt_grp/suggesthandler?suggest.dictionary=mySuggester&suggest=true&suggest.reload&suggest.build=true&suggest.q=comp&shards.keys=:/solr/IN_39_SWG&indent=true&shards.qt=/suggest&distrib=false&omitHeader=true&wt=json


* When I have gone through solr.log I was seeing below error.
INFO  - 2016-12-05 05:45:05.982; [c:Al_prnt_grp s:IN_40_SWG r:core_node5 
x:Al_prnt_grp_IN_40_SWG_replica3] 
org.apache.solr.spelling.suggest.SolrSuggester; SolrSuggester.build(mySuggester)
ERROR - 2016-12-05 05:45:05.984; [c:Al_prnt_grp s:IN_40_SWG r:core_node5 
x:Al_prnt_grp_IN_40_SWG_replica3] 
org.apache.solr.spelling.suggest.SolrSuggester; Store Lookup build failed
INFO  - 2016-12-05 05:45:05.984; [c:Al_prnt_grp s:IN_40_SWG r:core_node5 
x:Al_prnt_grp_IN_40_SWG_replica3] 
org.apache.solr.handler.component.SuggestComponent; SuggestComponent process 
with : shards.keys=:/solr/IN_39_SWG&distrib=false&suggest.build=true&indent=true&omitHeader=true&suggest.q=comp&suggest.count=10&suggest.reload=&suggest=true&suggest.dictionary=mySuggester&wt=json&shards.qt=/suggest


* When I am looking into forums I see similar issue was raised on 
20/Jun/2016 which is still open.
https://issues.apache.org/jira/browse/SOLR-9227

Step 1: Entry in solrconfig.xml

* Added searchcomponent and requesthandler for same in solrconfig.xml



  
mySuggester
FuzzyLookupFactory
suggester_fuzzy_dir
DocumentDictionaryFactory
content_autosuggest
text_auto
false
false
  



  
true
10
mySuggester
false
  
  
suggest
  



Step 2 : Entry in managed-schema.xml


   ...
   
 
   
  
 
  
  
  
  


  

Step 3 : Uploaded configsets to zookeeper for one collection

./zkcli.sh zkcli.sh -cmd upconfig -zkhost  zookeeperdev:8080,zookeeperprod:8081 
 -collection Al_prnt_grp -confname IR_CORE -solrhome 
/opt/solrusrcloud/solr-6.2.1/server/solr -confdir 
/opt/solrcloud/solr-6.2.1/server/solr/configsets/data_driven_schema_configs/conf

Step 4 : Reloaded the collection

http://:/solr/admin/collections?action=RELOAD&name=Al_prnt_grp



Best Regards,
V.V.R.Pavan Kumar
Technology Lead
INDD Unit
Infosys Limited
Desk : +91 044 44462476
Mob   : +91 7823982845

Solr Problems

[Pavan Kumar]

Hi Sir,

How to pass stored procedure input parameters in solr data-config.xml.

Data-config.xml



Thanks in advance.

Thanks & Regards,
Pavan Kumar

Solr Problem

[Pavan Kumar]

Hi Sir,


We have one application with postgres DB and Java front end.Now we have
written some procedure by
*IN* and *OUT* parameter and the front team used to use that IN & OUT
parameter and fetch the data from DB .The requirement
is that, the same thing we have to implement by using Solr. We have to show
the IN parameter in the URL
so that the front end team can use that URL by using IN parameter and fetch
the data also the out parameter
should display through application. Please help me out. Thanks in advance.

Thanks !
 
  
  










































   
 

Fwd: Script Transformer Help

[pavan patharde]

Hi Alex,

I tried putting the transformer on the inner entity. Now i can not access
the parent entity fields.

Can you tell me how to read the parent fields ?

Regards,
Pavan .P.Patharde



On Thu, Jul 17, 2014 at 10:08 AM, Alexandre Rafalovitch 
wrote:

> Have you tried putting the transformer on the inner entity definition?
> It's like a nested loop and you just put it in the outer loop.
>
> Regards,
>Alex.
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On Thu, Jul 17, 2014 at 11:29 AM, pavan patharde
>  wrote:
> > Hi All,
> >
> > I have data-config.xml as below:Script Transformer is omitted.
> > 
> >  > url="jdbc:hsqldb:/temp/example/ex"­­ user="sa" />
> >
> > <![CDATA[function f1(row){
> >row.put('message', 'Hello World!');return
> > row;}]]>
> >
> >
> > 
> >  > transformer="script:f1">
> > 
> > 
> >
> > 
> > 
> > 
> > 
> >
> > 
> > 
> > 
> >
> > I am able to access NAME and BSIN in the function f1. I am not able to
> > access the brand and cname. Is there any way i can access brand and cname
> > from child entity in script transformer ?
> > Thanks in advance.
> >
> > Regards,
> > Pavan .P.Patharde
>

Re: Script Transformer Help

[pavan patharde]

Hi Alex,

I tried putting the transformer on the inner entity. Now i can not access
the parent entity fields.

Can you tell me how to read the parent fields ?

Regards,
Pavan .P.Patharde



On Thu, Jul 17, 2014 at 10:08 AM, Alexandre Rafalovitch 
wrote:

> Have you tried putting the transformer on the inner entity definition?
> It's like a nested loop and you just put it in the outer loop.
>
> Regards,
>Alex.
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On Thu, Jul 17, 2014 at 11:29 AM, pavan patharde
>  wrote:
> > Hi All,
> >
> > I have data-config.xml as below:Script Transformer is omitted.
> > 
> >  > url="jdbc:hsqldb:/temp/example/ex"­­ user="sa" />
> >
> > <![CDATA[function f1(row){
> >row.put('message', 'Hello World!');return
> > row;}]]>
> >
> >
> > 
> >  > transformer="script:f1">
> > 
> > 
> >
> > 
> > 
> > 
> > 
> >
> > 
> > 
> > 
> >
> > I am able to access NAME and BSIN in the function f1. I am not able to
> > access the brand and cname. Is there any way i can access brand and cname
> > from child entity in script transformer ?
> > Thanks in advance.
> >
> > Regards,
> > Pavan .P.Patharde
>

Re: Script Transformer Help

[pavan patharde]

Thats a good idea Alexandre. I will try it and update the results.. Thanks.

Pavan .P.Patharde
Phone:9844626450


On Thu, Jul 17, 2014 at 10:08 AM, Alexandre Rafalovitch 
wrote:

> Have you tried putting the transformer on the inner entity definition?
> It's like a nested loop and you just put it in the outer loop.
>
> Regards,
>Alex.
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On Thu, Jul 17, 2014 at 11:29 AM, pavan patharde
>  wrote:
> > Hi All,
> >
> > I have data-config.xml as below:Script Transformer is omitted.
> > 
> >  > url="jdbc:hsqldb:/temp/example/ex"­­ user="sa" />
> >
> > <![CDATA[function f1(row){
> >row.put('message', 'Hello World!');return
> > row;}]]>
> >
> >
> > 
> >  > transformer="script:f1">
> > 
> > 
> >
> > 
> > 
> > 
> > 
> >
> > 
> > 
> > 
> >
> > I am able to access NAME and BSIN in the function f1. I am not able to
> > access the brand and cname. Is there any way i can access brand and cname
> > from child entity in script transformer ?
> > Thanks in advance.
> >
> > Regards,
> > Pavan .P.Patharde
>

Script Transformer Help

[pavan patharde]

Hi All,

I have data-config.xml as below:Script Transformer is omitted.



<![CDATA[function f1(row){
   row.put('message', 'Hello World!');return
row;}]]>
















I am able to access NAME and BSIN in the function f1. I am not able to
access the brand and cname. Is there any way i can access brand and cname
from child entity in script transformer ?
Thanks in advance.

Regards,
Pavan .P.Patharde

accessing field values from documents in custom searchComponent for solr 4.4 .

[Pavan Kumar]

Hi,

I am trying to implement a custom SearchComponent for solr 4.4 and need to
access a few fields for the all the documents (docId's) returned by
QueryComponent .


I see there is a retrievedDocuments map in response builder . But it is not
populated . Is there a field i have to set in the solr query url  to
populate this fields . I have set fl=.

Currently am trying to access the docs/field using SolrIndexSearcher.

SolrIndexSearcher searcher ;
searcher.doc(itr.next()).getField("field1");
//where itr is the docListIterator

This is slow if the documentCache dose not have toe dock .

Is there a better way to access one single field for all the documents
returned by QueryComponenet .


My query looks like this :

http://
/solr//select_exp?q=shirts&wt=xml&indent=true&defType=edismax&qf=field1_st+catchall_st&stopwords=true&lowercaseOperators=true&rows=1000&fsv=true&fl=field1%20field_2%20score&debugQuery=true

Thanks,
Pavan

space issue in search results

[PAVAN]

I have indexed title in the following way.

honda cars in rajaji nagar
honda cars in rajajinagar.

suppose if i search for 

honda cars in rajainagar (OR) 
honda cars in rajaji nagar 

it has to display both the results.

Anybody help me how can we do this.








--
View this message in context: 
http://lucene.472066.n3.nabble.com/space-issue-in-search-results-tp4133421.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: in Problem

[PAVAN]

Hi Dmitry,

I already defined in the following way







--
View this message in context: 
http://lucene.472066.n3.nabble.com/in-Problem-tp4092866p4092899.html
Sent from the Solr - User mailing list archive at Nabble.com.

in Problem

[PAVAN]

Hi,

When i type any query string without "in" it is giving proper results. But
when i try same query string using in then it is not displaying the proper
results. May i know what is the problem.

And i mentioned "in" as a stopword. If remove "in" from the stop words it is
not showing relevant results.

Ex :

used computers chennai -- showing good results

used computer in chennai -- Not showing proper results 


Can anybody tell me what is the problem?



--
View this message in context: 
http://lucene.472066.n3.nabble.com/in-Problem-tp4092866.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: AND/OR logic

[PAVAN]

Hi Jack,

Thank you for giving reply

 I am doing my configuration in the following way. Can you please check
it and give some suggestion if i need any changes based on my requirement.

i am storing the query string in the following way.

If q="a b c d e f"

s=a+b+c+d+e+f
s1=a+b+c+d+e
s2=f






   query
   debug
  
  
   
   
   
   
   *,score
   false
   all
   true
  
  
  3
  json

   AND
   fsw_title
   14
   {!edismax v=$s}
   mpId desc
   city:All OR _query_:"{!field f=city v=$c}"
   true
   mpId
   4
   true
   score desc
   edismax
   false
   tsw_title^15.0 tf_title^10.0 tsw_keywords^1
keywords^0.5
   fsw_title~1^50.0
   fsw_title~1^25.0
   sum(product(typeId,100),weightage)
   
   OR
   fsw_title
   14
   _query_:"{!edismax qf=$qfs1 pf=$pfx pf2=$pf2x v=$s1}" AND
_query_:"{!edismax qf=$qfs2 v=$s2}"
   mpId desc, score desc
   city:All OR _query_:"{!field f=city v=$c}"
   true
   mpId
   4
   true
   score desc
   false
   fsw_title^30 tsw_title^20 tf_title^15.0
keywords^1.0
   tsw_title^15.0 tf_title^10.0 tsw_keywords^1
keywords^0.5
   fsw_title~1^100.0
   fsw_title~1^50.0
   fsw_title~1^25.0
   product(typeId,100)





--
View this message in context: 
http://lucene.472066.n3.nabble.com/AND-OR-logic-tp4091931p4092059.html
Sent from the Solr - User mailing list archive at Nabble.com.

Custom Request Handlers

[PAVAN]

Hi,


  I am new to solr Can anyone suggest me how can i write my own custom
handlers. Because i need to filter queries based on 4 to 5 conditions.






--
View this message in context: 
http://lucene.472066.n3.nabble.com/Custom-Request-Handlers-tp4091936.html
Sent from the Solr - User mailing list archive at Nabble.com.

AND/OR logic

[PAVAN]

Hi,

 I have situation that if user enters any string to search then i need
to display the results in the following way.

1. It has to match exact string what he entered.
 
  (or)

2. It has to split the string and search for individual keywords(for every
string) and it has to display the results.

Ex : suppose user searching for 

 "royal enfeild bikes"

First Conditionit has to check for whole string "royal enfiled bikes"
Second Condition - it has to display the results like   royal OR enfiled
OR bikes

Can anyone give me suggestions.










--
View this message in context: 
http://lucene.472066.n3.nabble.com/AND-OR-logic-tp4091931.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SORTING RESULTS BASED ON RELAVANCY

[PAVAN]

Hi alex,

 Thanks for you replycan you please check the following details and
give me suggestions how can i do it, then it will be more helpful to me


i am passing query parameters like 

http://localhost:8080/solr/core/c=cityname&s=iphne+4&s1=iphne~0.5&s2=4~0.5

here "s" is the main string and splitted into s1 and s2 for fuzzy


if a user search for "iphne 4" first it has to check exact match it is not
found then i am splitting string into two strings s1 and s2. i am adding
~0.5 for both s1 and s2.


i need "iphone 4" result first


and i did the configuration in the following way...


AND
   fsw_title
   15
   {!edismax v=$s}
   
   city:All OR _query_:"{!field f=city v=$c}"
   true
   mpId
   3
   true
   
   edismax
   false
   tsw_title^15.0 tf_title^10.0 tsw_keywords^1
keywords^0.5
   fsw_title~1^50.0
   fsw_title~1^25.0
   sum(product(typeId,100),weightage)
   
OR
   fsw_title
   20
   _query_:"{!edismax qf=$qfs1 pf=$pfx pf2=$pf2x v=$s1}" AND
_query_:"{!edismax qf=$qfs2 v=$s2}"
   
   city:All OR _query_:"{!field f=city v=$c}"
   true
   mpId
   5
   true
   
   false
   fsw_title^30 tsw_title^20 tf_title^15.0
keywords^1.0
   tsw_title^15.0 tf_title^10.0 tsw_keywords^1
keywords^0.5
   fsw_title~1^100.0
   fsw_title~1^50.0
   fsw_title~1^25.0
   product(typeId,100)






--
View this message in context: 
http://lucene.472066.n3.nabble.com/SORTING-RESULTS-BASED-ON-RELAVANCY-tp4090789p4090794.html
Sent from the Solr - User mailing list archive at Nabble.com.

SORTING RESULTS BASED ON RELAVANCY

[PAVAN]

Hi,

   i am using fuzzy logic and it is giving exact results but i need to
sort the results based on relavancy. Means closer match results comes first.

anyone can help with this..


Regards,
Pavan.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/SORTING-RESULTS-BASED-ON-RELAVANCY-tp4090789.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr user

[Pavan Gupta]

Hi Ankita,
One reason could be that you are using area_t instead of city_t for mapping.
So the association may not be taking place in Solr. Have you tried searching
on skill? That should have worked for you.
Pavan

On Thu, Sep 2, 2010 at 12:10 PM, ankita shinde wrote:

> hi,
> I am able to index all my entries in my table named info. This table has
> four columns named id, name, city and skill.
> I have written a data-config file as follow :
>
> 
>  
>  driver="com.mysql.jdbc.Driver"
>  url="jdbc:mysql://3307/dbname"
>  user="user-name"
>  password="password"/>
>  
>
>query="select id,name,city,branch from info">
>
> 
> 
> 
> 
>
>
>  
> 
>
>
>
>
> *And the entries made in schema.xml are:*
>
> 
> 
>
>
> entries for id and name are already present.
>
>
> And i also have added requestimporthandler in solrconfig.xml as follow:
>
>  class="org.apache.solr.handler.dataimport.DataImportHandler">
> 
>  data-config.xml
> 
> 
>
>
>
> Data is successfully indexed. But I am able to find results only for
> column 'name'. For other columns it is not giving result.
>

Re: about some examples

[Pavan Gupta]

Hi Kajal,
You can refer to the example given at this link:

http://wiki.apache.org/solr/SolrJS#Creating_the_reuters_example
<http://wiki.apache.org/solr/SolrJS#Creating_the_reuters_example>Regards,
Pavan

On Tue, Aug 31, 2010 at 10:47 PM, kajal patil  wrote:

> We are working on solrJS.but we didnt get much more information about it.so
> please provide us some useful links on which we will get information.also
> provide some solrJS examples and demos...
> regards,
> kajal
>

Search results after importing from Dih

[Pavan Gupta]

Hi,
I was able to successfully index rows of a simple table of mysql db using
DIH. However, when I tried searching for the indexed data using solr admin
interface, no result based on data in table was displayed. Any idea why?
Regards,
Pavan

Require some advice

[Pavan Gupta]

Hi,
I am new to text search and mining and have been doing research for
different available products. My application requires reading a SMS message
(unstructured) and finding out entities such as person name, area, zip ,
city and skills associated with the person. SMS would be in form of free
text. The parsed data would be stored in database and used by Solr to
display results.
A SMS message could in the following form:
"John Mayer Mumbai 411004 Juhu, car driver, also capable of body guard"
We need to interpret in the following manner:
first name -> John
last name -> Mayer
city-> Mumbai
zip -> 411004
area->Juhu
skills -> car driver, body guard


1. Is Solr capable enough to handle this application considering that SMS
message would be unstructured.
2. How is Solr/Lucene as compared to other tools such as UIMA, GATE, CER
(stanford university), Lingpipe?
3. Is Solr only text search or can be used for information extraction?
4. Is it recommended to use Solr with other products such as UIMA and GATE.

There are companies that are specialized in making meaning out of
unstructured SMS messages. Do we have something similar in open source
world? Can we extend Solr for the same purpose?

You reply would be appreciated.
Thanking you.
Regards,
Pavan

Re: Using lucenes custom filters in solr

[pavan kumar donepudi]

Hi All,

  I have a custom filter for lucene ,Can anyone help me how to use this
in SOLR.

Thanks in advance,
Pavan