Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread Erick Erickson
Pretty much correct. The only change I’d make is that 7x is not actively being supported in the sense that only seriously critical bugs will be addressed. You’ll note that the last release of 7x was 7.7.2 in early June. Increased functionality, speedups, etc won’t be back-ported. So I can’t

Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread suyog joshi
Hi Erick, Thank you so much for sharing detailed information, indeed its really helpful for us to plan out the things. Really appreciate your guidance. So we can say its better to go with latest stable version (8.x) instead of 7.x, which is LTS right now, but can soon become EOL post launching

Re: Need some help on solr versions (LTS vs stable)

2019-11-06 Thread Erick Erickson
It’s variable. The policy is that we try very hard to maintain one major version back-compat. So generally, if you start with, say, 7x upgrading to 8x should be relatively straightforward. However, you will _not_ be able to upgrade from 7x to 9x, you must re-index everything from scratch. The

Need some help on solr versions (LTS vs stable)

2019-11-05 Thread suyog joshi
Hi Team, Can you please guide us on below queries for solr versions ? 1. Are there any major differences (for security, platform stability etc) between current LTS and Stable Solr version ? 2. How long a version remains in LTS before becoming EoL ? 3. How frequently LTS version gets changed ?

Re: Help to learn synonymQueryStyle and FieldTypeSimilarity

2019-10-22 Thread Paras Lehana
ymQueryStyle and FieldTypeSimilarity but i am still not clear how it > exactly works. > Can somebody please help me to understand this with the help of an example > ? > Any help will be appreciated. Thanks in advance. > > -- > *Thanks & Regards* > Shubham Goswami > Enterprise Softwar

Re: Help with Stream Graph

2019-10-20 Thread Rajeswari Natarajan
Thanks Joel. That fixed the problem. Regards, Rajeswari On Fri, Oct 18, 2019 at 12:50 PM Joel Bernstein wrote: > The query that is created to me looks looked good but it returns no > results. Let's just do a basic query using the select handler: > > product_s:product1 > > If this brings back

Re: Help with Stream Graph

2019-10-18 Thread Joel Bernstein
The query that is created to me looks looked good but it returns no results. Let's just do a basic query using the select handler: product_s:product1 If this brings back zero results then we know we have a problem with the data. Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Oct 18,

Re: Help with Stream Graph

2019-10-18 Thread Rajeswari Natarajan
Hi Joel, Do you see anything wrong in the config or data . I am using 7.6. Thanks, Rajeswari On Thu, Oct 17, 2019 at 8:36 AM Rajeswari Natarajan wrote: > My config is from > > >

Help to learn synonymQueryStyle and FieldTypeSimilarity

2019-10-18 Thread Shubham Goswami
Hi Community I am a beginner in solr and i am trying to understand the working of synonymQueryStyle and FieldTypeSimilarity but i am still not clear how it exactly works. Can somebody please help me to understand this with the help of an example ? Any help will be appreciated. Thanks in advance

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
My config is from https://github.com/apache/lucene-solr/tree/branch_7_6/solr/solrj/src/test-files/solrj/solr/configsets/streaming/conf Thanks, Rajeswari On Thu, Oct 17, 2019 at 8:16 AM Rajeswari Natarajan wrote: > I tried below query and it returns o results > > >

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
I tried below query and it returns o results http://localhost:8983/solr/knr/export?{!terms+f%3Dproduct_s}product1=false=basket_s,product_s=basket_s+asc,product_s+asc=json=2.2 { "responseHeader":{"status":0}, "response":{ "numFound":0, "docs":[]}} Regards, Rajeswari On Thu, Oct 17,

Re: Help with Stream Graph

2019-10-17 Thread Rajeswari Natarajan
Thanks Joel. Here is the logs for below request curl --data-urlencode 'expr=gatherNodes(knr,walk="product1->product_s",gather="basket_s")' http://localhost:8983/solr/knr/stream 2019-10-17 15:02:06.969 INFO (qtp952486988-280) [c:knr s:shard1 r:core_node2 x:knr_shard1_replica_n1]

Re: Help with Stream Graph

2019-10-17 Thread Joel Bernstein
Can you show the logs from this request. There will be a Solr query that gets sent with product1 searched against the product_s field. Let's see how many documents that query returns. Joel Bernstein http://joelsolr.blogspot.com/ On Thu, Oct 17, 2019 at 1:41 AM Rajeswari Natarajan wrote: >

Help with Stream Graph

2019-10-16 Thread Rajeswari Natarajan
Hi, Since the stream graph query for my use case , didn't work as i took the data from solr source code test and also copied the schema and solrconfig.xml from solr 7.6 source code. Had to substitute few variables. Posted below data curl -X POST http://localhost:8983/solr/knr/update -H

Re: Need help with Solr Streaming query

2019-10-16 Thread Erick Erickson
The NOT operator isn’t a Boolean NOT, so it requires some care, Chris Hostetter wrote a good blog about that. Try q=*:* -(:*c* The query q=-something really isn’t valid syntax, but some query parsers help you out by silently putting the *:* in front of it. that’s not guaranteed across all

Need help with Solr Streaming query

2019-10-16 Thread Prasenjit Sarkar
="/export",q="-(: *c*) ",fl="",sort=" asc"),sort=" asc") In the above query the not operator q="-(: *c*)" is not working with /export.However the same query works when I combine any postive search criteria with the not expression like q=

Re: Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType

2019-10-01 Thread David Smiley
/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Oct 1, 2019 at 7:34 AM anushka gupta < anushka_gu...@external.mckinsey.com> wrote: > Thanks, > > Could you please help me in combining two geofilt fqs as the following > gives > error, it treats ")&q

Re: Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType

2019-10-01 Thread anushka gupta
Thanks, Could you please help me in combining two geofilt fqs as the following gives error, it treats ")" as part of the d parameter and gives error that 'd=80)' is not a valid param: ({!geofilt}=adminLatLon=33.0198431,-96.6988856=80)+OR+({!geofilt}=adminLatLon=50.2171726,8

Re: Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType

2019-09-30 Thread David Smiley
.265894+d=80+sort=min(geodist(50.2171726,8.265894))}) > > > > Sorting works fine if I add ‘&’ in geofilt condition like : > q=david={!geofilt=adminLatLon=33.0198431,-96.6988856=80=geodist(33.0198431,-96.6988856)} > > > > But when I combine the two FQs then sortin

Re: Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType

2019-09-30 Thread Tim Casey
26,8.265894))}) > > Sorting works fine if I add ‘&’ in geofilt condition like : > q=david={!geofilt=adminLatLon=33.0198431,-96.6988856=80=geodist(33.0198431,-96.6988856)} > > But when I combine the two FQs then sorting doesn’t work. > > Please help. > > > Bes

RE: Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType

2019-09-30 Thread Anushka Gupta
ease help. Best regards, Anushka gupta From: David Smiley Sent: Friday, September 13, 2019 10:29 PM To: Anushka Gupta Subject: [EXT]Re: Need urgent help with Solr spatial search using SpatialRecursivePrefixTreeFieldType Hello, Please don't email me directly for public help. CC is okay if

[JOB] remote job at Help Scout

2019-09-26 Thread Leah Knobler
Hey all! Help Scout <https://t.yesware.com/tt/5c3e6e41ed343ce324b9d063a065f0f54b1dbc48/a7b6c6ce29fdcfd3033c830348fdf63e/5ef7f23b853bcf4180b332337995eaa9/www.helpscout.com/>, a 100 person remote company that builds helpful customer messaging tools, is looking for a Java Data Engineer

Re: Can you help with this JOIN and OR query?

2019-09-11 Thread Mikhail Khludnev
Hello, James. Right. Syntax is cumbersome q=articledate:[2018-09-04T00:00:00Z TO 2019-09-10T23:59:59Z] {!join to=id from=url v=$param}=articledate:[2018-09-04T12:00:00Z TO 2019-09-10T11:59:59Z]) On Wed, Sep 11, 2019 at 9:39 AM Smith2, James wrote: > Hi there, > > I was hoping that you may be

Can you help with this JOIN and OR query?

2019-09-11 Thread Smith2, James
Hi there, I was hoping that you may be able to assist us with a search issue we're facing. Each one of these queries work on their own: articledate:[2018-09-04T00:00:00Z TO 2019-09-10T23:59:59Z] {!join to=id from=url}articledate:[2018-09-04T12:00:00Z TO 2019-09-10T11:59:59Z]) But if we try

Need help | NoNodeException | Could not read DIH properties

2019-09-05 Thread Pal Sumit
eturning (previously it was returning data). https://SolrHostname/solr//select?q=(Composition)=edismax=title^2 author impn source=100=json It would be a great help if someone provide me a clue. Please let me know if more details are needed to analyze. Thanks & Regar

Re: Basic Query Not Working - Please Help

2019-07-30 Thread Furkan KAMACI
> } > > > ] > > > } > > > ] > > > } > > > > > > 5. Now when i go to Query tab and click Execute Search with *.*, it > shows > > > my recently added document as follows: > > > { > > > "responseHeader":{ "status":0, "QTime":0, "params":{ "q":"*:*", "_": > > > "1563780352100"}}, "response":{"numFound":1,"start":0,"docs":[ { > > "id":"1", > > > " > > > prjname":["Project1"], "apps":["{appname=App1, > topics=[{topicname=topic1, > > > links=[http://www.google.com, http://www.t6.com]}, {topicname=topic2, > > > links=[http://www.java.com, http://www.rediff.com]}]};, > "{appname=App2, > > > topics=[{topicname=topic3, links=[http://www.t3.com, http://www.t4.com > > ]}, > > > {topicname=topic4, links=[http://www.rules.com, http://www.amazon.com > > > ]}]}"], > > > "_version_":1639742305772503040}] }} > > > > > > 6. But now when I am trying to search based on field topicname or > > prjname, > > > it does not returns any document. Even if put anything in q like App1, > > zero > > > results are being returned. > > > > > > > > > Can someone help me understanding what I might have done incorrectly? > > > May be I defined my schema incorrectly. > > > > > > Thanks in advance > > > > > >

Re: Basic Query Not Working - Please Help

2019-07-26 Thread Vipul Bahuguna
ow when i go to Query tab and click Execute Search with *.*, it shows > > my recently added document as follows: > > { > > "responseHeader":{ "status":0, "QTime":0, "params":{ "q":"*:*", "_": > > "1563780352100"}}, "response":{"numFound":1,"start":0,"docs":[ { > "id":"1", > > " > > prjname":["Project1"], "apps":["{appname=App1, topics=[{topicname=topic1, > > links=[http://www.google.com, http://www.t6.com]}, {topicname=topic2, > > links=[http://www.java.com, http://www.rediff.com]}]};, "{appname=App2, > > topics=[{topicname=topic3, links=[http://www.t3.com, http://www.t4.com > ]}, > > {topicname=topic4, links=[http://www.rules.com, http://www.amazon.com > > ]}]}"], > > "_version_":1639742305772503040}] }} > > > > 6. But now when I am trying to search based on field topicname or > prjname, > > it does not returns any document. Even if put anything in q like App1, > zero > > results are being returned. > > > > > > Can someone help me understanding what I might have done incorrectly? > > May be I defined my schema incorrectly. > > > > Thanks in advance > > >

Re: Basic Query Not Working - Please Help

2019-07-22 Thread Furkan KAMACI
uot;1563780352100"}}, "response":{"numFound":1,"start":0,"docs":[ { "id":"1", > " > prjname":["Project1"], "apps":["{appname=App1, topics=[{topicname=topic1, > links=[http://www.google.com, http://www.t6.com]}, {topicname=topic2, > links=[http://www.java.com, http://www.rediff.com]}]};, "{appname=App2, > topics=[{topicname=topic3, links=[http://www.t3.com, http://www.t4.com]}, > {topicname=topic4, links=[http://www.rules.com, http://www.amazon.com > ]}]}"], > "_version_":1639742305772503040}] }} > > 6. But now when I am trying to search based on field topicname or prjname, > it does not returns any document. Even if put anything in q like App1, zero > results are being returned. > > > Can someone help me understanding what I might have done incorrectly? > May be I defined my schema incorrectly. > > Thanks in advance >

Basic Query Not Working - Please Help

2019-07-22 Thread Vipul Bahuguna
http://www.t6.com]}, {topicname=topic2, links=[http://www.java.com, http://www.rediff.com]}]};, "{appname=App2, topics=[{topicname=topic3, links=[http://www.t3.com, http://www.t4.com]}, {topicname=topic4, links=[http://www.rules.com, http://www.amazon.com]}]};], "_version_":1639742305772503040}] }} 6. But now when I am trying to search based on field topicname or prjname, it does not returns any document. Even if put anything in q like App1, zero results are being returned. Can someone help me understanding what I might have done incorrectly? May be I defined my schema incorrectly. Thanks in advance

Re: SOLR EofException help

2019-06-13 Thread ennio
Thanks for the information. I will check my server timeout to see what is happening. That was very helpful. Also thanks for pointing out the swap space memory allocation I will double check here. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: SOLR EofException help

2019-06-13 Thread Shawn Heisey
On 6/13/2019 7:30 AM, ennio wrote: The server for most part runs fine, but when I look at the logs I see from time to time the following error. org.eclipse.jetty.io.EofException: Closed Jetty's EofException is nearly always caused by a specific event: The client talking to Solr closed the

SOLR EofException help

2019-06-13 Thread ennio
while to process but eventually it comes back to a normal state. I'm not running SOLR cloud, it just a single instance of SOLR Thanks for the help. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Erick Erickson
t; >>>> On 7 Jun 2019, at 07:27, jena > >> sthita2010@ > >> wrote: >>>> >>>> Hello guys, >>>> >>>> We have 4 solr(version 4.4) instance on production environment, which >>>>

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread David Santamauro
erations. We have around 26million records and the index size is >>> around >>> 70GB. We serve 100k+ requests per day. >>> >>> >>> Because of heavy indexing & deletion, we optimise solr instance >>> everyday,

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread jena
amp; >>> add >>> operations. We have around 26million records and the index size is >>> around >>> 70GB. We serve 100k+ requests per day. >>> >>> >>> Because of heavy indexing & deletion, we optimise solr instance >>> everyda

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Erick Erickson
ion. >> >> Prior to Solr 7.5 you don’t have many options except to re-index and _not_ >> optimize. So if possible I’d reindex from scratch into a new collection and >> do not optimize. Or restructure your process such that you can optimize in a >> quiet period whe

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread David Santamauro
info for 4.4 >> version. Is there any API i can use to get my segment information ? Will try >> to use maxSegments and see if it can help us during optimization. >> >> >> >> -- >> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html > >

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Erick Erickson
te: >> >> Thanks @Nicolas Franck for reply, i don't see any any segment info for 4.4 >> version. Is there any API i can use to get my segment information ? Will try >> to use maxSegments and see if it can help us during optimization. >> >> >> >> -- >> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html > >

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread jena
Thanks @Erick for the suggestions. That looks so bad, yes your assumptions are right, we have lot of delete & index documents as well. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread jena
Thanks Shawn for suggestions. Interesting to know deleteByQuery has some impact, will try to change it as you have suggested. Thabks -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread David Santamauro
, i don't see any any segment info for 4.4 > version. Is there any API i can use to get my segment information ? Will try > to use maxSegments and see if it can help us during optimization. > > > > -- > Sent from: ht

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread David Santamauro
gt; Thanks @Nicolas Franck for reply, i don't see any any segment info for 4.4 > version. Is there any API i can use to get my segment information ? Will try > to use maxSegments and see if it can help us during optimization. > > > > -- > Sent

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Michael Joyner
Optimisation takes around 1hr 30minutes. We are not able fix this issue, please help. Thanks & Regards -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Erick Erickson
AM, jena wrote: > > Thanks @Nicolas Franck for reply, i don't see any any segment info for 4.4 > version. Is there any API i can use to get my segment information ? Will try > to use maxSegments and see if it can help us during optimization. > > > > -- > Sent

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Shawn Heisey
On 6/6/2019 11:27 PM, jena wrote: Because of heavy indexing & deletion, we optimise solr instance everyday, because of that our solr cloud getting unstable , every solr instance go on recovery mode & our search is getting affected & very slow because of that. Optimisation takes around 1hr

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread jena
Thanks @Nicolas Franck for reply, i don't see any any segment info for 4.4 version. Is there any API i can use to get my segment information ? Will try to use maxSegments and see if it can help us during optimization. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Urgent help on solr optimisation issue !!

2019-06-07 Thread Nicolas Franck
se solr instance everyday, > because of that our solr cloud getting unstable , every solr instance go on > recovery mode & our search is getting affected & very slow because of that. > Optimisation takes around 1hr 30minutes. > We are not able fix this issue, please help.

Urgent help on solr optimisation issue !!

2019-06-07 Thread jena
eavy indexing & deletion, we optimise solr instance everyday, because of that our solr cloud getting unstable , every solr instance go on recovery mode & our search is getting affected & very slow because of that. Optimisation takes around 1hr 30minutes. We are not able fix this issue, plea

Re: Please help on pdate type during indexing

2019-06-03 Thread Shawn Heisey
, and ending with Z. I have put timezone in the string, please help, As far as I know, you can't do that. Solr only handles dates in UTC - no timezone. There is one place where Solr has a timezone configurable -- that's for date math. So that Solr knows what time a day starts when

Please help on pdate type during indexing

2019-06-02 Thread derrick cui
:'org.apache.solr.common.SolrInputField:UpdateDate=2019-06-03T05:22:14.842Z',, retry=0 commError=false errorCode=400  I have put timezone in the string, please help, thanks

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Shawn Heisey
On 5/3/2019 12:52 AM, Salmaan Rashid Syed wrote: I say that the nodes are limited to 4 because when I launch Solr in cloud mode, the first prompt that I get is to choose number of nodes [1-4]. When I tried to enter 7, it says that they are more than 4 and choose a smaller number. That's the

Help extracting text from PDF images when indexing files

2019-05-03 Thread Miguel Fernandes
text from the parsed images. In the configuration of ExtractingRequestHandler, the lib clauses are present in my solrconfig.xml, that section is as below: true content parseContext.xml And my parseContext.xml file is: Any help on how to correct

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Jörn Franke
gt;>> (max as limited by Solr) at 4 different ports. I don’t know how to go >>> beyond 4 nodes/ports in this case. >>> >>> The other option is to run Solr as service and create multiple copies of >>> Solr folder within the Server folder and acces

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Salmaan Rashid Syed
r folder within the Server folder and access each Solr at different > port > > with its own collection as shown by > > https://www.youtube.com/watch?v=wmQFwK2sujE > > > > I am really confused as to which is the better path to choose. Please > help > > me out. &g

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Salmaan Rashid Syed
o go > > beyond 4 nodes/ports in this case. > > > > The other option is to run Solr as service and create multiple copies of > > Solr folder within the Server folder and access each Solr at different > port > > with its own collection as shown by > > h

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Jörn Franke
lr at different port > with its own collection as shown by > https://www.youtube.com/watch?v=wmQFwK2sujE > > I am really confused as to which is the better path to choose. Please help > me out. > > Thanks. > > Regards, > Salmaan > > > *Thanks and Regards,* > Sa

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Jörn Franke
gt; > The other option is to run Solr as service and create multiple copies of > Solr folder within the Server folder and access each Solr at different port > with its own collection as shown by > https://www.youtube.com/watch?v=wmQFwK2sujE > > I am really confused as to which

Re: Accessing Solr collections at different ports - Need help

2019-05-03 Thread Walter Underwood
ww.youtube.com/watch?v=wmQFwK2sujE > > I am really confused as to which is the better path to choose. Please help > me out. > > Thanks. > > Regards, > Salmaan > > > *Thanks and Regards,* > Salmaan Rashid Syed > +91 8978353445 | www.panna.ai | > 5550 Granite Pkwy, Suite #225, Plano TX-75024. > Cyber Gateways, Hi-tech City, Hyderabad, Telangana, India.

Accessing Solr collections at different ports - Need help

2019-05-02 Thread Salmaan Rashid Syed
the Server folder and access each Solr at different port with its own collection as shown by https://www.youtube.com/watch?v=wmQFwK2sujE I am really confused as to which is the better path to choose. Please help me out. Thanks. Regards, Salmaan *Thanks and Regards,* Salmaan Rashid Syed +91

Re: Autosuggest help

2019-04-06 Thread Midas A
Any update? On Thu, 4 Apr 2019, 1:09 pm Midas A, wrote: > Hi, > > We need to use auto suggest click stream data in Auto suggestion . How we > can achieve this ? > > Currently we are using suggester for auto suggestions . > > > Regards, > Midas >

Autosuggest help

2019-04-04 Thread Midas A
Hi, We need to use auto suggest click stream data in Auto suggestion . How we can achieve this ? Currently we are using suggester for auto suggestions . Regards, Midas

Re: Help with slow retrieving data

2019-03-26 Thread Wendy2
Hi Eric, Thank you for your response! On the old system, I changed to use docValues=true, and had better performance. But the searcher was not warmed before I measured it. Also the local disk was too small so I used an attached volume which turned out was a big cause of the slow retrieve. On

Re: Help with slow retrieving data

2019-03-25 Thread Erick Erickson
Glad it’s working out for you. There are a couple of things here that bear a bit more investigation. Using SSDs shouldn’t materially affect the response if: 1> the searcher is warmed. Before trying your query, execute a few queries like “q="some search that hits a log of docs"=myfield asc” 2>

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! I tried "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. " I tried the above approach as you recommended, the performance was getting better, reduced about 3 seconds. Then I tested on a new cloud server

Re: Help with slow retrieving data

2019-03-25 Thread Wendy2
Hi Eric, Thank you very much for your response! "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs." I tried use docValues and reduced about 3 seconds. Now I am going to "try 2> if that doesn’t make much of a difference, try adding useDocValuesAsStored

Re: Help with slow retrieving data

2019-03-24 Thread Erick Erickson
If the fields you’re returning have to be pulled from the store=“true” parts of the index, then each value returned requires 1> a disk read 2> decompressing 16K minimum which is what Shawn was getting at. Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs.

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn,Thanks for your response. I have several Solr cores on the same Solr instance. The particular core with slow retrieve response has 6 gb data. Sorry for the confusion.I restart Solr and ran same query with rows=0 vs 1, QTime for both are OK, so I guess it is the retrieving slow? I

Re: Help with slow retrieving data

2019-03-24 Thread Shawn Heisey
On 3/24/2019 12:11 PM, Wendy2 wrote: Thank you very much for your response! Here is a screen shot. Is the CPU an issue? You said that your index is 6GB, but the process listing is saying that you have more than 30GB of index data being managed by Solr. There's a discrepancy somewhere.

Re: Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Shawn, Thank you very much for your response! Here is a screen shot. Is the CPU an issue? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with slow retrieving data

2019-03-24 Thread Shawn Heisey
On 3/24/2019 7:16 AM, Wendy2 wrote: Hi Solr users:I use Solr 7.3.1 and 150,000 documents and about 6GB in total. When I try to retrieve 2 ids (4 letter code, indexed and stored), it took 17s to retrieve 1.14M size data. I tried to increase RAM and cache, but Can you get the screenshot

Help with slow retrieving data

2019-03-24 Thread Wendy2
Hi Solr users:I use Solr 7.3.1 and 150,000 documents and about 6GB in total. When I try to retrieve 2 ids (4 letter code, indexed and stored), it took 17s to retrieve 1.14M size data. I tried to increase RAM and cache, but only helped to some degree (from 25s to 17s). Any idea/suggestions

Re: Need help on LTR

2019-03-22 Thread Kamuela Lau
I think the issue is that you store the feature as originalScore but in your model you refer to it as original_score On Wed, Mar 20, 2019 at 1:58 PM Mohomed Rimash wrote: > one more thing i noticed is your feature params values doesn't wrap in q or > qf field. check that as well > > On Wed, 20

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
one more thing i noticed is your feature params values doesn't wrap in q or qf field. check that as well On Wed, 20 Mar 2019 at 01:34, Amjad Khan wrote: > Did, but same error > > { > "responseHeader":{ > "status":400, > "QTime":5}, > "error":{ > "metadata":[ >

Re: Need help on LTR

2019-03-19 Thread Roopa ML
In model file replace original_score with originalScore Roopa Sent from my iPhone > On Mar 19, 2019, at 2:44 PM, Amjad Khan wrote: > > Roopa, > > Yes > >> On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: >> >> Does your feature definitions and the feature names used in the model match? >>

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Did, but same error { "responseHeader":{ "status":400, "QTime":5}, "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","java.lang.NullPointerException"], "msg":"org.apache.solr.ltr.model.ModelException: Model type does

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
Please update the weights values to greater than 0 and less than 1. On Wed, 20 Mar 2019 at 00:13, Amjad Khan wrote: > Feature File > === > > [ > { > "store" : "exampleFeatureStore", > "name" : "isCityName", > "class" : "org.apache.solr.ltr.feature.FieldValueFeature", >

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Roopa, Yes > On Mar 19, 2019, at 11:51 AM, Roopa Rao wrote: > > Does your feature definitions and the feature names used in the model match? > > On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > >> Yes, I did. >> >> I can see the feature that I created by this >>

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Feature File === [ { "store" : "exampleFeatureStore", "name" : "isCityName", "class" : "org.apache.solr.ltr.feature.FieldValueFeature", "params" : { "field" : "CITY_NAME" } }, { "store" : "exampleFeatureStore", "name" : "originalScore", "class" :

Re: Need help on LTR

2019-03-19 Thread Mohomed Rimash
Can you share the feature file and the model file, 1. I had few instances where invalid values for parameters (ie weights set to more than 1 , with minmaxnormalizer) resulted the above error, 2, Check all the features added to the model has a weight under params -> weights in the model On Tue,

Re: Need help on LTR

2019-03-19 Thread Roopa Rao
Does your feature definitions and the feature names used in the model match? On Tue, Mar 19, 2019 at 10:17 AM Amjad Khan wrote: > Yes, I did. > > I can see the feature that I created by this > schema/feature-store/exampleFeatureStore and it return me the features I > created. But issue is when

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Yes, I did. I can see the feature that I created by this schema/feature-store/exampleFeatureStore and it return me the features I created. But issue is when I try to put store-model. > On Mar 19, 2019, at 12:18 AM, Mohomed Rimash wrote: > > Hi Amjad, After adding the libraries into the path,

Re: Need help on LTR

2019-03-19 Thread Amjad Khan
Hi, Yes, I did restarted the solr server with this JVM param. > On Mar 19, 2019, at 3:35 AM, Jörn Franke wrote: > > Did you add the option -Dsolr.ltr.enabled=true ? > >> Am 19.03.2019 um 04:15 schrieb Amjad Khan : >> >> I followed the Solr LTR Documentation >> >>

Re: Need help on LTR

2019-03-19 Thread Jörn Franke
Did you add the option -Dsolr.ltr.enabled=true ? > Am 19.03.2019 um 04:15 schrieb Amjad Khan : > > I followed the Solr LTR Documentation > > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html > > > 1. Added library

Re: Need help on LTR

2019-03-18 Thread Mohomed Rimash
Hi Amjad, After adding the libraries into the path, Did you restart the SOLR ? On Tue, 19 Mar 2019 at 08:45, Amjad Khan wrote: > I followed the Solr LTR Documentation > > https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html < >

Need help on LTR

2019-03-18 Thread Amjad Khan
I followed the Solr LTR Documentation https://lucene.apache.org/solr/guide/7_4/learning-to-rank.html 1. Added library into the solr-config 2. Successfully added feature 3. Get schema to see feature is available 4. When I try

Re: Help with a DIH config file

2019-03-16 Thread Jörn Franke
You have to specify the option recursive=true on the entity files On Fri, Mar 15, 2019 at 7:59 PM wclarke wrote: > One last question. > > I have everything running as it should finally. However, when I pull out > of > testing to do the entire directory it's just cycling through. The >

Re: Help with a DIH config file

2019-03-16 Thread Jörn Franke
https://lucene.apache.org/solr/guide/6_6/uploading-structured-data-store-data-with-the-data-import-handler.html#the-filelistentityprocessor On Sun, Mar 17, 2019 at 1:32 AM Jörn Franke wrote: > You have to specify the option recursive=true on the entity files > > On Fri, Mar 15, 2019 at 7:59 PM

Re: Help with a DIH config file

2019-03-15 Thread wclarke
One last question. I have everything running as it should finally. However, when I pull out of testing to do the entire directory it's just cycling through. The directory is full of folders that have the documents in them. Do I need an html or other file sitting in there randomly to get it to

Re: Help with a DIH config file

2019-03-15 Thread wclarke
Thanks! that fixed it. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-15 Thread Tim Allison
ly preferable if the > indexing process could ignore exceptions and proceed on than if it just stops > dead at the first problem. (I'm also pretty sure that Whitney is already > using the ignoreTikaException attribute in her configuration, but it doesn't > seem to help i

Re: Help with a DIH config file

2019-03-15 Thread Jörn Franke
blem. (I'm also pretty sure that Whitney is already > using the ignoreTikaException attribute in her configuration, but it doesn't > seem to help in this instance). > > Any suggestions would be greatly appreciated! > > thanks, > Demian > > -Original Me

RE: Help with a DIH config file

2019-03-15 Thread Demian Katz
that Whitney is already using the ignoreTikaException attribute in her configuration, but it doesn't seem to help in this instance). Any suggestions would be greatly appreciated! thanks, Demian -Original Message- From: Jörn Franke Sent: Friday, March 15, 2019 4:18 AM To: solr-user

Re: Help with a DIH config file

2019-03-15 Thread Jörn Franke
Do you have an exception? It could be that the pdf is broken - can you open it on your computer with a pdfreader? If the exception is related to Tika and pdf then file an issue with the pdfbox project. If there is an issue with Tika and MsOffice documents then Apache poi is the right project

Re: Help with a DIH config file

2019-03-15 Thread wclarke
Thank you so much. You helped a great deal. I am running into one last issue where the Tika DIH is stopping at a specific language and fails there (Malayalam). Do you know of a work around? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-14 Thread Jörn Franke
sorry for my late reply. thanks for sharing yes this is possible. maybe my last mail were confusing. I hope the examples below help Alternative 1 - Use only DIH without update processor tika-data-config-2xml - add transformer in entity and the transformation in field (here done for id

Re: Help with a DIH config file

2019-03-13 Thread wclarke
Got each one working individually, but not multiples. Is it possible? Please see attached files. Thanks!!! tika-data-config-2.xml solrconfig.xml --

Re: Help with a DIH config file

2019-03-13 Thread wclarke
I didn't know I could do an updateProcessorChain and call it in the config file. I tried doing it in the solrconfig, but it just wouldn't take. I will try this though! Thanks The value is the file path in id/url. -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with a DIH config file

2019-03-13 Thread wclarke
Absolutely! I attached it to the original message, But I can post here too. I am VERY new to Solr and am winging it and while the documentation has been a little helpful, I just need more complex examples. tika-data-config-2.xml

Re: Help with a DIH config file

2019-03-12 Thread Jörn Franke
r mime >> type that might be so that it can be searchable. >> >> I am running it through the solr admin data import as opposed to the >> post.jar (I have tried both). And this is running on Windows and cannot >> be >> run on Linux as we have no one who can

Re: Help with a DIH config file

2019-03-12 Thread Jörn Franke
ing it through the solr admin data import as opposed to the > post.jar (I have tried both). And this is running on Windows and cannot be > run on Linux as we have no one who can support it. I am posting my > tika-data-config.xml (not tikaconfig) I named it this way so as not to be > confuse

<    1   2   3   4   5   6   7   8   9   10   >