Docker and Solr Indexing

2018-09-10 Thread solrnoobie
So we have a dockerized aws environment with the solr docker container having only 4 gigs for max ram. Our problem is whenever we index, the container containing the leader shard will restart after around 2 or less minutes of index time (batch is 50 docs per batch with 3 threads in our app thread

Potential bug? maxConnectionsPerHost on requestHandler configuration

2018-09-10 Thread Ash Ramesh
Hi, I tried setting up a bespoke ShardHandlerFactory configuration for each request handler in solrconfig.xml. However when I stepped through the code in debug mode (via IntelliJ) I could see that the ShardHandler created and used in the searcher still didn't reflect the values in solrconfig (even

Re: group.limit>1 and sorting is not working as expected

2018-09-10 Thread Venkateswarlu Bommineni
Hello Erik, Sorry for the confustion . here is the scenario. We have 2 fields rank,price for each product. multiple products may have same rank but different prices. So on products listing page, by default we will group on rank and show 3 products for each group and sort based on Rank. But Cust

Re: local "q.op=AND" ignored for edismax query

2018-09-10 Thread dshih
Thanks Shawn! Based on what you said, is my query supposed to work as is if I set luceneMatchVersion=7.1.0? It does not appear to. Also, my understanding is using the local param makes the AND apply only to the following search terms provided to the "q" query string. If I add a q.op=AND as a se

Re: group.limit>1 and sorting is not working as expected

2018-09-10 Thread Erick Erickson
bq. I just wanted to know if there is any attribute which says sort on all the document list instead of relative to group results. I really don't know what you want here. "sort on all the document list" seems like just sorting without grouping. >From that problem statement I don't see what groupi

Re: group.limit>1 and sorting is not working as expected

2018-09-10 Thread Venkateswarlu Bommineni
Thanks for the reply Shawn. I have tried multiple combination of group.sort and sort but non of them worked. I just wanted to know if there is any attribute which says sort on all the document list instead of relative to group results. Can you please help if you have any idea or work around ? T

Re: Unable to enable SSL with self-sign certs

2018-09-10 Thread cyndefromva
TRUS_STORE is a typo (I used what was already there, I just uncommented it). I'm on a different network so I have to type everything by hand. I was hoping I put enough already , but ugh... probably more typos to come. Here it is: 2018-09-10 19:17:15.311 WARN: (main) [ ] o.e.j.u.c.AbstractLifeCy

Re: Date Query Using Local Params

2018-09-10 Thread Antelmo Aguilar
Hi Erik, Thank you! I did mess with the v parameter, but I was doing it wrong. I was doing this v='([2013-07-08 TO 2013-07-09] OR [2013-07-21 TO 2013-07-25])' Anyways, I needed to use the "fq" parameter and I did this fq=({!field f=collection_date_range op=Within v='[2013-07-08 TO 2013-07-09]'}

Re: Date Query Using Local Params

2018-09-10 Thread Erik Hatcher
When using the {!...} syntax, and combining it with other clauses, the expression parsed needs to come from a local-param `v` parameter (otherwise, without `v`, the parser eats the rest of the string after the closing curly bracket). So you could do something like this: q={!field f=collec

Re: Date Query Using Local Params

2018-09-10 Thread Antelmo Aguilar
Hi Shawn, Thank you. So just to confirm, there is no way for me to use an OR operator with also using the "within" op parameter described in the bottom of this page? https://lucene.apache.org/solr/guide/6_6/working-with-dates.html#WorkingwithDates-MoreDateRangeFieldDetails I appreciate your res

Re: Date Query Using Local Params

2018-09-10 Thread Shawn Heisey
On 9/10/2018 1:21 PM, Antelmo Aguilar wrote: Hi, I have a question. I am trying to use the "within" op parameter in a Date Search. This works like I would expect: {!field f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] I would like to use an OR with the query though, something li

Re: Unable to enable SSL with self-sign certs

2018-09-10 Thread Shawn Heisey
On 9/10/2018 12:47 PM, cyndefromva wrote: I installed solr 5.4.1 and java 1.8 on its own linux server and used the install_solr_service.sh file to install and setup solr. At this point I was able to start the process and access the dashboard from a browser. After shutting down solr I then attempt

Date Query Using Local Params

2018-09-10 Thread Antelmo Aguilar
Hi, I have a question. I am trying to use the "within" op parameter in a Date Search. This works like I would expect: {!field f=collection_date_range op=Within}[2013-07-08 TO 2013-07-09] I would like to use an OR with the query though, something like this: {!field f=collection_date_range op=Wit

Unable to enable SSL with self-sign certs

2018-09-10 Thread cyndefromva
I installed solr 5.4.1 and java 1.8 on its own linux server and used the install_solr_service.sh file to install and setup solr. At this point I was able to start the process and access the dashboard from a browser. After shutting down solr I then attempted to enable SSL via the Enabling SSL

Re: Silent error from DataImportHandler

2018-09-10 Thread Erick Erickson
You very often get _much_ more detail in the Solr log rather than the admin UI BTW On Mon, Sep 10, 2018 at 8:50 AM Monique Monteiro wrote: > > Hi Andrea, > > In fact, I had to add *logLevel="debug"* to the DIH configuration. Just > checking "Debug" on console is not enough. I also checked "V

Re: Corrupt Index error on Target cluster

2018-09-10 Thread Stephen Bianamara
Oh, I see I missed that fix. The versions were 6.2.1 and 6.6.2 (I mistakenly said before they were both 6.6). On Sun, Sep 9, 2018, 2:35 AM Susheel Kumar wrote: > Thanks. I have 6.6.2. Do you remember the exact minor version which you > run into with corruptIndex. I did fix it using CheckIndex.

Re: Silent error from DataImportHandler

2018-09-10 Thread Monique Monteiro
Hi Andrea, In fact, I had to add *logLevel="debug"* to the DIH configuration. Just checking "Debug" on console is not enough. I also checked "Verbose". Now, a database exception (locked account is shown). Thanks! Monique On Mon, Sep 10, 2018 at 12:26 PM Andrea Gazzarini wrote: > I cannot gi

Re: Silent error from DataImportHandler

2018-09-10 Thread Andrea Gazzarini
I cannot give you detailed instructions as I don't have in front of me a Solr console with the dataimport enabled, but I remember that there's a detailed section which reports a lot of information. In the meantime: shooting in the dark, if the query is working and "total rows fetched" = 0, the

Re: Silent error from DataImportHandler

2018-09-10 Thread Monique Monteiro
This is shown in the section "Raw Debug-Response". On Mon, Sep 10, 2018 at 12:20 PM Andrea Gazzarini wrote: > Hi Monique, this is the output; when you check the debug checkbox > another section is printed > > Andrea > > On 10/09/2018 17:19, Monique Monteiro wrote: > > Text: > > > > { "responseHe

Re: Silent error from DataImportHandler

2018-09-10 Thread Andrea Gazzarini
Hi Monique, this is the output; when you check the debug checkbox another section is printed Andrea On 10/09/2018 17:19, Monique Monteiro wrote: Text: { "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [ "defaults", [ "config", "data-cnpj-config.xml" ] ], "command": "full-import",

Re: Silent error from DataImportHandler

2018-09-10 Thread Monique Monteiro
Text: { "responseHeader": { "status": 0, "QTime": 463 }, "initArgs": [ "defaults", [ "config", "data-cnpj-config.xml" ] ], "command": "full-import", "mode": "debug", "documents": [], "verbose-output": [], "status": "idle", " importResponse": "", "statusMessages": { "Time Elapsed": "0:0:0.432", "To

Re: Silent error from DataImportHandler

2018-09-10 Thread Walter Underwood
Copy and paste the text of the error. Pictures of text aren’t very useful, even when they do make it through the mail reflector. Also, expand the error (the small info button) to get a stack trace. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep

Re: Silent error from DataImportHandler

2018-09-10 Thread Andrea Gazzarini
Hi Monique, I think you cannot attach files / images, please post, if available, the url of the image or a text description. Andrea On 10/09/2018 17:05, Monique Monteiro wrote: Hi Andrea, Solr console doesn't return a very different information even with debug mode enabled: image.png On

Re: Silent error from DataImportHandler

2018-09-10 Thread Monique Monteiro
Hi Andrea, Solr console doesn't return a very different information even with debug mode enabled: [image: image.png] On Mon, Sep 10, 2018 at 12:00 PM Andrea Gazzarini wrote: > You can check the solr.log or the solr-console.log. Another option is to > activate the debug mode in the Solr console

Re: Silent error from DataImportHandler

2018-09-10 Thread Andrea Gazzarini
You can check the solr.log or the solr-console.log. Another option is to activate the debug mode in the Solr console before running the data import. Andrea On 10/09/2018 16:57, Monique Monteiro wrote: Hi all, I have a data import handler configured with an Oracle SQL query which works like a

Re: Solr Index Issues

2018-09-10 Thread Walter Underwood
Every time you see "Expected mime type application/octet-stream but got text/html” from SolrJ, it means that Solr returned an error. Look for an error in the Solr logs at the same time as the SolrJ message. It could be any error, which is why we can’t help more. After you know the Solr error, w

Silent error from DataImportHandler

2018-09-10 Thread Monique Monteiro
Hi all, I have a data import handler configured with an Oracle SQL query which works like a charm. However, when I have the same query configured in Solr's data import handler, nothing happens, and it returns: "*Total Requests made to DataSource*": "1", "*Total Rows Fetched*": "0",

Re: Solr Index Issues

2018-09-10 Thread Erick Erickson
It would be best to ask on the Nutch mailing list, this list doesn't have very many people who know _how_ Nutch uses Solr though. Best, Erick On Sun, Sep 9, 2018 at 11:47 PM Bineesh wrote: > > Hi Team, > > We are using Nutch 1.15 and Solr 6.6.3 > > We tried crawling one of the URL and and noticed

Re: solr boost query

2018-09-10 Thread Erick Erickson
You can't do this with boosting. Boosting affects scoring, i.e. the ranking. I'd expect this to show many topic As before anything else, other things being equal. For a limited number of topics, you could group by the topic and get the top 70 of each, throwing away the extras in topics B and C. Y

Re: solr boost query

2018-09-10 Thread Erick Erickson
You can't do this with boosting. Boosting affects scoring, i.e. the ranking. I'd expect this to show On Mon, Sep 10, 2018 at 12:37 AM sara hajili wrote: > > Hi > I have some docs in my solr index. and now i want to run a query. please > help me how create this query? > i have documents like this:

AW: Solr 7.4 and log4j2 JSONLayout

2018-09-10 Thread Michael Aleythe, Sternwald
Hey Shawn, i removed the additional jars and tried the foreground option with the following result: 2018-09-10 11:41:03.174:INFO::main: Logging initialized @616ms to org.eclipse.jetty.util.log.StdErrLog 2018-09-10 11:41:03.313:INFO:oejs.Server:main: jetty-9.4.10.v20180503; built: 2018-05-03T15

solr boost query

2018-09-10 Thread sara hajili
Hi I have some docs in my solr index. and now i want to run a query. please help me how create this query? i have documents like this: { topic_code:"A" }, { topic_code:"B" }, { topic_code:"A" }, { topic_code:"A" }, { topic_code:"C" }, { topic_code:"A" },.. now i want to get respanse from a solr 100