Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Arnold Bronley
@Andrea: Yeah, I would try to avoid getting that information from System.getProperty. I am also looking for some class that will give this information. @Erick: Is there any way to get the information about current Solr endpoint/Zk ensemble info from inside StatelessScriptUpdateProcessorFactory

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Andrea Gazzarini
I remember ZK coordinates (hosts, ports and root) are set as system properties in Solr nodes (please open the admin console and see their names). So, it would be just a matter of System.getProperty(ZK ensemble coordinates|root) Prior to go in that direction: I don't know/remember if there's some

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Erick Erickson
Just like any other SolrCloud request. Simplest case is to fire an HTTP request from the update processor just like you would from a browser. > On Aug 29, 2019, at 3:31 PM, Arnold Bronley wrote: > > @Andrea: I agree with you. Do you know if there is a way to initialize > SolrCloudClient

Re: Undefined field - solr 7.2.1 cloud

2019-08-29 Thread Antony A
Yes. I do restart the cores on all the different servers. I will look at implementing reloading the collection. Thank you for your suggestion. Cheers, Antony On Thu, Aug 29, 2019 at 1:34 PM Shawn Heisey wrote: > On 8/29/2019 1:22 PM, Antony A wrote: > > I do restart Solr after changing schema

Re: Undefined field - solr 7.2.1 cloud

2019-08-29 Thread Shawn Heisey
On 8/29/2019 1:22 PM, Antony A wrote: I do restart Solr after changing schema using "solr zk upconfig". I am yet to confirm but I do have a daily cron that does "delta" import. Does that process have any bearing on some cores losing the field? Did you restart all the Solr servers? If the

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Arnold Bronley
@Andrea: I agree with you. Do you know if there is a way to initialize SolrCloudClient directly from some information that I get from SolrQueryRequest or from AddUpdateCommand object? @Erick: Thank you for the information about StatelessScriptUpdateProcessorFactory. "In your situation, add this

Re: Undefined field - solr 7.2.1 cloud

2019-08-29 Thread Antony A
I do restart Solr after changing schema using "solr zk upconfig". I am yet to confirm but I do have a daily cron that does "delta" import. Does that process have any bearing on some cores losing the field? On Thu, Aug 29, 2019 at 11:32 AM Shawn Heisey wrote: > On 8/29/2019 11:26 AM, Antony A

Re: Query-time synonyms without indexing

2019-08-29 Thread Erick Erickson
Ah, thanks for letting us know. Erick > On Aug 29, 2019, at 9:20 AM, Bjarke Buur Mortensen > wrote: > > The section without type is the one getting picked up for the > index-time chain, so that wasn't my problem. > > It turns out that because of >

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Erick Erickson
Have you looked at using one of the update processors? Consider StatelessScriptUpdateProcessorFactory for instance. You can do anything you’d like to do in a script (Groovy, Postscript. Python I think, and others). See: ./example/files/conf/update-script.js for one example. You put it in your

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Andrea Gazzarini
"client" and "server" side depends just on the perspective. In my opinion it is not a black/white and can have different shapes. In your case, I believe your component, which is on Solr side, can plays both roles (i.e. "server" component for collection A and client component for collection B)

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Arnold Bronley
I can't use CloudSolrClient because I need to intercept the incoming indexing request and then add one more field to it. All this happens on Solr side and not client side. On Thu, Aug 29, 2019 at 1:05 PM Andrea Gazzarini wrote: > Hi Arnold, > why don't you use solrj (in this case a

Re: Undefined field - solr 7.2.1 cloud

2019-08-29 Thread Shawn Heisey
On 8/29/2019 11:26 AM, Antony A wrote: Hi, I am running on Solr cloud 7.2.1. I have 4 core collection. The fields are available in the schema.xml in solr admin UI. This tells me zookeeper has the correct schema. But unfortunately only the leader core has the correct response to the query with

Undefined field - solr 7.2.1 cloud

2019-08-29 Thread Antony A
Hi, I am running on Solr cloud 7.2.1. I have 4 core collection. The fields are available in the schema.xml in solr admin UI. This tells me zookeeper has the correct schema. But unfortunately only the leader core has the correct response to the query with the field while other cores are throwing

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Andrea Gazzarini
Hi Arnold, why don't you use solrj (in this case a CloudSolrClient) instead of dealing with such low-level details? The actual location of the document you are looking for would be completely abstracted. Best, Andrea On Thu, 29 Aug 2019, 18:50 Arnold Bronley, wrote: > So, here is the problem

Re: req.getCore().getCoreContainer().getCore(core_name) is returning null - Solr 8.2.0

2019-08-29 Thread Arnold Bronley
So, here is the problem that I am trying to solve. I am moving from Solr master-slave architecture to SolrCloud architecture. I have one custom Solr plugin that does following: 1. When a document (say document with unique id doc1)is getting indexed to a core say core A then this plugin adds one

Re: Re: Multi-language Spellcheck

2019-08-29 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Thanks, everyone! -- Audrey Lorberfeld Data Scientist, w3 Search Digital Workplace Engineering CIO, Finance and Operations IBM audrey.lorberf...@ibm.com On 8/29/19, 11:28 AM, "Atita Arora" wrote: I would agree with the suggestion, I remember something similar presented by someone at

Re: Multi-language Spellcheck

2019-08-29 Thread Atita Arora
I would agree with the suggestion, I remember something similar presented by someone at Berlin Buzzwords 19. On Thu, Aug 29, 2019, 5:03 PM Jörn Franke wrote: > It could be sensible to have one spellchecker / language (as different > endpoint or as a queryparameter at runtime). Alternatively,

Re: Multi-language Spellcheck

2019-08-29 Thread Jörn Franke
It could be sensible to have one spellchecker / language (as different endpoint or as a queryparameter at runtime). Alternatively, depending on your use case you could get away with a generic fieldtype that does not do anything language specific, but I doubt. > Am 29.08.2019 um 16:20 schrieb

Re: Clustering error - Solr 8.2

2019-08-29 Thread Jörn Franke
Maybe there are more details in the logfiles? It could be also that a parameter is configured with a different default? Try also to change the Solr version in solrconfig.xml to a higher one, e.g. 8.0.0 > Am 29.08.2019 um 16:12 schrieb Joe Obernberger : > > Thank you Erick. I'm upgrading from

Multi-language Spellcheck

2019-08-29 Thread Audrey Lorberfeld - audrey.lorberf...@ibm.com
Hi All, We are starting up an internal search engine that has to work for many different languages. We are starting with a POC of Spanish and English documents, and we are using the DirectSolrSpellChecker. From reading others' threads online, I know that we have to have multiple

Re: Clustering error - Solr 8.2

2019-08-29 Thread Joe Obernberger
Thank you Erick.  I'm upgrading from 7.6.0 and as far as I can tell the schema and configuration (solrconfig.xml) isn't different (apart from the version).  Right now, I'm at a loss.  I still have the 7.6.0 cluster running and the query works OK there. Sure seems like I'm missing a field

Re: Question: Solr perform well with thousands of replicas?

2019-08-29 Thread Shawn Heisey
On 8/28/2019 9:27 PM, Hongxu Ma wrote: I have a solr-cloud cluster, but it's unstable when collection number is big: 1000 replica/core per solr node. To solve this issue, I have read the performance guide: https://cwiki.apache.org/confluence/display/SOLR/SolrPerformanceProblems I noted there

Re: Query-time synonyms without indexing

2019-08-29 Thread Bjarke Buur Mortensen
The section without type is the one getting picked up for the index-time chain, so that wasn't my problem. It turns out that because of https://issues.apache.org/jira/browse/LUCENE-8134, I needed to add a omitTermFreqAndPositions="true" to the declaration. This has to do with defaults for a

RE: Require searching only for file content and not metadata

2019-08-29 Thread Khare, Kushal (MIND)
I have been working on the same and finding out why I am not getting any data in TextHandler or Metadata. For that, I tried first creating just the parser to extract content from the documents using the Tika AutoDetect Parser. Finally, I found out that I was missing a jar.So, this separate

Re: Question: Solr perform well with thousands of replicas?

2019-08-29 Thread Erick Erickson
There are two factors: 1> the raw number of replicas on a Solr node. 2> total resources Solr needs. You say “..it’s unstalble…”. _How_ is it unstable? What symptoms are you seeing? You might want to review: https://cwiki.apache.org/confluence/display/solr/UsingMailingLists And not as you add

Re: Require searching only for file content and not metadata

2019-08-29 Thread Erick Erickson
I already provided feedback, you haven’t evidenced any attempt to follow up on it. Best, Erick > On Aug 29, 2019, at 4:54 AM, Khare, Kushal (MIND) > wrote: > > Erick, > I am using the code that I posted yesterday. But, am not getting anything in > 'texthandler.toString'. Please check my

Re: Solr query exclude parent when no _childDocuments exists

2019-08-29 Thread Mikhail Khludnev
Hello. _text_=kids is not a query syntax Solr supports. Last time I've looked into, mixing doc blocks and childfree docs is not supported. Anyway, debugQuery=true usually helps to understand puzzling results. On Thu, Aug 29, 2019 at 2:19 AM craftlogan wrote: > So in Solr I have a data

alternative suggestions on how to store product attributes in collection

2019-08-29 Thread Derek Poh
Hi I would like to know if there are suggestions on how I can handle my task below. Please pardon the lengthy description. I need to store product attributes in a collection. Attributes like Size, Color, Material etc. Each product can have up to max of 5 attributes. Between products, their

RE: Require searching only for file content and not metadata

2019-08-29 Thread Khare, Kushal (MIND)
Erick, I am using the code that I posted yesterday. But, am not getting anything in 'texthandler.toString'. Please check my snippet once and guide. Because, I think I am very close to my requirement yet stuck here. I also debugged my code. It is not going inside doTikaDocuments() & giving Null

Re: Problems with restricting access to users using Basic auth

2019-08-29 Thread Salmaan Rashid Syed
Thanks a lot Jason, I will try this out and let you know. Thanks again. On Wed 28 Aug, 2019, 7:45 PM Jason Gerlowski, wrote: > Hi Salmaan, > > Are you still seeing this behavior, or were you able to figure things out? > > I just got a chance to try out the security.json in Solr 7.6 myself, >

Solr Master Issue

2019-08-29 Thread Akreeti Agarwal
Hi, I have been facing issue on my solr server. My solr version is solr-5.5.5. I have connected to slaves servers with master server. Sometimes my slave replication fails or it stops on slave side. I get this error on master side: (Please help me with the solution) 2019-08-19 22:29:55.573