Solr 7.4 and Zookeeper 3.4.12

2018-06-28 Thread Zimmermann, Thomas
Hi, I was wondering if there was a reason Solr 7.4 is still recommending ZK 3.4.11 as the major version in the official changelog vs shipping with 3.4.12 despite the known regression in 3.4.11. Are there any known issues with running 7.4 alongside ZK 3.4.12. We are beginning a major Solr upgrad

SolrJ Kerberos Client API

2018-06-28 Thread Tushar Inamdar
Hello, We are looking to move from SolrJ client v5.5.x to the latest v7.4.x. The documentation on wiring kerberos with the client API here seems out-of-date. The HttpClientUtil class

RE: 7.3 appears to leak

2018-06-28 Thread Markus Jelsma
Hello Yonik, If leaking a whole SolrIndexSearcher would cause this problem, then the only custom component would be our copy/paste-and-enhance version of the elevator component, is the root of all problems. It is a direct copy of the 7.2 source where only things like getAnalyzedQuery, the Eleva

Re: 7.3 appears to leak

2018-06-28 Thread Yonik Seeley
> * SortedIntDocSet instances ánd ConcurrentLRUCache$CacheEntry instances are > both leaked on commit; If these are actually filterCache entries being leaked, it stands to reason that a whole searcher is being leaked somewhere. -Yonik

RE: Custom FieldType not getting populated in the response

2018-06-28 Thread Harsh Verma
To provide an update here. I was able to get the plugin to work as expected, but I have to make couple of changes - one to solrconfig.xml and another to my query itself. 1. Disable resultQueryCache in Solr. This fixed the sorting issue for me. After result for a query are cached, updates

Re: Importance of having the lsof utility on our solr server VMs

2018-06-28 Thread Shawn Heisey
On 6/28/2018 11:22 AM, THADC wrote: > Today I am running the ./bin/solr command from new VMs that apparently don't > have the lsof command installed. I noticed a warning message saying the > command needs lsof in order to determine if solr is listening on the port I > am trying to have it run on. B

Re: 7.4.0 changes in DocTransformer behaviour

2018-06-28 Thread Shawn Heisey
On 6/28/2018 8:15 AM, Markus Jelsma wrote: > Ah, forgot about that thread. But yes, it makes sense and we used it as such > in production. But the test was never updated, never failed, until 7.4.0 came > around. So it is confusing why the tests didn't fail, and confusing why it > does in 7.4.0.

Re: Retrieving json.facet from a search

2018-06-28 Thread Yonik Seeley
There isn't typed support, but you can use the generic support like so: .getResponse().get("facets") -Yonik On Thu, Jun 28, 2018 at 2:31 PM, Webster Homer wrote: > I have a fairly large existing code base for querying Solr. It is > architected where common code calls solr and returns a solrj Qu

[ANNOUNCE] Solr Reference Guide for 7.4 released

2018-06-28 Thread Cassandra Targett
The Lucene PMC is pleased to announce that the Solr Reference Guide for Solr 7.4 is now available. This 1,258 page PDF is the definitive guide to using Apache Solr, the search server built on Apache Lucene. The PDF Guide can be downloaded from: https://www.apache.org/dyn/closer.cgi/lucene/solr/r

Retrieving json.facet from a search

2018-06-28 Thread Webster Homer
I have a fairly large existing code base for querying Solr. It is architected where common code calls solr and returns a solrj QueryResponse object. I'm currently using Solr 7.2 the code interacts with solr using the Solrj client api I have a need that would be very easily met by using the json.f

Custom FieldType not getting populated in the response

2018-06-28 Thread Harsh Verma
Hi All, I am trying to fetch values (docValues to be exact) from external redis during query time using a custom written FieldType which I am loading in my solr instance. I notice that my custom FieldType is being initialized based on the schema when loading the core. I also notice that during

Importance of having the lsof utility on our solr server VMs

2018-06-28 Thread THADC
Hello, Today I am running the ./bin/solr command from new VMs that apparently don't have the lsof command installed. I noticed a warning message saying the command needs lsof in order to determine if solr is listening on the port I am trying to have it run on. But then is says its started anyway.

RE: 7.3 appears to leak

2018-06-28 Thread Markus Jelsma
Hello again, Back to this topic, upgrade to 7.4 didn't mysteriously fix the leak our main text search collection has as i had so vigorously hoped. Again, it are SortedIntDocSet instances that leak consistently on the 15 minute index/commit interval. Some facts: * problem started after upgradin

Caching of dynamic external file fields

2018-06-28 Thread Zisis T.
In Solr there's /ExternalFileFieldReloader/ which is responsible for caching the contents of external files whenever a new searcher is being warmed up. It happens that I've defined a dynamic field to be used as an /ExternalField/ as in /* */ If you have a look inside the code /ExternalFileFiel

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

2018-06-28 Thread Arturas Mazeika
Hi Shawn et al, I think I got it working. I disabled the firewall, and then I was able to download and upload the configdirs. Interestingly enough, after I re-enabled the firewall, I was able to continue to upload and download the configdirs. As if the problem did not take place at all. I am hi

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

2018-06-28 Thread Arturas Mazeika
Hi Shawn, et al, I haven't thought about ip6. Interesting idea. - I've tried to use the address 127.0.0.1. It did not help (I've un-commented the suppress-output-line in the script, so it is possible to see what it is being done) [1]. I also tried all possible combinations of the IP addresses tha

solr allow read permission to anonymous/guest user

2018-06-28 Thread Dinesh Sundaram
Hi, Is there any option to allow read permissions to anonymous/guest user? expecting to prompt credentials only if any update or delete operations. Thanks, Dinesh Sundaram

RE: Collection reload leaves dangling SolrCore instances

2018-06-28 Thread Markus Jelsma
Hello, It doesn't appear to be fixed on 7.4. During core reload there is the memory spike, afterwards i loose about 110 MB in OldGen. Forcing GC doesn't free the memory. On reloads, it seems one instance per core is retained. So on my local box where all collections are in one instance, i can

Re: A user defined request handler is failing to fetch the data.

2018-06-28 Thread Erick Erickson
At a glance, you may really be seeing recursive calls. What does the solr log (rather than the client) say is happening? Any call that comes into /filesearch will make a call to... ./filesearch perhaps? What is your goal here? You say you're "testing distributed search". But what do you mean by t

RE: 7.4.0 changes in DocTransformer behaviour

2018-06-28 Thread Markus Jelsma
Hello Shawn, Ah, forgot about that thread. But yes, it makes sense and we used it as such in production. But the test was never updated, never failed, until 7.4.0 came around. So it is confusing why the tests didn't fail, and confusing why it does in 7.4.0. Any ideas why now? Thanks, Markus

Re: cannot download the config directory with zkcli.bat from embedded zookeeper

2018-06-28 Thread Shawn Heisey
On 6/28/2018 4:03 AM, Arturas Mazeika wrote: > f:\solr_server\solr-7.3.1\server\scripts\cloud-scripts\zkcli.bat -zkhost > localhost:10999 -cmd downconfig -confdir d:\de_wiki_man_config -confname > de_wiki_man > > Caused by: java.io.IOException: Unable to establish loopback connection Take a look a

Re: Indexing Approach

2018-06-28 Thread Shawn Heisey
On 6/27/2018 8:59 PM, solrnoobie wrote: > One last thing though, will a queue based system work for us? Or are there > better suitable implementations? Exactly how you write your indexing software is up to you.  There is no single approach that's the best.  Examine your business needs and the thin

Re: Solr Update

2018-06-28 Thread Shawn Heisey
On 6/27/2018 10:00 AM, Goston IV, Stanley W wrote: > I was wondering if it is possible to do a solr update by doing something like > the following: > > JSON: > > { > "add":{ > "doc":{ > "id_txt":"_query_:{q=title_txt:test.jpg fl=id_txt}", > "title_txt": {"set":"Maybe"}, > "

Re: Solr 6.1 collection backup into HDFS

2018-06-28 Thread Shawn Heisey
On 1/7/2017 3:46 AM, akalfus wrote: > Hello,I'm trying to run a collection backup with the following command - > /solr/admin/collections?action=BACKUP&collection=collection_name&repository=hdfs&location=/tmp/backup/&name=nameafter > trying to run in in local mode and failing due to not having an NF

Re: Create an index field of type dictionary

2018-06-28 Thread Shawn Heisey
On 6/26/2018 11:48 AM, Ritesh Kumar (Avanade) wrote: > Is it possible to create an index field of type *dictionary*. I have > seen stringarry, datetime, bool etc. but I am looking for a field type > like list of objects. The types that you find in a Solr schema are just made-up sequences of charac

cannot download the config directory with zkcli.bat from embedded zookeeper

2018-06-28 Thread Arturas Mazeika
Hi Solr Folks, I was benchmarking solrCloud with the German Wikipedia docs under Windows 10 Pro, noticed that Windows defender was grabbing resources substantially, changed the policy (so windows defender would not kick in). Since then I am not able to download the config files from the solrCloud