Re: Issue with scoreNodes stream expression

Have you tried running a very simple expression first. For example does this run: random(gettingstarted, q="*:*", fl="id", rows="200") Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Sep 19, 2017 at 4:56 PM, Aurélien MAZOYER < aurelien.mazo...@francelabs.com> wrote: > Hi, > > > > I wante

Re: Solr Streaming Question

Also random() will work with any type of field. Only the /export handler limits the field list to docValues. Each time you call random() it will give you a different random sample. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Sep 19, 2017 at 10:04 PM, Joel Bernstein wrote: > Try this c

Re: Solr Streaming Question

Try this construct: update(list(random(...), random(...), random(...))) Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Sep 19, 2017 at 9:02 PM, Susheel Kumar wrote: > You can follow the sectionCreating an Alert With the Topic Streaming > Expression" at http://joelsolr.blogspot.com/

Cannot load LTRQParserPlugin inot my core

Hi ! I am having this issue: • org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.ltr.search.LTRQParserPlugin' I have set up in my solrconfig.xml and my solr version is 6.5.0 I can see there is no jar in LTR contrib…so I didn’t set

Re: Solr Streaming Question

You can follow the sectionCreating an Alert With the Topic Streaming Expression" at http://joelsolr.blogspot.com/ and use random function for getting random records and schedule using daemon function to retrieve periodically etc. Thanks, Susheel On Tue, Sep 19, 2017 at 4:56 PM, Erick Erickson

RE: Using SOLR J 5.5.4 with SOLR 6.5

Thanks so much for all the answer, gonna test it out then.. Best Regards, Felix Stanley -Original Message- From: Walter Underwood [mailto:wun...@wunderwood.org] Sent: Wednesday, September 20, 2017 1:05 AM To: solr-user@lucene.apache.org Subject: Re: Using SOLR J 5.5.4 with SOLR 6.5

question about an entry in the log file

Hi eveyone I am trying to figure out why calling commit from my client takes a very long time in an environment with concurrent updates, and I see the following snippet in the solr log files when client calls for commit. my question is regarding the third info. what is it opening? and how can

Solr replication

Need some inputs or help in resolving replication across solr nodes. We have installed Solr 6.5 in cloud mode and have 3 ZooKeepers and 2 Solr nodes configured. Enabled Solr replication in my Solrj client but the replication fails and is unable to create a collection. The same code works in our

Re: Solrcloud configuration

Addendum: It's not sql server, but I imagine the steps will be similar if not identical except for the details of the JDBC driver you need. On Tue, Sep 19, 2017 at 4:11 PM, John Bickerstaff wrote: > This may also be of some assistance: > > https://gist.github.com/maxivak/3e3ee1fca32f3949f052 >

Re: Solrcloud configuration

This may also be of some assistance: https://gist.github.com/maxivak/3e3ee1fca32f3949f052 I haven't tested, just found it. On Tue, Sep 19, 2017 at 4:10 PM, John Bickerstaff wrote: > This may be of some assistance... > > http://lucene.apache.org/solr/guide/6_6/ > > There is a section discussing

Re: Solrcloud configuration

This may be of some assistance... http://lucene.apache.org/solr/guide/6_6/ There is a section discussing sharding and another section that includes the schema. On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan wrote: > Hello David > > No, I didn't read any documentation on the schema and DIH. >

Re: How to remove control characters in stored value at Solr side

On 9/18/2017 12:45 PM, Markus Jelsma wrote: > But, can you then explain why Apache Nutch with SolrJ had this problem? It > seems that by default SolrJ does use XML as transport format. We have always > used SolrJ which i assumed would default to javabin, but we had this exact > problem anyway, a

Re: Solr Streaming Question

Webster: I think you're looking for UpdateStream. Unfortunately the fix version wasn't entered so you'll have to look at your particular version but going strictly from the dates it appears in 6.0. David: Stored is irrelevant. Streaming only works with docValues="true" fields and moves the docVa

Issue with scoreNodes stream expression

Hi, I wanted to try the new scoreNodes stream expression that is used to make recommendations: https://cwiki.apache.org/confluence/display/solr/Graph+Traversal#GraphTraver sal-UsingthescoreNodesFunctiontoMakeaRecommendation but encountered some issue with it. The following steps can easil

Re: Solrcloud configuration

Hello David No, I didn't read any documentation on the schema and DIH. Actually we are already using Solr 4 version. I am now upgrading in solrcloud with shards. I have done lots of google, but not getting relevant information DIH and schema with Solr shards. I am getting result with older versio

Re: Solr Streaming Question

I am also curious about this, specifically about indexed/non stored fields. On Tue, Sep 19, 2017 at 3:33 PM, Webster Homer wrote: > Is it possible to use the streaming API to stream documents from a > collection and load them into a new collection? I was thinking that this > would be a great way

Solr Streaming Question

Is it possible to use the streaming API to stream documents from a collection and load them into a new collection? I was thinking that this would be a great way to get a random sample of data from our main collections to developer machines. Making it a random sample would be useful as well. This lo

Re: Solrcloud configuration

Did you read the documentation on the schema and the DIH? On Tue, Sep 19, 2017 at 3:04 PM, Shashi Roushan wrote: > Hi All, > > I need your help to configure solrcloud with shards. > I have created collection and shards using solr6 and Zookeeper. Its working > fine. > My problems are: > Where I p

Re: Solr nodes crashing (OOM) after 6.6 upgrade

+1. Asking for way more than anything you need may result into OOM. rows and facet.limit should be carefully passed. On Tue, Sep 19, 2017 at 1:23 PM, Toke Eskildsen wrote: > shamik wrote: > > I've facet.limit=-1 configured for few search types, but facet.mincount > is > > always set as 1. Didn

Solrcloud configuration

Hi All, I need your help to configure solrcloud with shards. I have created collection and shards using solr6 and Zookeeper. Its working fine. My problems are: Where I put schema and dbdataconfig files? How I can use DIH to import data from SQL server To solr? In older version I was using schema

Re: no search results for specific search in solr 6.6.0

Unfortunately the link you provided goes to "localhost", which isn't accessible. The very first thing I'd do is go to the admin/analysis page and put the terms in both the "index" and "query" boxes for the field in question. Next, attach &debug=query to the query to see how the query is actually p

Re: no search results for specific search in solr 6.6.0

Can you provide the fieldType definition for text_fr? Also, when you use the Analysis page in the admin UI, what tokens are generated during indexing for FRaoo using the text_fr fieldType? On Tue, Sep 19, 2017 at 12:01 PM Sascha Tuschinski wrote: > Hello Community, > > We are using a Solr Core

Re: Solr nodes crashing (OOM) after 6.6 upgrade

shamik wrote: > I've facet.limit=-1 configured for few search types, but facet.mincount is > always set as 1. Didn't know that's detrimental to doc values. It is if you have a lot (1000+) of unique values in your facet field, especially when you have more than 1 shard. Only ask for the number yo

Re: Using SOLR J 5.5.4 with SOLR 6.5

As I understand it, any node in the cluster will direct the document to the leader for the appropriate shard. Works for us. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 19, 2017, at 9:59 AM, David Hastings > wrote: > > Thanks! Going to ha

Re: Sorting by distance resources with WKT polygon data

Hello, Sorry for the belated response. Solr only supports sorting from point or rectangles in the index. For rectangles use BBoxField. For points, ideally use the new LatLonPointSpatialField; failing that use LatLonType. You can use RPT for point data but I don't recommend sorting with it; use

Re: Using SOLR J 5.5.4 with SOLR 6.5

Thanks! Going to have to throw up another solr 6.x instance for testing again. Solr cloud will maintain index integrity across the nodes if indexed to just one node correct? On Tue, Sep 19, 2017 at 12:55 PM, Walter Underwood wrote: > Yes, good old HTTP. > > wunder > Walter Underwood > wun...@wu

Re: Using SOLR J 5.5.4 with SOLR 6.5

Yes, good old HTTP. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Sep 19, 2017, at 9:54 AM, David Hastings > wrote: > > Do you use HttpSolrClient then? > > On Tue, Sep 19, 2017 at 12:26 PM, Walter Underwood > wrote: > >> We run SolrJ 4.7.1 wi

Re: Solr returning same object in different page

Which version of Solr are you on? Are you using SolrCloud or any distributed search? In that case, I think( as already mentioned by Shawn) this could be related [1] . if it is just plain Solr, my shot in the dark is your boost function : {!boost+b=recip(ms(NOW,field1),3.16e-11,1,1)}{!boost+b=reci

Re: Using SOLR J 5.5.4 with SOLR 6.5

Do you use HttpSolrClient then? On Tue, Sep 19, 2017 at 12:26 PM, Walter Underwood wrote: > We run SolrJ 4.7.1 with Solr 6.5.1 (16 node cloud). No problems. > > We do not use the cloud-specific client and I’m pretty sure that we don’t > use ConcurrentUpdateSolrServer. The latter is because it do

Re: [bulk]: Dates and DataImportHandler

FWIW, I know mine worked, so maybe try: I can't conceive of what the locale would possibly do when a dateFormat is specified, so I omitted the attribute. (Maybe one can specify dateFormat *or *locale--it seems like specifying both would cause a clash.) For what it's worth, the format you're tryi

Re: Solr nodes crashing (OOM) after 6.6 upgrade

Emir, after digging deeper into the logs (using new relic/solr admin) during the outage, it looks like a combination of query load and indexing process triggered it. Based on the earlier pattern, memory would tend to increase at a steady pace, but then surge all of a sudden, triggering OOM. After I

Re: Using SOLR J 5.5.4 with SOLR 6.5

We run SolrJ 4.7.1 with Solr 6.5.1 (16 node cloud). No problems. We do not use the cloud-specific client and I’m pretty sure that we don’t use ConcurrentUpdateSolrServer. The latter is because it doesn’t report errors properly. We do our indexing through the load balancer and let the Solr Cloud

TermVectors and ExactStatsCache

Hi! I have a SolrCloud 6.6 collection with 3 shards setup where I need the TermVectors TF and DF values for queries. I have configured the ExactStatsCache in the solrConfig: When I query "detector works", it returns different docfreq values based on the shard the document comes from: "termV

Re: Using SOLR J 5.5.4 with SOLR 6.5

What about the ConcurrentUpdateSolrServer for solrj? That is what almost all of my indexing code is using for solr 5.x, Its been a while since I experimented with upgrading but i seem to remember having to go to HttpSolrClient and couldnt get the code to compile, so i tabled the experiment for a w

no search results for specific search in solr 6.6.0

Hello Community, We are using a Solr Core with Solr 6.6.0 on Windows 10 (latest updates) with field names defined like "f_1179014266_txt". The number in the middle of the name differs for each field we use. For language specific fields we are adding an language specific extension e.g. "f_117901

Re: Using SOLR J 5.5.4 with SOLR 6.5

Felix: There's no specific testing that I know of for this issue, it's "best effort". Which means it _should_ work but I can't make promises. Now that said, underlying it all is just HTTP requests going back and forth so I know of no a-priori reasons it wouldn't be fine. It's just "try it and see

Re: Using SOLR J 5.5.4 with SOLR 6.5

On 9/18/2017 11:47 PM, Felix Stanley wrote: > We are planning to use SOLR J 5.5.4 to query from SOLR 6.5. > > The reason was that we have to rely on JDK 1.7 at the client and as far as I > know SOLR J 6.x.x only support JDK 1.8. > > I understood that SOLR J generally maintains backwards/forward com

RE: Zookeeper credentials are showed up on the Solr Admin GUI

Hi Susheel, Thank you so much for so quick response! I've created the issue as you requested, please refer to the link: https://issues.apache.org/jira/browse/SOLR-11369 Thank you! Ivan -Original Message- From: Susheel Kumar [mailto:susheel2...@gmail.com] Sent: Tuesday, September 19, 2

Re: Zookeeper credentials are showed up on the Solr Admin GUI

Hi Ivan, Can you please submit a JIRA/bug report for this at https://issues.apache.org/jira/projects/SOLR Thanks, Susheel On Tue, Sep 19, 2017 at 11:12 AM, Pekhov, Ivan (NIH/NLM/NCBI) [C] < ivan.pek...@nih.gov> wrote: > Hello Guys, > > We've been noticing this problem with Solr version 5.4.1 and

Zookeeper credentials are showed up on the Solr Admin GUI

Hello Guys, We've been noticing this problem with Solr version 5.4.1 and it's still the case for the version 6.6.0. The problem is that we're using SolrCloud with secured Zookeeper and our users are granted access to Solr Admin GUI, and, at the same time, they are not supposed to have access to

Re: Solr nodes crashing (OOM) after 6.6 upgrade

With frequent commits, autowarming isn’t very useful. Even with a daily bulk update, I use explicit warming queries. For our textbooks collection, I configure the twenty top queries and the twenty most common words in the index. Neither list changes much. If we used facets, I’d warm those, too.

Re: Installation help

I have been worked on solr cloud before 3-4 years. I worked day and night as at that time i was not a linux guy. After lots of nightmare reading I installed solr cloud with external zookeeper.Find here "Solr Cloud Installation with External Zookeeper"

RE: How to remove control characters in stored value at Solr side

Ah, thanks! -Original message- > From:Chris Hostetter > Sent: Monday 18th September 2017 23:11 > To: solr-user@lucene.apache.org > Subject: RE: How to remove control characters in stored value at Solr side > > > : But, can you then explain why Apache Nutch with SolrJ had this proble

ClassCastException in RelevanceComparator

Hi, Solr: 4.10.2 Schema has two fields of TrieIntField type. Simple match all query with a cursorMark produces the following exception: 2017-09-19 11:52:53.684 [qtp1722023916-7992] ERROR org.apache.solr.servlet.SolrDispatchFilter - null:java.lang.ClassCast Exception: java.lang.Long canno

Re: Search by similarity?

In addition to that, I still believe More Like This is a better option for you. The reason is that the MLT is able to evaluate the interesting terms from your document (title is the only field of interest for you), and boost them accordingly. Related your "80% of similarity", this is more tricky.

RE: [bulk]: Dates and DataImportHandler

Hi, I have a similar problem. I try to change the timezone for the last_index_time by setting in the section of my data-config.xml file. But when doing this I always get a NullPointerException on Delta Import: 2017-09-15 14:04:00.825 INFO (Thread-2938) [ x:mex_prd_dev1100-ap] o

Re: Knn classifier doesn't work

hi Alessandro, yes please, feel free to open a Jira issue, patches welcome ! Tommaso Il giorno lun 18 set 2017 alle ore 14:30 alessandro.benedetti < a.benede...@sease.io> ha scritto: > Hi Tommaso, > you are definitely right! > I see that the method : MultiFields.getTerms > returns : > if (term

Re: Solr nodes crashing (OOM) after 6.6 upgrade

Hi Shamik, Can you tell us a bit more about how you use Solr before it OOM. Do you observe some heavy indexing or it happens during higher query load. Does memory slowly increases or jumps suddenly? Do you have any monitoring tool to see if you can correlate some metric with memory increase? You

Re: Solr nodes crashing (OOM) after 6.6 upgrade

Thanks, the change seemed to have addressed the memory issue (so far), but on the contrary, the GC chocked the CPUs stalling everything. The CPU utilization across the cluster clocked close to 400%, literally stalling everything.On a first look, the G1-Old generation looks to be the culprit that to

Re: Solr nodes crashing (OOM) after 6.6 upgrade

On Mon, 2017-09-18 at 20:47 -0700, shamik wrote: > I did bring down the heap size to 8gb, changed to G1 and reduced the > cache params. The memory so far has been holding up but will wait for > a while before passing on a judgment.  Sounds reasonable. > autowarmCount="0"/> [...] > The change se