Re: solr.autoSoftCommit.maxDocs:1

2024-10-16 Thread Vincenzo D'Amore
rg/jira/browse/SOLR-17240 and provided workaround. > > Jan > > > 9. okt. 2024 kl. 11:01 skrev Vincenzo D'Amore : > > > > Hi Jan, thanks for your suggestion. > > The solrcloud cluster where I found this configuration > > (autoSoftCommit.maxDocs:1) recently

Re: solr.autoSoftCommit.maxDocs:1

2024-10-09 Thread Vincenzo D'Amore
that you must add more hardware to keep up. > > Jan > > > 7. okt. 2024 kl. 10:24 skrev Vincenzo D'Amore : > > > > Hi Jan, thanks for answering. This is the case, the collection has to be > > updated in real time, I'm just afraid that multiple updates could slow > down the > > cluster. > > -- Vincenzo D'Amore

Re: solr.autoSoftCommit.maxDocs:1

2024-10-07 Thread Vincenzo D'Amore
Hi Jan, thanks for answering. This is the case, the collection has to be updated in real time, I'm just afraid that multiple updates could slow down the cluster.

Re: solr.autoSoftCommit.maxDocs:1

2024-10-07 Thread Vincenzo D'Amore
icas=2 and > numshards=1: 2K docs. > > Committing after a single document simply takes forever. > > The default on 8.11.2 has no maxDocs in either `autoCommit` setting. > > Dima > > -- Vincenzo D'Amore

Re: solr.autoSoftCommit.maxDocs:1

2024-10-04 Thread Vincenzo D'Amore
ping :) On Wed, Oct 2, 2024 at 4:15 PM Vincenzo D'Amore wrote: > Hi all, > > Recently, I found the following configuration in a solrcloud cluster ver. > 8.11.2 (2 core 32GB RAM). > > > ${solr.autoCommit.maxDocs:-1} > ${solr.autoCommi

solr.autoSoftCommit.maxDocs:1

2024-10-02 Thread Vincenzo D'Amore
that the solrcloud cluster receives a spike of updates (thousands of documents or more), for each document a softcommit is triggered for the whole cluster, what do you think, what happens? Best regards, Vincenzo -- Vincenzo D'Amore

Re: upgrade from Solr 8 11.1 to 8 11.3 reindex

2024-05-08 Thread Vincenzo D'Amore
11.1 to > 8.11.3? > > I was under the impression that reindex would not be needed since it’s > just a minor version upgrade, but would like to confirm that’s true. > > also, > should the be changed to 8.11.3 when upgrading, or > can I leave it as 8.11.1? > > Thanks, > Bill -- Vincenzo D'Amore

Re: Run solr in cloud mode and debug from intellij

2024-02-24 Thread Vincenzo D'Amore
run locally will shorten the documentation too. Vincenzo D'Amore On Sat, 24 Feb 2024 at 00:38, Jan Høydahl wrote: > Hi, > > Thanks for this contrib. > > My only concern is that it is duplicating what is already explained in > https://github.com/apache/solr/blob/ma

Re: Run solr in cloud mode and debug from intellij

2024-02-23 Thread Vincenzo D'Amore
ache.org At: 02/20/24 10:34:23 UTCTo: > users@solr.apache.org > Cc: solr-u...@lucene.apache.org > Subject: Re: Run solr in cloud mode and debug from intellij > > Should I create an issue (improvement) on jira first? > > > On Tue, Feb 20, 2024 at 11:29 AM Vincenzo D'Amore

Re: Run solr in cloud mode and debug from intellij

2024-02-20 Thread Vincenzo D'Amore
Should I create an issue (improvement) on jira first? On Tue, Feb 20, 2024 at 11:29 AM Vincenzo D'Amore wrote: > Thanks, I'm going to do it. > > On Tue, Feb 20, 2024 at 11:23 AM Mikhail Khludnev wrote: > >> Yeah. Agree. A little bit cryptic. I'm up to appr

Re: Run solr in cloud mode and debug from intellij

2024-02-20 Thread Vincenzo D'Amore
Thanks, I'm going to do it. On Tue, Feb 20, 2024 at 11:23 AM Mikhail Khludnev wrote: > Yeah. Agree. A little bit cryptic. I'm up to approve your PR! > > On Tue, Feb 20, 2024 at 12:59 PM Vincenzo D'Amore > wrote: > > > Hi Mikhail, thanks for sharing. > &

Re: Run solr in cloud mode and debug from intellij

2024-02-20 Thread Vincenzo D'Amore
dividual tests in debug mode. > From > > the article[1], I tried the start command from the bin > > directory(/Users/rajani/projects/solr/solr) and got a class not found > > exception "Caused by: org.apache.solr.cli.SolrCLI" Did I miss any more > > build steps? Could yo

Re: [dev help wanted] admin UI: make commandline args sorting optional

2024-02-05 Thread Vincenzo D'Amore
ue: > https://issues.apache.org/jira/browse/SOLR-16466 > > Thanks, > Christine -- Vincenzo D'Amore

Re: [dev help wanted] SOLR-17074: incorrectly escaped quotes in bin/solr script

2024-01-16 Thread Vincenzo D'Amore
Hi David, I'll take a look at it after. On Tue, Jan 16, 2024 at 2:23 PM David Smiley wrote: > Nearby there's https://issues.apache.org/jira/browse/SOLR-17112 as well; > rather trivial > > On Tue, Jan 16, 2024 at 6:57 AM Vincenzo D'Amore > wrote: > > > Hi

Re: [dev help wanted] SOLR-17074: incorrectly escaped quotes in bin/solr script

2024-01-16 Thread Vincenzo D'Amore
buting to fix them? > > Please see https://issues.apache.org/jira/browse/SOLR-17074 for details. > > Thanks, > Christine -- Vincenzo D'Amore

pivot vs json.facet

2023-11-16 Thread Vincenzo D'Amore
there are differences in terms of performance. Best regards, Vincenzo -- Vincenzo D'Amore

Re: Delete large number of documents using UI

2023-11-13 Thread Vincenzo D'Amore
gt; Overwrite > true. > > Will it bring down the server deleting 10 million liked this? > -- Vincenzo D'Amore

Re: Backup from old server and Restore to new server

2023-09-30 Thread Vincenzo D'Amore
d release notes and test the result > before going live. Upgrading across major versions is always work. Lucene > (and therefore solr) requires that you reindex data with each major > version. There are stopgap tools to allow an upgrade of an existing index, > but that is a temporary measure that only works for N to N+1 and you are > expected to re-index before N+2. > > - Gus > > -- > http://www.needhamsoftware.com (work) > https://a.co/d/b2sZLD9 (my fantasy fiction book) > -- Vincenzo D'Amore

Re: Some nodes show high query latency

2023-09-30 Thread Vincenzo D'Amore
ame latency? Looks > like 3 of 32 nodes consistently display high latency ( 1-2 seconds QTime) > compared to the rest of the nodes(~30 ms). What can cause this behavior? > -- Vincenzo D'Amore

Re: Backup from old server and Restore to new server

2023-09-27 Thread Vincenzo D'Amore
t; > directory into it doesn't do anything either. > > > > I have also tried creating a core on the new server. That also fails as > it > > can't find solrconfig.xml, but does create a /var/solr/data/corename > > directory. > > > > I'm just dr

Re: Backup from old server and Restore to new server

2023-09-27 Thread Vincenzo D'Amore
; > >>>> > > >> > > > https://solr.apache.org/guide/solr/latest/deployment-guide/backup-restore.html > > >>>>> And several other pages, which all seem to repeat the advice, the > > >> backup > > >>>>> restore process is simple. This is a standalone install so I should > > use > > >>>>> > > >>>>> > > >>>> > > >> > > > http://localhost:8983/solr/collname/replication?command=backup&location=/snapshots > > >>>>> > > >>>>> to backup, which works fine: the backup appears in /snapshots/ as > > >>>>> snapshot.2023xxx. All good. > > >>>>> > > >>>>> I take the backup, and copy it to the new server, and put it in the > > >> same > > >>>>> location, /snapshots/2023xxx > > >>>>> Then apparenly I only need to run > > >>>>> > > >>>>> > > >>>> > > >> > > > http://localhost:8983/solr/collname/replication?command=restore&name=snapshot.2023xxx&location=/snapshots > > >>>>> > > >>>>> But this doesn't work. I've tried a lot of different variations, > > >>>> combining > > >>>>> snapshot name and location, with or without the collection name, > but > > >> all > > >>>> I > > >>>>> get is the zen like error > > >>>>> Searching for Solr? > > >>>>> You must type the correct path. > > >>>>> Solr will respond. > > >>>>> > > >>>>> So that's where I'm at. I'm wondering if I've missed a step that's > > >>>> obvious > > >>>>> to Solr veterans, but which is missing from the backup/restore > page. > > >>>>> Do I need to create the core first, for example. Or create the core > > and > > >>>>> copy config files over to the new server. > > >>>> > > >>>> > > >> > > >> > > > > > -- Vincenzo D'Amore

Re: Backup from old server and Restore to new server

2023-09-25 Thread Vincenzo D'Amore
the latest 8.x version, sure, but I thought I'd try. > > On Mon, Sep 25, 2023 at 4:59 PM Vincenzo D'Amore > wrote: > > > :) > > looking at solr.log you can see the requests and, even if you cannot be > > completely sure, which core is currently receiving reque

Re: Backup from old server and Restore to new server

2023-09-25 Thread Vincenzo D'Amore
them is > actively in use. I think the other one doesn't need to be migrated. But > will know for sure when I manage it and can test the app with the new > server! > Core in use seems to be about 12Gb. > > On Mon, Sep 25, 2023 at 3:48 PM Vincenzo D'Amore > wrote: > &

Re: Backup from old server and Restore to new server

2023-09-25 Thread Vincenzo D'Amore
type the correct path. > Solr will respond. > > So that's where I'm at. I'm wondering if I've missed a step that's obvious > to Solr veterans, but which is missing from the backup/restore page. > Do I need to create the core first, for example. Or create the core and > copy config files over to the new server. > -- Vincenzo D'Amore

Re: solrj client memory leak via ThreadLocal in solrj.impl.Http2SolrClient?

2023-08-28 Thread Vincenzo D'Amore
e if I can count the > threadlocals over time. > - Write a standalone client - Make all executions in new different threads > with occasional reuse of thread > > -Tim > > > On Mon, Aug 28, 2023 at 7:17 AM Vincenzo D'Amore > wrote: > > > Hi Tim, have you fig

Re: solrj client memory leak via ThreadLocal in solrj.impl.Http2SolrClient?

2023-08-28 Thread Vincenzo D'Amore
Hi Tim, have you figured out the problem? Just curious to know what you have done at the end. On Fri, Aug 25, 2023 at 4:48 PM Vincenzo D'Amore wrote: > Just my 2 cent:, I have always used solr clients as singletons. You have > to instantiate them only once and reuse them forever. >

Re: solrj client memory leak via ThreadLocal in solrj.impl.Http2SolrClient?

2023-08-25 Thread Vincenzo D'Amore
Just my 2 cent:, I have always used solr clients as singletons. You have to instantiate them only once and reuse them forever. On Fri, 25 Aug 2023 at 15:35, Tim Funk wrote: > Update - It looks like the ThreadLocal leak is different and unrelated to > creating / closing a new Http2SolrClient eve

Re: docValues question

2023-06-14 Thread Vincenzo D'Amore
> If the dest field of a copyField action has docValues=true, does that > require the source field to also have docValues turned on? No, it’s not required. -- Vincenzo D'Amore

Re: Not able to create custom Solr docker image on top of the base image (Solr 9.2.1)

2023-06-01 Thread Vincenzo D'Amore
gt; > RUN apt-get update && \ > apt-get upgrade --yes && \ > apt-get install --yes locales > -- Vincenzo D'Amore

Re: Solr logs (hits value) and memory allocation

2023-05-03 Thread Vincenzo D'Amore
, an array of ScoreDoc objects is created for each > query with the size of the numFound for the local core/replica. This should > clearly visible in VisualVM. This happens in SolrIndexSearcher. > > Regards, > Markus > > Op wo 3 mei 2023 om 17:20 schreef Vincenzo D'Amore

Solr logs (hits value) and memory allocation

2023-05-03 Thread Vincenzo D'Amore
Hi all, Just asking if there could be some correlation from the amount of memory allocated by a Solr query and the number of *hits* selected in solr logs. I haven't found anything in the Solr documentation. Do you know if there is some advice for the hits value? Thanks, Vincenzo -- Vin

Re: Atomic update is not working

2023-04-11 Thread Vincenzo D'Amore
lr.common.SolrException", > > "error-class","org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException", > > "root-error-class","org.apache.solr.update.processor.DistributedUpdateProcessor$DistributedUpdatesAsyncException"], > "msg":"Async exception during distributed update: Error from server at > http://localhost:8983/solr/readhub_shard2_replica_n6/: > null\n\n\n\nrequest: > http://localhost:8983/solr/readhub_shard2_replica_n6/\nRemote error > message: [doc=null] missing required field: doc_status", > "code":400}} > > Please check the screen shot also > > > [image: image.png] > > > -- Vincenzo D'Amore

Re: Solr 4.10 - master/slave replication

2023-03-08 Thread Vincenzo D'Amore
the propagation process. This I hope will relax the memory consumption and make the slave more reliable. On Wed, Mar 8, 2023 at 3:37 PM Shawn Heisey wrote: > On 3/8/23 04:16, Vincenzo D'Amore wrote: > > I'm working on a Solr 4.10 master/slave cluster where every night aroun

Solr 4.10 - master/slave replication

2023-03-08 Thread Vincenzo D'Amore
e number of concurrent replications that can be activated. Best regards, Vincenzo -- Vincenzo D'Amore

Re: How to index a csv dataset into Solr using SolrJ

2023-02-11 Thread Vincenzo D'Amore
m> a > : > : > écrit : > : > : > > > : > : > >> Read csv in your app, create a Solr doc from each line and > ingest to > : > : > Solr > : > : > >> in fitting batches. You can use a csv library or just parse each > : > line > : > : > >> yourself if the format is fixed. > : > : > >> > : > : > >> If you need to post csv directly to Solr you’d use a plain http > post > : > : > with > : > : > >> content-type csv, but in most cases your app would do that. > : > : > >> > : > : > >> Jan Høydahl > : > : > >> > : > : > >>> 29. jan. 2023 kl. 20:21 skrev marc nicole >: > : > : > >>> > : > : > >>> Hi guys, > : > : > >>> > : > : > >>> I can't find a reference on how to index a dataset.csv file > into > : > Solr > : > : > >> using > : > : > >>> SolrJ. > : > : > >>> https://solr.apache.org/guide/6_6/using-solrj.html > : > : > >>> > : > : > >>> Thanks. > : > : > >> > : > : > > : > : > > : > : > : > > : > -Hoss > : > http://www.lucidworks.com/ > : > > -Hoss > http://www.lucidworks.com/ -- Vincenzo D'Amore

Re: Solr Restarting frequently.

2023-01-20 Thread Vincenzo D'Amore
ng that period of time. > > We have tried to replicate the same on the local env by setting up a solr and > zookeeper cluster by forcefully restarting/stopping leader zookeeper nodes > and we have got something like : *have-not-heard-back-local-cluster.log *and > We could replicate [#2]. > > Seeking help here..to find out what could be the possible reason for these > frequent restarts of solr cloud nodes. > *Regards. > * > > -- Vincenzo D'Amore

Re: Solr Restarting frequently.

2023-01-19 Thread Vincenzo D'Amore
n which is >> taking a long time which leads to client sessions are getting timed out >> during that period of time. >> >> We have tried to replicate the same on the local env by setting up a solr >> and zookeeper cluster by forcefully restarting/stopping leader zookeeper >> nodes and we have got something like : >> *have-not-heard-back-local-cluster.log *and We could replicate [#2]. >> >> Seeking help here..to find out what could be the possible reason for these >> frequent restarts of solr cloud nodes. >> *Regards. >> * >> >> -- Vincenzo D'Amore

Re: Data Migration from Solr 8 to Solr Cloud 8

2022-11-14 Thread Vincenzo D'Amore
of moving to > sharding. > > Regards, > Eashwar > > > On Mon, Nov 14, 2022 at 12:48 PM Vincenzo D'Amore > wrote: > > > Hi Eashwar, > > > > may I ask you why do you want move to SolrCloud? Scalability? Or you > > collection has grown s

Re: Data Migration from Solr 8 to Solr Cloud 8

2022-11-13 Thread Vincenzo D'Amore
Hi Eashwar, may I ask you why do you want move to SolrCloud? Scalability? Or you collection has grown so much that you are thinking to shard it? Ciao, Vincenzo -- mobile: 3498513251 skype: free.dev > On 14 Nov 2022, at 04:45, Eashwar Natarajan wrote: > > Hi all, > >We have been usi

Solr Deduplication config error with partial update

2022-10-21 Thread Vincenzo D'Amore
1.3}, "htlDisp" : {"set":4}, "flightDisp" : {"set":2}, "notAvail" : {"set":"S"}, "onRequest" : {"set":"S"} } Best regards, Vincenzo -- Vincenzo D'Amore

Re: disabling schemaless mode - SolrCloud 8.11.2

2022-10-14 Thread Vincenzo D'Amore
this side effect. Disabling it can be dangerous. -- Vincenzo D'Amore

Re: disabling schemaless mode - SolrCloud 8.11.2

2022-10-14 Thread Vincenzo D'Amore
t? Where the default processors are configured? On Wed, Oct 12, 2022 at 7:55 PM Shawn Heisey wrote: > On 10/12/22 05:54, Vincenzo D'Amore wrote: > > Does anyone know what's the responsibility of > > DistributedUpdateProcessorFactory? > > That update processor takes care of a

disabling schemaless mode - SolrCloud 8.11.2

2022-10-12 Thread Vincenzo D'Amore
s to understand what it does, and why it has to be activated when schemaless mode is on. Best regards, Vincenzo -- Vincenzo D'Amore

join queries with synchronous filterCache is not supported

2022-09-27 Thread Vincenzo D'Amore
Hi all, I was facing this error in with solr join query: org.apache.solr.common.SolrException: Using join queries with synchronous filterCache is not supported! Details can be found in Solr Reference Guide under 'query-settings-in-solrconfig'. I solved this error by: - switching filterCache to C

Re: Which method is more performant? SubQueries or Collapsing the results?

2022-09-24 Thread Vincenzo D'Amore
is efficient in terms of response time and performance. > -- Vincenzo D'Amore

Re: SolrCloud node fail to connect to another node in the cluster

2022-09-04 Thread Vincenzo D'Amore
e:DOC_EBF3D4C11F1239852490280F583D052FC214A10D6E716BD98C19CBC599E5EFED&debug=true&shards=http://solrnode-23.volo.local:8080/solr/volocomapi_search_shard_201501_replica_n573/ > > > > Response > > > > > > Checking the network traffic with tcpdump on the solrquery-01 machine does > not show any connection as it does on the solrnode-01 machine > > > > *tcpdump from the solrquery-01 machine* > > > > *tcpdump on the solrnode-01 machine* > > > > *Question* > > Do you have any suggestions on how to investigate this issue further? > Suggestions on possible solutions? > > > > > > Thank you in advance, > > Matteo > -- Vincenzo D'Amore

Re: Solr update only if field differs

2022-08-05 Thread Vincenzo D'Amore
t in > solr operation to figure it out for you. > > If I’m wrong I would love to know, but indexing code logic will always be > faster than relying on a built in server function for these sorts of > things. > > > > > > > On Aug 4, 2022, at 6:41 PM, Vincenzo D&#

Re: Solr update only if field differs

2022-08-04 Thread Vincenzo D'Amore
pdateProcessorFactory > was contributed. > > Please read: > > Add support for hash based exact/near duplicate document handling > https://issues.apache.org/jira/browse/SOLR-799 > > Deduplication > https://cwiki.apache.org/confluence/display/solr/Deduplication > > Koji &g

Re: Solr update only if field differs

2022-08-03 Thread Vincenzo D'Amore
I cannot understand what "the second update" means... > > Koji > > On 2022/08/02 0:39, Vincenzo D'Amore wrote: > > Koji, on second thought, this SignatureUpdateProcessorFactory does not > > avoid the second update... > > > > On Mon, Aug 1, 2022 at 5:36 P

Re: Solr update only if field differs

2022-08-01 Thread Vincenzo D'Amore
Khludnev wrote: > Hi, Vincenzo. > I can only remember version control via checking a particular field. > > https://solr.apache.org/guide/solr/latest/indexing-guide/partial-document-updates.html#document-centric-versioning-constraints > > On Sun, Jul 31, 2022 at 2:52 AM Vincenz

Re: Solr update only if field differs

2022-08-01 Thread Vincenzo D'Amore
Koji, on second thought, this SignatureUpdateProcessorFactory does not avoid the second update... On Mon, Aug 1, 2022 at 5:36 PM Vincenzo D'Amore wrote: > Hi Koji, thanks! It is exactly what I was looking for! > > On Mon, Aug 1, 2022 at 4:28 AM Koji Sekiguchi > wrote: > >

Re: Solr update only if field differs

2022-08-01 Thread Vincenzo D'Amore
r/update/processor/SignatureUpdateProcessorFactory.java > > Koji > > On 2022/07/30 18:41, Vincenzo D'Amore wrote: > > Hi all, > > > > As far as I know it is not possible, but just to be sure I'm asking from > > your experience, do you know if there is any w

Solr update only if field differs

2022-07-30 Thread Vincenzo D'Amore
Hi all, As far as I know it is not possible, but just to be sure I'm asking from your experience, do you know if there is any way, on Solr side, to update a document only if one or more fields differs from the stored document? Best regards, Vincenzo -- Vincenzo D'Amore

Re: group.ngroups=true and multi shard

2022-06-30 Thread Vincenzo D'Amore
e.org/jira/browse/SOLR-7036 > https://issues.apache.org/jira/browse/SOLR-4763 > > On Thu, Jun 30, 2022 at 6:31 PM Vincenzo D'Amore > wrote: > > > Hi, > > > > I have a collection that is becoming bigger than usual (few millions of > > documents) so we are d

group.ngroups=true and multi shard

2022-06-30 Thread Vincenzo D'Amore
{ "range":"2aaa-7fff", "state":"active", "replicas":{ "core_node24":{ "core":"device-product-hash_shard3_replica_n23", "node_name":"solr-0.solrcluster.svc.cluster.local:8983_solr", "base_url":" http://solr-0.solrcluster.svc.cluster.local:8983/solr";, "state":"active", "type":"NRT", "force_set_state":"false", "leader":"true"}, "core_node28":{ "core":"device-product-hash_shard3_replica_n27", "node_name":"solr-2.solrcluster.svc.cluster.local:8983_solr", "base_url":" http://solr-2.solrcluster.svc.cluster.local:8983/solr";, "state":"active", "type":"NRT", "force_set_state":"false", "router":{"name":"compositeId"}, "maxShardsPerNode":"-1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}} -- Vincenzo D'Amore

Re: SolrCloud on Red Hat OpenShift Service on AWS

2022-06-27 Thread Vincenzo D'Amore
Ping On Fri, 24 Jun 2022 at 15:27, Vincenzo D'Amore wrote: > Hi all, > > I'm guessing if anyone has already deployed SolrCloud on Red Hat OpenShift > Service on AWS. > Can we run the Solr official image on ROSA out of the box or do we need to > do some customizatio

SolrCloud on Red Hat OpenShift Service on AWS

2022-06-24 Thread Vincenzo D'Amore
omers are asking me to do it with ROSA. Do you know any drawbacks? Any thoughts or suggestions will be appreciated. Best regards, Vincenzo -- Vincenzo D'Amore

Re: Solr indexing performance tips

2022-06-16 Thread Vincenzo D'Amore
ure out why my indexing process > sometimes stalled for LONG time spans. > > Thanks, > Shawn > > -- Vincenzo D'Amore

Re: Solr indexing performance tips

2022-06-16 Thread Vincenzo D'Amore
rote: > > > >> * 9 different cores. Each weighs around ~100 MB on disk and has > > > >> approximately 90k documents inside each. > > > >> * Updating is performed using update method in batches of 1000, > > around 9 > > > >> processes in

Re: Solr deletes all collections after recreating (docker)

2022-06-08 Thread Vincenzo D'Amore
Solr home, or Solr will delete all the cores on startup. > > Thanks, > Shawn > > -- Vincenzo D'Amore

Re: Solr deletes all collections after recreating (docker)

2022-06-08 Thread Vincenzo D'Amore
time, > solr writes an error to docker log, what is attached below, and all my > cores and collections were deleted by solr. > > How can I save my data in docker volume and why solr deleted all > collections, cores on startup ? > > > -- Vincenzo D'Amore

Re: Re: Unique key field

2022-06-07 Thread Vincenzo D'Amore
and would rather rely on > docValues. But in our case, it is filling up the field cache and that is > the reason we are planning to enable docValues for that field. > Is this functionality version specific? > > On 2022/06/07 12:35:39 Vincenzo D'Amore wrote: > > "str

Re: Unique key field

2022-06-07 Thread Vincenzo D'Amore
che will then not have id field. > > > Please correct me if my understanding is wrong. > > Also, will there be any other performance impact with this change, for > example, query time taking longer than before? > > Thanks & Regards, > Poorna > -- Vincenzo D'Amore

Re: Solr scale function

2022-06-01 Thread Vincenzo D'Amore
alues of one or more fields within Solr, but only within the documents that are in the current result set. Hope this helps to make things clearer. Best regards, Vincenzo On Tue, May 31, 2022 at 9:27 PM Mikhail Khludnev wrote: > Vincenzo, > Can you elaborate what it means ' appl

Re: Solr scale function

2022-05-31 Thread Vincenzo D'Amore
price":179.99, "scale(sum(sum(price,query($q)),query($fq)), 0, 1)":0.97198087}, { "manu_id_s":"corsair", "price":185.0, "scale(sum(sum(price,query($q)),query($fq)), 0, 1)":1.0}, { "manu_id_s

Solr scale function

2022-05-31 Thread Vincenzo D'Amore
($q)), 0, 1)":0.0052296496}, { "price":329.95, "scale(sum(price,query($q)), 0, 1)":0.15004548}, { "price":479.95, "scale(sum(price,query($q)), 0, 1)":0.2182583}, { "price":649.99, "scale(sum(price,query($q)), 0, 1)":0.29558435}] }} On the other hand, I was thinking of implementing a custom scale function that by default works only on the current result set and not on the entire collection. Any suggestions on how to solve this problem? Best regards, Vincenzo -- Vincenzo D'Amore

Re: SolrJ connection handling, best practice(s)?

2022-05-30 Thread Vincenzo D'Amore
use of HttpSolrClient ( Http2SolrClient is denoted "experimental" > and has cause some problem ) > * no special tweaking of underneath HttpClient > > Any reason for this minimal setup not being able to stem many many > concurrent requests? What is the proposed SolrJ based solr client setup > (for a single Solr server)? > > Thx > - Clemens > -- Vincenzo D'Amore

Re: Solr OOM issues

2022-05-27 Thread Vincenzo D'Amore
Solr process goes down with OOM due to > resource hungry Search queries > Any help or direction towards this matter would be immensely helpful > > > Thanks, > > Parag > -- Vincenzo D'Amore

Re: Schema field type property - uninvertible

2022-05-24 Thread Vincenzo D'Amore
Just another question, so having a new schema.xml, for the "id" field and the other fields that are pint/plong/string/etc.. (i.e. have "docValues=true") should I apply uninvertible=false ? On Sun, May 22, 2022 at 10:59 PM Vincenzo D'Amore wrote: > Thanks Shawn

Re: Schema field type property - uninvertible

2022-05-22 Thread Vincenzo D'Amore
re a way to have "uninvertible" globally default to > "false", I would recommend to do so. But I think there is not at the > moment, so manually configuring "uninvertbile=false" and adding > "docValues=true" or "uninvertible=true" as necessa

Re: Schema field type property - uninvertible

2022-05-20 Thread Vincenzo D'Amore
ping :) On Thu, May 19, 2022 at 9:13 AM Vincenzo D'Amore wrote: > Hi All, > > recently I've noticed the property "uninvertible". Reading the > documentation: > > > If true, indicates that an indexed="true" docValues="false" field can

Schema field type property - uninvertible

2022-05-19 Thread Vincenzo D'Amore
mory data structure to serve in place of DocValues" and this is good for "stability", not explaining exactly what it means. Could anyone please describe this better, for example describing a worst case scenario and a good one? Best regards, Vincenzo -- Vincenzo D'Amore

Solr - frequent OOM

2022-05-03 Thread Vincenzo D'Amore
OOM happens the Solr behaviour is completely compromised or Solr returns seamlessly to work normally? Best regards, Vincenzo -- Vincenzo D'Amore

Re: Regarding maximum number of documents that can be returned safely from SOLR to Java Application.

2022-04-28 Thread Vincenzo D'Amore
n was so huge. If the performance is so important, you should use SolrJ to build something that reads from a stream (solr exports api or solr streams api) and then writes directly into a stream, that produces directly the csv file. -- Vincenzo D'Amore

Re: Regarding maximum number of documents that can be returned safely from SOLR to Java Application.

2022-04-27 Thread Vincenzo D'Amore
Ok, but the OP has to know that doing this often can be a serious issue. For example if you are implementing an endpoint that can be called 10/100 times per hour, each call will result in a few humongous objects allocated in the JVM.

Re: Regarding maximum number of documents that can be returned safely from SOLR to Java Application.

2022-04-27 Thread Vincenzo D'Amore
fely from SOLR. > > It’s impossible to answer that. First, how do you mean “safe”? How big > are your documents? > > > > Let’s turn it around. Do you have a number in mind where you’re > wondering if Solr can handle it? Like you’re thinking “Can Solr handle 10 > million documents averaging 10K each”? That’s much easier to address. > > > > Andy -- Vincenzo D'Amore

Re: Solr GC Tuning causes issues and doesn't start Solr url

2022-04-26 Thread Vincenzo D'Amore
> > Please let us know if you require more information to investigate this and > guide us through. > > > > > > *Thanks & Regards,* > > > > Deeksha Shrivastava > > Senior Engineer > > deeksha.shrivast...@nagarro.com > > M: +91 7376139953 > > > > > -- Vincenzo D'Amore

Re: SOLR TF/IDF factor removal.

2022-04-14 Thread Vincenzo D'Amore
https://github.com/freedev/solr-constant-similarity this is just an implementation of what Markus was suggesting. Could be a good idea adding a constant similarity class into the solr standard distribution. On Thu, Apr 14, 2022 at 3:48 PM Vincenzo D'Amore wrote: > Hi, > > l

Re: SOLR TF/IDF factor removal.

2022-04-14 Thread Vincenzo D'Amore
LR > > TF/IDF factor. > > > > Please do let us know your suggestions in removal of TF/IDF factor or any > > other solution approach that we can consider in this case. > > > > Thanks > > Fiz Fareedh. > > > -- Vincenzo D'Amore

Re: Vulnerability on solr port

2022-04-07 Thread Vincenzo D'Amore
ally just paths within DocumentRoot -- no >> > port number. I.e. you can't use them to redirect from :80 to :8983. >> > >> > I'm not sure what that CVE is really about either, there's just not >> > enough detail there to make any sense. Authentication's kinda b0rk3d in >> > IIS anyway; AFAIK auth returns a 401, not a redirect. Whereas a redirect >> > to IP is perfectly fine when, as you say, server can't figure out what >> > name to put in there. The "iformation disclosure" problem sounds like it >> > came out of the knee-jerk security research team since if the host is >> > reachable, then its IP address is known... >> > >> > Dima >> > >> >> >> -- >> http://www.needhamsoftware.com (work) >> http://www.the111shift.com (play) >> > > > -- > Vincenzo D'Amore > > -- Vincenzo D'Amore

Re: Vulnerability on solr port

2022-04-07 Thread Vincenzo D'Amore
Whereas a redirect > > to IP is perfectly fine when, as you say, server can't figure out what > > name to put in there. The "iformation disclosure" problem sounds like it > > came out of the knee-jerk security research team since if the host is > > reachable, then its IP address is known... > > > > Dima > > > > > -- > http://www.needhamsoftware.com (work) > http://www.the111shift.com (play) > -- Vincenzo D'Amore

Re: Vulnerability on solr port

2022-04-07 Thread Vincenzo D'Amore
lnerability from the security team . > ... > > Maybe you should educate them about a vulnerability in the `ping` > command: if they ping your solr server by its name, it'll tell them the > server's ip address. > > Dima > > > -- Vincenzo D'Amore

Re: Solr dashboard - number of CPUs available

2022-03-19 Thread Vincenzo D'Amore
R.new: 11850 It seems there is something that is committing frequently and looking at UPDATE.updateHandler.commits basically I see the same numbers, but a little bit higher. On Fri, Mar 18, 2022 at 11:56 PM Shawn Heisey wrote: > On 3/18/22 12:35, Vincenzo D'Amore wrote: > > The

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
CACHE.searcher.documentCache.evictionsRamUsage:0 CACHE.searcher.documentCache.hitratio:0.51 CACHE.searcher.documentCache.hits:8566 CACHE.searcher.documentCache.inserts:8164 CACHE.searcher.documentCache.lookups:16730 CACHE.searcher.documentCache.maxIdleTime:-1 CACHE.searcher.documentCache.maxRamMB:-1 CACHE.se

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
m > sure the next query of *:*&rows=2 is pretty fast since caches get > populated. > > I don't know what to say for next steps - lower the jvm memory and/or check > the stats in the admin console -> core selct -> Plugins/Stats -> CACHE. > > What are the stora

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
Is it possible that there are too frequent commits? I mean if each commit usually invalidates the cache, even the a stupid *:* rows=1 can be affected. How can I see how frequent commits are? Or when the latest commit has been done? On Fri, Mar 18, 2022 at 8:36 PM Vincenzo D'Amore wrote:

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
nutes making my *solr* caching pretty worthless. > > tuning solr also includes tuning queries. Start with timing id:123 type > K:V lookups and work your complexity up from there. Use debug=true and > attempt to read it. > > There are many many knobs. You need to set a baseline

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
quest do less work. Sharding can also help. > > I’m not a fan of always choosing 31 GB for the JVM. Allocate only as much > as is needed. Java will use the whole heap whether it is needed or not. You > might only need 8 GB. All of our clusters run with 16 GB. That includes > some machines with 36 cores. > > -- Vincenzo D'Amore

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
As well as set xms and xmx to the same value, I > have no proof but it seems to take less processing to keep them the same > than to keep allocating different memory footprints > > > On Mar 18, 2022, at 1:38 PM, Vincenzo D'Amore > wrote: > > >

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
> it’s like a punch card like system where all the fields have to match. > > > On Mar 18, 2022, at 12:45 PM, Vincenzo D'Amore > wrote: > > > > Thanks for your support, just sharing what I found until now. > > > > I'm working with SolrCl

Re: Solr dashboard - number of CPUs available

2022-03-18 Thread Vincenzo D'Amore
> It was only backported to java 8 quite recently, so if you're still on > that might want to check if you're on the latest version. > > https://bugs.java.com/bugdatabase/view_bug.do?bug_id=JDK-8146115 > https://bugs.openjdk.java.net/browse/JDK-8264136 > > >

Re: Solr dashboard - number of CPUs available

2022-03-16 Thread Vincenzo D'Amore
ote: > > On 3/16/22 03:56, Vincenzo D'Amore wrote: >> just asking how can I rely on the number of processors the solr dashboard >> shows. >> >> Just to give you a context, I have a 2 nodes solrcloud instance running in >> kubernetes. >> Looking at solr das

Solr dashboard - number of CPUs available

2022-03-16 Thread Vincenzo D'Amore
. I'm going deeper but as far as I can tell, the solr dashboard don't lie. I need help trying to understand if the solr dashboard is reliable. Best regards, Vincenzo -- Vincenzo D'Amore

Re: Memory and thread leak using SolrJ

2022-02-05 Thread Vincenzo D'Amore
Just create all the clients you need and reuse them all along. By the way in the documentation should be written somewhere what’s the best practices for the Solr clients usages. Ciao, Vincenzo -- mobile: 3498513251 skype: free.dev > On 5 Feb 2022, at 11:55, Vincenzo D'Amor

Re: Memory and thread leak using SolrJ

2022-02-05 Thread Vincenzo D'Amore
> SolrClient Are singletons and are thread safe You should reuse them -- mobile: 3498513251 skype: free.dev > On 5 Feb 2022, at 02:49, Steven White wrote: > > Hi everyone, > > This simple code, is causing me memory and thread loak (threads remain in > "sleeping" mode): > >for (int j = 0;

Re: Regarding Log4j Vulnerability in Solr-8.2.0

2022-01-11 Thread Vincenzo D'Amore
md:REM set SOLR_OPTS=%SOLR_OPTS% -Dlog4j2.formatMsgNoLookups=true On Tue, Jan 11, 2022 at 5:06 PM Vincenzo D'Amore wrote: > Hi Thomas, > > Why the 8.11.0? > I read that the latest stable version is 8.11.1 > https://solr.apache.org/docs/8_11_1/changes/Changes.html#v8.11.1.bug_fixes

Re: Regarding Log4j Vulnerability in Solr-8.2.0

2022-01-11 Thread Vincenzo D'Amore
use, disclosure, dissemination, forwarding, printing or copying > of > > this email, and/or any action taken in reliance on the contents of this > e‑mail > > is strictly prohibited and may be unlawful. Where permitted by > applicable > > law, this e‑mail and other e‑mail communications sent to and from > Cognizant > > e‑mail addresses may be monitored. > > -- Vincenzo D'Amore

Re: running Solr 6.6 with OpenJDK 11?

2021-12-14 Thread Vincenzo D'Amore
erver (hardware). > Now I'm thinking about upgrading from Oracle Java 8 to OpenJDK 11. > > Does Solr 6.6 run with OpenJDK 11, are there any known problems? > > Regards Bernd > -- Vincenzo D'Amore

Re: Question Apache Solr 7.7.0, 8.7 and 8.9 - log4j vulnerability

2021-12-14 Thread Vincenzo D'Amore
.9 on Windows and Linux > environment. What mitigation option do we need to take for this > vulnerability? > > > > https://solr.apache.org/security.html#apache-solr-affected-by-apache-log4j-cve-2021-44228 -- Vincenzo D'Amore

Re: [Operator] [ANNOUNCE] Apache Solr Operator v0.5.0 released

2021-11-18 Thread Vincenzo D'Amore
Thanks Ciao, Vincenzo -- mobile: 3498513251 skype: free.dev > On 18 Nov 2021, at 18:05, Atita Arora wrote: > > You can join *kubernetes.slack.com <http://kubernetes.slack.com> > #solr-operator* channel. > > >> On Thu, Nov 18, 2021 at 9:45 AM Vincenzo D'

  1   2   >