Re: Any blog or url that explain step by step configure grafana dashboard to monitor solr metrics

2020-09-23 Thread Rajdeep Sahoo
You can refer the below url https://lucene.apache.org/solr/guide/7_3/monitoring-solr-with-prometheus-and-grafana.html On Thu, 24 Sep, 2020, 8:25 am yaswanth kumar, wrote: > Can some one post here any blogs or url where I can get the detailed steps > involved in configuring grafana dashboard for

Re: How to remove duplicate tokens from solr

2020-09-18 Thread Rajdeep Sahoo
master/solr/lib) in a lib directory in the Solr Home directory. The location for the lib directory is near the solr.xml file. On Fri, 18 Sep, 2020, 1:04 am Rajdeep Sahoo, wrote: > But not sure why these type of search string is causing high cpu > utilization. > > On Fri, 18 Sep, 2020,

Re: How to remove duplicate tokens from solr

2020-09-17 Thread Rajdeep Sahoo
umption is that for > duplicated tokens in search string, lucene would have the intelligence to > not fetch the doc ids again, so you should not be worried about spending > computation resources to reevaluate the same tokens (Someone correct me if > I am wrong!) > > -Rahul &

Re: How to remove duplicate tokens from solr

2020-09-17 Thread Rajdeep Sahoo
; Alex. > > On Thu, 17 Sep 2020 at 14:35, Rajdeep Sahoo > wrote: > > > > Hi team, > > Is there any way to remove duplicate tokens from solr. Is there any > filter > > for this. >

How to remove duplicate tokens from solr

2020-09-17 Thread Rajdeep Sahoo
Hi team, Is there any way to remove duplicate tokens from solr. Is there any filter for this.

Re: Max docs and num docs are not matching after optimization

2020-05-11 Thread Rajdeep Sahoo
Please help On Mon, 11 May, 2020, 11:51 AM Rajdeep Sahoo, wrote: > Hi all, > We are using solr 7.7.2 . After optimization the deleted docs count is > still showing as part of max docs. > As per my knowledge after optimization max docs and num docs count > should match. It i

Max docs and num docs are not matching after optimization

2020-05-10 Thread Rajdeep Sahoo
Hi all, We are using solr 7.7.2 . After optimization the deleted docs count is still showing as part of max docs. As per my knowledge after optimization max docs and num docs count should match. It is not happening here.. Is there any way to troubleshoot this.

Solr index size has increased in solr 7.7.2

2020-04-15 Thread Rajdeep Sahoo
Hi all We are migrating from solr 4.6 to solr 7.7.2. In solr 4.6 the size was 2.5 gb but here in solr 7.7.2 the solr index size is showing 6.8 gb with the same no of documents. Is it expected behavior or any suggestions how to optimize the size.

Re: Replica is going into recovery in Solr 6.1.0

2020-02-12 Thread Rajdeep Sahoo
What is your memory configuration On Thu, 13 Feb, 2020, 9:46 AM vishal patel, wrote: > Is there anyone looking at this? > > Sent from Outlook > > From: vishal patel > Sent: Wednesday, February 12, 2020 3:45 PM > To: solr-user@lucene.apa

Re: Solr 7.7 heap space is getting full

2020-02-06 Thread Rajdeep Sahoo
rongly disagree that more heap is needed for bigger indexes. > >> Except for faceting, Lucene was designed to stream index data and > >> work regardless of the size of the index. Indexing is in RAM buffer > >> sized chunks, so large updates also don’t need extra RAM. > >

Re: Solr 7.7 heap space is getting full

2020-02-02 Thread Rajdeep Sahoo
thing larger. > > Best, > Erick > > > On Feb 2, 2020, at 10:19 AM, Rajdeep Sahoo > wrote: > > > > What can we do in this scenario as the solr master node is going down and > > the indexing is failing. > > Please provide some workaround for this issue.

Re: Solr 7.7 heap space is getting full

2020-02-02 Thread Rajdeep Sahoo
va to use all of heap before running a major > GC. That > is how the JVM works. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Feb 1, 2020, at 6:35 AM, Rajdeep Sahoo > wrote: > > > > Please reply

Re: Solr 7.7 heap space is getting full

2020-02-01 Thread Rajdeep Sahoo
Please reply anyone On Fri, 31 Jan, 2020, 11:37 PM Rajdeep Sahoo, wrote: > This is happening when the no of indexed document count is increasing. >With 1 million docs it's working fine but when it's crossing 4.5 > million it's heap space is getting full. > > &

Re: Solr 7.7 heap space is getting full

2020-01-31 Thread Rajdeep Sahoo
This is happening when the no of indexed document count is increasing. With 1 million docs it's working fine but when it's crossing 4.5 million it's heap space is getting full. On Wed, 22 Jan, 2020, 7:05 PM Michael Gibney, wrote: > Rajdeep, you say that "suddenly" heap space is getting full

Re: Solr cloud production set up

2020-01-20 Thread Rajdeep Sahoo
Please suggest anyone On Sun, 19 Jan, 2020, 9:43 AM Rajdeep Sahoo, wrote: > Apart from reducing no of facets in the query, is there any other query > params or gc params or heap space or anything else that we need to tweak > for improving search response time. > > On Sun, 19 Jan

Re: Solr 7.7 heap space is getting full

2020-01-20 Thread Rajdeep Sahoo
around 1gb each. When loading the core by selecting it,the jvm space us becoming full. On Mon, 20 Jan, 2020, 9:26 AM Rajdeep Sahoo, wrote: > Anything else regarding gc tuning. > > On Mon, 20 Jan, 2020, 8:08 AM Rajdeep Sahoo, > wrote: > >> Initially we were getting the warni

Solr console showing error in 7 .7

2020-01-20 Thread Rajdeep Sahoo
When reloading the solr console,it is showing some error in the console itself for some small amount of time. The error is error reloading/initialising the core.

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
Anything else regarding gc tuning. On Mon, 20 Jan, 2020, 8:08 AM Rajdeep Sahoo, wrote: > Initially we were getting the warning message as ulimit is low i.e. 1024 > so we changed it to 65000 > Using ulimit -u 65000. > > Then the error was failed to reserve shared memory error =

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
info.gov/app/collection/cfr > https://www.govinfo.gov/app/cfrparts/month > > I hope that helps. > > Lotfi Mehai > https://www.linkedin.com/in/lmehai/ > > > > > > On Sun, Jan 19, 2020 at 9:05 PM Rajdeep Sahoo > wrote: > > > Initially we were ge

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
alter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 19, 2020, at 5:47 PM, Rajdeep Sahoo > wrote: > > > > Hi, > > Currently there is no request or indexing is happening. > > It's just start up > > And during th

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
ex updated? > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 19, 2020, at 4:49 PM, Rajdeep Sahoo > wrote: > > > > Hi, > > Still facing the same issue... > > Anything else that we need to

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
ts \ > “ > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 19, 2020, at 9:25 AM, Rajdeep Sahoo > wrote: > > > > We are using solr 7.7 . Ram size is 24 gb and allocated space is 12 gb. > We > > have co

Re: Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
Please reply anyone On Sun, 19 Jan, 2020, 10:55 PM Rajdeep Sahoo, wrote: > We are using solr 7.7 . Ram size is 24 gb and allocated space is 12 gb. We > have completed indexing after starting the server suddenly heap space is > getting full. >Added gc params , still not wor

Solr 7.7 heap space is getting full

2020-01-19 Thread Rajdeep Sahoo
We are using solr 7.7 . Ram size is 24 gb and allocated space is 12 gb. We have completed indexing after starting the server suddenly heap space is getting full. Added gc params , still not working and jdk version is 1.8 . Please find the below gc params -XX:NewRatio=2 -XX:SurvivorRatio=3 -XX:

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
he time each component > takes. > > > On Jan 18, 2020, at 1:50 PM, Rajdeep Sahoo > wrote: > > > > Thanks for the suggestion, > > > > Is there any way to get the info which operation or which query params > are > > increasing the response time. &g

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
k more about your query’s than your > infrastructure, solr cloud won’t help you at all especially if your asking > for things you don’t need > > > On Jan 18, 2020, at 1:25 PM, Rajdeep Sahoo > wrote: > > > > We have assigned 16 gb out of 24gb for heap . > >

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
it not going to help. On Sat, 18 Jan, 2020, 11:36 PM Shawn Heisey, wrote: > On 1/18/2020 10:09 AM, Rajdeep Sahoo wrote: > > We are having 2.3 million documents and size is 2.5 gb. > >10 core cpu and 24 gb ram . 16 slave nodes. > > > >Still some of the querie

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
ry arrays > and sorting. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 18, 2020, at 9:29 AM, Rajdeep Sahoo > wrote: > > > > Hi shawn, > > Thanks for this info, > > Could you

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
. On Sat, 18 Jan, 2020, 10:52 PM Shawn Heisey, wrote: > On 1/18/2020 9:55 AM, Rajdeep Sahoo wrote: > > We do parallel indexing in production, > > > > What about search performance in solr cloud in comparison with master > > slave. > > And what about blo

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
instance and it runs more than fine > > > On Jan 18, 2020, at 11:31 AM, Shawn Heisey wrote: > > > > On 1/18/2020 1:05 AM, Rajdeep Sahoo wrote: > >> Our Index size is huge and in master slave the full indexing time is > almost > >> 24 hrs. > >>

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
shard and replica. Is there any co relation with master slave set up. On Sat, 18 Jan, 2020, 10:01 PM Shawn Heisey, wrote: > On 1/18/2020 1:05 AM, Rajdeep Sahoo wrote: > > Our Index size is huge and in master slave the full indexing time is > almost > > 24 hrs. > >

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
st with a simple setup for let’s say 1 mio document and > interpolate from this. It could be also that your ETL is the bottleneck and > not Solr. > At the same time you can simulate user queries using Jmeter or similar. > > > Am 18.01.2020 um 09:05 schrieb Rajdeep Sahoo >: > >

Re: Solr cloud production set up

2020-01-18 Thread Rajdeep Sahoo
: > Why do you want to change to Solr Cloud? Master/slave is a great, stable > cluster architecture. > > wunder > Walter Underwood > wun...@wunderwood.org > http://observer.wunderwood.org/ (my blog) > > > On Jan 17, 2020, at 6:19 PM, Rajdeep Sahoo > wrote: > >

Re: Solr cloud production set up

2020-01-17 Thread Rajdeep Sahoo
Please reply anyone On Sat, 18 Jan, 2020, 12:13 AM Rajdeep Sahoo, wrote: > Hi all, > We are using solr cloud 7.7.1 > In a live production environment how many solr cloud server do we need, > Currently ,we are using master slave set up with 16 slave server with > solr 4.6. >

Solr cloud production set up

2020-01-17 Thread Rajdeep Sahoo
Hi all, We are using solr cloud 7.7.1 In a live production environment how many solr cloud server do we need, Currently ,we are using master slave set up with 16 slave server with solr 4.6. In solr cloud do we need to scale it up or 16 server will suffice the purpose.

Re: In production solr cloud 4.6 is not working

2020-01-11 Thread Rajdeep Sahoo
MailingLists > > > > On Jan 11, 2020, at 2:47 AM, Rajdeep Sahoo > wrote: > > > > Hi , > > > > Anyone Please suggest. > > > > On Sat, 11 Jan, 2020, 12:33 AM Rajdeep Sahoo, < > rajdeepsahoo2...@gmail.com> > > wrote: > > > >

Re: In production solr cloud 4.6 is not working

2020-01-10 Thread Rajdeep Sahoo
Hi , Anyone Please suggest. On Sat, 11 Jan, 2020, 12:33 AM Rajdeep Sahoo, wrote: > Hi all, > In production we have done the set up of solr cloud with solr version > 4.6 , the set up contains 3 zookeeper and 4 shards each having three > replicas, a total of 12 solr nodes. >

In production solr cloud 4.6 is not working

2020-01-10 Thread Rajdeep Sahoo
Hi all, In production we have done the set up of solr cloud with solr version 4.6 , the set up contains 3 zookeeper and 4 shards each having three replicas, a total of 12 solr nodes. Active indexing was going on , after switching on we are experiencing a lot of issues , all the nodes stopped ser

Re: Solr 7.5 speed up, accuracy details

2019-12-28 Thread Rajdeep Sahoo
Hi all, How can I get the performance improvement features in indexing and search in solr 7.5... On Sat, 28 Dec, 2019, 9:18 PM Rajdeep Sahoo, wrote: > Thank you for the information > Why you are recommending to use the schema api instead of schema xml? > > > On Sat, 28

Re: Solr 7.5 seed up, accuracy details

2019-12-28 Thread Rajdeep Sahoo
You will have anyway to reindex everything so it is a also a good > opportunity to look at your existing processes and optimize them. > > > Am 28.12.2019 um 15:19 schrieb Rajdeep Sahoo >: > > > > Hi all, > > Is there any way I can get the speed up,accuracy details i.

Solr 7.5 seed up, accuracy details

2019-12-28 Thread Rajdeep Sahoo
Hi all, Is there any way I can get the speed up,accuracy details i.e. performance improvements of solr 7.5 in comparison with solr 4.6 Currently,we are using solr 4.6 and we are in a process to upgrade to solr 7.5. Need these details. Thanks in advance

Solr join query

2019-07-22 Thread Rajdeep Sahoo
Can we join two solr collection based on multivalued field.

Solr query high response time

2019-03-22 Thread Rajdeep Sahoo
Hi all, My solr query sometime taking more than 60 sec to return the response . Is there any way I can check why it is taking so much time . Please let me know if there is any way to analyse this issue(high response time ) .Thanks

Re: Solr block join

2019-01-27 Thread Rajdeep Sahoo
But how can I use it. In what context block join is required. If I use it, what are the benefits I will be getting. On Jan 27, 2019 6:49 PM, "Mikhail Khludnev" wrote: > Rajdeep, it's already implemented in Lucene and Solr. > > > On Sun, Jan 27, 2019 at 1:1

Re: Solr block join

2019-01-27 Thread Rajdeep Sahoo
Please help in understanding how to implement block join query On Jan 27, 2019 1:43 AM, "Mikhail Khludnev" wrote: > https://lucene.apache.org/solr/guide/7_6/other-parsers. > html#block-join-parent-query-parser > > On Sat, Jan 26, 2019 at 10:30 PM Rajdeep Sahoo > >

Re: Solr block join

2019-01-26 Thread Rajdeep Sahoo
Please suggest anyone On Jan 8, 2019 11:07 PM, "Rajdeep Sahoo" wrote: > What is the use of block join in solr >

Solr thread dump analysis

2019-01-26 Thread Rajdeep Sahoo
Hi all, How can I analyse solr thread dump and how the thread dump analysis can be helpful for improving solr performance. Please suggest

Solr block join

2019-01-08 Thread Rajdeep Sahoo
What is the use of block join in solr

Solr code base setup

2019-01-08 Thread Rajdeep Sahoo
How can I set up code Base and do the changes.

Inverted index and forward index in Solr shrading

2019-01-08 Thread Rajdeep Sahoo
Can any explain me what is inverted index and forward index used in solr shrading . Is there any resource from where I can find some knowledge about this.

Re: Solr cache clear

2018-11-21 Thread Rajdeep Sahoo
to stop doing whatever you're doing that leads to > > whatever the real problem is. Maybe reducing the cache sizes. > > > > Best, > > Erick > > On Tue, Nov 20, 2018 at 9:05 AM Shawn Heisey > wrote: > > > > > > On 11/20/2018 9:25 AM, Rajdeep Saho

Solr cache clear

2018-11-20 Thread Rajdeep Sahoo
Hi all, Without restarting is it possible to clear the cache?

Solr query response time analysis

2018-11-19 Thread Rajdeep Sahoo
Hi all, Please suggest, how can I analyze the time taken by a solr query? Is there any tool for analyzing the query response time.I f there is any way to do this please suggest.

Re: Solr File based spellchecker is not returning expected result

2018-09-15 Thread Rajdeep Sahoo
can anyone please help me regarding spell checking issue what I have mentioned? On Thu, Sep 13, 2018 at 12:31 AM Rajdeep Sahoo wrote: > Hi , > I am using solr 4.6 version. > My document is having a "iphone 7" but when I am searching with with > "iphone7" I am

Re: Need Support - Apache Solr - 20180915

2018-09-15 Thread Rajdeep Sahoo
You can go for solr cloud if you have billions of data and in future if you want to increase the volume. Solr is a file based database for retriving data and not for complex oprations like joining multiple tables.If your requirement is only storing and fast retrieving then solr is the best option i

Re: Solr File based spellchecker is not returning expected result

2018-09-12 Thread Rajdeep Sahoo
in the same call we are using direct solr spellchecker If we are not getitng some result in the second call we are using directsolr spellchecker. How can I write a function query for getting suggestion against multiple spellchecker? On Thu, Sep 13, 2018 at 12:31 AM Rajdeep Sahoo wrote: >

Solr File based spellchecker is not returning expected result

2018-09-12 Thread Rajdeep Sahoo
Hi , I am using solr 4.6 version. My document is having a "iphone 7" but when I am searching with with "iphone7" I am getting the result because here worddelimiterfilterfactory is taking care by slipt on numerics functionality. (Iphone7-->iphone 7) But I want solr to return a spellcheck suggestio