lr PMC Chair and Vice
> President. This decision was approved by the board in its February 2021
> meeting.
>
> Congratulations Jan!
>
> --
> Anshum Gupta
>
--
Regards,
Shalin Shekhar Mangar.
wrote:
> Hi,
>
> Is there in Solrcloud any load balancing based on CPU load on Solr nodes ?
>
> If for shard a replica fails to handle a query, the query is sent to
> another replica in order to be completed ?
>
> Regards
>
> Dominique
>
--
Regards,
Shalin Shekhar Mangar.
;> nodes, or between your client and Solr.
>>
>> - Houston
>>
>> On Wed, Dec 9, 2020 at 3:24 PM Abhishek Mishra
>> wrote:
>>
>> > Hello guys,
>> > We are kind of facing some of the issues(Like timeout etc.) which are
>> very
>> > inconsistent. By any chance can it be related to EKS? We are using solr
>> 7.7
>> > and zookeeper 3.4.13. Should we move to ECS?
>> >
>> > Regards,
>> > Abhishek
>> >
>>
>
--
Regards,
Shalin Shekhar Mangar.
under 50 million documents, that are spread across 4 servers.
> Each server has a node each.
>
> One side is updating happily so would think that sharding wouldn't be
> needed at this point?
>
> We are using Solr version 7.7.1.
>
> Thanks,
>
> Daniel
>
>
--
Regards,
Shalin Shekhar Mangar.
firstSearcher" triggered which then try to find
> the Max value for version using Field Cache but because of too many records
> it occupy lot of memory to carry out the task.
> Can someone please validate Is what I am talking in above para is the
> problem or problem lies in somewhere else?
>
> Best Regards,Sanjay
>
--
Regards,
Shalin Shekhar Mangar.
hout your information.
>
> Cheers
>
> On Sat, Oct 24, 2020 at 11:37 PM Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
> > Hi Jonathan,
> >
> > Are you using the "shards.preference" parameter by any chance? There is a
> > bug that
We're quite puzzled by this and would really like some help figuring out
> *why* the CPU on one is so much higher. I did try to get the jaeger tracing
> working (we already have jaeger in our cluster), but we just kept getting
> errors on startup with solr not being able to load the main function...
>
>
> Thank you in advance!
> Cheers
> Jonathan
>
>
>
>
--
Regards,
Shalin Shekhar Mangar.
Perhaps this bug in the kernel?
https://groups.google.com/forum/#!topic/mechanical-sympathy/QbmpZxp6C64
Can you check if you are running an affected kernel?
On Fri, Nov 1, 2019 at 7:09 AM Daniel de Oliveira Mantovani <
daniel.oliveira.mantov...@gmail.com> wrote:
> I have a Solr 7.6.0 Cloud with
?
> >
> > wunder
> > Walter Underwood
> > wun...@wunderwood.org
> > http://observer.wunderwood.org/ (my blog)
> >
>
>
--
Regards,
Shalin Shekhar Mangar.
r.java:624)
> > at java.lang.Thread.run(Thread.java:748)
> >
> > Problem description
> >
> > So, the problem is that it only has a pool size of 10, of which 10 are
> > busy and nothing gets queued (synchronous execution). In fact, it really
> > only removed 10 replicas and the other 9 replicas stayed there. When
> > manually sending the API command to delete this node it works fine, since
> > Solr only needs to remove the remaining 9 replicas and everything is good
> > again.
> > Question
> >
> > How can I either increase this (small) thread pool size and/or activate
> > queueing the remaining deletion tasks? Another solution might be to retry
> > the failed task until it succeeds.
> >
> > Using Solr 7.7.1 on Ubuntu Server installed with the installation script
> > from Solr (so I guess it's using Jetty?).
> >
> > Thanks for your help!
> >
>
--
Regards,
Shalin Shekhar Mangar.
o you can't delete it.
>
> If your collection is typical and has compositeId routing, deleting a
> shard is really only possible after you have run SPLITSHARD and then you
> will only be able to delete the original shard that gets split.
>
> Aside from SPLITSHARD, I really have no idea how to mark a shard as
> inactive, but that will be required before you can delete it.
>
> Thanks,
> Shawn
>
--
Regards,
Shalin Shekhar Mangar.
on documents in the index,
> occupying 700GB of disk space.
>
> We need to completely power off the system to move it.
>
> Are there any actions we should take on shutdown to help the process?
> Anyhing we should expect on power on?
>
> Thanks,
>
> Kyle
>
--
Regards,
Shalin Shekhar Mangar.
n as you specify in the schema that a field has docValues=true,
> Solr treats all existing documents as having docValues enabled for that
> field. As there is no docValue content, DocValues-aware functionality such
> as sorting and faceting will not work for that field, until the documents
> has been re-indexed.
> >
> > - Toke Eskildsen
>
--
Regards,
Shalin Shekhar Mangar.
added in 5.5.3 and 6.2.0 by this issue
> hmmm, I have never seen these threads before, not even in 6.6
>
> > Shalin worked on that issue, maybe they can shed some light on it and
> >indicate whether there should be many threads running that code
> I'd appreciate
>
> Yet again, many thanks.
> - Clemens
>
>
--
Regards,
Shalin Shekhar Mangar.
ire a reindexing in order to
> take advantage of the skg functionality, or would it work regardless? A
> full reindex is quite a large operation in my use case
>
--
Regards,
Shalin Shekhar Mangar.
. It was
> shards 1-9 and shard 20. The suspicion is that there's something
> hard-coded that limits it to 10 responses ... because without that, I
> would expect the number of shards in the response to match the number of
> nodes.
>
> Thanks,
> Shawn
>
>
--
Regards,
Shalin Shekhar Mangar.
sn't appear to have a way to set the properties
> when we create the triggers.
>
> Are we missing something or is this not supported at this time? I couldn't
> find a relevant JIRA or other documentation or solr-user discussion on
> this.
>
> thanks,
>
> JiM
>
--
Regards,
Shalin Shekhar Mangar.
;sysLoadAvg":98.0}],
> "violations":[]},
> "WARNING":"This response format is experimental. It is likely to
> change in the future."}
>
>
> Exhibit B: (admin/autoscaling)
>
> "cluster-preferences":[{
> "minimize":"cores",
> "precision":1}
> ,{
> "maximize":"freedisk",
> "precision":10}
> ,{
> "minimize":"sysLoadAvg",
> "precision":3}],
> "cluster-policy":[{
> "replica":"<2",
> "node":"#ANY"}
> ,{
> "replica":"0",
> "freedisk":"<10",
> "strict":"true"}],
>
--
Regards,
Shalin Shekhar Mangar.
ts?*?
> If there kindly share me the reference
>
> Thanks and Regards,
> Satish
>
--
Regards,
Shalin Shekhar Mangar.
out of disk space on one of the nodes while
> others would have plenty? I observe some are getting close to ~80%
> utilization while others stay at ~60%
> * Would this difference be due to collection index size differences or due
> to error on my side to come up with a useful policy/preferences?
>
> Thank you
>
--
Regards,
Shalin Shekhar Mangar.
od.org/ (my blog)
>
>
--
Regards,
Shalin Shekhar Mangar.
tive Method)
> > >>
> > >> at
> > >> sun.reflect.NativeMethodAccessorImpl.invoke(
> > NativeMethodAccessorImpl.java:
> > >> 62)
> > >>
> > >> at
> > >> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> > >> DelegatingMethodAccessorImpl.java:43)
> > >>
> > >> at java.lang.reflect.Method.invoke(Method.java:498)
> > >>
> > >> at org.eclipse.jetty.start.Main.invokeMain(Main.java:214)
> > >>
> > >> at org.eclipse.jetty.start.Main.start(Main.java:457)
> > >>
> > >> at org.eclipse.jetty.start.Main.main(Main.java:75)
> > >>
> > >> Caused by: org.apache.solr.common.SolrException:
> > >> java.net.UnknownHostException: ditsearch001.es.com: Name or service
> not
> > >> known
> > >>
> > >> at
> > >>
> org.apache.solr.common.cloud.SolrZkClient.(SolrZkClient.java:171)
> > >>
> > >> at
> > >>
> org.apache.solr.common.cloud.SolrZkClient.(SolrZkClient.java:117)
> > >>
> > >> at
> > >>
> org.apache.solr.common.cloud.SolrZkClient.(SolrZkClient.java:112)
> > >>
> > >> at
> > >> org.apache.solr.common.cloud.SolrZkClient.(SolrZkClient.java:99)
> > >>
> > >> at
> > >> org.apache.solr.servlet.SolrDispatchFilter.loadNodeConfig(
> > >> SolrDispatchFilter.java:263)
> > >>
> > >> ... 44 more
> > >>
> > >> Caused by: java.net.UnknownHostException: ditsearch001.es.com: Name
> or
> > >> service not known
> > >>
> > >> at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
> > >>
> > >> at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.
> > java:928)
> > >>
> > >> at
> > >>
> java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
> > >>
> > >> at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
> > >>
> > >> at java.net.InetAddress.getAllByName(InetAddress.java:1192)
> > >>
> > >> at java.net.InetAddress.getAllByName(InetAddress.java:1126)
> > >>
> > >> at
> > >> org.apache.zookeeper.client.StaticHostProvider.(
> > >> StaticHostProvider.java:61)
> > >>
> > >> at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:445)
> > >>
> > >> at org.apache.zookeeper.ZooKeeper.(ZooKeeper.java:380)
> > >>
> > >> at
> > >> org.apache.solr.common.cloud.SolrZooKeeper.(
> > SolrZooKeeper.java:43)
> > >>
> > >> at
> > >> org.apache.solr.common.cloud.ZkClientConnectionStrategy.
> > >> createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
> > >>
> > >> at
> > >> org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(
> > >> DefaultConnectionStrategy.java:37)
> > >>
> > >> at
> > >>
> org.apache.solr.common.cloud.SolrZkClient.(SolrZkClient.java:146)
> > >>
> > >> ... 48 more
> > >>
> >
>
--
Regards,
Shalin Shekhar Mangar.
> cluster status endpoint.
> > With that we now face the problem managing this correctly when scaling up
> > multiple servers at once.
> >
> > Are we missing something here? Is there really no way for a node to be
> > auto-assigned to a shard in 7.3?
> > And if so, are there any recommendations for an approach to reliably
> doing
> > this ourselves?
> >
> > Thanks!
> > Adam
> >
>
>
>
> --
> http://www.the111shift.com
>
--
Regards,
Shalin Shekhar Mangar.
end
> the query to zookeeper or send it to a particular solr node? How does the
> querying process work in general.
>
> Thank you
>
--
Regards,
Shalin Shekhar Mangar.
ahl, search solution architect
> Cominvent AS - www.cominvent.com
>
> > 12. jun. 2018 kl. 08:10 skrev Shalin Shekhar Mangar <
> shalinman...@gmail.com>:
> >
> > Hi Jan,
> >
> > Comments inline:
> >
> > On Tue, Jun 12, 2018 at 2:19 AM Jan Høydah
stions
planned that will return suggestions even when there are no policy
violations.
>
> --
> Jan Høydahl, search solution architect
> Cominvent AS - www.cominvent.com
>
>
--
Regards,
Shalin Shekhar Mangar.
d not find anything in the API. Is this
> still a gap?
>
> regards,
> Hendrik
>
--
Regards,
Shalin Shekhar Mangar.
object with default version 0
>
> Obviously, a workaround is to force ZooKeeper to have a version greater
> than 0 for aliases.json file (for instance by not clearing the file and
> just overwriting it again and again).
>
>
> But we were wondering, is this the intended behavior for Solr ?
>
> Thanks for reading,
>
> Gaël
--
Regards,
Shalin Shekhar Mangar.
aving differing numbers of shards are contemplated are better
> accomplished
> > by hosting multiple shards on each target Solr instance.
>
>
> I am precisely little curious to know how would this fare if this isn't
> followed.
> Would highly appreciate any pointers around this.
>
> Sincerely,
> Atita
>
--
Regards,
Shalin Shekhar Mangar.
cument be resent by the leader to the replica shards to
> index the document after sometime or how is scenario addressed?
>
> Also, given the above context, when I set the value of min_rf parameter to
> say 2, does that mean the calling application will be informed that the
> indexing failed?
>
--
Regards,
Shalin Shekhar Mangar.
lly caught my attention. Does anyone here have an idea where
> to look?
>
> Many thanks,
> Markus
>
--
Regards,
Shalin Shekhar Mangar.
> > selecting traffic. So it seems not to be a general problem with java,
> GC,
> > >
> > >
> > > We disabled all other insert/updates and we are able to reproduce this
> > slow
> > > update behaviour in the Solr Admin console with a single update of one
> > > document.
> > >
> > > We are lost.
> > >
> > > We didn't change the Solr configuration.
> > > The load seems to be not higher then during previous peaks
> > > The developers didn't change anything (so they say)
> > > Search is still fast.
> > >
> > > But single simple updates takes >30sec
> > >
> > > Any ideas about this? We tried quite a lot the last two days
> > >
> > > Cheers
> > > Felix
> >
> >
>
--
Regards,
Shalin Shekhar Mangar.
> I tried all setting from ALL, TRACE, DEBUG, ...
>
> Also the Reference Guide 6.6 shows the Admin UI as I see it, but
> the table below the image has levels FINEST, FINE, CONFIG, ...
> https://lucene.apache.org/solr/guide/6_6/configuring-logging.html
> This is confusing.
>
>
bly guide me as to whats going on Solr Cloud
>2. If CLUSTERSTATUS is the right pick to build such utility. Do we
> have any other option?
>
>
> Thanks for any pointers and suggestions.
>
> Appreciate your attention looking this through.
>
> Atita
>
--
Regards,
Shalin Shekhar Mangar.
han the
> intended recipient is strictly prohibited. If you have received this
> message in error, please notify the sender by reply email and delete the
> message and any attachments. Thank you.
>
--
Regards,
Shalin Shekhar Mangar.
Solr-User-f472068.html
>
--
Regards,
Shalin Shekhar Mangar.
did not change!
>
> How can I manually change the leader if the firewall blocks the SolrCloud
> ports from being listened?
>
>
>
>
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
>
--
Regards,
Shalin Shekhar Mangar.
e", with -replicationFactor 1 -shards 1, and the -d option
> > pointing at the config you want uploaded for the collection. You could
> > even go with a higher shard count if you want. Increasing
> > replicationFactor is probably possible, but as all this would be running
> on
> > a single server, there's no point.
> >
> > Thanks,
> > Shawn
> >
> >
>
>
> --
> med vennlig hilsen,
> Marvin B. Lillehaug
>
--
Regards,
Shalin Shekhar Mangar.
gt;
>>
>> ...
>>
>>
>> 524288
>> true
>>
>> ...
>>
>> ...
>>
>>
>>
>> I would like to know why is this metrics not exposed by default just like
>> all the other metrics?
>>
>> Is there any performance overhead that we should be concerned about it?
>>
>> If there was no particular reason, then can we expose it by default?
>>
>>
>>
>> Regards
>> Suresh
>>
--
Regards,
Shalin Shekhar Mangar.
d=true is
> ignored and the values are pulled from docValues.
>
> And only if useDocValuesAsStored=false is explicitly used then stored=true
> comes
> into play.
>
> Or short, useDocValuesAsStored=true (the default) has precedence over
> stored=true.
> I this right?
>
> Regards
> Bernd
--
Regards,
Shalin Shekhar Mangar.
didn't lead me to
> expect this behavior:
>
>> replicationFactor
>>
>>The number of replicas to be created for each shard.
>
> Is this expected behavior (by anyone but me)?
> Should I report it as a bug?
>
> [1]: https://lucene.apache.org/solr/guide/7_1/collections-api.html
>
> Regards
> Ansgar Wiechers
> --
> "Abstractions save us time working, but they don't save us time learning."
> --Joel Spolsky
--
Regards,
Shalin Shekhar Mangar.
;
>> Either TLOG or PULL would do a full index copy if the local index is
>> suddenly very different from the leader. This could happen in situations
>> where you have NRT replicas and the leader changes -- NRT replicas will
>> typically have very different files in their on-disk indexes even though
>> they contain the same documents. When the leader changes to a different
>> NRT replica, TLOG/PULL replicas will suddenly find that they have a very
>> different list of index files, so they will fetch the entire index.
>>
>> Thanks,
>> Shawn
>>
--
Regards,
Shalin Shekhar Mangar.
is complete, no other steps are required.
References:
https://issues.apache.org/jira/browse/SOLR-11486
https://issues.apache.org/jira/browse/SOLR-10335
https://wiki.apache.org/solr/SolrSecurity
--
Regards,
Shalin Shekhar Mangar.
tham Digital Science)
References:
https://issues.apache.org/jira/browse/SOLR-11482
https://issues.apache.org/jira/browse/SOLR-11477
https://wiki.apache.org/solr/SolrSecurity
--
Regards,
Shalin Shekhar Mangar.
releases. It is possible that the mirror you
are using may not have replicated the release yet. If that is the
case, please try another mirror. This also goes for Maven access.
--
Regards,
Shalin Shekhar Mangar.
; error, please notify the sender by replying to this message and permanently
> delete this e-mail, its attachments, and any copies of it immediately. You
> should not retain, copy or use this e-mail or any attachment for any purpose,
> nor disclose all or any part of the contents to any o
.update.SolrIndexWriter@3ee73284
>>> INFO - 2017-09-19 16:42:20.660; [c:dosweb2016 s:shard2 r:core_node5
>>> x:dosweb2016] org.apache.solr.search.SolrIndexSearcher; Opening
>>> [Searcher@644a8d33[dosweb2016] realtime]
>>> INFO - 2017-09-19 16:42:20.668; [c:dosweb2016 s:shard2 r:core_node5
>>> x:dosweb2016] org.apache.solr.update.DirectUpdateHandler2;
>>> end_commit_flush
>>>
>>>
>>> thanks,
>>> --
>>> Kaveh Minooie
>
>
> --
> Kaveh Minooie
--
Regards,
Shalin Shekhar Mangar.
CVE-2017-9803: Security vulnerability in kerberos delegation token functionality
Severity: Important
Vendor:
The Apache Software Foundation
Versions Affected:
Apache Solr 6.2.0 to 6.6.0
Description:
Solr's Kerberos plugin can be configured to use delegation tokens,
which allows an application
I deduct that
>> 11GB of SHR from the RES value, then all the numbers work.
>>
>> The screenshot was almost 3 years ago, so I do not know what machine it
>> came from, and therefore I can't be sure what the actual heap size was.
>> I think it was about 6GB -- the difference between RES and SHR. I have
>> used a 6GB heap on some of my production servers in the past. The
>> server where I got this screenshot was not having any noticeable
>> performance or memory problems, so I think that I can trust that the
>> main numbers above the process list (which only come from the OS) are
>> correct.
>>
>> Thanks,
>> Shawn
>>
>>
--
Regards,
Shalin Shekhar Mangar.
or a collection of two
>> shards. Having this code:
>>
>> cloudDescriptor = core.getCoreDescriptor().getCloudDescriptor();
>> return cloudDescriptor.getNumShards();
>>
>> In some cases cloudDescriptor.getNumShards() throws an NPE. Am i doing
>> something wrong?
>>
>> Thanks,
>> Markus
>>
--
Regards,
Shalin Shekhar Mangar.
uery
> param?
> I can build a custom component but dabbling with query parsers would be way
> too much for me to handle.
>
> Thanks
> Suresh
>
>
>
>
> On Tue, Aug 8, 2017 at 9:49 PM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
>> The
which the solr query should
> fail?
>
> We would like to build a custom component which logs the query, the query
> identifier (the tag which user provides) and the IP address of the client
> machine which fired this query.
>
>
> Thanks
> Suresh
--
Regards,
Shalin Shekhar Mangar.
aphite_host:NO_HOST_SET}
> 2003
>${graphite_prefix:NO_PREFIX_SET}
>http://observer.wunderwood.org/ (my blog)
>
>
--
Regards,
Shalin Shekhar Mangar.
classes in Lucene are instantiating a Logger,
> > should I use Logger instead? I tried to log with it, but I don't see any
> > output in logs.
> >
> >
> > Regards
> > Nawab
> >
>
--
Regards,
Shalin Shekhar Mangar.
CVE-2017-7660: Security Vulnerability in secure inter-node
communication in Apache Solr
Severity: Important
Vendor:
The Apache Software Foundation
Versions Affected:
Solr 5.3 to 5.5.4
Solr 6.0 to 6.5.1
Description:
Solr uses a PKI based mechanism to secure inter-node communication
when
ve at Nabble.com.
>
--
Regards,
Shalin Shekhar Mangar.
t make new changes visible, but it will start a new transaction
>> log frequently.
>>
>>
>> 6
>> false
>>
>>
>> An automatic commit (soft or hard) with a one second interval is going to
>> cause that warning you're seeing.
>>
>> https://lucidworks.com/understanding-transaction-logs-softcommit-and-commit-in-sorlcloud/
>>
>> Thanks,
>> Shawn
>>
--
Regards,
Shalin Shekhar Mangar.
o node name and core name, 2)
having the collection name to core name resolution take _route_ param
into account. Both 1 and 2 can solve the problem. Can you please open
a Jira issue?
>
> Thanks,
>
> Chris
--
Regards,
Shalin Shekhar Mangar.
t; --
> View this message in context:
> http://lucene.472066.n3.nabble.com/SPLITSHARD-Working-tp4333876.html
> Sent from the Solr - User mailing list archive at Nabble.com.
--
Regards,
Shalin Shekhar Mangar.
nothing method :-)
>
> How about a short check if an instance is still running
> and using that log file before moving it to archived?
>
> Regards
> Bernd
>
> Am 04.05.2017 um 09:07 schrieb Shalin Shekhar Mangar:
>> Yes this is expected. On startup old console logs and
gt; bin/solr start -cloud -p 7574
> -> solr-8983-console.log is moved to server/logs/archived/
> -> server/logs/ has solr-7574-console.log
>
> Is this how it should be or do I have a misconfig?
>
> Regards
> Bernd
--
Regards,
Shalin Shekhar Mangar.
OLR-10532 but unfortunately I
don't have the time to fix it soon. Patches are always welcome.
>
> From my solrconfig.xml:
>
>
> mySuggester
> AnalyzingInfixLookupFactory
> mySuggester
> DocumentDictionaryFactory
> mySuggest
> x
> suggestTypeLc
> false
>
>
>
> Cheers,
> Damien.
--
Regards,
Shalin Shekhar Mangar.
I also opened https://issues.apache.org/jira/browse/SOLR-10532 to fix
this annoying and confusing behavior of SuggestComponent.
On Thu, Apr 20, 2017 at 8:40 PM, Andrea Gazzarini <gxs...@gmail.com> wrote:
> Ah great, many thanks again!
>
>
>
> On 20/04/17 17:09, Shalin
as
suggested but I just wanted to correct the wrong information I gave
earlier.
On Thu, Apr 20, 2017 at 6:23 PM, Andrea Gazzarini <gxs...@gmail.com> wrote:
> Perfect, I don't need NRT at this moment so that fits perfectly
>
> Thanks,
> Andrea
>
>
> On 20/04/17 14:37, Shalin Shekh
better to rely on the background merging
> instead of issuing explicit optimizes, but I think in this case one optimize
> in a day it shouldn't be a problem.
>
> Did I get you correctly?
>
> Thanks again,
> Andrea
>
>
> On 20/04/17 13:17, Shalin Shekhar Mangar wrote:
>
Can the client not send an optimize command explicitly after all
indexing/deleting is complete?
>
> Many thanks,
> Andrea
>
>
>
> On 20/04/17 11:11, Shalin Shekhar Mangar wrote:
>>
>> Comments inline:
>>
>>
>> On Wed, Apr 19, 2017 at 2:46 PM, Andrea G
I use send a request
>> with only suggest.q=... to my /suggest request handler and get
>> back distributed suggestions?
The SuggestComponent works in distributed mode and it will request and
merge results from all shards.
>>
>> Thanks in advance
>> Andrea
>
>
--
Regards,
Shalin Shekhar Mangar.
known issue? Ticket?
>
> Thanks,
> Markus
--
Regards,
Shalin Shekhar Mangar.
fields and the document size is about
>> >3KB.
>> >- Using SolrJ and SolrCloudClient, each batch to solr contains 500
>> docs.
>> >
>> > When I start my bulk indexer program the CPU utilization is 100% on each
>> > server but the rate of the indexer is about 1500 docs per second.
>> >
>> > I know that some solr benchmarks reached 70,000+ doc. per second.
>> >
>> > The question: What is the best way to determine the bottleneck on solr
>> > indexing rate?
>> >
>> > Thanks,
>> > Mahmoud
>>
--
Regards,
Shalin Shekhar Mangar.
ansactionLog$LogCodec.writeStr(Ljava/lang/String;)V
> at
> org.apache.solr.update.TransactionLog.writeCommit(TransactionLog.java:457)
>
>
> wunder
> Walter Underwood
> wun...@wunderwood.org
> http://observer.wunderwood.org/ (my blog)
>
>
--
Regards,
Shalin Shekhar Mangar.
tion.STATE_FORMAT, 1) == 1 ? null
> : ZkStateReader.getCollectionPath(cName);
>
> Any if that will be changed to default to version 2 anytime soon?
>
> thanks,
> Hendrik
--
Regards,
Shalin Shekhar Mangar.
;> privileged material. Any review, transmission, dissemination or other use,
>> or taking of any action in reliance upon this message by persons or entities
>> other than the intended recipient is prohibited and may be unlawful. If you
>> received this message in error, please contact the sender and delete it from
>> your computer.
>
>
--
Regards,
Shalin Shekhar Mangar.
i que tous les documents qui y sont attachés."
> **
> " This e-mail and any attached documents may contain confidential or
> proprietary information and may be subject to export control laws and
> regulations. If you are not the intended recipient, you are notified that
> any dissemination, copying of this e-mail and any attachments thereto or
> use of their contents by any means whatsoever is strictly prohibited.
> Unauthorized export or re-export is prohibited. If you have received this
> e-mail in error, please advise the sender immediately and delete this
> e-mail and all attached documents from your computer system."
> #
>
--
Regards,
Shalin Shekhar Mangar.
lr)
>>
>> My new place tells me they're sending requests to Zookeeper - and those are
>> getting sent on to Solr by Zookeeper - -- this is news to me if it's
>> true...
>>
>> Is there any documentation of exactly the role(s) played by Zookeeper in a
>> SolrCloud setup?
>>
--
Regards,
Shalin Shekhar Mangar.
monitored for security, legal,
> regulatory compliance and/or other appropriate reasons.
--
Regards,
Shalin Shekhar Mangar.
ensive mirroring
network for distributing releases. It is possible that the mirror you
are using may not have replicated the release yet. If that is the
case, please try another mirror. This also applies to Maven access.
--
Regards,
Shalin Shekhar Mangar.
work.
> >
> > this probably was introduced in a851d5f557aefd76c01ac23da076a14dc7576d8e
> > by Erick (not sure which one :) ) on July 2nd. Master still has this
> issue.
> > Would be great if this was fixed in the incoming 6.3...
> >
> > My cmd scripting is not too strong and I did not go further. I searched
> > Jira but found nothing. By the way is it not possible to open tickets in
> > Jira anymore?
> >
> > xavier
> >
>
--
Regards,
Shalin Shekhar Mangar.
> options. Nice.
>
> The new arrangement is a mess.
>
>
> Ari
>
>
>
> --
> -->
> Aristedes Maniatis
> GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A
>
--
Regards,
Shalin Shekhar Mangar.
cores for this query, notice these are ordered
> > > descending, the ones above are not, also notice the scores are
> identical to
> > > that of the result set itself.
> > >
> > > http://www.gezondheidenco.nl/179901/
> > > website-over-misofonie-online/">
> > > 153.9952 = sum of:
> > > 153.9952 = max plus 0.65 times others of:
> > > http://www.gezondheidenco.nl/tag/misofonie/;>
> > > 149.88002 = sum of:
> > > 149.88002 = max plus 0.65 times others of:
> > > http://www.gezondheidenco.nl/263802/
> misofonie-psychische-
> > > aandoening-is-behandelen/">
> > > 147.82175 = sum of:
> > > 147.82175 = max plus 0.65 times others of:
> > > http://www.gezondheidenco.nl/tag/
> ereniging-misofonie-nl/">
> > > 144.10309 = sum of:
> > > 144.10309 = max plus 0.65 times others of:
> > >
> > > I am completely surprised to see this crazy behaviour. But i vaguely
> > > remeber something about this before, but cannot find references.
> > >
> > > Any idea?
> > >
> > > Thanks,
> > > Markus
> > >
> >
> >
> >
> > --
> > Regards,
> > Shalin Shekhar Mangar.
> >
>
--
Regards,
Shalin Shekhar Mangar.
75 = max plus 0.65 times others of:
> http://www.gezondheidenco.nl/tag/ereniging-misofonie-nl/;>
> 144.10309 = sum of:
> 144.10309 = max plus 0.65 times others of:
>
> I am completely surprised to see this crazy behaviour. But i vaguely
> remeber something about this before, but cannot find references.
>
> Any idea?
>
> Thanks,
> Markus
>
--
Regards,
Shalin Shekhar Mangar.
. This also goes for Maven access.
--
Regards,
Shalin Shekhar Mangar.
-supp...@shoregrp.com immediately, and destroy this
> >> communication. Any unauthorized copying, disclosure or distribution
> >> of the material in this communication is strictly forbidden. Any
> >> views or opinions presented in this email are solely those of the
> >> aut
that you hadn't already
installed the service before already.
On Tue, Sep 13, 2016 at 12:53 AM, Shalin Shekhar Mangar <
shalinman...@gmail.com> wrote:
> Which version of red hat? Is lsof installed on this system?
>
> On Mon, Sep 12, 2016 at 4:30 PM, Preeti Bhat <preeti.b...@sho
of viruses. The company accepts no
> liability for any damage caused by any virus transmitted by this email.
>
>
>
--
Regards,
Shalin Shekhar Mangar.
that looks like the following:
"Could not download file"...
That one will have a more useful stack trace. Can you please find it and
paste it on email?
--
Regards,
Shalin Shekhar Mangar.
-v5-2-1-tp4294336.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
Regards,
Shalin Shekhar Mangar.
t;
>
> UpdateLog
>
>
>
> Starting log replay tlog{file=E:\solr_home\transcribedReports_shard1_
> replica2\data\tlog\tlog.005 refcount=2} active=true
> starting pos=20222
>
> 9/1/2016, 12:37:10 PM
>
>
>
> WARN false
>
>
>
>
>
> UpdateLog
>
>
>
> Log replay finished. recoveryInfo=RecoveryInfo{adds=10 deletes=0
> deleteByQuery=1 errors=0 positionOfStart=20222}
>
> 9/1/2016, 12:37:10 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Could not publish as ACTIVE after succesful recovery
>
> 9/1/2016, 12:37:10 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Recovery failed - trying again... (0)
>
> 9/1/2016, 12:37:37 PM
>
>
>
> WARN false
>
>
>
>
>
> UpdateLog
>
>
>
> Starting log replay tlog{file=E:\solr_home\transcribedReports_shard1_
> replica2\data\tlog\tlog.006 refcount=2} active=true
> starting pos=0
>
> 9/1/2016, 12:37:38 PM
>
>
>
> WARN false
>
>
>
>
>
> UpdateLog
>
>
>
> Log replay finished. recoveryInfo=RecoveryInfo{adds=2 deletes=0
> deleteByQuery=0 errors=0 positionOfStart=0}
>
> 9/1/2016, 12:37:41 PM
>
>
>
> WARN false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Stopping recovery for core=[transcribedReports_shard1_replica2]
> coreNodeName=[core_node14]
>
> 9/1/2016, 12:42:13 PM
>
>
>
> WARN false
>
>
>
>
>
> UpdateLog
>
>
>
> Starting log replay tlog{file=E:\solr_home\transcribedReports_shard1_
> replica2\data\tlog\tlog.007 refcount=2} active=true
> starting pos=1748
>
> 9/1/2016, 12:42:14 PM
>
>
>
> WARN false
>
>
>
>
>
> UpdateLog
>
>
>
> Log replay finished. recoveryInfo=RecoveryInfo{adds=12 deletes=0
> deleteByQuery=0 errors=0 positionOfStart=1748}
>
> 9/1/2016, 12:42:14 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Could not publish as ACTIVE after succesful recovery
>
> 9/1/2016, 12:42:14 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Recovery failed - trying again... (0)
>
> 9/1/2016, 12:42:43 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Could not publish as ACTIVE after succesful recovery
>
> 9/1/2016, 12:42:43 PM
>
>
>
> ERROR false
>
>
>
>
>
> RecoveryStrategy
>
>
>
> Recovery failed - trying again... (0)
>
>
>
> *Jon Hawkesworth*
> Software Developer
>
>
>
>
>
> Hanley Road, Malvern, WR13 6NP. UK
>
> O: +44 (0) 1684 312313
>
> *jon.hawkeswo...@mmodal.com <jon.hawkeswo...@mmodal.com> www.mmodal.com
> <http://www.medquist.com/>*
>
>
>
> *This electronic mail transmission contains confidential information
> intended only for the person(s) named. Any use, distribution, copying or
> disclosure by another person is strictly prohibited. If you are not the
> intended recipient of this e-mail, promptly delete it and all attachments.*
>
>
>
--
Regards,
Shalin Shekhar Mangar.
> AbstractConnection.java:540)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:635)
> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(
> QueuedThreadPool.java:555)
> at java.lang.Thread.run(Thread.java:745)
>
>
> KATHERINE MORA
> Senior Engineer
>
>
--
Regards,
Shalin Shekhar Mangar.
>
> >- *sample_shard1_replica1:* org.apache.solr.common.cloud.
> >ZooKeeperException:org.apache.solr.common.cloud.ZooKeeperException:
> >Specified config does not exist in ZooKeeper: sample.
> >
> >
> > Please let me know what i'm missing.
> >
> > Regards,
> > Naveen Reddy.
> >
>
--
Regards,
Shalin Shekhar Mangar.
>
> My idea is, if 8 DIHs use 8 CPUs then I have 8 CPUs left for merging
> (maxIndexingThreads/maxMergeAtOnce/mergeFactor).
> It should do no commit, no optimize.
> ramBufferSizeMB is high because I have plenty of RAM and I want make use
> the speed of RAM.
> segmentsPerTier is high to reduce merging.
>
> But somewhere is a misconfiguration because indexing gets stalled.
>
> Any idea what's going wrong?
>
>
> Bernd
>
>
>
>
>
--
Regards,
Shalin Shekhar Mangar.
d on that machine.
>
> Performing a netstat reveals that the FDC mostly consists of
> TCP-connections in the state of "CLOSE_WAIT".
>
>
>
--
Regards,
Shalin Shekhar Mangar.
a
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-Merge-Index-tp4286081.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
--
Regards,
Shalin Shekhar Mangar.
(FutureTask.java:166)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:724)
>
> please help me, look forward to your reply. Thanks a lot!
>
> Best Regards!
> Kent
>
--
Regards,
Shalin Shekhar Mangar.
; connection, I wonder if this pattern is OK. Once I shutdown the zookeeper,
> the application can not do the solr query, the error as "no live
> SolrServers available to handle this request".
>
> so I need to restart our connection to reconnect solrcloud.
>
> as we use the singleton pattern, we do not use the method of "shutdown" to
> release the solrserver connection, will this be a problem? or we need to
> create the connection on demand every time?
>
>
> please help me, look forward to your reply. Thanks a lot!
>
>
> Best Regards!
> Kent Mu
>
--
Regards,
Shalin Shekhar Mangar.
ould guess after about 200MB (4.2GB % 2GB).
>
>
> Long story short: Keep your posts below 2GB.
>
> - Toke Eskildsen, State and University Library, Denmark
>
>
>
--
Regards,
Shalin Shekhar Mangar.
e1":{
> "core":"search_shard2_replica1",
> "base_url":"http://idx4.oi.dev:8983/solr;,
> "node_name":"idx4.oi.dev:8983_solr",
> "state":"down"},
> "core_node2":{
> "core":"search_shard2_replica2",
> "base_url":"http://idx6.oi.dev:8983/solr;,
> "node_name":"idx6.oi.dev:8983_solr",
> "state":"down"},
> "core_node4":{
> "core":"search_shard2_replica3",
> "base_url":"http://idx1.oi.dev:8983/solr;,
> "node_name":"idx1.oi.dev:8983_solr",
> "state":"active",
> "leader":"true",
> "router":{"name":"compositeId"},
> "maxShardsPerNode":"1",
> "autoAddReplicas":"false"}}
>
>
>
>
--
Regards,
Shalin Shekhar Mangar.
t;> > On Thu, Apr 7, 2016 at 6:56 PM, Erick Erickson <
> erickerick...@gmail.com
> >> <mailto:erickerick...@gmail.com>> wrote:
> >> > What does your configuration file look like for the replication
> >> > handler? Does this happen whenever you restart a slave even if
> >> > _nothing_ has changed on the master?
> >> >
> >> > And this will certainly happen if you're optimizing the master before
> >> > you restart, although that doesn't sound likely.
> >> >
> >> > Best,
> >> > Erick
> >> >
> >> > On Thu, Apr 7, 2016 at 6:54 AM, Lior Sapir <lior.sa...@gmail.com
> >> <mailto:lior.sa...@gmail.com>> wrote:
> >> > > Solr slave is doing full replication (entire index) of index after
> >> master
> >> > > restart
> >> > > Using solr 5.3.1 not cloud (using maser slave architecture ) I see
> >> that
> >> > > slave replicates entire index after master restart even though the
> >> index
> >> > > version is the same
> >> > >
> >> > > This is bad for me since the slave which is doing serving replicates
> >> 80gb
> >> > > if I restart the server and our service is down
> >> > >
> >> > > I attached a file with some snippets of the slave log before and
> >> after the
> >> > > master restart.
> >> > >
> >> > > Is there some default configuration issue causing this problem?
> >> > > Both indexes master and slave were not updated for sure before and
> >> after the
> >> > > master restart.
> >> > > The index version stayed exactly the same.
> >> > >
> >> > >
> >> > >
> >> >
> >> >
> >>
> >>
> >
>
--
Regards,
Shalin Shekhar Mangar.
mails and attachments from TradeStone Software, Inc. are confidential.
> If you are not the intended recipient, please notify the sender
> immediately by
> replying to the e-mail, and then delete it without making copies or using
> it
> in any way. No representation is made that this email or any attachments
> are
> free of viruses. Virus scanning is recommended and is the responsibility of
> the recipient.
--
Regards,
Shalin Shekhar Mangar.
lr/tree/master/solr/core/src/test/org/apache/solr
>
> On Mon, Apr 11, 2016 at 12:24 PM, Shalin Shekhar Mangar <
> shalinman...@gmail.com> wrote:
>
> > Please use MiniSolrCloudCluster instead of EmbeddedSolrServer for
> > unit/integration tests.
> >
> &g
not the intended recipient you may
> not use, disclose, distribute, copy, print or rely on this email.
>
> Email transmission cannot be guaranteed to be secure or error free, as
> information may be intercepted, corrupted, lost, destroyed, arrive late or
> incomplete or contain viruses. This email and any files attached to it have
> been checked with virus detection software before transmission. You should
> nonetheless carry out your own virus check before opening any attachment.
> GOSS Interactive Ltd accepts no liability for any loss or damage that may
> be caused by software viruses.
>
>
>
--
Regards,
Shalin Shekhar Mangar.
1 - 100 of 1747 matches
Mail list logo
