Re: issue with 5.3.1 and index version

2016-03-31 Thread Shalin Shekhar Mangar
wn bug? > > #strings segments_9 > > segments > > Lucene54 > > commitTimeMSec > > 1459374733276 > > > > > -- > Bill Bell > billnb...@gmail.com > cell 720-256-8076 > -- Regards, Shalin Shekhar Mangar.

Re: Solr Managed Schema by Default in 5.5

2016-03-11 Thread Shalin Shekhar Mangar
t;> wouldn't need to upload anything to zookeeper, the change would already >> be there -- but you'd have to take an extra step (retrieving from >> zookeeper) to make sure it's in version control. >> >> My recommendation is to just keep using version control as you have >> been, which you can do with either the Classic or Managed schema. The >> filename for the schema would change with the managed version, but >> nothing else. >> >> Thanks, >> Shawn >> >> -- Regards, Shalin Shekhar Mangar.

Re: ramBufferSizeMB and maxIndexingThreads

2016-01-19 Thread Shalin Shekhar Mangar
mum value no matter how > maxIndexingThreads I have, or is it multiplied by the number if indexing > threads? So, if I have ramBufferSizeMB set to 100 MB, and 8 indexing > threads, does this mean the total ram buffer will be 100 MB or 800 MB ? > > Thanks > Angel -- Regards, Shalin Shekhar Mangar.

Re: Solr cluster doesn't recover from a ZK disconnect if collection.reload() was issued

2016-01-14 Thread Shalin Shekhar Mangar
l -SIGSTOP and then in 2 min kill -SIGCONT >> >> 4. solr2 shard replicas are *Down *forever. No recovery. >> >> If we omit step #2, the cluster recovers as expected. >> -- Regards, Shalin Shekhar Mangar.

Re: Changing Solr Schema with Data

2015-12-28 Thread Shalin Shekhar Mangar
gt; data that I don't want to delete. Is there a way where I can change the >> > schema of the index while keeping the data intact? >> > >> > Regards, >> > Salman >> -- Regards, Shalin Shekhar Mangar.

Re: Collection API migrate statement

2015-12-15 Thread Shalin Shekhar Mangar
ca2 > INFO - 2015-12-15 14:43:19.199; [ ] > org.apache.solr.update.DirectUpdateHandler2; start mergeIndexes{} > > As there are no errors in the target collection, am I right in assuming the > timeout occured because the merge took too long? If that is so, how to I > inc

Re: Getting a document version back after updating

2015-12-12 Thread Shalin Shekhar Mangar
it is possible to get the version without making one more >> extra call getById. Can I get that as part of the update response when I am >> updating or adding a new document? >> On Dec 12, 2015 3:28 PM, "Shalin Shekhar Mangar" >> wrote: >> >>> You wi

Re: Solr Cloud 5.3.0 Read Time Outs

2015-12-12 Thread Shalin Shekhar Mangar
he maxWarmingSearchers error possibly cause the read timeouts to occur? > If yes, when maxWarmingSearchers warning is addressed, will that remove the > errors for the read timeouts? > > Best regards, > Adrian > -- Regards, Shalin Shekhar Mangar.

Re: Getting a document version back after updating

2015-12-12 Thread Shalin Shekhar Mangar
nse after > adding or updating the document via Solrj 5.2.1? -- Regards, Shalin Shekhar Mangar.

Re: Unable to create lot of cores -- Failing after 100 cores

2015-12-11 Thread Shalin Shekhar Mangar
t; > Hello all, > > > > We need to create around 300 collections with replication factor 2. But > > after creating 100, we couldn't create more and most of them are in RED > > state in the solrcloud. > > > > Is this issue related to zookeeper jute.maxBuffer issue? If so, how can > > we increase the size of zookeeper maxbuffer and memory size. > > > > Thanks > > Venkat > > > > -- Regards, Shalin Shekhar Mangar.

Re: Authorization API versus zkcli.sh

2015-12-11 Thread Shalin Shekhar Mangar
e that the only acceptable way to create security.json is >>> to load a minimal version with zkcli.sh and then to build the remaining >>> components with the Authentication API and the Authorization API (in a >>> script, if one wants to automate the process: although such a script would >>> have to include plain-text passwords)? >>> >>> I figured there is no harm in asking. >>> >> >> >> >> -- >> Anshum Gupta > > > > -- > - > Noble Paul -- Regards, Shalin Shekhar Mangar.

Re: Solr Integration tests

2015-12-10 Thread Shalin Shekhar Mangar
>>> with these two files in a folder, Is it possible to run an Integration >>>>Test >>>> ? >>>> >>>> Any pointers/suggestions ? I tried running test case pointing it to the >>>> parent folder but got an error >>>> >>>> java.lang.AssertionError: fix your classpath to have >>>>tests-framework.jar >>>> before lucene-core.jar >>>> >>>> And I cannot seem to fix the above either. Am using gradle and actually >>>>do >>>> have test-framework as the first dependency. >>>> >>>> >>>> >> > -- Regards, Shalin Shekhar Mangar.

Re: Protect against duplicates with the Migrate statement

2015-12-03 Thread Shalin Shekhar Mangar
Duplication) but I still > end up with duplicates in the ColdDocuments collection. > > > > Does anyone have any suggestions on how I can protect against duplicates with > the migrate statement? Any ideas would be greatly appreciated. > > > Many thanks > > Philippa -- Regards, Shalin Shekhar Mangar.

Re: Solr Collections Migrate statement

2015-11-24 Thread Shalin Shekhar Mangar
d documents be deleted? > > > Many thanks > > Philippa -- Regards, Shalin Shekhar Mangar.

Re: Using facets and stats with solr v4

2015-11-20 Thread Shalin Shekhar Mangar
true > > > > It also seems this isnt avilable for lower verison (v4), so is there anyway > to acheive similar as we as stuck on v4? > > Any help / advice / pointers would be great! - thanks in advance > > Ian > > > -- Regards, Shalin Shekhar Mangar.

Re: Solr.cmd cannot create collection in Solr 5.2.1

2015-10-26 Thread Shalin Shekhar Mangar
ectory. This is somewhat counterintuitive when compared to >> what happens when NOT running in cloud mode, but the logic is fairly >> simple: The conf directory is what gets uploaded to zookeeper. >> >> A question for fellow committers: Is it too much handholding for us to >> look in a conf directory in zookeeper? My bias is that we should not do >> that, but I do not see it as particularly harmful. > > Or to have the upconfig command barf if there isn't a solrconfig.xml > file in the directory concerned. That'd give quick feedback that > something is being done wrong. > > Upayavira -- Regards, Shalin Shekhar Mangar.

Re: missing in json facet does not work for stream?

2015-10-23 Thread Shalin Shekhar Mangar
I see, thanks! On Fri, Oct 23, 2015 at 8:08 PM, Yonik Seeley wrote: > On Fri, Oct 23, 2015 at 10:24 AM, Shalin Shekhar Mangar > wrote: >> Now I am curious, what does it do! > > It's basically like facet.method=enum, but it truly streams > (calculates each facet bucke

Re: missing in json facet does not work for stream?

2015-10-23 Thread Shalin Shekhar Mangar
it designed or a known issue? > > You found an undocumented feature (method=stream) ;-) > That facet method doesn't have adequate testing yet, so I haven't > publicized / documented it. > Support for things like "missing" may be some of the stuff still TBD. > > -Yonik -- Regards, Shalin Shekhar Mangar.

Re: Get this committed

2015-10-23 Thread Shalin Shekhar Mangar
ll > billnb...@gmail.com > cell 720-256-8076 -- Regards, Shalin Shekhar Mangar.

Re: locks and high CPU

2015-10-22 Thread Shalin Shekhar Mangar
tionFilterChain.doFilter(ApplicationFilterChain.java:210)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/core/StandardWrapperValve.invoke(StandardWrapperValve.java:222)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/core/StandardContextValve.invoke(StandardContextValve.java:123)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/core/StandardHostValve.invoke(StandardHostValve.java:171)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/valves/ErrorReportValve.invoke(ErrorReportValve.java:99)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/valves/AccessLogValve.invoke(AccessLogValve.java:953)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/core/StandardEngineValve.invoke(StandardEngineValve.java:118)[optimized] >>>>> at >>>>> >>>>> org/apache/catalina/connector/CoyoteAdapter.service(CoyoteAdapter.java:408)[optimized] >>>>> at >>>>> >>>>> org/apache/coyote/http11/AbstractHttp11Processor.process(AbstractHttp11Processor.java:1023)[optimized] >>>>> at >>>>> >>>>> org/apache/coyote/AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:589)[optimized] >>>>> at >>>>> >>>>> org/apache/tomcat/util/net/JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)[optimized] >>>>> ^-- Holding lock: >>>>> org/apache/tomcat/util/net/SocketWrapper@0x496e58810[thin lock] >>>>> at >>>>> >>>>> java/util/concurrent/ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)[inlined] >>>>> at >>>>> >>>>> java/util/concurrent/ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)[optimized] >>>>> at java/lang/Thread.run(Thread.java:682)[optimized] >>>>> at jrockit/vm/RNI.c2java(J)V(Native Method) -- Regards, Shalin Shekhar Mangar.

Re: `cat /dev/null > solr-8983-console.log` frees host's memory

2015-10-21 Thread Shalin Shekhar Mangar
exactly as it should. The OS had simply cached a >> large chunk of the logfile, exactly as it is designed to do, and once >> the file was deleted, it stopped reserving that memory and made it >> available. >> >> https://en.wikipedia.org/wiki/Page_cache >> >> Thanks, >> Shawn >> -- Regards, Shalin Shekhar Mangar.

Re: CloudSolrClient send routed update/delete by query

2015-10-20 Thread Shalin Shekhar Mangar
r.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234) > at > org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226) > at > org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376) > at > org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328) > at > org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1098) > at > org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:869) > . . . -- Regards, Shalin Shekhar Mangar.

Re: Blob store, blob size & storage mechanism

2015-10-20 Thread Shalin Shekhar Mangar
t; Okay, thx. I heard it mentioned at Lucene Revolution as a location for >> storing machine learning models. Do people really have models coming in >> at under 2Mb? >> >> It'd be good to get this limitation into the BlobStore docs. >> >> Upayavira >> >

Re: Blob store, blob size & storage mechanism

2015-10-20 Thread Shalin Shekhar Mangar
ed uses of the blob store, > putting GB of data in it scares me a little. Is it reasonable and does > it work? > > Upayavira -- Regards, Shalin Shekhar Mangar.

Re: Replication and soft commits for NRT searches

2015-10-13 Thread Shalin Shekhar Mangar
that any dissemination, copying of this e-mail and any attachments > thereto or use of their contents by any means whatsoever is strictly > prohibited. If you have received this e-mail in error, please advise the > sender immediately and delete this e-mail and all attached documents from > your computer system." > # -- Regards, Shalin Shekhar Mangar.

Re: OverseerCollectionMessageHandler logging

2015-10-09 Thread Shalin Shekhar Mangar
itoring systems can trigger warnings all over > the place. Is there a specific reason for this, or should I change it to > INFO? > > Alan Woodward > www.flax.co.uk > > -- Regards, Shalin Shekhar Mangar.

Re: faceting is unusable slow since upgrade to 5.3.0

2015-09-21 Thread Shalin Shekhar Mangar
' (with reindexing) makes no remarkable difference > - 'softCommit' isn't used > > My enviroment is > OS: Solaris 5.11 on AMD64 > JDK: 1.8.0_25 and 1.8.0_60 (same behavior) > JavaOpts: -Xmx 10g -XX:+UseG1GC -XX:+AggressiveOpts -XX:+UseLargePages > -XX:LargePageSizeInBytes=2m > > Any help/advice is welcome > Uwe -- Regards, Shalin Shekhar Mangar.

Re: solr4.7: leader core does not elected to other active core after sorl OS shutdown, known issue?

2015-09-21 Thread Shalin Shekhar Mangar
solr"}}}, > > Is this something known bug in 4.7 and late on fixed? Any reference JIRA we > can study about? If the solr service is stopped gracefully, we can see > leader core election happens and switched to other active core. But if we > just directly shutdown a Solr OS, we can reproduce in our environment that > some "Down" cores remains "leader" at ZK clusterstate.json -- Regards, Shalin Shekhar Mangar.

Re: Solr4.7: tlog replay has a major delay before start recovering transaction replay

2015-09-21 Thread Shalin Shekhar Mangar
true starting pos=25981 > WARN - 2015-09-16 20:22:53.301; > org.apache.solr.update.UpdateLog$LogReplayer; Log replay finished. > recoveryInfo=RecoveryInfo{adds=914 deletes=215 deleteByQuery=0 errors=0 > positionOfStart=25981} > > Thank you all~ -- Regards, Shalin Shekhar Mangar.

Re: Does more shards in core improve performance?

2015-09-16 Thread Shalin Shekhar Mangar
taking the same amount of time to do the indexing. > > Currently, both my shards are in the same machine. Will the performance be > improved if the shards are located in different machine? > > > Regards, > Edwin -- Regards, Shalin Shekhar Mangar.

Re: Exception in SolrResponseBase.getQTime

2015-09-16 Thread Shalin Shekhar Mangar
header = response.getResponseHeader(); if (header != null) { qtime = ((Number) header.get("QTime")).intValue(); } On Wed, Sep 16, 2015 at 12:09 PM, Shalin Shekhar Mangar wrote: > Hi Gauri, > > Can you give more details on when this happens? Which Solr version? > Also, c

Re: Exception in SolrResponseBase.getQTime

2015-09-15 Thread Shalin Shekhar Mangar
collection in similar way and they do have > the similar solrconfig...exactly same. > > Could you please help me out on this? > > -- > Regards, > Gauri Shankar -- Regards, Shalin Shekhar Mangar.

Re: Loading Solr Analyzer from RuntimeLib Blob

2015-09-10 Thread Shalin Shekhar Mangar
jar is loaded on the classpath before > the schema is loaded? > > Thanks for the help, > > -Steve -- Regards, Shalin Shekhar Mangar.

Re: Error in creating a new collection

2015-09-03 Thread Shalin Shekhar Mangar
ode=1&collection.configName=test3 > > { > "responseHeader":{ > "status":0, > "QTime":3175}, > "success":{"":{ > "responseHeader":{ > "status":0, > "QTime":3040}, > "core":"test3_shard1_replica1"}}} > > So I'm thinking about a "lock" problem or something like that. > > Could you help me please? > > Thank you very much! > Bye -- Regards, Shalin Shekhar Mangar.

Re: how to extend JavaBinCodec and make it available in solrj api

2015-08-08 Thread Shalin Shekhar Mangar
Or use the XsltResponseWriter :) On Sat, Aug 8, 2015 at 7:51 PM, Shalin Shekhar Mangar wrote: > No, I'm afraid you will have to extend the XmlResponseWriter in that case. > > On Sat, Aug 8, 2015 at 2:02 PM, Dmitry Kan wrote: >> Shalin, >> >> Thanks, can I also i

Re: how to extend JavaBinCodec and make it available in solrj api

2015-08-08 Thread Shalin Shekhar Mangar
ighlighter with more nested levels, >> > than just one. Something like this (in xml representation): >> > >> > >> > >> > >> > >> > >> > id1 >> > >> > Snippet text go

Re: how to extend JavaBinCodec and make it available in solrj api

2015-08-07 Thread Shalin Shekhar Mangar
> > id1 > > Snippet text goes here > > > > > > > > > > > Can this be modelled with existing types? > > > On Thu, Aug 6, 2015 at 9:47 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com> wrote: >

Re: how to extend JavaBinCodec and make it available in solrj api

2015-08-06 Thread Shalin Shekhar Mangar
the api? Is there plugin framework > such that JavaBinCodec is extended and used for the new data structure? > > > > -- > Dmitry Kan > Luke Toolbox: http://github.com/DmitryKey/luke > Blog: http://dmitrykan.blogspot.com > Twitter: http://twitter.com/dmitrykan > SemanticAnalyzer: www.semanticanalyzer.info -- Regards, Shalin Shekhar Mangar.

Re: Issue when zookeeper session expires during shard leader election.

2015-07-28 Thread Shalin Shekhar Mangar
t; > I have a patch in testing that does this, and I think addresses the problem. > > What is the general process for this? I didn’t want to reopen a close Jira > item. Should I create a new one so the issue and the proposed fix can be > discussed? > > Thanks. > > Mike. > > -- Regards, Shalin Shekhar Mangar.

Re: Programmatically find out if node is overseer

2015-07-17 Thread Shalin Shekhar Mangar
than one node. Does it mean that these nodes were designated > potential 'overseers', but OVERSEERSTATUS' will return the actual one? Yes, the OVERSEERSTATUS will return the current (actual) leader always. > > Shai > > On Fri, Jul 17, 2015 at 10:11 PM, Shalin Shekha

Re: Programmatically find out if node is overseer

2015-07-17 Thread Shalin Shekhar Mangar
Overseers in a single cluster >> >> How can multiple Overseers happen? And what are the consequences? >> >> Regards >> >> > On 17 Jul 2015, at 19:37, Anshum Gupta wrote: >> > >> > ideally, there shouldn't be a point where you have multiple active >> > Overseers in a single cluster >> > > > > -- > Anshum Gupta -- Regards, Shalin Shekhar Mangar.

Re: Distributed queries hang in a non-SolrCloud environment, Solr 4.10.4

2015-07-02 Thread Shalin Shekhar Mangar
lient usage, ruling out a hardware issue. > > Does anyone have any suggestions for potential avenues of attack for getting > to the bottom of this? Or are there any known issues that could be implicated > in this? > > - Ronald S. Wood -- Regards, Shalin Shekhar Mangar.

Re: Bug: replies mixed up with concurrent requests from the same host

2015-07-01 Thread Shalin Shekhar Mangar
at case, everything works well. > > I had already noticed that bug in mozilla. I have a bookmark folder with a > bunch of test requests, and when I click on the "open all in tabs" button, > the result from requests appears in the tab for another one, in a random > fashion. > > Regards, > Kevin > > > > > -- Regards, Shalin Shekhar Mangar.

Re: SolrCloud Document Update Problem

2015-06-29 Thread Shalin Shekhar Mangar
ents have the same > unique ID. One document with old values and another one with new values. > It happens only we update the document. > > Please suggest or guide... > > Rgds -- Regards, Shalin Shekhar Mangar.

Re: suggester returning stems instead of whole words

2015-06-17 Thread Shalin Shekhar Mangar
t;>>that you might be picking up? >>> >>>Best, >>>Erick >>> >>>On Wed, Jun 17, 2015 at 6:50 AM, Alistair Young >>> wrote: >>>> yep did both of those things. Getting the same results as using >>>>dc.subject >>

Re: ZooKeeper connection refused

2015-06-17 Thread Shalin Shekhar Mangar
Is ZK healthy? Can you try the following from the server on which Solr is running: echo ruok | nc zk1 2181 On Wed, Jun 17, 2015 at 7:25 PM, shacky wrote: > 2015-06-17 15:34 GMT+02:00 Shalin Shekhar Mangar : >> You are asking telnet to connect to zk1 on port 2181 but you have not >

Re: suggester returning stems instead of whole words

2015-06-17 Thread Shalin Shekhar Mangar
;>it's returning 'technolog' , 'temperatur' and 'tutori' >>> >>>using this config: >>> >>> >>> >>> suggest >>> >>name="classname">org.apache.solr.spelling.suggest.Suggester >>> >>name="lookupImpl">org.apache.solr.spelling.suggest.fst.WFSTLookupFactory< >>>/ >>>str> >>> dc.subject >>> 0.005 >>> true >>> >>> >>> >>name="/suggest"> >>> >>> true >>> suggest >>> true >>> 10 >>> true >>> >>> >>> suggest >>> >>> >>> >>>thanks, >>> >>>Alistair >>> >>>-- >>>mov eax,1 >>>mov ebx,0 >>>int 80h >> > -- Regards, Shalin Shekhar Mangar.

Re: ZooKeeper connection refused

2015-06-17 Thread Shalin Shekhar Mangar
eper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) > > I can telnet to the ZooKeeper port: > > root@index1:~# telnet zk1 2181 > Trying 192.168.70.31... > Connected to index1.dc.my.network. > Escape character is '^]'. > > Could you help me please? > > Thank you very much! > Bye -- Regards, Shalin Shekhar Mangar.

Re: Dedupe in a SolrCloud

2015-06-17 Thread Shalin Shekhar Mangar
quest handler or write a second request Handler which I only use if I > want set the signature field. > I know I can do that manually when Im using eg curl but is it also possible > with SolrJ? :) > > > Thanks, > Markus > > > > -- Regards, Shalin Shekhar Mangar.

[ANNOUNCE] Apache Solr 5.2.1 released

2015-06-15 Thread Shalin Shekhar Mangar
ork for distributing releases. It is possible that the mirror you are using may not have replicated the release yet. If that is the case, please try another mirror. This also goes for Maven access. Happy searching! -- Shalin Shekhar Mangar on behalf of the Lucene PMC.

Re: Limitation on Collections Number

2015-06-14 Thread Shalin Shekhar Mangar
some > > > limit has been reached. > > > These tests are done on a single node + an additional node for replica. > > > > > > Can someone elaborate on what could limit Solr to a high number of > > > collections (if at all)? > > > i.e. if we wanted to have 5K or 10K (or 100K) collections, is there > > > anything in Solr that can prevent it? Where would it break? > > > > > > Thanks, > > > Arnon > > > -- Regards, Shalin Shekhar Mangar.

Re: SolrCloud and configuration files on ZooKeeper

2015-06-08 Thread Shalin Shekhar Mangar
reated a new collection with the following SOLR command: > > ./solr create_collection -c test -replicationFactor 3 > > I also tried to list the configuration in the ZooKeeper's CLI: > > [zk: 127.0.0.1:2181(CONNECTED) 4] ls /configs/test > [currency.xml, protwords.txt, managed-schema, solrconfig.xml, synonyms.txt, > elevate.xml, stopwords.txt, params.json, lang] > > But... Where is the schema.xml file? > -- Regards, Shalin Shekhar Mangar.

Re: Complete list of parameters in request handlers

2015-06-08 Thread Shalin Shekhar Mangar
will read and update request handlers. Beside the top > level key / value parameters, I came across "defaults", "invariants" and > "appends" as list items. Are there any others I should be looking for? > Where can I find the complete list? > > Thanks > > Steve > -- Regards, Shalin Shekhar Mangar.

Re: Problems while setting classpath (while upgrading to Solr 5.1 from Solr 4.X)

2015-06-04 Thread Shalin Shekhar Mangar
, it will default to server/solr in the root of > > the extracted download. > > > > In the solr home, create a "lib" directory. Put all extra or contrib > > jars required by Solr there. Start Solr. > > > > That's it. All jars included in the lib directory that you created are > > automatically loaded by Solr. You do not need any directives in > > your solrconfig.xml file. > > > > Thanks, > > Shawn > > > > > -- Regards, Shalin Shekhar Mangar.

Re: Peer Sync fails when newly added node is elected leader.

2015-06-04 Thread Shalin Shekhar Mangar
2015-06-04 14:26:11.153 -0700 (,,,) coreZkRegister-1-thread-3 : INFO > org.apache.solr.cloud.ZkController - I am the leader, no recovery necessary > > This seems like a fairly common scenario. So I suspect, either I am doing > something incorrectly, or I have an incorrect assumption about how this is > supposed to work. > > Does anyone have any suggestions? > > Thanks > > Mike. > -- Regards, Shalin Shekhar Mangar.

Re: Clarification on Collections API for 5.x

2015-05-27 Thread Shalin Shekhar Mangar
ot using the collections API may still > >>>work in 5.0, it is unsupported, not recommended, and the behavior will > >>>change in a 5.x release." > >>> > >>>Currently, we launch several solr nodes with identical cores defined > >>>using the new Core Discovery process. These nodes are also connected to > >>>a > >>>zookeeper ensemble. Part of the core definition is to set the configSet > >>>to use. This configSet is uploaded to zookeeper separately. This > >>>effectively creates a Collection. > >>> > >>>Is this method no long supported in 5.x? > >>> > >>>Thanks! > >>>Jim Musil > >>> > >> > > -- Regards, Shalin Shekhar Mangar.

Re: Deduplication

2015-05-20 Thread Shalin Shekhar Mangar
have xyz and MyCustomUpdateProc to run on each replica (including the leader) right before the doc is indexed (i.e. just before RunUpdateProcessor) Unfortunately, due to an oversight, this feature hasn't been documented well which is something I'll fix. See https://issues.apache.org/jira/browse/SOLR-6892 for more details. > > Thx, > > - Bram > > -- Regards, Shalin Shekhar Mangar.

Re: Problem with numeric "math" types and the dataimport handler

2015-05-19 Thread Shalin Shekhar Mangar
ther index (building from a different database) where this > isn't happening, because the MySQL column is *NOT* unsigned, which > causes the JDBC driver to use java.lang.Long instead of > java.math.BigInteger. > > Thanks, > Shawn > > -- Regards, Shalin Shekhar Mangar.

Re: JSON

2015-05-19 Thread Shalin Shekhar Mangar
Someone just opened https://issues.apache.org/jira/browse/SOLR-7574 which is exactly what you experienced. On Tue, May 19, 2015 at 8:34 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > That sounds reasonable. Please open a Jira issue. > > On Sat, May 16, 2015 at 9:22 A

Re: JSON

2015-05-19 Thread Shalin Shekhar Mangar
you don't send any > body. > We could catch that error earlier perhaps, but it still looks like an > error? > > -Yonik > > -- > Bill Bell > billnb...@gmail.com > cell 720-256-8076 > -- Regards, Shalin Shekhar Mangar.

Re: utility methods to get field values from index

2015-05-12 Thread Shalin Shekhar Mangar
using stored fields and was wondering if this approach > would be faster. > > Apologies if this is too much to ask for. > > Parvesh Garg, > -- Regards, Shalin Shekhar Mangar.

Re: Best way to backup and restore an index for a cloud setup in 4.6.1?

2015-05-11 Thread Shalin Shekhar Mangar
d indexes on another set of servers? > > We are not sharding if that makes any difference. > > Thanks, > g10vstmoney > -- Regards, Shalin Shekhar Mangar.

Re: SolrJ vs. plain old HTTP post

2015-05-11 Thread Shalin Shekhar Mangar
better for the job: SolrJ or plain old HTTP > post? > > > > > > In other word, what are the advantages of using SolrJ when the need is > to > > > push data to Solr for indexing? > > > > > > Thanks, > > > > > > Steve > > > > > -- Regards, Shalin Shekhar Mangar.

Re: Finding out optimal hash ranges for shard split

2015-05-06 Thread Shalin Shekhar Mangar
he users can then use this > shard ranges for the actual split? > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Finding-out-optimal-hash-ranges-for-shard-split-tp4203609p4204100.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Regards, Shalin Shekhar Mangar.

Re: Finding out optimal hash ranges for shard split

2015-05-05 Thread Shalin Shekhar Mangar
5.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Regards, Shalin Shekhar Mangar.

Re: Collections API Overseer status and statistics

2015-04-30 Thread Shalin Shekhar Mangar
r more information please visit http://www.mimecast.com > > ----------- > -- Regards, Shalin Shekhar Mangar.

Re: Async deleteshard commands?

2015-04-28 Thread Shalin Shekhar Mangar
not run async: > > > > > 0 > 16 > > > > > And in addition REQUESTSTATUS calls for that requestId fail with "Did not > find taskid [12-foo-4] in any tasks queue". > > Synchronous deletes are causing problems for me in production as they are > timing out in some cases. > > Thanks, > Ian > > > p.s. I'm on version 5.0.0 > -- Regards, Shalin Shekhar Mangar.

Re: Overseer role in solrCloud

2015-04-28 Thread Shalin Shekhar Mangar
if in 'down' state (because it doesn't need to). > > Thanks in advance for helping me understand solrCloud intern state change > mechanism. > > -- > -- Regards, Shalin Shekhar Mangar.

Re: Can we have [core name] in each log entry?

2015-04-21 Thread Shalin Shekhar Mangar
> Stefan Moises > > *** > Stefan Moises > Senior Softwareentwickler > Leiter Modulentwicklung > > shoptimax GmbH > Ulmenstrasse 52 H > 90443 Nürnberg > Amtsgericht Nürnberg HRB 21703 > GF Friedrich Schreieck > > Fax: 0911/25566-29 > moi...@shoptimax.de > http://www.shoptimax.de > *** > > -- Regards, Shalin Shekhar Mangar.

Re: Replication for SolrCloud

2015-04-18 Thread Shalin Shekhar Mangar
> уважением > > *i.A. Jürgen Wagner* > > Head of Competence Center "Intelligence" > > & Senior Cloud Consultant > > > > Devoteam GmbH, Industriestr. 3, 70565 Stuttgart, Germany > > Phone: +49 6151 868-8725, Fax: +49 711 13353-53, Mobile: +49 171 864 > 1543 > > E-Mail: juergen.wag...@devoteam.com, URL: www.devoteam.de > > -- > > Managing Board: Jürgen Hatzipantelis (CEO) > > Address of Record: 64331 Weiterstadt, Germany; Commercial Register: > > Amtsgericht Darmstadt HRB 6450; Tax Number: DE 172 993 071 > > > > > > > -- Regards, Shalin Shekhar Mangar.

Re: clusterstate.json is sometimes out-of-sync

2015-04-09 Thread Shalin Shekhar Mangar
to a live node. Let me know if this makes > sense. > > On Thu, Apr 9, 2015 at 2:31 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com> wrote: > > > Yes, you can use the 'clusterstatus' API which will return an aggregation > > of all states. See > > &

Re: clusterstate.json is sometimes out-of-sync

2015-04-09 Thread Shalin Shekhar Mangar
s using prior versions of Solr don't see. > > By the way, is there one method to retrieve state across 4.x and 5.x? It > seems that there are different methods depending on Solr version. > > On Thu, Apr 9, 2015 at 12:23 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com&g

Re: Shard is down, what to do?

2015-04-09 Thread Shalin Shekhar Mangar
n Thu, Apr 9, 2015 at 4:47 PM, Aman Tandon wrote: > Hi, > > One of my shard is down, it is also not recovering at all. It is down from > last 4 hours. What should I do? What could be the reasons behind this? > > With Regards > Aman Tandon > -- Regards, Shalin Shekhar Mangar.

Re: Indexing Process: Lucene checksum error

2015-04-09 Thread Shalin Shekhar Mangar
> p.si did not match. expected checksum is 2426498564 and actual is checksum > 4157813087. expected length is 396 and actual length is 394 > > > With Regards > Aman Tandon > -- Regards, Shalin Shekhar Mangar.

Re: clusterstate.json is sometimes out-of-sync

2015-04-09 Thread Shalin Shekhar Mangar
son does not reflect the > aggregation of states of collections, the latter is always correct. I could > verify this from the admin panel (under Tree view) and from ZKCli. Is there > something I'm missing that could generate this issue? > > -- > > A. Adel > -- Regards, Shalin Shekhar Mangar.

Re: solr query latency spike when replicating index

2015-04-03 Thread Shalin Shekhar Mangar
ave node when replicating index > from master. Especially when master just finished optimization, the slave > node will copy the whole index, and the latency is really bad. > > Is there some way to fix it? > > Thanks, > Wei > -- Regards, Shalin Shekhar Mangar.

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
On Fri, Apr 3, 2015 at 12:52 PM, Toke Eskildsen wrote: > Shalin Shekhar Mangar wrote: > > The UnInvertedField method of faceting is no longer used in Solr. > > True. Un-inversion still takes place for non-DV-fields though (see > UnivertingReader, whic

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
Sorry I should have been more clear. The UnInvertedField method of faceting is not used in Solr since Solr 5.0. On Fri, Apr 3, 2015 at 12:17 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > The UnInvertedField method of faceting is no longer used in Solr. >

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
ould like to see that go away, but that's just > part of an ongoing mission to get Solr to break free from the old "2 > billion should be enough for everyone"-design. > > - Toke Eskildsen -- Regards, Shalin Shekhar Mangar.

Re: Generating json response in custom requestHandler (xml is working)

2015-04-02 Thread Shalin Shekhar Mangar
OR 404 > > Problem accessing /solr/etr_base_core/trends&wt=json. Reason: > > Not Found > > > I had the feeling that the response format is transparent for me when I > write a custom > requestHandler. But it seems I've overseen something. > > Does anybody have an idea? > > > Regards > > Christian > -- Regards, Shalin Shekhar Mangar.

Re: Replica and node states

2015-03-25 Thread Shalin Shekhar Mangar
rds these orphanage > replicas, so I'll make sure I do this cleanup from time to time. > > Yeah but just to avoid any misunderstanding -- the live nodes are watched by ZK so checking live-ness is a hash set lookup which is the cost but a small one. But yeah you do need to cleanup from

Re: Replica and node states

2015-03-25 Thread Shalin Shekhar Mangar
uting any requests to a replica. > > Shai > > On Wed, Mar 25, 2015 at 8:05 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com> wrote: > > > Comments inline: > > > > On Wed, Mar 25, 2015 at 8:30 AM, Shai Erera wrote: > > > > > Hi > > >

Re: Replica and node states

2015-03-25 Thread Shalin Shekhar Mangar
en if the JVM crashed. A replica publishes itself as 'down' on shutdown so if the graceful shutdown step is skipped then the replica will continue to be 'active' in the cluster state. Even LIR doesn't apply here because there's no point in the leader marking a node as 'down' if it is not 'live' already. > > Shai > -- Regards, Shalin Shekhar Mangar.

Re: rough maximum cores (shards) per machine?

2015-03-24 Thread Shalin Shekhar Mangar
gt; Are there any rules of thumb for how many cores (aka shards, since I > am > > > > using SolrCloud) is "too many" for one machine? I realize there is > no > > > one > > > > answer (depends on size of the machine, etc.) so I'm just looking > for a > > > > rough idea. Something like the following would be very useful: > > > > > > > > * People commonly run up to X cores/shards on a mid-sized (4 or 8 > core) > > > > server without any problems. > > > > * I have never heard of anyone successfully running X cores/shards > on a > > > > single machine, even if you throw a lot of hardware at it. > > > > > > > > Thanks! > > > > - Ian > > > > > > > > > > -- Regards, Shalin Shekhar Mangar.

Re: How to verify a document is indexed by all replicas

2015-03-24 Thread Shalin Shekhar Mangar
heir version or something? By > > "up-to-date" > > > I mean that they've all processed the same update requests that came > > > through. > > > > > > If there's a replica lagging behind, I'd like to wait for it to catch > up, > > > something like a checkpoint(), before I continue sending more updates. > > > > > > Shai > > > -- Regards, Shalin Shekhar Mangar.

Re: Solr tlog and soft commit

2015-03-17 Thread Shalin Shekhar Mangar
message in context: > http://lucene.472066.n3.nabble.com/Solr-tlog-and-soft-commit-tp4193105p4193559.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Regards, Shalin Shekhar Mangar.

Re: Solr TCP layer

2015-03-09 Thread Shalin Shekhar Mangar
Hi Saumitra, I've been thinking of adding http/2 support for inter node communication initially and client server communication next in Solr. There's a patch for SPDY support but now that spdy is deprecated and http/2 is the new standard we need to wait for Jetty 9.3 to release. That will take car

Re: qt.shards in solrconfig.xml

2015-02-26 Thread Shalin Shekhar Mangar
om> > >> wrote: > >> > >> > A query I posted yesterday amounted to me forgetting that I have to > >> > set qt.shards when I use a URL other than plain old '/select' with > >> > SolrCloud. Is there any way to configure a query handler to automate > >> > this, so that all queries addressed to '/RNI' get that added in? > >> > > >> > >> > >> > >> -- > >> Sincerely yours > >> Mikhail Khludnev > >> Principal Engineer, > >> Grid Dynamics > >> > >> <http://www.griddynamics.com> > >> > >> > -- Regards, Shalin Shekhar Mangar.

Re: qt.shards in solrconfig.xml

2015-02-26 Thread Shalin Shekhar Mangar
all queries addressed to '/RNI' get that added in? > > > > > > > > > > > -- > > Sincerely yours > > Mikhail Khludnev > > Principal Engineer, > > Grid Dynamics > > > > <http://www.griddynamics.com> > > > > > -- Regards, Shalin Shekhar Mangar.

Re: Setting Up an External ZooKeeper Ensemble

2015-02-24 Thread Shalin Shekhar Mangar
zookeeper.ClientCnxn$SendThread; Session 0x0 for server null, > unexpected error, closing socket connection and attempting reconnect > > > Where am I going wrong? > > -- > ckreddybh. > -- Regards, Shalin Shekhar Mangar.

Re: snapinstaller does not start newSearcher

2015-02-24 Thread Shalin Shekhar Mangar
at org.apache.solr.core.SolrCore.(SolrCore.java:845) > ... 9 more > > Any idea what causes this issue. > > Thanks in advance. > Alex. > > -- Regards, Shalin Shekhar Mangar.

Re: Question on CloudSolrServer API

2015-02-23 Thread Shalin Shekhar Mangar
trol the number of connections pooled > here in SolrJ Client? Also, what will be the default values for maximum > Connections and all. > > - Thanks > > On Thu, Feb 19, 2015 at 6:09 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com> wrote: > > > No, you should reu

Re: Question on CloudSolrServer API

2015-02-19 Thread Shalin Shekhar Mangar
No, you should reuse the same CloudSolrServer instance for all requests. It is a thread safe object. You could also create a static/common HttpClient instance and pass it to the constructor of CloudSolrServer but even if you don't, it will create one internally and use it for all requests so that c

Re: Release date for Solr 5

2015-02-17 Thread Shalin Shekhar Mangar
about 4-5 days. > > > > On Mon, Feb 16, 2015 at 10:09 PM, CKReddy Bhimavarapu < > chaitu...@gmail.com > > > > > wrote: > > > > > What is the anticipated release date for Solr 5? > > > > > > -- > > > ckreddybh. > > >

Re: Question about session affinity and SolrCloud

2015-02-14 Thread Shalin Shekhar Mangar
requests (for scatter/gather) and each request may again select a random replica. There are definitely some optimizations that can be explored here. > > From what I can find there does not appear to be any option of session > affinity within the SolrCloud query execution? > > > Thanks! > -- Regards, Shalin Shekhar Mangar.

Re: Dovecot FTS Solr Error [urgent/serious]

2015-02-13 Thread Shalin Shekhar Mangar
as follows):- > > doveadm index -u u...@domain.net inbox > > > Could someone tell me what is happening in the log(can the apache solr > read the request from dovecot correctly or is this some schema problem > or what?) ? > > Thanks > > Kevin > -- Regards, Shalin Shekhar Mangar.

Re: Unexplained leader initiated recovery after updates

2015-02-06 Thread Shalin Shekhar Mangar
age in context: > http://lucene.472066.n3.nabble.com/Unexplained-leader-initiated-recovery-after-updates-tp4178496p4184336.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Regards, Shalin Shekhar Mangar.

Re: Connection Reset Errors with Solr 4.4

2015-01-24 Thread Shalin Shekhar Mangar
; > > > > > > > > org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:191) > > > > at > > > > > > > > > > > > > > org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:300) > > > > at > > > > > > > > > > > > > > org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:127) > > > > at > > > > > > > > > > > > > > org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:717) > > > > at > > > > > > > > > > > > > > org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:522) > > > > at > > > > > > > > > > > > > > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906) > > > > at > > > > > > > > > > > > > > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805) > > > > at > > > > > > > > > > > > > > org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784) > > > > at > > > > > > > > > > > > > > org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365) > > > > ... 9 more > > > > > > > > > > > > Thanks, > > > > Nishanth > > > > > > > > > > -- Regards, Shalin Shekhar Mangar.

Re: Replicas fall into recovery mode right after update

2015-01-24 Thread Shalin Shekhar Mangar
there any setting that would fix this issue ? > > > > > - > -goutham > -- > View this message in context: > http://lucene.472066.n3.nabble.com/SolrCloud-Replicas-fall-into-recovery-mode-right-after-update-tp4181706.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Regards, Shalin Shekhar Mangar.

Re: Is it possible to read multiple RSS feeds and XML Zip file feeds with DIH into one core?

2015-01-23 Thread Shalin Shekhar Mangar
url="https://nvd.nist.gov/download/nvd-rss.xml"; >>>>> processor="XPathEntityProcessor" >>>>> forEach="/RDF/item" >>>>> transformer="DateFormatTransformer"> >>>>> >>>>> >>>> commonField="true" /> >>>>> >>>> commonField="true" >>>>> /> >>>>> >>>> commonField="true" /> >>>>> >>>> commonField="true" >>>>> /> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> However, my problem is that I also have to load multiple XML feeds into >>>>> the >>>>> same core. Here is one example (there are about 10 of them): >>>>> >>>>> http://static.nvd.nist.gov/feeds/xml/cve/nvdcve-2.0-2014.xml.zip >>>>> >>>>> >>>>> Is there any built-in functionality that would allow me to do this? >>>>> Basically, the use-case is to load and index all the XML ZIP files >>>>> first, >>>>> and then check the RSS feed every two hours and update the indexes with >>>>> any >>>>> new ones. >>>>> >>>>> Regards, >>>>> >>>>> Joe >>>>> >>>>> >>>>> > -- Regards, Shalin Shekhar Mangar.

<    1   2   3   4   5   6   7   8   9   10   >