Re: solcloud on tomcat - the 8983 port problem

That worked. Thanks both of you (Hoss too). I had in fact set the solr.xml hostPort on both shards to 80 earlier to match Tomat. But I kept getting INFO: Update state numShards=null message={ "operation":"state", "core_node_name":"10.x.x.105:8983_solr_mycore", "numShards":null, "shard":

Re: solcloud on tomcat - the 8983 port problem

: I've got SolrCloud running under Tomcat 6, the respective settings are ... : I am deliberately running Tomcat on 80 but on SOLR I stuck with 8983 because : it appears to be the default for SolrCloud. This doesn't really make sense to me ... what do you mean "on SOLR I stuck with 8983"

Re: solcloud on tomcat - the 8983 port problem

In solr.XML, hostPort should be set to 80. Zookeeper tracks the port so the various nodes can find one another as long as you set it correctly in that file. On May 31, 2013 8:38 PM, "cleardot" wrote: > I know this issue has been answered somewhere. > > I've got SolrCloud running under Tomcat 6, t

Re: Sorting results by last update date

Jack Thank you so much for detailed answer. -BR, Kamal On Thu, May 30, 2013 at 6:18 PM, Jack Krupansky wrote: > I wrote "Otherwise, it would miss dates after the start of today", but > that should be "Otherwise, it would miss documents with times after the > start of today if the current time i

Re: Server inconsistent state & Core Reload issue

: If you look at my email the container that is running SOLR got the request : params (http access logs provided in first email) but when it goes through : the SOLR app/code on the container (probably through request filters or : dispatchers..I don't know exactly) its getting lost, which is what I

solcloud on tomcat - the 8983 port problem

I know this issue has been answered somewhere. I've got SolrCloud running under Tomcat 6, the respective settings are tomcat6.conf --- I am deliberately running Tomcat on 80 but on SOLR I stuck with 8983 because it appears

whole index in memory

Hello, I have a solr index of size 5GB. I am thinking of increasing cache size to 5 GB, expecting Solr will put whole index into memory. 1. Will Solr indeed put whole index into memory? 2. What are drawbacks of this approach? Thanks in advance. Alex.

Re: installing & configuring solr over ms sql server - tutorial needed

Why dont you follow this one tutorial to set the SOLR on tomcat.. http://wiki.apache.org/solr/SolrTomcat -- View this message in context: http://lucene.472066.n3.nabble.com/installing-configuring-solr-over-ms-sql-server-tutorial-needed-tp4067344p4067488.html Sent from the Solr - User mailing l

Re: installing & configuring solr over ms sql server - tutorial needed

Hi, I am still having a problem with this tutorial trying to get solr on tomcat. in step 4 when I copy apache-solr-1.4.0\example\solr to my tomcat dir I get a folder with bin and collection1 folder. Do I need them? should I create conf under

Re: seeing lots of "autowarming" messages in log during DIH indexing

the DIH is launched via a script - called by a "cron like" scheduler. clean, commit and optimize are all true. thx mark #!/bin/bash SERVER=$1 PORT=$2 CLEAN=$3 COMMIT=$4 OPTIMIZE=$5 COREPATH=$6 echo SERVER: $SERVER echo PORT: $PORT echo CLEAN: $CLEAN echo COMMIT: $COMMIT echo OPTIMIZE: $OPTIMI

Re: Strip HTML Tags and Store

Great. That was an example from the book. -- Jack Krupansky -Original Message- From: Kalyan Kuram Sent: Friday, May 31, 2013 4:04 PM To: solr-user@lucene.apache.org Subject: RE: Strip HTML Tags and Store Thanks it worked..!! From: j...@basetechnology.com To: solr-user@lucene.apache.

RE: 2 VM setup for SOLRCLOUD?

Thanks. When you say updates will fail, do you mean document updates will fail, or, updates to the cluster, like adding a new node? If adding new data will fail, I will definitely need to figure out a different way to set this up. -Original Message- From: Erick Erickson [mailto:erickeri

Re: installing & configuring solr over ms sql server - tutorial needed

solrconfig.xml - the lib directives specified in the configuration file are the lib locations where Solr would look for the jars. solr.xml - In case of the Multi core setup, you can have a sharedLib for all the collections. You can add the jdbc driver into the sharedLib folder. -- View this mes

Re: installing & configuring solr over ms sql server - tutorial needed

btw: The other stages still refer to location relative to tomcat On Sat, Jun 1, 2013 at 12:02 AM, Mysurf Mail wrote: > for instance step 5 - Download and install a SQL Server JDBC drive. > Where do I put it when using jetty? > > * Just asked here a question if an official tutorial for ms sql s

Re: installing & configuring solr over ms sql server - tutorial needed

for instance step 5 - Download and install a SQL Server JDBC drive. Where do I put it when using jetty? * Just asked here a question if an official tutorial for ms sql server exists before I try to go through several tutorials. On Fri, May 31, 2013 at 6:42 PM, Alexandre Rafalovitch wrote: > W

Re: Getting tons of EofException with jetty/SolrCloud

Wonderful discussion, but it seems that the exact values here should only affect the freshness of the search results and the growth of the logs. What I have going on in a very simple, 10 node SolrCloud with quite low insert rates (10K docs/20 minutes) absolutely kills the cloud in the first 20 min

Re: 2 VM setup for SOLRCLOUD?

Be really careful here. Zookeeper requires a quorum, which is ((zk nodes)/2) + 1. So the problem here is that if (zk nodes) is 2, both of them need to be up. If either of them is down, searches will still work, but updates will fail. Best Erick On Fri, May 31, 2013 at 11:39 AM, James Dulin wrote

Re: Getting tons of EofException with jetty/SolrCloud

On Fri, May 31, 2013 at 4:11 PM, Jason Hellman wrote: > Those are default, though autoSoftCommit is commented out by default. > > Keep in mind about the hard commit running every 15 seconds: it is not > updating your searchable data (due to the openSearcher=false setting). In > theory, your da

Re: Getting tons of EofException with jetty/SolrCloud

Those are default, though autoSoftCommit is commented out by default. Keep in mind about the hard commit running every 15 seconds: it is not updating your searchable data (due to the openSearcher=false setting). In theory, your data should be searchable due to autoSoftCommit running every 1 s

RE: Strip HTML Tags and Store

Thanks it worked..!! > From: j...@basetechnology.com > To: solr-user@lucene.apache.org > Subject: Re: Strip HTML Tags and Store > Date: Thu, 30 May 2013 22:53:37 -0400 > > Update Request Processors to the rescue again. Namely, the HTML Strip Field > Update processor: > > Add to your solrconfig:

Re: Getting tons of EofException with jetty/SolrCloud

15000 false 1000 I think these are close to the default values...not sure if I changed them. These mean a hard commit every 15 seconds...right? Seems sort of reasonable since we get a few hundred doc inserts in 15 seconds. Not sure...any advice is very welcome. -- View this message i

Re: Getting tons of EofException with jetty/SolrCloud

Possibly a pointer in a wrong direction, but: what's your commit strategy? Is it possible that Solr is doing hard commits too often and that is holding up the threads. You could switch to soft-commits with time-based hard commits and see if that helps. Regards, Alex. Personal blog: http://blog.

Re: Find rows within range of other rows

Looks like what you need is pivoted facets...Range within range http://wiki.apache.org/solr/SimpleFacetParameters#Pivot_.28ie_Decision_Tree.29_Faceting Pivot faceting allows you to facet within the results of the parent facet Category1 (17) item 1 (9) item 2 (8) Category2 (6) item 3 (6) Categor

Getting tons of EofException with jetty/SolrCloud

I have a 10 node, 4.3 SolrCloud with 5 shards. It's a heavy write (100x more writes than reads) environment. After less than 10k docs in 20 minutes or so I get tons of EofExceptions from what appears to be the synchronization traffic between the nodes. When I do queries during this exception sto

Re: SolrCloud running away with resources

Thanks! I've found the cause for this problem was the hardware load balancer (F5 LTM) was creating thousands of connections. So it turns out that it had nothing to do with SolrCloud. However, now I have another problem for which I'll create another post. -- View this message in context: ht

Re: dataConfig DTD or schema

: > TemplateTransformer : : But doesn't that override the value even if it is present? I thought : the request was for default value if one is not supplied. Though maybe : I was wrong. Bah! You are completley correct ... I didn't fully understand the question. Sorry for the noise. -Hoss

Re: updating docs in solr cloud hangs

As far as I know, partial update in Solr 4.X doesn’t partially update Lucene index , but instead removes a document from the index and indexes an updated one. The underlying lucene always requires to delete the old document and index the new one.. We usually dont use partial update when updating

Re: dataConfig DTD or schema

On Fri, May 31, 2013 at 1:43 PM, Chris Hostetter wrote: > TemplateTransformer But doesn't that override the value even if it is present? I thought the request was for default value if one is not supplied. Though maybe I was wrong. Regards, Alex. Personal blog: http://blog.outerthoughts.com/

Re: dataConfig DTD or schema

: > On the other side: I have a problem. Because I want to give some entities : > a default value "A" and others default value "B" - which I could do inside : > a inside of in data-config.xml but not inside a in : > schema.xml. : In that case, you will need to write a custom DIH Transformer. No

Re: dataConfig DTD or schema

: References: <1370004174910-4067305.p...@n3.nabble.com> : In-Reply-To: <1370004174910-4067305.p...@n3.nabble.com> : Subject: dataConfig DTD or schema https://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please do no

Re: Docvalue on a StrField equal a codec error

As I mentioned to Yago on #solr IRC, I modified the DocValues wiki page to note that has to be configured in solrconfig.xml in order to use per-field doc values formats. - Steve On May 31, 2013, at 11:09 AM, yriveiro wrote: > Hi, > > I have this error on a solr.StrField defined in my schema:

Re: Setting up a development environment

Shalin and Shawn, thanks for your help! Just for the records, in case somebody else having the same problems will read this thread: I'm using Ubuntu 13.02, ant 1.8.2, Oracle Java 1.7.0_21-b11 and the community edition of IntelliJ 12. I followed the steps outlined by Shalin. Everything works lik

Re: updating docs in solr cloud hangs

Hi, I'm experimenting the same issue, I'm indexing a big file with 15M in batches of 100K. Sometimes, the indexing operation hangs and my HTTP client return an error of timeout. I see that is more frequent when the collection has more replicas. Other thing that I can see is a lot of POST up

updating docs in solr cloud hangs

Hi all, We're using Solr 4.1.0 and a 15 node Solr Cloud (configured for a 2 minute autoCommit with no searcher being built). We have a large dataset in Cassandra and use a Hadoop cluster to read over the dataset, build documents, and insert them (via CloudSolrServer). That part works as expected

Shard Keys and Distributed Search

Hi all, I'm trying to make sure that I understand under what circumstance a distributed search is performed against Solr and if my general understanding of what constitutes a distributed search is correct. I have a Solr collection that was created using the Collections API with the following p

Re: How can a Tokenizer be CoreAware?

I am not an expert on this one but I would try doing this..I would implement SolrCoreAware class and override inform method to make it core aware.. something like ... public void inform( SolrCore core ) -- View this message in context: http://lucene.472066.n3.nabble.com/How-can-a-Tokenizer-b

RE: Support for Mongolian language

Please create a new topic for any new questions.. -- View this message in context: http://lucene.472066.n3.nabble.com/Support-for-Mongolian-language-tp4066871p4067374.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: installing & configuring solr over ms sql server - tutorial needed

I think that the main idea is that, as mentioned before, you first have install andrun SOLR; For this use the official tutorial, it is simple and it works, i used it a few months ago. Use also the examples, they are good to get an initial idea about solr. Then you setup sqlserver. Then you have to

Re: Highlighting fields

Didn't notice the original message. Sorry about that. -- Shreejay On Friday, May 31, 2013 at 5:55, Jack Krupansky wrote: > Please do not respond to hijacked message threads, other than to encourage > the sender to start a new message thread. > > -- Jack Krupansky > > -Original Message

Re: installing & configuring solr over ms sql server - tutorial needed

What's wrong with the one you found. Just ignore steps 1-4 and go right into driver and DIH setup. If you hit any problems, you now have a specific question to ask. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is t

RE: 2 VM setup for SOLRCLOUD?

Thanks, I think that the load balancer will be simple enough to set up in Azure. My only other current concern is having the zookeepers on the same VMs as Solr. While not ideal, we basically just need simple redunancy, so my theory is that if VM1 goes down, VM 2 will have the shard, node, an

Re: installing & configuring solr over ms sql server - tutorial needed

Thanks. A tutorial on getting solr over mssql ? I didnt find it even with jetty On Fri, May 31, 2013 at 6:21 PM, Alexandre Rafalovitch wrote: > You have two mostly-separate issues here. Running Solr in Tomcat and > indexing MSSql server. > > Try just running a default embedded-Jetty example unt

Re: Docvalue on a StrField equal a codec error

The solr version is the LUCENE_43 Cumprimentos -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Friday, May 31, 2013 at 4:22 PM, Alexandre Rafalovitch wrote: > Long shot. What's your Solr version and what's the LUCENE version in > your solrconfig.xml? > > Regards, >

Re: Docvalue on a StrField equal a codec error

Long shot. What's your Solr version and what's the LUCENE version in your solrconfig.xml? Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch - Time is the quality of nature that keeps events from happening all at once. Lately,

Re: installing & configuring solr over ms sql server - tutorial needed

You have two mostly-separate issues here. Running Solr in Tomcat and indexing MSSql server. Try just running a default embedded-Jetty example until you get data import sorted out. Then, you can worry about Tomcat. And it would be easier to help with one problem at a time. Regards, Alex. Person

Re: dataConfig DTD or schema

On Fri, May 31, 2013 at 8:35 PM, Hans-Peter Stricker wrote: > On the other side: I have a problem. Because I want to give some entities > a default value "A" and others default value "B" - which I could do inside > a inside of in data-config.xml but not inside a in > schema.xml. > > In that case,

Re: dataConfig DTD or schema

You can do a custom transformer in DIH which will do a default value. If you do, it could be a good one to contribute. Otherwise, you can have two different DIH handlers defined in solrconfig.xml with different UpdateRequestProcessor chains and use http://lucene.apache.org/solr/4_0_0/solr-core/org

Docvalue on a StrField equal a codec error

Hi, I have this error on a solr.StrField defined in my schema: FieldType 'string_dv' is configured with a docValues format,​ but the codec does not support it. In documentation http://wiki.apache.org/solr/DocValues#Specifying_a_different_Codec_implementation , the StrField field format appears

Re: dataConfig DTD or schema

On the other side: I have a problem. Because I want to give some entities a default value "A" and others default value "B" - which I could do inside a inside of in data-config.xml but not inside a in schema.xml. -- From: "Shalin Shekhar Mangar"

installing & configuring solr over ms sql server - tutorial needed

I am trying to config solr over ms sql server. I found only this tutorial whih is a bit old (2011) Is there an updated / formal tutorial?

Re: dataConfig DTD or schema

You are great! Thanks a lot for taking the time. -- From: "Shalin Shekhar Mangar" Sent: Friday, May 31, 2013 4:59 PM To: Subject: Re: dataConfig DTD or schema DataImportHandler does not support specifying default values for a field. However, the

Re: dataConfig DTD or schema

DataImportHandler does not support specifying default values for a field. However, the solr schema.xml lets you specify defaults. So, modify the corresponding field inside solr's schema.xml. For example: On Fri, May 31, 2013 at 8:20 PM, Hans-Peter Stricker wrote: > I wonder how to pass default

dataConfig DTD or schema

I wonder how to pass default values via , e.g. like this: BE or like this: In the course of this, I did not find a DTD or Schema for . Any hint is appreciated!!

Spell Checker (DirectSolrSpellChecker) correct settings

Hi guyz, I am new to solr. Here is the thing I have: When i search "Courtt", I get correct suggestion saying: "spellcheck": { "suggestions": [ "courtt", { "numFound": 1, "startOffset": 0, "endOffset": 6,

Re: Setting up a development environment

On 5/31/2013 4:17 AM, Shalin Shekhar Mangar wrote: > The "trunk" requires Java7 but the 4.x releases are cut from branch_4x > which is on Java6. There are some bugs in Java8 which cause test failures > on our build machines so just avoid it for now. I use IntelliJ so I cannot > comment on the probl

Re: Hook for destructing a plugin

You can use SolrCore.addCloseHook method to release your plugin's resources. On Fri, May 31, 2013 at 5:29 PM, Hongxin Liang wrote: > Hi, > > I tried to develop a Solr plugin, more specifically a request handler. > There is an "init" method that I can hook in my initialization logic, but I > coul

Re: Question on distrib=false

I think you misunderstand the concept of shards. If slave1 and slave2 are replicas of the master then neither "shards" param nor "distrib" parameter is required. On Fri, May 31, 2013 at 6:12 PM, sathish_ix wrote: > Hi, > > We have following setup , > > > Maseter Slave 1 > |___

Re: Highlighting fields

Please do not respond to hijacked message threads, other than to encourage the sender to start a new message thread. -- Jack Krupansky -Original Message- From: Shreejay Sent: Friday, May 31, 2013 5:10 AM To: solr-user@lucene.apache.org Subject: Re: Highlighting fields Are the fields

Re: Highlighting fields

Please do not use an existing message thread for another topic - that is known as "thread hijacking" and is a very discourteous thing to do. Please start a new message thread. You didn't "correct" the subject line, you CHANGED it. Please DO NOT do that on this list! -- Jack Krupansky -Ori

Question on distrib=false

Hi, We have following setup , Maseter Slave 1 |_ Slave 2 we indexed few records in slave1 and few records in slave2, while querying we need data only from slave 1. So used below query http://xxx.com/solr/select?q=*:*&shards=slave1,slave2&distrib=false We are get

Re: solr starting time takes too long

Right, the Wiki is a bit out of date. What's going to happen (I hope) is that SOLR-4779 will allow you to share the complete configuration, schema and solrconfig rather than try to share them individually. This is consistent with the SolrCloud way of having named config sets. Essentially, you'll p

Re: 2 VM setup for SOLRCLOUD?

Actually, you don't technically _need_ a load balancer, you could hard code all requests to the same node and internally, everything would "just work". But then you'd be _creating_ a single point of failure if that node went down, so a fronting LB is usually indicated. Perhaps the thing you're mis

Hook for destructing a plugin

Hi, I tried to develop a Solr plugin, more specifically a request handler. There is an "init" method that I can hook in my initialization logic, but I couldn't manage to find the corresponding "destroy" method in which I can tear down something. Also I tried to find some kind of event I can li

Re: indexing documents

Solr JSON isn't intended to index arbitrary JSON, and especially not intended to index nested documents. I suspect your issue is that "cat" has an array of name/value pairs that Solr doesn't understand. So no, I don't think you can index these docs without putting them into a form Solr understands

Re: SolrCloud running away with resources

Shouldn't be happening, although a lot of SolrCloud is new. So, what are your autocommit intervals, both hard and soft? That's the place where things go weird fast. Oddly, consider making your hard commit interval relatively short (say 1) with openSearcher=false. This is just a check, it d

intersection of filter queries with raw query parser

Hi folks, is it possible to use the raw query parser with a disjunctive filter query? Say, I have a field 'foo' and two values 'v1' and 'v2' (the field values are free text and can contain any character). What I want is to retrieve all documents satisying fq=foo:(v1 OR v2). In case only one f

Re: Continue Indexing Documents when single doc does not match schema

Hmmm, not sure that would work for diferent values? But it does point the way to a different solution, write a custom update processor that removed multivalued entries FWIW, Erick On Thu, May 30, 2013 at 1:54 PM, Alexandre Rafalovitch wrote: > On Thu, May 30, 2013 at 1:03 PM, Iain Lopata wr

Re: Continue Indexing Documents when single doc does not match schema

is just for reading the solr configurations at startup, and it's been removed in recent versions anyway so it's not surprising that didn't help. This has been a "feature" of solr for some time, there's no good way to say "just keep going". There was some work on this with SOLR-445, but i tdied on

Re: Setting up a development environment

On Fri, May 31, 2013 at 2:22 PM, Achim Domma wrote: > I would like to work with the Solr source code. My idea is to "debug" some > unit tests to get a better understanding of the inner workings of Solr. And > perhaps I might implement some custom code in the future. But to get > started, I need a

Re: Problem with PatternReplaceCharFilter

Thanks again for your input. In fact I already preprocess the data (concatenation of only the content values) and index it into another field. But my general problem is the following: My data has such a cryptic format and I have to search only within the content values. Therefore I preprocess it

Re: Highlighting fields

Are the fields you are trying to highlight "stored"? If yes then can you show the exact query you are using? Which version of solr? And which highlighter? ( you can paste the relevant highlight section from solr config file) -- Shreejay On Thursday, May 30, 2013 at 22:56, Sagar Chaturvedi

Setting up a development environment

I would like to work with the Solr source code. My idea is to "debug" some unit tests to get a better understanding of the inner workings of Solr. And perhaps I might implement some custom code in the future. But to get started, I need a working development environment where I can build and debu

RE: [DIH] Using SqlEntity to get a list of files and read files in XpathEntityProcessor

Thanks very much, it works, with dataSource (capital S) !!! Finally, I didn't have to define a "CHEMINRELATIF" field in the configuration, it's working without it. This is the definive working configuration: