Re: hot shard concept

On 10/30/2012 5:05 AM, Dmitry Kan wrote: Hi Shawn, Thanks for sharing your story. Let me get it right: How do you keep the incremental shard slim enough over time, do you periodically redistribute the documents from it onto cold shards? If yes, how technically you do it: the Lucene low-level wa

Re: How to change the boost of fields in edismx at runtime

Hi Saroj, You could use the boost function in a FunctionQuery. Something similar to, _val_:Title^10 and _val_:Keyword^2 _val_:Title^2 and _val_:Keyword^10 See http://wiki.apache.org/solr/SolrRelevancyFAQ#How_can_I_boost_the_score_of_newer_documentson how to use the boost function. Thanks, Indik

need help on solr search

Hi Solr experts, Our documents as well as queries consist of 10 properties in a particular order. Because of stringent requirements on search latency, we grouped them into only 2 fields with 5 properties each (we may use just 1 field, field number over 3 seems too slow), and each property value is

Re: SolrJ 4.0.0 addFilterQuery() issue ?

Thanks for the reply Chris. Yes you are correct, SolrJ is serializing a String[] instead of the separate String values. Using solrQuery.add("fq", "your first filter"); and solrQuery.add("fq", "your second filter"); has the same effect. Because it calls the add() method in the ModifiableSolrParams

Re: Query regarding solr search

Did you change it in schema.xml ?? Thanks and regards, Romita From: Leena Jawale To: "'solr-user@lucene.apache.org'" <'solr-user@lucene.apache.org'>, Cc: "Sawant, Amit2 " Date: 10/31/2012 12:07 PM Subject:Query regarding solr search Hi, My XML file is 1001 IBM 10

Re: Query regarding solr search

Okay, is correct, but it belongs in your Solr schema file, schema.xml, NOT your Solr XML data file. In other words, the schema.xml file declares the type for each field, NOT the Solr XML field elements. -- Jack Krupansky -Original Message- From: Leena Jawale Sent: Wednesday, Octobe

Query regarding solr search

Hi, My XML file is 1001 IBM 1001 INFPW03772 22/4/2010 1000 1002 DELL 1002 INFPW03734 09/7/2010 5000 But still the SerialNo and price1 working according to type text. Thanks, Leena Jawale From: Leena Jawale Sent: Tuesday, October 30, 2012 4:58 PM To: 'solr-user@lucene.apache.org'

Re: throttle segment merging

Hi Radim, To address your comment about JIRA and search - perhaps this is better - and it finds you: http://search-lucene.com/?q=throttle+merge&fc_project=Solr Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html

Re: Solr question

Hi/bok Mladen, Could function queries help you here? Have a look at http://wiki.apache.org/solr/FunctionQuery Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Tue, Oct 30, 2012 at 10:26 AM, mkaran wrote: >

Re: SolrCloud AutoSharding? In enterprise environment?

Hi Joseph, I think that if your clients talk to the VIP and not directly to Solr via http://search-lucene.com/jd/solr/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrServer.html you lose the ability to hit leaders directly (CloudSolrServer knows about them), which translates to a bit more w

Re: [Announce] Apache Solr 4.0 with RankingAlgorithm 1.4.4 and Realtime NRT available for download

Hi, Unless I'm missing something, Nagendra is now (finally - good to see the contrib Nagendra!) trying to provide the patch for Solr. If the patch goes in, then there is no need for Nagendra to have this external project any more. Nagendra, am I interpreting your intentions correctly here? Otis

Re: Stemming of irregular plurals such as Women and Skies

Hi Raj, I think you are looking for StemmerOverrideFilterFactory : http://wiki.apache.org/solr/LanguageAnalysis#solr.StemmerOverrideFilterFactory Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Tue, Oct 3

Re: Http 500/503 Responses from Solr

well, as for details for the server, it is running on a server with 6 gigs of ram ( jvm heap max is 4 gb), using ram directory for the index. here is my config file (some values are changed as i have been testing): LUCENE_40 ${solr.data.dir:}

Re: Subqueries... using results from the main query

Hi, Wouldn't this work for you: q=1234 +product_id:X +product_id:Y Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring - http://sematext.com/spm/index.html On Tue, Oct 30, 2012 at 9:23 AM, Gustav wrote: > Hello everyone, > > i would like to know i

Re: SolrJ 4.0.0 addFilterQuery() issue ?

: org.apache.solr.common.SolrException: : org.apache.lucene.queryparser.classic.ParseException: Cannot parse : '[Ljava.lang.String;@1ec278b5': Encountered "" at line 1, column 28. Hmmm.. that looks like a pretty anoying bug -- somehwere SolrJ is serializing a String[] instead of sending the indi

RE: Are there any limitations on multi-value field joins?

Thanks. Can you explain a bit more about your second point below. Specifically what makes it a bad fit? (design wise, performance)? Thanks again. Steven Sent from my Windows Phone From: Erick Erickson Sent: 30/10/2012 22:22 To: solr-user@lucene.apache.org Subject

Re: Are there any limitations on multi-value field joins?

Whenever anyone starts talking about using Solr to perform what would be multi-way DB joins I break out in hives. First of all, the "limited join capability" in Solr only returns the values from ONE of the documents. There's no way to return values from both the from and to documents. Second, Sol

Re: how to display MathML in search results?

On Tue, Oct 30, 2012 at 9:16 PM, Paul Libbrecht wrote: > So I guess > >> We call hyperbolic a loxodromic transformation that has a single >> fixed point. > > Also becomes > > We call hyperbolic a loxodromic transformation that has a single fixed point. Indeed, that does seem to be the case!

Re: how to display MathML in search results?

So I guess > We call hyperbolic a loxodromic transformation that has a single > fixed point. Also becomes We call hyperbolic a loxodromic transformation that has a single fixed point. ? In this case, it's definitely the Drupal side doing the html-stripping. paul Le 30 oct. 2012 à 21:51, J

Re: Tokenizer question

Maybe it would be simplest to use a PatternReplaceCharFilter to eliminate the ".jpg", and then use the StandardTokenizer, or use the white space tokenizer and the Word Delimiter Filter. -- Jack Krupansky -Original Message- From: RL Sent: Tuesday, October 30, 2012 3:57 AM To: solr-use

Re: how to display MathML in search results?

On Tue, Oct 30, 2012 at 8:21 PM, Paul Libbrecht wrote: > Le 30 oct. 2012 à 20:30, Joe Corneli a écrit : >> select?q=... directly in Solr. > > What's in there? > Are MathML islands gone? Yep! Like this: [...] For example, the universal closure of x + 2 = 3 x 2 3 x+2=3 is [...] instead of Fo

Re: how to display MathML in search results?

Le 30 oct. 2012 à 20:30, Joe Corneli a écrit : > select?q=... directly in Solr. What's in there? Are MathML islands gone? paul

Re: Urgent Help Needed: Solr Data import problem

We're getting a little far afield...but here is the incantation: mysql> grant all on DBNAME.* to 'USER'@'IP-ADDRESS' identified by 'PASSWORD'; mysql> flush privileges; cheers, Travis On Tue, Oct 30, 2012 at 2:40 PM, Amit Nithian wrote: > This error is typically because of a mysql permissions

Re: Query regarding solr search

-- Jack Krupansky -Original Message- From: Leena Jawale Sent: Tuesday, October 30, 2012 7:27 AM To: solr-user@lucene.apache.org Cc: Sawant, Amit2 Subject: RE: Query regarding solr search Hi, I understand that in the solr search considering the field type as text_en and not as int f

Re: row.get() in script transformer adds square brackets [] to string value

The question is whether your field in your Solr schema has multiValued="true". If so, your JavaScript would see an array of values. -- Jack Krupansky -Original Message- From: Radek Zajkowski Sent: Tuesday, October 30, 2012 7:44 AM To: solr-user@lucene.apache.org Subject: Re: row.get()

Re: how to display MathML in search results?

On Tue, Oct 30, 2012 at 5:55 PM, Paul Libbrecht wrote: > Joe, > > if XHTML works fine... why would MathML not? To clarify, it works fine when displaying nodes, not when displaying search results (nor when browsing the select?q=... directly in Solr. Joe

Re: Forwardslash delimiter.Solr4.0 query for path like /Customer/Content/*

Maybe a custom search component that runs before the QueryComponent and does the escaping? -- Jack Krupansky -Original Message- From: Dirk Högemann Sent: Tuesday, October 30, 2012 1:07 PM To: solr-user@lucene.apache.org Subject: Forwardslash delimiter.Solr4.0 query for path like /Cus

Re: Urgent Help Needed: Solr Data import problem

This error is typically because of a mysql permissions problem. These are usually resolved by a GRANT statement on your DB to allow for users to connect remotely to your database server. I don't know the full syntax but a quick search on Google should yield what you are looking for. If you don't c

Re: Subqueries... using results from the main query

Not to my knowledge. The closest thing is joins I think. My company hasn't had a need for features like this, so I'm not 100% sure. You're probably going to have to be a bit more patient to get a canonical answer. Michael Della Bitta Appinions 18

Re: how to display MathML in search results?

Joe, if XHTML works fine... why would MathML not? Is it swallowed? I agree with Dave that I see nothing Solr specific. Maybe a namespace issue? If the search results pull from Solr, they would pull from a stored field which you can inspect by using the url /solr/select?q= (this renders XML,

Re: how to display MathML in search results?

Hi Dave, Thanks for your offer to help! I moved the original post to a support request here: http://drupal.org/node/1827260 (Noting: display of the XHTML works fine in nodes themselves...) Joe On Tue, Oct 30, 2012 at 5:23 PM, Dave Stuart wrote: > Hi Joe, > > I have a suspect that this is a dr

Re: how to display MathML in search results?

Hi Joe, I have a suspect that this is a drupal thing as opposed to Solr specifically. Probably the best approach would be to add a extra field that is the raw data for display instead of using the content field which get a fair amount of processing. I would recommend opening a issue on the apa

Forwardslash delimiter.Solr4.0 query for path like /Customer/Content/*

Hi, I am currently upgrading from Solr 3.5 to Solr 4.0 I used to have filter-bases restrictions for my search based on the paths of documents in a content repository. E.g. fq={!q.op=OR df=}folderPath_}/customer/content/* Unfortunately this does not work anymore, as lucene now supports Regexpsea

RE: trunk is unable to replicate between nodes ( Unable to download ... completely)

Ah, we're also seeing Solr lookup an unexisting directory: 2012-10-30 16:32:26,578 ERROR [handler.admin.CoreAdminHandler] - [http-8080-exec-2] - : IO error while trying to get the size of the Directory:org.apache.lucene.store.NoSuchDirectoryException: directory '/opt/solr/cores/shard_a/data/ind

trunk is unable to replicate between nodes ( Unable to download ... completely)

Hi, We're testing again with today's trunk and using the new Lucene 4.1 format by default. When nodes are not restarted things are kind of stable but restarting nodes leads to a lot of mayhem. It seems we can get the cluster back up and running by clearing ZK and restarting everything (another

Re: [Announce] Apache Solr 4.0 with RankingAlgorithm 1.4.4 and Realtime NRT available for download

Happy to help! Cheers, Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Oct 29, 2012 at 11:37 PM, Nagendra Nagarajayya wrote: > Thanks Michael for the

RE: Nodes cannot recover and become unavailable

Hi Team, What is the preferred way to upgrade from SOLR 4.0.0-BETA to SOLR 4.0.0? We saw the same errors happening when we did the upgrade:- Oct 29, 2012 4:55:00 PM org.apache.solr.common.SolrException log SEVERE: Error while trying to recover. core=mediacms:org.apache.solr.common.SolrException:

Grouping based on multiple criteria

Hi list, I'd like to be able to present a list of results which are grouped on a single field, but then show various members of each group according to several different criteria. So for example, for e-commerce search, we group at the top level by the vendor, but then show the most expensive i

SolrCloud AutoSharding? In enterprise environment?

Hi All, I have looked at the below post URL and it really helps me a lot. http://lucene.472066.n3.nabble.com/SolrCloud-AutoSharding-td4011834.html But I have few questions. We are exploring SolrCloud to index millions of product details. We are planning to use a complete pool for SollCloud wi

Re: solr indexing using jquery AJAX

Also I believe you have to set the MIME type on your post. You might want to refer to the server side logs to see what Solr is saying about your request. There likely will be a descriptive error there. Michael Della Bitta Appinions 18 East 41st St

Re: solr indexing using jquery AJAX

On 30 October 2012 20:16, Amit Mallik wrote: > Hi I am trying to index using AJAX basically jquery. > Below is my code > try { > $.ajax({ > type: "POST", > url: > "http://myserver:8080/solr/update?commit=true";

solr indexing using jquery AJAX

Hi I am trying to index using AJAX basically jquery. Below is my code try { $.ajax({ type: "POST", url: "http://myserver:8080/solr/update?commit=true";, data: "20name=name>trailblazers", contentType: "text/xml",

Re: Items disappearing from Solr index

I have encountered another case where deleteByQuery fails. It fails for when i have a catalogueId value "www" and thus issue the query ( {!term f=catalogueId}www). One of my customers just reported this now. Any ideas why a val

RE: Unable to build trunk

Hi I have no IDE but it likely i have terminated the build at some point, leaving a lock. Clearing the cache fixed the problem. Thanks, -Original message- > From:Robert Muir > Sent: Tue 30-Oct-2012 15:14 > To: solr-user@lucene.apache.org > Subject: Re: Unable to build trunk > > Its

Solr question

I have a question about integrating custom functionality into Solr. What i want is the following scenario: 1. A query is issued to Solr 2. Solr uses my custom method to calculate the score (relevance) of each document with respect to the query. 3. the results are returned sorted by desce

SolrJ 4.0.0 addFilterQuery() issue ?

Hi All, I am using Solr 4.0 and SolrJ 4.0.0 to access Solr from a Spring web application, and I seem to have an issue when querying Solr. If the SolrQuery contains more than one addFilterQuery() I get an exception stating, org.apache.solr.common.SolrException: org.apache.lucene.queryparser.classi

Re: Urgent Help Needed: Solr Data import problem

Like Amit said, this appears not to be a Solr problem. From the command line of your machine, try this: mysql -u'readonly' -p'readonly' -h'10.86.29.32' hpcms_db_new If that works, and 10.86.29.32 is the server referenced by the URL in your data-config.xml problem, then at least you know you have

Re: Http 500/503 Responses from Solr

cache tuning? replication with load balancing? Who knows! (that is to say, that with this little info, one would only be guessing about how to improve the capacity of your server). On Tue, Oct 30, 2012 at 11:07 AM, deniz wrote: > Hi All, > > I ma running some load tests on my solr server, and

Re: Unable to build trunk

Its not "wonky". you just have to ensure you have nothing else (like some IDE, or build somewhere else) using ivy, then its safe to remove the .lck file there. I turned on this locking so that it hangs instead of causing cache corruption, but ivy only has "simplelockfactory" so if you ^C at the wr

Re: Doc Transformer to remove document from the response

I am not disputing that, the most general way to do it is to exclude hits just like you said. Was just thinking aloud about my particular use case, where I do not care about pagination. Thanks for your comments, e. On Oct 29, 2012, at 10:58 PM, Chris Hostetter wrote: > > : I did not look

Re: Unable to build trunk

Not sure if it's relevant, but sometimes the ivy caches are wonky. Try deleting (on OS X) ~/.ivy2 recursively and building again? Of course your next build will download a bunch of jars... FWIW, Erick On Tue, Oct 30, 2012 at 5:38 AM, Markus Jelsma wrote: > Hi, > > Since yesterday we're unable to

Subqueries... using results from the main query

Hello everyone, i would like to know if it is possible to make a SUBQUERY inside my query considering a field's current result of the main query in this subquery, Let me try to give a better explaination I Have a simple query, something like this: /?q="1234"&qf=product_id, this returns to me sev

Re: Running Solr Core/ Tika on Azure

Thanks Radek. I have this as this one on my list as one option to be tried out. Regards, Aloke On Tue, Oct 30, 2012 at 5:26 PM, Radek Zajkowski wrote: > I've been able to run Solr on Azure with this > > https://github.com/MSOpenTech/Windows-Azure-Solr > > Had to do some modification as we didn'

Re: SOLR - To point multiple indexes in different folder

Until you nail down what the user did, this is may cause problems. A sharded system assumes that the unique IDs in your schema exists on one and only one shard, otherwise you'll be getting multiple copies of the docs. And you've only shown a multi-core setup, NOT a sharded setup. You need to defi

Re: SolrCloud and distributed search

you can certainly save one hop by sending the update request to the shard leader (how are you sending things BTW, SolrJ?). But at this point that hasn't been done, see: https://issues.apache.org/jira/browse/SOLR-3154 It's certainly on the roadmap, but for now it works functionally so there are ot

Re: Solr4.0 / SolrCloud queries

In addition to Shawn's comments, you might want to see: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html Lucene's use of MMapDirectory can mislead you when looking at memory usage Best Erick On Mon, Oct 29, 2012 at 5:59 PM, Shawn Heisey wrote: > On 10/29/2012 3:26 PM,

Re: Running Solr Core/ Tika on Azure

I've been able to run Solr on Azure with this https://github.com/MSOpenTech/Windows-Azure-Solr Had to do some modification as we didn't need multiple slaves etc. but otherwise this was our jumping off point. If your Azure instance can mount the drive with files than you should be able to expose

Re: Jetty / Solr memory consumption

I just skimmed your post, but have you seen: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html MMapDirectory may be giving you a false sense of how much physical memory is actually being used. Best Erick On Mon, Oct 29, 2012 at 1:59 PM, Nicolai Scheer wrote: > Hi again! >

Re: row.get() in script transformer adds square brackets [] to string value

Thanks and sorry, forgot to include XML In data config: The Xml node: Is the the CDATA section causing this? Radek. On Mon, Oct 29, 2012 at 9:10 PM, Jack Krupansky wrote: > Sounds like it is multivalued - the square brackets indicate an array. > > -- Jack Krupansky > > -Original Messa

Running Solr Core/ Tika on Azure

Hi, Looking for feedback on running Solr Core/ Tika parsing engine on Azure. There's one offering for Solr within Azure from Lucid works. This offering however doesn't mention Tika. We are looking at options to make content from files (doc, excel, pdfs, etc.) stored within Azure storage search-ab

Re: Query regarding solr search

On 30 October 2012 16:57, Leena Jawale wrote: > Hi, > > I understand that in the solr search considering the field type as text_en > and not as int for the fields. > So how do I convert the field type of a particular field in solr XML as int > so that I can operate that > field for range queries

RE: Query regarding solr search

Hi, I understand that in the solr search considering the field type as text_en and not as int for the fields. So how do I convert the field type of a particular field in solr XML as int so that I can operate that field for range queries in solr?? Thanks, Leena Jawale From: Leena Jawale Sent: T

Are there any limitations on multi-value field joins?

Hi - I've done quite a bit of Googling and reading but can't find a definitive answer to this. I would like to have a list of key data rows each with a unique id and some data. datarow1 a b cdatarow2 x y zdatarow3 m n o... I'd then like to have other rows that point to one or more of they data ro

Re: hot shard concept

Hi Shawn, Thanks for sharing your story. Let me get it right: How do you keep the incremental shard slim enough over time, do you periodically redistribute the documents from it onto cold shards? If yes, how technically you do it: the Lucene low-level way or Solr / SolrJ way? -dmitry On Mon, Oc

Unable to build trunk

Hi, Since yesterday we're unable to build trunk and also a clean check out from trunk. We can compile the sources but not the example or dist. It hangs on resolve and after a while prints the following: resolve: [ivy:retrieve] [ivy:retrieve] :: problems summary :: [ivy:retrieve] WARNINGS

Re: Urgent Help Needed: Solr Data import problem

Hi, This is my data-config file:- and password is not null. and 10.86.29.32 is my unix server ip. regards, kunal On Tue, Oct 30, 2012 at 2:42 PM, Dave Stuart wrote: > It looks as though you have a password set on your unix server. you will > need to either remove this

Re: Urgent Help Needed: Solr Data import problem

It looks as though you have a password set on your unix server. you will need to either remove this or ti add the password into the connection string e.g. readonly:[yourpassword]@'10.86.29.32' >> 'readonly'@'10.86.29.32' >> (using password: NO)" On 30 Oct 2012, at 09:08, kunal sachdeva wrote:

Re: Urgent Help Needed: Solr Data import problem

Hi, I'm not getting this error while running in local machine. Please Help Regards, Kunal On Tue, Oct 30, 2012 at 10:32 AM, Amit Nithian wrote: > This looks like a MySQL permissions problem and not a Solr problem. > "Caused by: java.sql.SQLException: Access denied for user > 'readonly'@'10.86.

Re: SOLR - To point multiple indexes in different folder

Erick, Thanks for your response. All the 7 folders are of same schema, i mean document structure is same. I am not very sure how did customer get this data dump into different folders. Now we have configured Solr with multicore, each core pointing to each directory and using shards to get a single

Tokenizer question

I could not find a solution to that in the documentation or the mailing list, so here's my question. I have files following the pattern: firstname_lastname_employeenumber.jpg I'm able to search for the single terms firstname or lastname or the employeenumber using a solr.PatternTokenizerFactory.