Restricting results based on user authentication

Hi, I am using DIH feature of Solr for indexing a database. I am using Solr server and it is independent of my web application. I send a http request for searching and then process the returned result. Now we have a requirement that we have to filter the results further based on security level

DataImportHandler: UTF-8 and Mysql

Hello, First of all thanks to Jacob Singh for his reply on my mail last week, I completely forgot to reply. Multicore is perfect for my needs. I've got Solr running now with my new schema partially implemented and I've started to test importing data with DIH. I've run in to a number of

Deletion of indexes.

Hi, I am using solr 1.3. I am facing a problem to delete the index. I have mysql database. Some of the data from database is deleted, but the indexing for those records is still present. Due to that I am getting those records in search result. I don't want this type of behavior. I want to

To get all indexed records.

Hi, I am using solr 1.3. I want to retrieve all records from index file. How should I write solr query so that I will get all records? Thanks, Tushar. -- View this message in context: http://www.nabble.com/To-get-all-indexed-records.-tp21413170p21413170.html Sent from the Solr - User

Re: To get all indexed records.

Use *:* as a query to get all records. Refer to http://wiki.apache.org/solr/SolrQuerySyntax for more info. On Mon, Jan 12, 2009 at 5:30 PM, Tushar_Gandhi tushar_gan...@neovasolutions.com wrote: Hi, I am using solr 1.3. I want to retrieve all records from index file. How should I write

Re: To get all indexed records.

Hi Tushar, 1. If you are using SOLR admin console to search record, then default query '*:*' in the Query String search box will serve the purpose. 2. If you directly want to send an HTTP request for retrieving records then you can hit a URL similar to following -

Index is not created if my database table is large

Hii, I new to SOLR world... i am using solr multicore config in my webapp i am able to configure solr properly... but problem is when i am building using full data-import... if my databse table has few number of rows say 10 to 25 the index is created properly... and search query returns

Re: Greter than conditions in Solr.

On Jan 12, 2009, at 7:13 AM, Tushar_Gandhi wrote: Is it possible to write a query like id 0? Sure... id:[1 TO *] See here for lots more details: http://wiki.apache.org/solr/SolrQuerySyntax . Be sure to follow the link to the Lucene query syntax for fuller details. Erik

Re: Index is not created if my database table is large

Hi, I'm not sure that this is the same issue but I had a similar problem with importing a large table from Mysql, on the DataImportHandler FAQ (http://wiki.apache.org/solr/DataImportHandlerFaq) the first issue mentions memory problems. Try adding the batchSize=-1 attribute to your

Re: Index is not created if my database table is large

Hi,thnx for the reply ...but an you tell me where to set this batchSize??? in dataconfig.xml On Mon, Jan 12, 2009 at 8:48 AM, gwk g...@eyefi.nl wrote: Hi, I'm not sure that this is the same issue but I had a similar problem with importing a large table from Mysql, on the DataImportHandler

Re: Index is not created if my database table is large

Hey...i tried using batchsize=-1 it doesnt work,..I am not getting any memory problem as such... http://127.0.0.1/search/products/dataimport?command=full-importdebug=onverbose=true which runs without error gives me the response also but when i query using admin it does not returns any result

Re: Database permissions integration and Sub documents

On Jan 11, 2009, at 10:08 PM, Mike Shredder wrote: Hi , I'm new to Solr .. I've been able to get Solr up running. But got some quick questions. 1) How do I filter results based on permissions from an external database system ? -- Should I implement a queryfilter which will

Improving Readability of Hit Highlighting

I'm indexing text from an OCR of an old document. Many words get read perfectly, but they're typically embedded in a lot of junk. I would like the hit highlighting to show only the 'good' words, in the order in which they appeared in the original document. Is it possible to use output of the

Re: Query regarding Spelling Suggestions

Solr 1.3 doesn't use Log4J, it uses Java Utility Logging (JUL). I believe the info level in the logs is sufficient. Let's start by posting what you have? Also, are you able to get the sample spellchecking to work? On Jan 12, 2009, at 2:16 AM, Deshpande, Mukta wrote: Hi, Could you

Re: Deletion of indexes.

I got around this problem by using a trigger on the table I index that records the values of deleted items in a queue table so when my next Solr update rolls around it sends a remove request for that record's ID. Once the Solr deletion is done, I remove that ID from the queue table. Of

Re: Restricting results based on user authentication

Hi Manu, I haven't made a custom request handler in a while, but I want to clarify that, if you trust your application code, you don't actually need a custom request handler to do this sort of authentication filtering. At indexing time, you can add a role field to each object that you index, as

Custom Transformer to handle Timestamp

Hi all I am using solr to index data from my database. In my database there is a timestamp field of which data will be in the form of, 15-09-08 06:28:38.44200 AM. The column is of type TIMESTAMP in the oracle db. So in the schema.xml i have mentioned as: field name=LOGIN_TIMESTAMP

Single index - multiple SOLR instances

Hello, Is it possible to have the index created by a single SOLR instance, but have several SOLR instances field the search queries. Or do I HAVE to replicate the index for each SOLR instance that I want to answer queries? I need to set up a fail-over instance. Thanks - ashok -- View this

Re: Single index - multiple SOLR instances

Ashok, You can put your index on any kind of shared storage - SAN, NAS, NFS (this one is not recommended). That will let you point all your Solr instances to a single copy of your index. Of course, you will want to test performance to ensure the network is not slowing things down too much,

Re: Getting only fields that match

Norbert, Other than though explain query method I don't think we have any mechanism to figure out which field(s) exactly a query matched. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Norbert Hartl norb...@hartl.name To:

Re: Single index - multiple SOLR instances

Thanks, Otis. That is great, as I plan to place the index on NAS and make it writable to a single solr instance (write load is not heavy) and readable by many solr instances to handle fail-over and also share the query load (query load can be high) - ashok Otis Gospodnetic wrote: Ashok,

Re: Improving Readability of Hit Highlighting

I'm not sure if I have a good suggestion, but I have a question. :) What is considered junk? Would it be possible to eliminate the junk before it even goes into the index in order to avoid GIGO (Garbage In Garbage Out)? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch

Re: Improving Readability of Hit Highlighting

To answer your questions specifically, here is an example of the raw OCR output; CONTRACTORINMPRIMENTAYIVE : mom Ale ACCEPT INFORMATIONON TOUR SHEET TO ea to which I would like to see; mom ale access tour sheet to in the hit highlight. My schema for this field is pretty much standard, as

Re: Single index - multiple SOLR instances

OK. Of course, you'll have to make sure everything on the SAN is redundant (down to controllers, power supplies, etc.) and that the disks can handle that high query load/IO. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: ashokc

Highlighting Trouble With Bigram Shingle Index

I'm running into some highlighting issues that appear to arise only when I'm using a bigram shingle (ShingleFilterFactory) analyzer. I started with a bigram-free situation along these lines: field name=body type=noshingleText indexed=false stored=false / !-- Stored text for use with

Summing the results in a collapse

I have been using the Collapse extension, and have it working pretty good. However I would like to find out if there is a way to show the collapsed results, and then sum up a field of one of the remaining results. For example I display Result 1, (There 20 results, totalling $50.00).

Multiple result fields in a collapse or subquery

Is there anyway to have multiple collapse.field directives in the search string? What I am trying to accomplish is the following Result 1 (20 results) EU (5 results) USD (15 results) Result 2 (10 results) EU (5 results) USD (5 results) I thought that this

Re: Improving Readability of Hit Highlighting

Hi, Quick note: please include copy of previous email when replying, so people can be reminded of the context. You mentioned junk getting highlighted. In your case is CONTRACTORINMPRIMENTAYIVE getting highlighted? And that is junk?If so, why not augment your indexing to throw out junk

Re: Restricting results based on user authentication

Thanks Chris, I agree with your approach. I also dont want to add anything at the application level. I want authentication to be handled internally at the Solr level itself. Can you please explain me little more about how to add a role field to each object at indexing time? Is there any

Re: Restricting results based on user authentication

On Mon, Jan 12, 2009 at 9:31 PM, Manupriya manupriya.si...@gmail.com wrote: Thanks Chris, I agree with your approach. I also dont want to add anything at the application level. I want authentication to be handled internally at the Solr level itself. The application layer needs to be