Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Swapna,

Your answers are inline.

2009/9/30 swapna_here swapna.here...@gmail.com:

 hi all,

 I have indexed 10 documents (daily around 5000 documents will be indexed
 one at a time to solr)
 at the same time daily few(around 2000) indexed documents (added 30 days
 back) will be deleted using DeleteByQuery of SolrJ
 Previously each document used to be indexed within 5ms..
 but recently i am facing a delay (sometimes 2min to 10 min) while adding
 document to index.
 And my index (folder) size is also increased to 625MB which is very large
 Previously it was around 230MB

 My Questions are:

 1) is solr not deleting the older documents(added 30 days back) permenently
 from index event after committing

Have you run optimize?

 2)Why the index size is increased

If 5000 docs are added daily and only 2000 deleted, the index size
would increase because of the remaining 3000 documents.

 3)reason for delay (2min to 10 mins) while adding the document one at a time
 to index

I don't know why this would happen. Is your disk nearly full? Which OS
are you running on? What is the configuration of Solr?

 Help is appreciated

 Thanks in advance..

 --
 View this message in context: 
 http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25676777.html
 Sent from the Solr - User mailing list archive at Nabble.com.



Hope this helps
Pravin


Re: Solr Porting to .Net

2009-09-30 Thread Pravin Paratey
You may want to check out - http://code.google.com/p/solrnet/

2009/9/30 Antonio Calò anton.c...@gmail.com:
 Hi All

 I'm wondering if is already available a Solr version for .Net or if it is
 still under development/planning. I've searched on Solr website but I've
 found only info on Lucene .Net project.

 Best Regards

 Antonio

 --
 Antonio Calò
 --
 Software Developer Engineer
 @ Intellisemantic
 Mail anton.c...@gmail.com
 Tel. 011-56.90.429
 --



Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Also, what is your merge factor set to?

Pravin

2009/9/30 Pravin Paratey prav...@gmail.com:
 Swapna,

 Your answers are inline.

 2009/9/30 swapna_here swapna.here...@gmail.com:

 hi all,

 I have indexed 10 documents (daily around 5000 documents will be indexed
 one at a time to solr)
 at the same time daily few(around 2000) indexed documents (added 30 days
 back) will be deleted using DeleteByQuery of SolrJ
 Previously each document used to be indexed within 5ms..
 but recently i am facing a delay (sometimes 2min to 10 min) while adding
 document to index.
 And my index (folder) size is also increased to 625MB which is very large
 Previously it was around 230MB

 My Questions are:

 1) is solr not deleting the older documents(added 30 days back) permenently
 from index event after committing

 Have you run optimize?

 2)Why the index size is increased

 If 5000 docs are added daily and only 2000 deleted, the index size
 would increase because of the remaining 3000 documents.

 3)reason for delay (2min to 10 mins) while adding the document one at a time
 to index

 I don't know why this would happen. Is your disk nearly full? Which OS
 are you running on? What is the configuration of Solr?

 Help is appreciated

 Thanks in advance..

 --
 View this message in context: 
 http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25676777.html
 Sent from the Solr - User mailing list archive at Nabble.com.



 Hope this helps
 Pravin



Re: delay while adding document to solr index

2009-09-30 Thread Pravin Paratey
Swapna

While the disk space does increase during the process of optimization,
it should almost always return to the original size or slightly less.

This is a silly question. But off the top of my head, I can't think of
any other reason why the index size would increase - Are you running a
commit/ after adding documents?

If you are, you might want to compare the size of each document being
currently indexed with the ones you indexed a few months back.

To optimize the index, simply post optimize/ to Solr. Or read
[http://wiki.apache.org/solr/SolrOperationsTools]

Pravin

2009/9/30 swapna_here swapna.here...@gmail.com:

 thanks for your reply
 i have not optimized at all
 my knowledge is optimize improves the query performance but it will take
 more disk space
 except that i have no idea how to use it

 previously for 10 documents the size occupied was around 250MB

 But after 2 months it is 625MB

 why this happened ?
 is it because i have not optimized the index
 can any body tell me when and how to optimize the index(with configuration
 details) .
 --
 View this message in context: 
 http://www.nabble.com/delay-while-adding-document-to-solr-index-tp25676777p25678531.html
 Sent from the Solr - User mailing list archive at Nabble.com.




Re: Solr configuration with Text files

2009-03-10 Thread Pravin Paratey
AFAIK, you're going to have to code something up. Do remember to add CDATA
tags to your xml.

On Tue, Mar 10, 2009 at 11:31 PM, KennyN kenneth.n...@sparta.com wrote:


 This functionality is possible 'out of the box', right? Or am I going to
 need
 to code up something that reads in the id named files and generates the xml
 file?
 --
 View this message in context:
 http://www.nabble.com/Solr-configuration-with-Text-files-tp22438201p22440095.html
 Sent from the Solr - User mailing list archive at Nabble.com.