[Dspace-devel] [DuraSpace JIRA] Updated: (DS-739) Improve performance of Lucene indexing

2010-11-04 Thread Graham Triggs (DuraSpace JIRA)

 [ 
https://jira.duraspace.org/browse/DS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Graham Triggs updated DS-739:
-

Status: Open  (was: Received)

> Improve performance of Lucene indexing
> --
>
> Key: DS-739
> URL: https://jira.duraspace.org/browse/DS-739
> Project: DSpace
>  Issue Type: Improvement
>Reporter: Graham Triggs
>Assignee: Graham Triggs
> Fix For: 1.7.0
>
>


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
https://jira.duraspace.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira



--
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a 
Billion" shares his insights and actions to help propel your 
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
___
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel


[Dspace-devel] [DuraSpace JIRA] Updated: (DS-739) Improve performance of Lucene indexing

2010-11-04 Thread Graham Triggs (DuraSpace JIRA)

 [ 
https://jira.duraspace.org/browse/DS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Graham Triggs updated DS-739:
-

Description: 
Adds a batch processing mode for Lucene indexes.

Can be controlled by calling DSIndexer.setBatchProcessingMode(boolean).

NB: If you set batch processing mode to true, ensure that you set it to 'false' 
at the end of the batch to flush any unwritten documents.

The size of the batch can be controlled by setting a numeric value in 
dspace.cfg for the property: search.batch.documents

By default, the size of the batch is 20 documents.

> Improve performance of Lucene indexing
> --
>
> Key: DS-739
> URL: https://jira.duraspace.org/browse/DS-739
> Project: DSpace
>  Issue Type: Improvement
>Reporter: Graham Triggs
>Assignee: Graham Triggs
> Fix For: 1.7.0
>
>
> Adds a batch processing mode for Lucene indexes.
> Can be controlled by calling DSIndexer.setBatchProcessingMode(boolean).
> NB: If you set batch processing mode to true, ensure that you set it to 
> 'false' at the end of the batch to flush any unwritten documents.
> The size of the batch can be controlled by setting a numeric value in 
> dspace.cfg for the property: search.batch.documents
> By default, the size of the batch is 20 documents.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
https://jira.duraspace.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira



--
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a 
Billion" shares his insights and actions to help propel your 
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
___
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel


[Dspace-devel] [DuraSpace JIRA] Updated: (DS-739) Improve performance of Lucene indexing

2010-11-04 Thread Graham Triggs (DuraSpace JIRA)

 [ 
https://jira.duraspace.org/browse/DS-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Graham Triggs updated DS-739:
-

Documentation Status: In Description  (was: Not Required)
 Description: 
Adds a batch processing mode for Lucene indexes.

Can be controlled by calling DSIndexer.setBatchProcessingMode(boolean).

NB: If you set batch processing mode to true, ensure that you set it to 'false' 
at the end of the batch to flush any unwritten documents.

The size of the batch can be controlled by setting a numeric value in 
dspace.cfg for the property: search.batch.documents

By default, the size of the batch is 20 documents.


Additionally, there is the possibility to create a 'delayed index flusher'. If 
a web application pushes multiple search requests (ie. a barrage or sword 
deposits, or multiple quick edits in the ui), then this will combine them into 
a single index update (up to the limit of the batch defined above).

To use the delayed update, set the property 'search.index.delay' in dspace.cfg 
to the number of milliseconds to wait for an update. eg.

search.index.delay = 5000

will hold a Lucene update in a queue for up to 5 seconds. After 5 seconds - or 
the batch limit above is reached - all waiting updates will be written to the 
Lucene index.

  was:
Adds a batch processing mode for Lucene indexes.

Can be controlled by calling DSIndexer.setBatchProcessingMode(boolean).

NB: If you set batch processing mode to true, ensure that you set it to 'false' 
at the end of the batch to flush any unwritten documents.

The size of the batch can be controlled by setting a numeric value in 
dspace.cfg for the property: search.batch.documents

By default, the size of the batch is 20 documents.


> Improve performance of Lucene indexing
> --
>
> Key: DS-739
> URL: https://jira.duraspace.org/browse/DS-739
> Project: DSpace
>  Issue Type: Improvement
>Reporter: Graham Triggs
>Assignee: Graham Triggs
> Fix For: 1.7.0
>
>
> Adds a batch processing mode for Lucene indexes.
> Can be controlled by calling DSIndexer.setBatchProcessingMode(boolean).
> NB: If you set batch processing mode to true, ensure that you set it to 
> 'false' at the end of the batch to flush any unwritten documents.
> The size of the batch can be controlled by setting a numeric value in 
> dspace.cfg for the property: search.batch.documents
> By default, the size of the batch is 20 documents.
> Additionally, there is the possibility to create a 'delayed index flusher'. 
> If a web application pushes multiple search requests (ie. a barrage or sword 
> deposits, or multiple quick edits in the ui), then this will combine them 
> into a single index update (up to the limit of the batch defined above).
> To use the delayed update, set the property 'search.index.delay' in 
> dspace.cfg to the number of milliseconds to wait for an update. eg.
> search.index.delay = 5000
> will hold a Lucene update in a queue for up to 5 seconds. After 5 seconds - 
> or the batch limit above is reached - all waiting updates will be written to 
> the Lucene index.

-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: 
https://jira.duraspace.org/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira



--
The Next 800 Companies to Lead America's Growth: New Video Whitepaper
David G. Thomson, author of the best-selling book "Blueprint to a 
Billion" shares his insights and actions to help propel your 
business during the next growth cycle. Listen Now!
http://p.sf.net/sfu/SAP-dev2dev
___
Dspace-devel mailing list
Dspace-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-devel