[jira] Updated: (SOLR-1352) DIH: MultiThreaded

2009-11-13 Thread Noble Paul (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-1352:
-

Attachment: SOLR-1352.patch

first cut an ugly patch. a lot of work left before putting it in

> DIH: MultiThreaded
> --
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
>  Issue Type: Improvement
>  Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we 
> have implemented most of the features , the next best thing we can aim for is 
> performance. DIH should be able to take advantage of multiple cores in a box 
> .I expect the configuration to be as follows
> {code:xml}
> 
> 
> 
> {code}
> at the entity where the numThreads is specified it should fork into multiple 
> threads. If the numThreads<2 it executes w/o forking. In debug mode it 
> automatically becomes singlethreaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (SOLR-1352) DIH: MultiThreaded

2009-11-13 Thread Noble Paul (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-1352:
-

Description: 
It has been a long pending request to make DIH multithreaded. Now that we have 
implemented most of the features , the next best thing we can aim for is 
performance. DIH should be able to take advantage of multiple cores in a box .I 
expect the configuration to be as follows

{code:xml}



{code}

at the entity where the threads is specified it should fork into multiple 
threads. If the threads<2 it executes w/o forking. In debug mode it 
automatically becomes singlethreaded.

  was:
It has been a long pending request to make DIH multithreaded. Now that we have 
implemented most of the features , the next best thing we can aim for is 
performance. DIH should be able to take advantage of multiple cores in a box .I 
expect the configuration to be as follows

{code:xml}



{code}

at the entity where the numThreads is specified it should fork into multiple 
threads. If the numThreads<2 it executes w/o forking. In debug mode it 
automatically becomes singlethreaded.


'numThreads' becomes' threads'

> DIH: MultiThreaded
> --
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
>  Issue Type: Improvement
>  Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we 
> have implemented most of the features , the next best thing we can aim for is 
> performance. DIH should be able to take advantage of multiple cores in a box 
> .I expect the configuration to be as follows
> {code:xml}
> 
> 
> 
> {code}
> at the entity where the threads is specified it should fork into multiple 
> threads. If the threads<2 it executes w/o forking. In debug mode it 
> automatically becomes singlethreaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (SOLR-1352) DIH: MultiThreaded

2009-12-07 Thread Noble Paul (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-1352:
-

Attachment: SOLR-1352.patch

updated to trunk

> DIH: MultiThreaded
> --
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
>  Issue Type: Improvement
>  Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch, SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we 
> have implemented most of the features , the next best thing we can aim for is 
> performance. DIH should be able to take advantage of multiple cores in a box 
> .I expect the configuration to be as follows
> {code:xml}
> 
> 
> 
> {code}
> at the entity where the threads is specified it should fork into multiple 
> threads. If the threads<2 it executes w/o forking. In debug mode it 
> automatically becomes singlethreaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (SOLR-1352) DIH: MultiThreaded

2009-12-23 Thread Noble Paul (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Noble Paul updated SOLR-1352:
-

Attachment: SOLR-1352.patch

More or less final. I plan to commit this soon

> DIH: MultiThreaded
> --
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
>  Issue Type: Improvement
>  Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch, SOLR-1352.patch, SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we 
> have implemented most of the features , the next best thing we can aim for is 
> performance. DIH should be able to take advantage of multiple cores in a box 
> .I expect the configuration to be as follows
> {code:xml}
> 
> 
> 
> {code}
> at the entity where the threads is specified it should fork into multiple 
> threads. If the threads<2 it executes w/o forking. In debug mode it 
> automatically becomes singlethreaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Updated: (SOLR-1352) DIH: MultiThreaded

2010-01-02 Thread Lance Norskog (JIRA) 

 [ 
https://issues.apache.org/jira/browse/SOLR-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lance Norskog updated SOLR-1352:


Comment: was deleted

(was: In the future, especially with multi-threaded operations, the DIH will 
benefit from converting to immutable objects wherever possible.
 I have used this technique on a few multithreaded projects and it has really 
helped:
http://codeidol.com/java/effective-java/Processing/Item-38-Favor-the-immutable,-for-it-needs-no-locks/

("Effective Enterprise Java" is one my favorite system architecture books.)

)

> DIH: MultiThreaded
> --
>
> Key: SOLR-1352
> URL: https://issues.apache.org/jira/browse/SOLR-1352
> Project: Solr
>  Issue Type: Improvement
>  Components: contrib - DataImportHandler
>Reporter: Noble Paul
>Assignee: Noble Paul
> Fix For: 1.5
>
> Attachments: SOLR-1352.patch, SOLR-1352.patch, SOLR-1352.patch
>
>
> It has been a long pending request to make DIH multithreaded. Now that we 
> have implemented most of the features , the next best thing we can aim for is 
> performance. DIH should be able to take advantage of multiple cores in a box 
> .I expect the configuration to be as follows
> {code:xml}
> 
> 
> 
> {code}
> at the entity where the threads is specified it should fork into multiple 
> threads. If the threads<2 it executes w/o forking. In debug mode it 
> automatically becomes singlethreaded.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.