Revision: 9457
http://gate.svn.sourceforge.net/gate/?rev=9457&view=rev
Author: ian_roberts
Date: 2008-02-25 06:23:15 -0800 (Mon, 25 Feb 2008)
Log Message:
-----------
Added support for multi-threading when learning a multi-to-binary model.
- Changed model storage format. Rather than concatenating all the binary
models into a single file, we now create a directory containing a file with
the overall multi-model meta data and one file per binary model. If you try
and apply an old-style single-file model it will be transparently upgraded to
the new multi-file format.
- Rather than directly executing the multiple binary learning/application tasks
in sequence, MultiClassLearning now sets the tasks up as a List of Callables
and uses an ExecutorService to run them.
- The default executor (InThreadExecutorService) simply runs the tasks in
sequence in the main thread, as before, but a new optional "thread-pool-size"
attribute on the <multiClassification2Binary> config file element will cause
MultiClassLearning to use a fixed-size ThreadPoolExecutor instead, thus
running several tasks in parallel.
The difference is most noticeable on large training data sets with a
multi-processor machine. The default single thread approach may well be faster
on a single-processor machine or with a small dataset, the optimal setting can
only be determined by experiment.
Modified Paths:
--------------
gate/trunk/plugins/learning/src/gate/learning/ConstantParameters.java
gate/trunk/plugins/learning/src/gate/learning/LearningEngineSettings.java
gate/trunk/plugins/learning/src/gate/learning/LightWeightLearningApi.java
gate/trunk/plugins/learning/src/gate/learning/learners/MultiClassLearning.java
gate/trunk/plugins/learning/src/gate/learning/learners/weka/WekaLearning.java
gate/trunk/plugins/learning/test/chunklearning/engines-svm.xml
Added Paths:
-----------
gate/trunk/plugins/learning/src/gate/learning/learners/InThreadExecutorService.java
This was sent by the SourceForge.net collaborative development platform, the
world's largest Open Source development site.
-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
GATE-cvs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gate-cvs
