Richard Zowalla created OPENNLP-1982:
----------------------------------------
Summary: SentenceVectorsDL cannot run on a GPU
Key: OPENNLP-1982
URL: https://issues.apache.org/jira/browse/OPENNLP-1982
Project: OpenNLP
Issue Type: Improvement
Reporter: Richard Zowalla
Fix For: 3.0.0
{{SentenceVectorsDL}} always creates default {{OrtSession.SessionOptions}}, so
unlike {{NameFinderDL}} and {{DocumentCategorizerDL}} it cannot use the CUDA
execution provider through {{InferenceOptions}}. Add a constructor that takes
{{InferenceOptions}} and, once OPENNLP\-1937 is in, expose the device \(e.g.
{{cpu}} / {{cuda:N}}\), a maximum batch size and the intra\-op thread count as
options of the ONNX text embedder provider.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
