This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch feat/embeddings-timings-tests
in repository https://gitbox.apache.org/repos/asf/opennlp.git
from 7a560bd7a OPENNLP-1935: Regex removal (10/10): Forbid java.util.regex
in production code (#1348)
add 576206d29 GH-1389, GH-1390: Let SentenceVectorsDL run on a GPU and fix
the first CUDA request in a fresh JVM
add 99d88ba09 GH-1389: Skip the opennlp-dl-gpu tests where onnxruntime_gpu
has no native library
add 28a73a6c5 GH-1391: Test that embedAll caps the token positions of one
inference
add ca6486cc9 GH-1391: Cap the token positions of one embedAll inference
add 0bb417c15 GH-1391: Shorten the embedAll Javadoc and compute the
expected batch sizes
add ff24bab8b GH-1391: Test the batch boundaries and split groups of
embedAll
new 21a813707 Add a JMH benchmark for SentenceVectorsDL
new 493fe3c4e Keep SentenceVectorsDL tensors off the Java heap
new b26898cac Document the SentenceVectorsDL benchmark and allocation
numbers
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
opennlp-core/opennlp-ml/opennlp-dl-gpu/pom.xml | 33 ++
opennlp-core/opennlp-ml/opennlp-dl/BENCHMARKS.md | 64 ++++
opennlp-core/opennlp-ml/opennlp-dl/pom.xml | 69 +++-
.../dl/vectors/SentenceVectorsDLBenchmark.java | 146 +++++++++
.../src/main/java/opennlp/dl/AbstractDL.java | 6 +-
.../java/opennlp/dl/vectors/SentenceVectorsDL.java | 223 ++++++++++---
.../opennlp/dl/AbstractDLColdStartCudaTest.java | 73 +++++
.../test/java/opennlp/dl/ColdStartCudaProbe.java | 58 ++++
.../src/test/java/opennlp/dl/GpuRequestTest.java | 112 +++++++
.../dl/vectors/OnnxTextEmbedderProviderTest.java | 11 +
.../vectors/SentenceVectorsDLBatchLimitTest.java | 293 +++++++++++++++++
.../dl/vectors/SentenceVectorsDLEmbedderTest.java | 57 ++++
.../SentenceVectorsDLInferenceOptionsTest.java | 349 +++++++++++++++++++++
opennlp-docs/src/docbkx/machine-learning.xml | 16 +
14 files changed, 1467 insertions(+), 43 deletions(-)
create mode 100644 opennlp-core/opennlp-ml/opennlp-dl/BENCHMARKS.md
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/jmh/java/opennlp/dl/vectors/SentenceVectorsDLBenchmark.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/AbstractDLColdStartCudaTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/ColdStartCudaProbe.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/GpuRequestTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLBatchLimitTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLInferenceOptionsTest.java
