Thilo-Alexander Ginkel created IGNITE-13344:
-----------------------------------------------
Summary: DummyVectorizer fails to extract label for coordinate
with value "0.0" when backed by sparse vector
Key: IGNITE-13344
URL: https://issues.apache.org/jira/browse/IGNITE-13344
Project: Ignite
Issue Type: Bug
Components: ml
Affects Versions: 2.8.1
Reporter: Thilo-Alexander Ginkel
Given: A labeled DummyVectorizer:
{code:java}
new DummyVectorizer<String>()
.exclude(excludeCoordinates.stream().map(coord -> vectorLength +
coord).toArray(Integer[]::new))
.labeled(labelCoord);
{code}
{{When extracting the label, the call hierarchy eventually ends up at
org.apache.ignite.ml.dataset.feature.extractor.impl.DummyVectorizer#feature,
which returns null for val.getRaw when val is a sparse vector with the element
at the requested label coordinate being 0.0. This causes the training job to
fail (which expects a non-null label):}}
{noformat}
org.apache.ignite.IgniteException: Remote job threw user exception (override or
implement ComputeTask.result(..) method if you would like to have automatic
failover for this exception): nullorg.apache.ignite.IgniteException: Remote job
threw user exception (override or implement ComputeTask.result(..) method if
you would like to have automatic failover for this exception): null at
org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7037)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1146)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker.finishJob(GridJobWorker.java:961)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker.finishJob(GridJobWorker.java:809)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:659)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:519)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
~[ignite-core-2.8.1.jar:2.8.1] at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
~[na:na] at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630)
~[na:na] at java.base/java.lang.Thread.run(Thread.java:832) ~[na:na]Caused by:
org.apache.ignite.IgniteException: null at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1858)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:596)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7005)
~[ignite-core-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:590)
~[ignite-core-2.8.1.jar:2.8.1] ... 5 common frames omittedCaused by:
java.lang.NullPointerException: null at
org.apache.ignite.ml.dataset.impl.bootstrapping.BootstrappedDatasetBuilder.build(BootstrappedDatasetBuilder.java:91)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.bootstrapping.BootstrappedDatasetBuilder.build(BootstrappedDatasetBuilder.java:41)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.lambda$getData$4(ComputeUtils.java:239)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.cache.util.PartitionDataStorage.lambda$computeDataIfAbsent$1(PartitionDataStorage.java:56)
~[ignite-ml-2.8.1.jar:2.8.1] at
java.base/java.util.concurrent.ConcurrentHashMap.computeIfAbsent(ConcurrentHashMap.java:1708)
~[na:na] at
org.apache.ignite.ml.dataset.impl.cache.util.PartitionDataStorage.computeDataIfAbsent(PartitionDataStorage.java:56)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils.getData(ComputeUtils.java:209)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.cache.CacheBasedDataset.lambda$compute$c7cefc59$1(CacheBasedDataset.java:172)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.ml.dataset.impl.cache.util.ComputeUtils$DeployableCallable.call(ComputeUtils.java:432)
~[ignite-ml-2.8.1.jar:2.8.1] at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855)
~[ignite-core-2.8.1.jar:2.8.1] ... 8 common frames omitted{noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
