We can pass only a subset of the test cases. This subset corresponds to the SINGA ONNX operator coverage.
See for example the MXNET ONNX operator coverage: https://cwiki.apache.org/confluence/display/MXNET/ONNX+Operator+Coverage Moaz On Tue, May 21, 2019 at 4:30 PM Wang Wei <[email protected]> wrote: > Do we need to pass all 1116 tests? > > > > On Tue, May 21, 2019 at 9:14 PM Moaz Reyad (JIRA) <[email protected]> wrote: > > > Moaz Reyad created SINGA-458: > > -------------------------------- > > > > Summary: ONNX backend test failed > > Key: SINGA-458 > > URL: https://issues.apache.org/jira/browse/SINGA-458 > > Project: Singa > > Issue Type: Bug > > Reporter: Moaz Reyad > > > > > > The test of [SINGA ONNX backend| > > > https://github.com/apache/incubator-singa/blob/master/python/singa/sonnx.py#L224 > ] > > using [onnx.backend.test.BackendTest| > > > https://github.com/apache/incubator-singa/pull/462/commits/6dec4b24df8e469255c7399600eef27773f92052 > ] > > failed. > > > > There are 1116 unit tests and all of them fail with the error: > > > > > > {code:sh} > > Traceback (most recent call last): > > File > > > "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", > > line 248, in device_test_func > > return test_func(*args, device=device, **kwargs) > > File > > > "/home/moaz/singa/venv/local/lib/python2.7/site-packages/onnx/backend/test/runner/__init__.py", > > line 310, in run > > outputs = list(prepared_model.run(inputs)) > > File > > "/home/moaz/singa/venv/local/lib/python2.7/site-packages/singa/sonnx.py", > > line 198, in run > > tensors[x.name] = x > > AttributeError: 'numpy.ndarray' object has no attribute 'name' > > > > ---------------------------------------------------------------------- > > > > {code} > > > > > > > > > > > > -- > > This message was sent by Atlassian JIRA > > (v7.6.3#76005) > > >
