Hi Fernando,
Currently there are no explicit plans to do it, but that would be
certainly useful if other implementation start implementing tensor IPC
support.
One should start by defining a reference format (probably JSON) such as
exists for other IPC types:
https://arrow.apache.org/docs/format/Integration.html
Regards
Antoine.
Le 16/03/2021 à 10:02, Fernando Herrera a écrit :
Are there any plans to include integration testing for tensors in the
pipeline?
Thanks,
Fernando
On Mon, Mar 15, 2021 at 8:16 PM Antoine Pitrou <anto...@python.org> wrote:
On Mon, 15 Mar 2021 19:48:22 +0000
Fernando Herrera <fernando.j.herr...@gmail.com> wrote:
Hi Neal,
Thanks for the update and the link.
I found that the project has these files for tensor checking
https://github.com/apache/arrow-testing/tree/e8ce32338f2dfeca3a5126f7677bdee159604000/data/arrow-ipc-tensor-stream
So, if I understand correctly, for any application to be compatible
with C++ tensors it should be able to read these files. Am I correct?
No, these are invalid files found by fuzz testing, that used to crash
the C++ IPC reader. More information here:
https://arrow.apache.org/docs/developers/cpp/fuzzing.html
We don't have any reference files for integration testing of tensors
and sparse tensors currently.
Regards
Antoine.
