[Numpy-discussion] Re: Exporting numpy arrays to binary JSON (BJData) for better portability

2022-08-27 Thread Francesc Alted
Hi Qianqian, Your work in bjdata's is very interesting. Our team (Blosc) has been working on something along these lines, and I was curious on how the different approaches compares. In particular, Blosc2 uses the msgpack format to store binary data in a flexible way, but in my experience, using

[Numpy-discussion] Re: Exporting numpy arrays to binary JSON (BJData) for better portability

2022-08-27 Thread Qianqian Fang
hi Francesc, wonderful works on blosc2! congrats! this is exactly the direction that I would hope more data creators/data users would pay attention to. clearly blosc2 is a well positioned for high performance - msgpack is one of the most proliferated binary JSON formats out there, with many

[Numpy-discussion] Re: Exporting numpy arrays to binary JSON (BJData) for better portability

2022-08-27 Thread Stephan Hoyer
On Sat, Aug 27, 2022 at 9:17 AM Qianqian Fang wrote: > 2. a key belief > > of the NeuroJSON project is that "human readability" is the single most > important factor to decide the longevity of both codes and data. The > human