On 2/25/19, Robert M. Münch <robert.mue...@saphirion.com> wrote:
> Hi, see: https://github.com/lemire/simdjson
>
> Can parse GB/s of JSON input. This might be a good candidate to use in the
> extension.
Thanks for the link.
I downloaded one of the sample input files "gsoc-2018.json" and then
ran the following test case using the SQLite command-line shell:
.timer on
SELECT length(readfile('/home/drh/tmp/gsoc-2018.json'));
WITH RECURSIVE c(x) AS (VALUES(1) UNION ALL SELECT x+1 FROM c WHERE x<1000)
SELECT sum(json_valid(readfile('/home/drh/tmp/gsoc-2018.json'))) FROM c;
The script above first measures the length of the input json file
(3327831 bytes) then it parses the file 1000 times. The second second
statement ran in 1.101 seconds (real time) on my 4-year-old linux
workstation, for a performance of just over 3GB/sec, which is slightly
faster than reported simdjson performance of 2.9GB/sec.
--
D. Richard Hipp
d...@sqlite.org
_______________________________________________
sqlite-users mailing list
sqlite-users@mailinglists.sqlite.org
http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
