Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
Thanks that runs fine now. RBS On Mon, Sep 4, 2017 at 8:45 AM, Richard Hipp wrote: > On 9/4/17, Bart Smissaert wrote: > > > > malformed JSON > > > > SQLite should never segfault, regardless of whether or not the JSON is > malformed. > > The ticket (https://sqlite.org/src/info/b899b6042f97f5) shows a > modified test case that uses no JSON at all. > > -- > D. Richard Hipp > d...@sqlite.org > ___ > sqlite-users mailing list > sqlite-users@mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users > ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
Thanks, this runs OK now. I am not familiar with JSON, but was just trying this out and see if I could make it work in SQLite. RBS On Mon, Sep 4, 2017 at 8:40 AM, Rowan Worth wrote: > On 4 September 2017 at 15:37, Bart Smissaert > wrote: > > > Trying this out, so I edited the source and indeed now there is no crash. > > I get however a message: > > > > malformed JSON > > > > This is the dump of that testing table, dataset: > > > > doc > > {"field1": [{"value": "val1"}, {"value": "val2"}] > > {"field1": [{"value": "val3"}, {"value": "val2"}] > > {"field1": [{"value": "val4"}, {"value": "val1"}] > > > > Is there anything wrong with this JSON data? > > > > Yes, it's malformed. > > > ... :P > Specifically, there's no closing curly brace for the top-level object. > > {"field1": > [ > {"value": "val1"}, > {"value": "val2"} > ] > *** MISSING CURLY BRACE HERE *** > > -Rowan > ___ > sqlite-users mailing list > sqlite-users@mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users > ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
On 9/4/17, Bart Smissaert wrote: > > malformed JSON > SQLite should never segfault, regardless of whether or not the JSON is malformed. The ticket (https://sqlite.org/src/info/b899b6042f97f5) shows a modified test case that uses no JSON at all. -- D. Richard Hipp d...@sqlite.org ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
On 4 September 2017 at 15:37, Bart Smissaert wrote: > Trying this out, so I edited the source and indeed now there is no crash. > I get however a message: > > malformed JSON > > This is the dump of that testing table, dataset: > > doc > {"field1": [{"value": "val1"}, {"value": "val2"}] > {"field1": [{"value": "val3"}, {"value": "val2"}] > {"field1": [{"value": "val4"}, {"value": "val1"}] > > Is there anything wrong with this JSON data? > Yes, it's malformed. ... :P Specifically, there's no closing curly brace for the top-level object. {"field1": [ {"value": "val1"}, {"value": "val2"} ] *** MISSING CURLY BRACE HERE *** -Rowan ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
Trying this out, so I edited the source and indeed now there is no crash. I get however a message: malformed JSON This is the dump of that testing table, dataset: doc {"field1": [{"value": "val1"}, {"value": "val2"}] {"field1": [{"value": "val3"}, {"value": "val2"}] {"field1": [{"value": "val4"}, {"value": "val1"}] Is there anything wrong with this JSON data? RBS On Mon, Sep 4, 2017 at 1:35 AM, Richard Hipp wrote: > A proposed fix for this problem is now on trunk. > > > On 9/3/17, Richard Hipp wrote: > > On 9/3/17, Martin Thierer wrote: > >> I'm consistently getting a core dump for a query that has json > >> functions in a subquery. The same functions work fine in other > >> queries. > > > > Thanks for the concise bug report. A ticket is here: > > https://sqlite.org/src/tktview/b899b6042f97f > > > > I'm away from the office at a database conference (in Tokyo - all > > y'all Tokyo-based SQLite users come say "hello" to me at > > http://www.db-tech-showcase.com/dbts/tokyo) so I have limited cycles > > available to work on this. Dan or Joe might be able to fix this when > > they get to the office in about 12 hours if I can't get to it before > > then. > > > > -- > > D. Richard Hipp > > d...@sqlite.org > > > > > -- > D. Richard Hipp > d...@sqlite.org > ___ > sqlite-users mailing list > sqlite-users@mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users > ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
A proposed fix for this problem is now on trunk. On 9/3/17, Richard Hipp wrote: > On 9/3/17, Martin Thierer wrote: >> I'm consistently getting a core dump for a query that has json >> functions in a subquery. The same functions work fine in other >> queries. > > Thanks for the concise bug report. A ticket is here: > https://sqlite.org/src/tktview/b899b6042f97f > > I'm away from the office at a database conference (in Tokyo - all > y'all Tokyo-based SQLite users come say "hello" to me at > http://www.db-tech-showcase.com/dbts/tokyo) so I have limited cycles > available to work on this. Dan or Joe might be able to fix this when > they get to the office in about 12 hours if I can't get to it before > then. > > -- > D. Richard Hipp > d...@sqlite.org > -- D. Richard Hipp d...@sqlite.org ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
Re: [sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
On 9/3/17, Martin Thierer wrote: > I'm consistently getting a core dump for a query that has json > functions in a subquery. The same functions work fine in other > queries. Thanks for the concise bug report. A ticket is here: https://sqlite.org/src/tktview/b899b6042f97f I'm away from the office at a database conference (in Tokyo - all y'all Tokyo-based SQLite users come say "hello" to me at http://www.db-tech-showcase.com/dbts/tokyo) so I have limited cycles available to work on this. Dan or Joe might be able to fix this when they get to the office in about 12 hours if I can't get to it before then. -- D. Richard Hipp d...@sqlite.org ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users
[sqlite] sqlite 3.20.1: Core dump when running query with json functions in subquery
I'm consistently getting a core dump for a query that has json functions in a subquery. The same functions work fine in other queries. I came up with this small example which triggers the crash for me when executed from the sqlite3 shell for a new, empty database: CREATE TABLE dataset ( doc TEXT ); INSERT INTO dataset VALUES ('{"field1": [{"value": "val1"}, {"value": "val2"}]'); INSERT INTO dataset VALUES ('{"field1": [{"value": "val3"}, {"value": "val2"}]'); INSERT INTO dataset VALUES ('{"field1": [{"value": "val4"}, {"value": "val1"}]'); SELECT * FROM dataset WHERE 'val1' IN (SELECT json_extract(json_each.value, '$.value') FROM json_each(json_extract(dataset.doc, '$.field'))); As I got syntax errors when copy-pasting even from my own email draft, I also put it here: https://gist.github.com/thierer/f4367232f58a452ff960fe61c3250fbe This is with sqlite 3.20.1 on Arch Linux x86_64. Thanks! (both for looking into this issue and sqlite in general...) Martin ___ sqlite-users mailing list sqlite-users@mailinglists.sqlite.org http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users