Re: [sqlite] [EXTERNAL] Re: Any operation to trigger osMunmap?

2018-04-19 Thread Hick Gunter
For PSS to become smaller, pages have to be either unmapped or evicted from main memory by the OS. Probably the only way to force SQLite to unmap the memory is to set a new mmap_size (possibly after closing and reopening the database connection, which will cause a boatload of IO that most

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Petite Abeille
> On Apr 19, 2018, at 1:06 PM, Richard Hipp wrote: > > We are open to adding MERGE INTO at some point in the future. Excellent! > But the UPSERT syntax is both easier to understand Debatable. > and easier to implement, Possibly. > and we prefer to follow PostgreSQL

[sqlite] sqldiff wish list

2018-04-19 Thread Dominique Devienne
Hi, First, thanks for the tool. It's a useful one. But here's a quick wish-list, after using the tool in a real use case: 1) a --version switch, to know which SQLite version is statically compiled inside sqldiff 2) in-row difference: Within a row-pair, generate a minimal UPDATE and omits all

[sqlite] UPSERT available in pre-release

2018-04-19 Thread Richard Hipp
The latest pre-release snapshot [1] contains support for UPSERT following the PostgreSQL syntax. The documentation is still pending. Nevertheless, early feedback is welcomed. You can respond either to this mailing list, or directly to me. -- D. Richard Hipp d...@sqlite.org

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Richard Hipp
On 4/19/18, Petite Abeille wrote: > > >> On Apr 19, 2018, at 12:29 PM, Richard Hipp wrote: >> >> The latest pre-release snapshot [1] > > Link missing? [1] https://sqlite.org/download.html > >> contains support for UPSERT >> following the PostgreSQL

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Petite Abeille
> On Apr 19, 2018, at 12:29 PM, Richard Hipp wrote: > > The latest pre-release snapshot [1] Link missing? > contains support for UPSERT > following the PostgreSQL syntax. > The documentation is still pending. > Nevertheless, early feedback is welcomed. You can respond

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Shevek
Opinion: Of all the DBMS's UPSERT/MERGE semantics, postgresql's is the least useful because it's very limited: It can only do a check against a constraint, and the cost of evaluating that constraint has to be carried by all other statements which mutate the table. Oracle/Teradata MERGE is a

[sqlite] SQLiteProviderServices Access

2018-04-19 Thread Efe Burak
Hi can we make SQLiteProviderServices public? I need to initialize the database from the code and was surprised to find the class is internal sealed. Or I can use any other alternatives to initializing the db without an App.Config. I have no access to App.Config being used in the application.

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Quan Yong Zhai
Dear Richard, I modified the wordcount.c in SQLite/test directory, to use the new upsert command: INSERT INTO wordcount(word,cnt) VALUES(?1,1) ON CONFLICT(word) DO UPDATE SET cnt=cnt+1 Before: wordcount --all :memory: sqlite3.c 2.406 wordcount --insert 2.296 wordcount --insert

Re: [sqlite] UPSERT available in pre-release

2018-04-19 Thread Richard Hipp
On 4/19/18, Quan Yong Zhai wrote: > I modified the wordcount.c in SQLite/test directory, to use the new upsert > > Before: >wordcount --all :memory: sqlite3.c > 2.406 wordcount --insert > 2.296 wordcount --insert --without-rowid > > After: > wordcount --all :memory:

Re: [sqlite] Are you getting spam when you post to sqlite-users ?

2018-04-19 Thread Keith Medcalf
Richard, The ARIN PPML has the same spammer harvesting their list to get subscriber email addresses and replying with the same type of "spam" ... --- The fact that there's a Highway to Hell but only a Stairway to Heaven says a lot about anticipated traffic volume. >-Original

[sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread MARCHAND Loïc
I index a file in a SQLite DB. I create my table with this: CREATE TABLE Record (RecordID INTEGER,Data TEXT,PRIMARY KEY (RecordID)) I read a file, and for each line I add a row on the table. Each line can have binary data at end. It's not a problem for many chars, but \0 char make a problem. If

Re: [sqlite] JDBC driver experience

2018-04-19 Thread dmp
> Are you using SQLite with JDBC? If so, can you please answer a few > questions below? > You can post on this mailing list or send your reply directly to me. 1. Which JDBC are you using? Current Xerial SQLite JDBC https://github.com/xerial/sqlite-jdbc Others that I have tried are a

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread Simon Slavin
On 19 Apr 2018, at 1:27pm, MARCHAND Loïc wrote: > CREATE TABLE Record (RecordID INTEGER,Data TEXT,PRIMARY KEY (RecordID)) > > I read a file, and for each line I add a row on the table. Each line can have > binary data at end. It's not a problem for many chars, but

Re: [sqlite] JDBC driver experience

2018-04-19 Thread Eduardo Morras
On Thu, 19 Apr 2018 09:37:20 -0700 "dmp" wrote: > Currently I trying to complete a plugin for Ajqvue > that transfers data from others databases to SQLite. Hi, I made an odbc virtual table to achive this. It's closed source but the ¿difficulty? to develop one

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread David Raymond
After a little testing, of the core functions: Affected by \x00: substr like length quote replace when you're trying to replace the \x00 Not affected by \x00: plain ol select instr lower upper trim ltrim rtrim replace when you're not replacing the \x00 (works and replaces bits after the \x00 as

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
are you testing this in the sqlite3 shell or in your own program? You should have no issue getting thisdata, sqlite3_column_text followed by sqlite3_column_bytes (the byte count is set when the data is fetched in some format). without modification, you can either excape \0 with'||char(0)||'

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
It's not that it's impossible. https://github.com/mackyle/sqlite/compare/master...d3x0r:AllowInlineNulChars Improves handling in TCL, sqlite shell, and passing complete composed SQL strings to prepare... Which is why I know if you don't use the broken C-flavored(tainted) SQL String functions,

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread Keith Medcalf
Actually, nothing in the C or C++ world will "go past" the NULL byte since the very definition of a C string is a "bunch-o-bytes that are non-zero followed by one that is". If you want to embed non UTF8 text you should be using a BLOB not TEXT. Text means "an array of non-zero characters

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
On Thu, Apr 19, 2018 at 3:22 PM, Keith Medcalf wrote: > > Actually, nothing in the C or C++ world will "go past" the NULL byte since > the very definition of a C string is a "bunch-o-bytes that are non-zero > followed by one that is". > > that doesnt' mean you can use a

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
On Thu, Apr 19, 2018 at 3:37 PM, J Decker wrote: > > > On Thu, Apr 19, 2018 at 3:22 PM, Keith Medcalf > wrote: > >> >> Actually, nothing in the C or C++ world will "go past" the NULL byte >> since the very definition of a C string is a "bunch-o-bytes that

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread Keith Medcalf
And what makes you think a "javascript string" is a "C string"? While the "string" part may be the same, "javascript" certainly does not equal "C". Just like you do not have issues with embedded zero-bytes in "pascal strings". Note that "pascal" != "C" even though "string" == "string".

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
On Thu, Apr 19, 2018 at 4:07 PM, Keith Medcalf wrote: > > And what makes you think a "javascript string" is a "C string"? While the > "string" part may be the same, "javascript" certainly does not equal "C". > Just like you do not have issues with embedded zero-bytes in

Re: [sqlite] SQLite3 - Search on text field with \0 binary data

2018-04-19 Thread J Decker
On Thu, Apr 19, 2018 at 1:49 PM, David Raymond wrote: > After a little testing, of the core functions: > > Affected by \x00: > substr > like > length > quote > replace when you're trying to replace the \x00 > > Not affected by \x00: > plain ol select > instr > lower >