Re: [sqlite] Tedious CSV import question

2009-09-26 Thread Petite Abeille
On Sep 25, 2009, at 9:03 PM, Wilson, Ronald wrote: Yeah. The clearest thing in the RFC is the ABNF grammar. However, even that leaves out common cases like white space outside of quoted fields, which most people would expect to be trimmed. Also, I think most people would expect

Re: [sqlite] Tedious CSV import question

2009-09-25 Thread Petite Abeille
On Sep 25, 2009, at 7:33 PM, Wilson, Ronald wrote: I read the RFC last night Oh, my... Programming in Lua has a nice, concise example regarding CSV parsing (near the end of the page): http://www.lua.org/pil/20.4.html Quote: To break a CSV into an array is more difficult, because we must

Re: [sqlite] Tedious CSV import question

2009-09-25 Thread Petite Abeille
On Sep 25, 2009, at 9:21 PM, C. Mundi wrote: Your post neatly articulates virtually every facet of this issue. Thank you. I wish we could get everyone to stop using csv. I hate to look at xml but I often wish everyone would use it instead of csv. In fact, in Switzerland, there is a federal

Re: [sqlite] Tedious CSV import question

2009-09-24 Thread Petite Abeille
On Sep 24, 2009, at 11:47 PM, Jay A. Kreibich wrote: The bigger issue is that CSV isn't really a format, but more of a loose idea. Right, that said, sticking to RFC 4180 is not such a bad bet: Common Format and MIME Type for Comma-Separated Values (CSV) Files

Re: [sqlite] How to disable fsync() in SQLite

2009-07-27 Thread Petite Abeille
On Jul 27, 2009, at 8:31 PM, W.-H. Gu wrote: Is there a way to disable fsync() pragma synchronous = off http://www.sqlite.org/pragma.html#pragma_synchronous -- PA. http://alt.textdrive.com/nanoki/ ___ sqlite-users mailing list

Re: [sqlite] Heirarchical queries question

2009-07-20 Thread Petite Abeille
On Jul 17, 2009, at 11:18 PM, Igor Tandetnik wrote: This is known as a nested-set model: http://dev.mysql.com/tech-resources/articles/hierarchical-data.html Perhaps of interest as well: Trees in the database: Advanced data structures http://www.alberton.info/talks

Re: [sqlite] Advice on which to use (SQLite or SQL Server) for the following app.

2009-06-11 Thread Petite Abeille
On Jun 11, 2009, at 4:53 PM, Sam Carleton wrote: I am a late comer to this discussion, so this might have already been purposed... Additionally, if this was not mentioned already, you can partition your database across multiple physical files through the magic of 'attach database' or

Re: [sqlite] Advice on which to use (SQLite or SQL Server) for the following app.

2009-06-11 Thread Petite Abeille
On Jun 11, 2009, at 9:05 PM, Jim Wilcoxson wrote: you will have to place each on its own physical disk drive to increase transaction rates. Arguably, such micro management of what data block sits on what disk spindle would be better left to the underlying volume manager or such. A bit

[sqlite] [ANN] IPLocation.db (20090201)

2009-02-05 Thread Petite Abeille
Hello, IPLocation.db provides access to MaxMind's GeoLite City data as a - rather hefty- SQLite3 database. http://alt.textdrive.com/assets/public/Nanoki/IPLocation.20090201.tar.bz2 (42.5 MB) Usage example: % sqlite3 IPLocation.db select location.start as start,

Re: [sqlite] Techniques to delay writes to SQLite

2009-02-03 Thread Petite Abeille
On Feb 3, 2009, at 3:12 PM, Brandon, Nicholas (UK) wrote: I'm open to other techniques particularly if they would be simpler to implement and manage! Using a queue of DML statements sound very reasonable :) Nanoki [1] uses that technique when indexing text documents with fts3: (1) A request

Re: [sqlite] Temporary table performance

2008-12-15 Thread Petite Abeille
On Dec 15, 2008, at 8:31 PM, Ofir Neuman wrote: What can I do in order to improve performance? take a look at pragma temp_store = memory http://www.sqlite.org/pragma.html#pragma_temp_store Will it be better to delete the content of the table instead of delete the table and recreate it?

Re: [sqlite] CURRENT_DATE Behavior

2008-10-22 Thread Petite Abeille
On Oct 21, 2008, at 10:44 PM, jonwood wrote: Given some of the comments here, one might wonder how those poor MS SQL Server folks are able to get anything working at all. ;-) Good point. Usually, they don't have anything working at all :)) Cheers, PA. -- http://alt.textdrive.com/nanoki/

Re: [sqlite] [Index] Listing 6001 after 601 and not after 801?

2008-10-05 Thread Petite Abeille
On Oct 5, 2008, at 3:59 PM, Gilles Ganault wrote: Is there a trick in SQL that lets me do this? ORDER BY ASC won't do this. order by to_char( account_id ) perhaps? -- PA. http://alt.textdrive.com/nanoki/ ___ sqlite-users mailing list

Re: [sqlite] SQLite syntax diagrams

2008-10-03 Thread Petite Abeille
On Oct 3, 2008, at 4:48 PM, D. Richard Hipp wrote: http://www.sqlite.org/draft/syntaxdiagrams.html http://www.sqlite.org/draft/lang.html Comments, criticism, and error reports are welcomed - particularly if they are received in time to be addressed prior to the release of 3.6.4, currently

Re: [sqlite] fts search, quoting and sippet generation

2008-09-08 Thread Petite Abeille
On Sep 7, 2008, at 1:46 AM, Peter Hoffmann wrote: 1) The first one is to strip out all tags before inserting new text into the virtual table. I don't want to do this, because I have a pure text interface too, where the tags in results won't hurt. Went down that road (i.e. stripping tags

Re: [sqlite] create table if not exists virtual table?

2008-08-30 Thread Petite Abeille
On Aug 28, 2008, at 11:39 PM, Scott Hess wrote: There is already such a feature request at: http://www.sqlite.org/cvstrac/tktview?tn=2604 I just added a patch there which, I believe, implements this. I'm going to float it on sqlite-dev to see if I'm missing anything. Nice :) Hope to see

Re: [sqlite] create table if not exists virtual table?

2008-08-27 Thread Petite Abeille
Hello, On Aug 26, 2008, at 11:34 PM, Dennis Cote wrote: Petite Abeille wrote: Is it possible to use 'if not exists' in conjunction with the creation DDL for a virtual table? No, its not possible. The syntax of a create table statement is shown here http://www.sqlite.org

Re: [sqlite] FTS, snippet Unicode?

2008-08-27 Thread Petite Abeille
On Aug 27, 2008, at 4:52 AM, Alexandre Courbot wrote: I know there is a patch at http://www.sqlite.org/cvstrac/tktview?tn=3140,38 that is supposed to improve Unicode support in FTS3. I suspect it to turn any Unicode character into a token - however maybe you can use it as a basis to

[sqlite] create table if not exists virtual table?

2008-08-26 Thread Petite Abeille
Hello, Is it possible to use 'if not exists' in conjunction with the creation DDL for a virtual table? For example: create table if not exists document( content text ) vs. create virtual table if not exists document using fts3( content text ) The first statement works as advertise, but the

[sqlite] FTS, snippet Unicode?

2008-08-26 Thread Petite Abeille
Hello, % sqlite3 -version 3.5.9 FTS's snippet seems to truncate Unicode sequences at time. For example, given the following text: Motto: ძალა ერთობაშია (Georgian) Strength is in Unity FTS's snippet would return the extract bellow for 'Unity, Freedom, Work': “… ��ია (Georgian) Strength is

[sqlite] SQL question

2008-08-18 Thread Petite Abeille
Hello, Not specific to sqlite, but a rather generic SQL question... Given a set of ids, what would be the proper way to find the records containing all those ids? Specifically, given a 'document_token' table containing a document_id mapping to multiple token_id, how would one find the

[sqlite] [ANN] IPLocation.db

2008-07-09 Thread Petite Abeille
Hello, IPLocation.db provides access to MaxMind's GeoLite City data as a - rather hefty- SQLite3 database. http://alt.textdrive.com/assets/public/Nanoki/IPLocation.100.zip (48.3 MB) Usage example: % sqlite3 IPLocation.db select location.start as start, location.end as

Re: [sqlite] SQL questions

2008-06-27 Thread Petite Abeille
On Jun 27, 2008, at 7:15 PM, Igor Tandetnik wrote: Personally, I never saw any DBMS that supported anything like this. I can't prove that none such exists, of course. Oracle provides something called Function Based Indexes:

Re: [sqlite] How to speed up my queries?

2008-06-03 Thread Petite Abeille
On Jun 3, 2008, at 7:27 PM, Christophe Leske wrote: i am a new member of this list and interested in speeding up my sqlite queries. There are no magic bullets, but The SQLite Query Optimizer Overview is a good read: http://www.sqlite.org/optoverview.html As well as Query Plans:

Re: [sqlite] 'insert or ignore' vs self join?

2008-05-28 Thread Petite Abeille
Hello, On May 27, 2008, at 9:07 PM, Stephen Oberholtzer wrote: Well, the first thing you should bring away from this experience is that the number of VM instructions isn't really an indicator of how efficient the query is :) Good point :) Now, I'm not sure exactly why one is faster

[sqlite] 'insert or ignore' vs self join?

2008-05-27 Thread Petite Abeille
Hello, % sqlite3 -version 3.5.9 I'm trying to figure out a frugal way to handle a unique key constrain... I tried using both 'insert or ignore' and a self join. The self join seems to be noticeably faster even though 'insert or ignore' would empirically appear to be the better deal

Re: [sqlite] Exceptions to sorting?

2008-05-17 Thread Petite Abeille
On May 16, 2008, at 11:07 PM, Igor Tandetnik wrote: Well, for any string A there exists another string B that sorts after A. How can I guarantee that, after I choose A as my sorts after everything marker, somebody doesn't put B into the database? Well... not to beat a dead horse or

Re: [sqlite] FTS3 Question

2008-05-17 Thread Petite Abeille
On May 17, 2008, at 9:49 AM, Mike Marshall wrote: SELECT guid FROM data WHERE text MATCH SELECT query FROM category Perhaps something along these lines: select data.guid fromdata joincategory on category.guid = data.guid where data.text match category.query Or something :) -- PA.

Re: [sqlite] Exceptions to sorting?

2008-05-16 Thread Petite Abeille
On May 16, 2008, at 10:23 PM, Andrés G. Aragoneses wrote: If I use ORDER BY ItemName = '', ItemNameLowered I get 2,1,3 and I want to get 1,3,2. Any ideas? Perhaps something like: select * from item order by case when name = '' then 'z' else name end --

Re: [sqlite] Exceptions to sorting?

2008-05-16 Thread Petite Abeille
On May 16, 2008, at 10:41 PM, Igor Tandetnik wrote: That would sort 'zebra' after ''. Well... this is meant as an example... 'z' should be whatever character one deems appropriate, e.g. '{' or whatever utf-8 sequence does the job. -- PA. http://alt.textdrive.com/nanoki/

Re: [sqlite] Exceptions to sorting?

2008-05-16 Thread Petite Abeille
On May 16, 2008, at 10:40 PM, Andrés G. Aragoneses wrote: Interesting, but the replacement to 'z' seems kind of a hack, I would not prefer magic strings... Well... it doesn't have to be 'z'... it's just an example... choose whatever character sequence is relevant to get the proper ordering

Re: [sqlite] SQLite version 3.5.9

2008-05-14 Thread Petite Abeille
Hello, On May 14, 2008, at 7:17 PM, D. Richard Hipp wrote: There is also a new *experimental* PRAGMA called journal_mode which can provide performance improvements under some circumstances. I'm trying the new journal_mode pragma: % uname -v Darwin Kernel Version 9.2.2;

Re: [sqlite] SQLite version 3.5.9

2008-05-14 Thread Petite Abeille
On May 14, 2008, at 8:10 PM, D. Richard Hipp wrote: Works for me. Did you compile the shell yourself or use the prebuilt binary? I did compile it myself. Any additional configuration(s) one should take care of to enable this pragma? ___

Re: [sqlite] SQLite version 3.5.9

2008-05-14 Thread Petite Abeille
On May 14, 2008, at 8:10 PM, D. Richard Hipp wrote: Works for me. Did you compile the shell yourself or use the prebuilt binary? Ooops... never mind... the shell works fine... I was using sqlite3_prepare and my application was linked against a different version of the lib... Everything

Re: [sqlite] property/config file for SQLite

2008-05-02 Thread Petite Abeille
On May 2, 2008, at 8:50 PM, [EMAIL PROTECTED] wrote: Is there a way to configure SQLite using a property/config file? Is changing the source code the only way to affect how it behaves? Have you looked at pragmas? http://www.sqlite.org/pragma.html -- PA. http://alt.textdrive.com/nanoki/

Re: [sqlite] accented characters upper/lower case in SELECT LIKE statements

2008-05-01 Thread Petite Abeille
On May 1, 2008, at 4:09 PM, Jay A. Kreibich wrote: As the document referenced above explains, you can create a user function called like(A,B) that will over-ride the built-in behavior for LIKE. If you're only dealing with one language, such as Brazilian-Portuguese, then you can just

[sqlite] query execution plan inconsistency?

2008-04-26 Thread Petite Abeille
Hello, [sqlite 3.5.8, Mac OS X 10.5.2] Given the following schema [1]: document - document_token - token I'm trying to retrieve some documents with a set of token(s) [2]. Things works rather fine when looking for multiple tokens: select sum( document_token.weight ) as score,

[sqlite] explain query plan?

2008-04-17 Thread Petite Abeille
Hello, In index using and explain using question, Dennis Cote wrote: An EXPLAIN QUERY PLAN returns three columns. The output of explain query plan is not documented (to the best of my knowledge anyway), but is fairly self explanatory. It shows the order that tables are scanned and which

Re: [sqlite] [OT] Program to document database lay out

2008-04-16 Thread Petite Abeille
On Apr 16, 2008, at 12:09 AM, Hartwig Wiesmann wrote: I am looking for a program that can visualize the relations between different tables, their connections and indices. Martin Krzywinski's Schemaball is rather interesting:

[sqlite] integer primary key and unique index?

2008-04-15 Thread Petite Abeille
Hello, Would adding an unique index on an integer primary key be of any benefit? Or is it redundant? In Primary key and index, Ben Carlyle wrote the following: 1 Table = 1 BTree, the BTree holds the data and is ordered by ROWID 1 Table with 1 Index = 2 BTrees, the second referring to rows in

[sqlite] Table modifications and analyze

2008-04-14 Thread Petite Abeille
Hello, What heuristics do people use to determine the frequency for analyzing their indices? Is there something equivalent to user_tab_modifications that keep tracks of the number of inserts, updates and deletes for each table? Thanks in advance. Kind regards, -- PA.

[sqlite] [noob] merge statement equivalent?

2008-04-10 Thread Petite Abeille
Hello, How does one emulate a DML MERGE statement in SQLite [1]? INSERT OR REPLACE sounds promising but the REPLACE documentation under the ON CONFLICT clause seems to imply that in the case of a constraint violation the existing row will be deleted entirely and then replaced by a brand

<    1   2   3   4   5   6