Re: [sqlite] massive insert
My friend.. very simple... use a transaction to do that... BEGIN; insert into ... insert into ... insert into ... insert into ... ... ... ... insert into ... COMMIT; I usually insert 1 in 5 seconds in a non good PC -- Cesar Rodas http://www.phpclasses.org/grank
Re: [sqlite] fts2 (full-text search v2) checked into CVS.
Ok. I have another question. I compile SQLite (the last version 3.3.8) with this fts2 extension. So how can i index something (i mean with the SQL). Thanks. And I think this ext is very useful On 10/13/06, Scott Hess <[EMAIL PROTECTED]> wrote: You'll want (from the bottom of http://www.sqlite.org/download.html): cvs -d :pserver:[EMAIL PROTECTED]:/sqlite login cvs -d :pserver:[EMAIL PROTECTED]:/sqlite checkout sqlite or perhaps cvs -d :pserver:[EMAIL PROTECTED]:/sqlite login cvs -d :pserver:[EMAIL PROTECTED]:/sqlite checkout sqlite/ext/fts2 though I wouldn't recommend checking out just the module. If there's a core API change, the module will follow that change and get out-of-sync with whatever tarball you're using. This code is certainly a week or two from being ready to enter a tarball. -scott On 10/12/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > That's very cool... What i am wondering is if is there any way to > download the complete tarball of that folder... > > thanks. > > On 10/13/06, Scott Hess <[EMAIL PROTECTED]> wrote: > > I've checked a new version of the full-text search module into > > ext/fts2 under CVS. fts2 uses a very different style of storage from > > fts1, and is much much faster for insertions (25x faster inserting the > > Enron email database, for instance). The interface is identical, you > > just refer to fts2 instead of fts1. > > > > Caveats: It uses a new storage format, and there is currently no > > support for "upgrading" a table from fts1 to fts2. Additionally, I > > have a number of follow-on changes which will be going in over the > > next couple weeks, some of which are likely to break data > > compatibility. I'm just tossing this out here in case people are > > interested in experimenting with it. > > > > Thanks, > > scott > > > > - > > To unsubscribe, send email to [EMAIL PROTECTED] > > - > > > > > > > -- > Cesar Rodas > http://www.phpclasses.org/grank > > - > To unsubscribe, send email to [EMAIL PROTECTED] > - > > - To unsubscribe, send email to [EMAIL PROTECTED] - -- Cesar Rodas http://www.phpclasses.org/grank
Re: [sqlite] fts2 (full-text search v2) checked into CVS.
That's very cool... What i am wondering is if is there any way to download the complete tarball of that folder... thanks. On 10/13/06, Scott Hess <[EMAIL PROTECTED]> wrote: I've checked a new version of the full-text search module into ext/fts2 under CVS. fts2 uses a very different style of storage from fts1, and is much much faster for insertions (25x faster inserting the Enron email database, for instance). The interface is identical, you just refer to fts2 instead of fts1. Caveats: It uses a new storage format, and there is currently no support for "upgrading" a table from fts1 to fts2. Additionally, I have a number of follow-on changes which will be going in over the next couple weeks, some of which are likely to break data compatibility. I'm just tossing this out here in case people are interested in experimenting with it. Thanks, scott - To unsubscribe, send email to [EMAIL PROTECTED] - -- Cesar Rodas http://www.phpclasses.org/grank - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] Helloo...
Thanks Nuyt. I will implement. On 10/12/06, Kees Nuyt <[EMAIL PROTECTED]> wrote: On Thu, 12 Oct 2006 15:24:22 -0400, you wrote: > PD: I think it could be implement in SQLite to but > I dont know if it support UNION in selects... It does. http://www.sqlite.org/lang_select.html -- ( Kees Nuyt ) c[_] - To unsubscribe, send email to [EMAIL PROTECTED] - -- Cesar Rodas http://cesars.users.phpclasses.org/grank
[sqlite] Helloo...
Hello, I just would like to let you know about this page that I think it is of your interest. Class: guaranix Rank http://cesars.users.phpclasses.org/grank Regards Cesar Rodas PD: I think it could be implement in SQLite to but I dont know if it support UNION in selects...
Re: [sqlite] Re: Anyone can help me?
I know that man. I start to develop my own Rank system bases on PageRank algorithm, and if any help me it will be GNU. On 9/26/06, Clay Dowling <[EMAIL PROTECTED]> wrote: I think first it would be helpful if you had a working pagerank algorithm. Data storage is not really what makes Google's pagerank and search engines so impressive, it's the searching and categorization capabilities. Clay Cesar David Rodas Maldonado said: > Some one what to help? > > On 9/26/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: >> >> I am developing a hobby that is how to calculate something like the >> PageRank with SQLite for HDD Storage. >> >> Thanks to all. >> > -- Simple Content Management http://www.ceamus.com - To unsubscribe, send email to [EMAIL PROTECTED] -
[sqlite] Re: Anyone can help me?
Some one what to help? On 9/26/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: I am developing a hobby that is how to calculate something like the PageRank with SQLite for HDD Storage. Thanks to all.
[sqlite] Anyone can help me?
I am developing a hobby that is how to calculate something like the PageRank with SQLite for HDD Storage. Thanks to all.
Re: [sqlite] how sqlite works?
Ok Thanks John I will try to buy! Thanks everybody for your help! On 9/21/06, John Stanton <[EMAIL PROTECTED]> wrote: I suggest that you get Donald Knuth's books (Fundamental Algorithms, Sorting and Seaching and Semi-Numerical Algorithms). They have everything you need to know, and plenty more. Knuth explains various type of B-Tree and plenty of merging algorithms. Cesar David Rodas Maldonado wrote: > I meen, If SQLite has two index and very large Index (about 10.000.000each > one) how do i merge it, I mean (index1 = index2 for every one and limit it > in thousand). > > Understand? > > > On 9/15/06, Dennis Cote <[EMAIL PROTECTED]> wrote: > >> >> Cesar David Rodas Maldonado wrote: >> > If there a document of how SQLite Virtual Machine Works ( papers )? I >> > would >> > like do something similar with B-Tree, B+ Tree but i dont know how to >> > merge >> > a select with tow Index? Understand my question?? >> > >> > Please answer me >> > >> see the links VDBE Tutorial and VDBE Opcodes near he bottom of the >> documentation page http://www.sqlite.org/docs.html >> >> Dennis Cote >> >> >> - >> >> To unsubscribe, send email to [EMAIL PROTECTED] >> >> - >> >> >> > - To unsubscribe, send email to [EMAIL PROTECTED] -
Re: [sqlite] how sqlite works?
Thanks for your answer Ms. Smith!
On 9/19/06, Christian Smith <[EMAIL PROTECTED]> wrote:
Cesar David Rodas Maldonado uttered:
> I meen, If SQLite has two index and very large Index (about 10.000.000each
> one) how do i merge it, I mean (index1 = index2 for every one and limit
it
> in thousand).
>
> Understand?
I guess not.
Are you trying to do an INNER JOIN merger on the two indexes? SQLite does
this by having a nested loop, with the equality test as the action of the
inner loop:
for each row in x {
for each row in y matching x.row {
# Do whatever for the inner join
}
}
If you're trying to do equivalent of a UNION select, then this is just a
standard merge sort using the two indexes as the sources.
http://en.wikipedia.org/wiki/Merge_sort
>
>
> On 9/15/06, Dennis Cote <[EMAIL PROTECTED]> wrote:
>>
>> Cesar David Rodas Maldonado wrote:
>> > If there a document of how SQLite Virtual Machine Works ( papers )? I
>> > would
>> > like do something similar with B-Tree, B+ Tree but i dont know how to
>> > merge
>> > a select with tow Index? Understand my question??
>> >
>> > Please answer me
>> >
>> see the links VDBE Tutorial and VDBE Opcodes near he bottom of the
>> documentation page http://www.sqlite.org/docs.html
>>
>> Dennis Cote
>>
>>
>>
>>
-
>> To unsubscribe, send email to [EMAIL PROTECTED]
>>
>>
>>
-
>>
>>
>
--
/"\
\ /ASCII RIBBON CAMPAIGN - AGAINST HTML MAIL
X - AGAINST MS ATTACHMENTS
/ \
-
To unsubscribe, send email to [EMAIL PROTECTED]
-
Re: [sqlite] how sqlite works?
I meen, If SQLite has two index and very large Index (about 10.000.000 each one) how do i merge it, I mean (index1 = index2 for every one and limit it in thousand). Understand? On 9/15/06, Dennis Cote <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > If there a document of how SQLite Virtual Machine Works ( papers )? I > would > like do something similar with B-Tree, B+ Tree but i dont know how to > merge > a select with tow Index? Understand my question?? > > Please answer me > see the links VDBE Tutorial and VDBE Opcodes near he bottom of the documentation page http://www.sqlite.org/docs.html Dennis Cote - To unsubscribe, send email to [EMAIL PROTECTED] -
[sqlite] how sqlite works?
If there a document of how SQLite Virtual Machine Works ( papers )? I would like do something similar with B-Tree, B+ Tree but i dont know how to merge a select with tow Index? Understand my question?? Please answer me
[sqlite] Hello
Good afternoon to all! Please some one can tell me how to optimize SQLite for an inverted index of about 100.000.000.000 of rows or please how can I do that with B-Trees or ISAM. Please help me if you can.. Thanks... I am doing an GNU search project for my University.
[sqlite] Re: A question...
What i meaning how sqlite do for search b-tree indexs? the index are copy to main memory or the merge is done just in hard disk search for every item? understand my question? On 9/4/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: Hello to all! I am developing a application for great performance and I want to know how SQLite works for merger two list of index, because as i understand every index is a b-tree right? Please help me because i need great perfomance, i am developing a very large Inverted Index. Thanks to all
[sqlite] A question...
Hello to all! I am developing a application for great performance and I want to know how SQLite works for merger two list of index, because as i understand every index is a b-tree right? Please help me because i need great perfomance, i am developing a very large Inverted Index. Thanks to all
Re: [sqlite] "Invalid or corrupt file" when building .lib file for version 3.3.7 dll
I am sorry my friend... try with Dev-cpp! That's better that MS VC. What i do always is download the source and compile like part of my project or create the library. I think the first one will better for velocity but not for update. On 8/25/06, Rob Richardson <[EMAIL PROTECTED]> wrote: Greetings! I am using MS Visual Studio 6 under the Windows XP pro operating system. I downloaded the dll for version 3.3.7. I tried to run Lib to build the .lib file for the dll. Here's the command line: lib /machine:i386 sqlite3.def This was run with the folder containing sqlite3.def as the current folder. When I ran it, I got: sqlite3.def : fatal error LNK1136: invalid or corrupt file What did I do wrong? RobR, about to build the DLL from the source files RAD-CON INC.
[sqlite] what is this?
What is this page? http://www.sqlite.org/cvstrac/fileview?f=sqlite/src/pg.c i'd like to know why this pg.c is not include into the tarball of the sqlite source code..., and that this do? Thanks.
Re: [sqlite] Btree
Thanks Jay now i can understand. On 8/24/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > So is the a manual of how can I use the SQLite Btree algorithm for my own? It's not exposed so you can do it easily. > And if I use the Btree will be faster than use SQLite? because SQLite need > to understand the SQL and I think that took time... if the query is complex I doubt it would be significantly faster, except when you execute many different queries. If you use the same set of queries "Preparing" allows you to parse it once and execute it many times. This is probably 90% of what you want with only 10% of the effort. - To unsubscribe, send email to [EMAIL PROTECTED] -
[sqlite] how can i optimize this query
I have done this project http://www.phpclasses.org/browse/package/3303.htmlis a fulltext search. Please help me to optimize this souce, couse i am planning to move this souce to C. This a fulltext search that supports SQLite or mysql. Please Help me to do this project better. Thanks to all On 8/24/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: I will like to join to your group! what i have to do? how can we exchange info? Thanks Pierre Aubert On 8/24/06, Pierre Aubert < [EMAIL PROTECTED]> wrote: > > Hello Cesar, > I have a lot of idea for ft3 but not much time currently. If you want to > join the project you are welcome. My next work will be on creating a sqlite > extension called ft3:) with a module and > virtual tables. > > Pierre > > P.S.: don't stress over your english, French is my mother tongue and I > do a lot of mistakes > myself. On the other hand, it is necessary to speak in english thus ... > > - Message d'origine > De : Cesar David Rodas Maldonado <[EMAIL PROTECTED] > > À : Pierre Aubert <[EMAIL PROTECTED]> > Envoyé le : Mercredi, 23 Août 2006, 7h25mn 47s > Objet : Re: [sqlite] Re : [sqlite] how can i optimize this query > > > Hello Pierre Aubert > > I saw your project ft3, that was my inspiration, can I ask you more > about > your projects? more details? > > Thanks Cesar Rodas > > On 8/23/06, Pierre Aubert <[EMAIL PROTECTED]> wrote: > > > > Hello Cesar, > > may be you can have a look at ft3 (ft3.sourceforge.net) which does the > > same thing. > > Some advices: > > * partition your table ft_index on wordid > >I use 1024 tables and use them like that: > > ft_index[ wordid % 1024 ] > > to access them. This reduce the size of the table and thus the size > of > > the index. > > * use a large block size via pragma (this speed up large reads) > > > > FT3 ways is to switch to a binary index stored into a blob for each > word. > > Something like > > create table ft_index ( > > wordid int, > > scores blob > > ); > > > > and the blob is an array of (docid, rank, position, ...) > > > > This is a lot faster of course but you have to deal with the join > > yourself. > > > > PIerre. > > > > P.S.: I will try to use the new virtual table interface to access the > blob > > datas. > > > > - Message d'origine > > De : Cesar David Rodas Maldonado < [EMAIL PROTECTED]> > > À : sqlite-users@sqlite.org > > Envoyé le : Mardi, 22 Août 2006, 10h10mn 30s > > Objet : [sqlite] how can i optimize this query > > > > I have the next table with about 10.000.000 of records- > > > > CREATE TABLE ft_index ( > > docid int(11) NOT NULL default '0', > > wordid int(11) NOT NULL default '0', > > posicion int(11) NOT NULL default '0', > > ranking float NOT NULL default '0', > > lang int(11) NOT NULL default '0', > > KEY docid (docid,wordid,posicion,ranking), > > KEY lang (lang) > > ); > > > > How can i optimize the next query, couse i need velocity (this is for > a > > fulltext search project): > > > > > > select > > t0.*, > > t0.ranking + t1.ranking + t2.ranking + t3.ranking + t4.ranking as > ranking > > from ft_index as t0 > > inner join ft_index as t1 on (t0.docid = t1.docid) > > inner join ft_index as t2 on ( t0.docid = t2.docid) > > inner join ft_index as t3 on (t0.docid = t3.docid) > > inner join ft_index as t4 on (t0.docid = t4.docid) > > where (t0.wordid = '18929') AND (t1.wordid = '27283') AND( t2.wordid = > > '4351' and t2.posicion + 1 = t3.posicion and t3.wordid = '9418' and > > t3.posicion + 1 = t4.posicion ) group by t0.docid order by ranking; > > > > Every inner join is for search a word that i save in another table > (with > > the > > number of words). > > > > > > > > > > > > > >
[sqlite] Btree
Hello to everyone. I want to ask something for the people who made SQLite. Every Index in a table is a Btree? So is the a manual of how can I use the SQLite Btree algorithm for my own? And if I use the Btree will be faster than use SQLite? because SQLite need to understand the SQL and I think that took time... if the query is complex Thanks
[sqlite] sqlite book
Hello.. Please I need to know if is there a Good book about SQLite i want to learn it, i want to know how to optimize and how it works Thanks to all
[sqlite] Re: how can i optimize this query
The query SQL query that I sent represents the next search : word1 word2 "word3 word4" On 8/22/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: I have the next table with about 10.000.000 of records- CREATE TABLE ft_index ( docid int(11) NOT NULL default '0', wordid int(11) NOT NULL default '0', posicion int(11) NOT NULL default '0', ranking float NOT NULL default '0', lang int(11) NOT NULL default '0', KEY docid (docid,wordid,posicion,ranking), KEY lang (lang) ); How can i optimize the next query, couse i need velocity (this is for a fulltext search project): select t0.*, t0.ranking + t1.ranking + t2.ranking + t3.ranking + t4.ranking as ranking from ft_index as t0 inner join ft_index as t1 on (t0.docid = t1.docid) inner join ft_index as t2 on (t0.docid = t2.docid) inner join ft_index as t3 on (t0.docid = t3.docid) inner join ft_index as t4 on (t0.docid = t4.docid) where (t0.wordid = '18929') AND (t1.wordid = '27283') AND( t2.wordid = '4351' and t2.posicion + 1 = t3.posicion and t3.wordid = '9418' and t3.posicion + 1 = t4.posicion ) group by t0.docid order by ranking; Every inner join is for search a word that i save in another table (with the number of words).
[sqlite] how can i optimize this query
I have the next table with about 10.000.000 of records- CREATE TABLE ft_index ( docid int(11) NOT NULL default '0', wordid int(11) NOT NULL default '0', posicion int(11) NOT NULL default '0', ranking float NOT NULL default '0', lang int(11) NOT NULL default '0', KEY docid (docid,wordid,posicion,ranking), KEY lang (lang) ); How can i optimize the next query, couse i need velocity (this is for a fulltext search project): select t0.*, t0.ranking + t1.ranking + t2.ranking + t3.ranking + t4.ranking as ranking from ft_index as t0 inner join ft_index as t1 on (t0.docid = t1.docid) inner join ft_index as t2 on (t0.docid = t2.docid) inner join ft_index as t3 on (t0.docid = t3.docid) inner join ft_index as t4 on (t0.docid = t4.docid) where (t0.wordid = '18929') AND (t1.wordid = '27283') AND( t2.wordid = '4351' and t2.posicion + 1 = t3.posicion and t3.wordid = '9418' and t3.posicion + 1 = t4.posicion ) group by t0.docid order by ranking; Every inner join is for search a word that i save in another table (with the number of words).
Re: [sqlite] linking C program
I always include the source into my C program (with KDevelop for linux or DEV-CPP for windows). And if you do that you could config better. On 8/14/06, Michael Alperovitch <[EMAIL PROTECTED]> wrote: Hi, I am new SQLite user. How I can link the simple C Program with Sqlite static or shared library. I tried to link to libsqlite3.a and it cannot find sqlite3_open(), sqllite3_close(), sqllite3_exec() functions. I got the same result linking with libsqlite3.so shared library. Thanks for any help. Michael Alperovitch Tricipher Inc.
Re: [sqlite] C precompiler to bytecode
That's a very good idea!, and I would like to help for do that On 8/8/06, Daniel Önnerby <[EMAIL PROTECTED]> wrote: Hi everyone! I'm just a bit curios if it would be possible to make like a C precompiler or a macro of some kind that compiles/interpret the SQL-statements to bytecode just like the sqlite_prepare does but does this when compiling/precompiling your application instead of at runtime. Since most application written in C/C++ use static SQL-statements (unless you are building your SQL-strings on the fly) and then bind the values, I guess there would be several benefits for your compiled application: * Faster: Since the SQL-statement is already interpreted. * Smaller (not that sqlite needs to be smaller): The executable does not need to contain the part of sqlite that interprets the SQL-statements since this was made at compile time. Just a thought :) Best regards Daniel Önnerby
Re: [sqlite] Insert delay!
I know that that Math and CS is very cool, but in the beginning is very boring. I will share my code in the next week. I am doing something like lucene ( a library for fulltext search). On 8/7/06, John Stanton <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > Yeah John I am studying Math and computer science (but i am in the first > year, and this is very boring) in National University Of Paraguay. > When I finish my idea i will share my code. > > Thanks For understand my English John! > > > On 8/5/06, John Stanton <[EMAIL PROTECTED]> wrote: > >> >> Cesar David Rodas Maldonado wrote: >> > I was thinking a lot in the next month in how can I do the delay insert >> and >> > I found something for do that, is basic because I don't have a lot of >> > knowledge, I'm just start the University. >> > >> > OK, I need with SQLite to select all the time as possible, and delay >> the >> > Insert, I don't care the time that took insert something. These >> is my >> > needs with SQLite. Is something Interesting on my idea? If there is one >> I >> > will share my idea. >> > >> Your English is not very clear, but as I understand your idea it could >> be realized by performing your INSERTs in a thread, ideally set to a low >> priority and fed from a FIFO queue. You need to be aware of the locking >> constraints. >> >> Have success with your studies. Are you studying Math and Computer >> Science? >> > You are welcome. I look forward to seeing your code. Math and CS can be very exciting, so stick at it. I have a daughter who has been studying Math and Computer Science and is now in an cutting edge PhD program and very happy. The best is yet to come for you.
Re: [sqlite] Insert delay!
Yeah John I am studying Math and computer science (but i am in the first year, and this is very boring) in National University Of Paraguay. When I finish my idea i will share my code. Thanks For understand my English John! On 8/5/06, John Stanton <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > I was thinking a lot in the next month in how can I do the delay insert and > I found something for do that, is basic because I don't have a lot of > knowledge, I'm just start the University. > > OK, I need with SQLite to select all the time as possible, and delay the > Insert, I don't care the time that took insert something. These is my > needs with SQLite. Is something Interesting on my idea? If there is one I > will share my idea. > Your English is not very clear, but as I understand your idea it could be realized by performing your INSERTs in a thread, ideally set to a low priority and fed from a FIFO queue. You need to be aware of the locking constraints. Have success with your studies. Are you studying Math and Computer Science?
Re: [sqlite] Insert delay!
Your all right! what i am doing right know is cache the insert query and execute when the is not select, and that is almost working. When i was developing my "insert delay" I thought that will be great is SQLite support an option like MySQL (insert delay). And i dont wanna use Postgresql, cause this is client-server, I like SQLite, and with my "insert delay" SQLite for me is more useful than postgresql On 8/5/06, Clay Dowling <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > I was thinking a lot in the next month in how can I do the delay insert and > I found something for do that, is basic because I don't have a lot of > knowledge, I'm just start the University. > > OK, I need with SQLite to select all the time as possible, and delay the > Insert, I don't care the time that took insert something. These is my > needs with SQLite. Is something Interesting on my idea? If there is one I > will share my idea. If you're trying to save your inserts until your app has some idle time, the best technique I can come up with is to cache those inserts in your application. When your activity monitoring thread detects that there is no other database activity it can fire off a process to perform the inserts. That keeps your app very responsive to user queries. If you find that you need a higher degree of concurrency you might consider PostgreSQL. But you'll probably be okay with SQLite as long as your app can find the time to run the inserts often enough. Clay -- http://www.lazarusid.com/notes/ Lazarus Notes Articles and Commentary on Web Development
[sqlite] Insert delay!
I was thinking a lot in the next month in how can I do the delay insert and I found something for do that, is basic because I don't have a lot of knowledge, I'm just start the University. OK, I need with SQLite to select all the time as possible, and delay the Insert, I don't care the time that took insert something. These is my needs with SQLite. Is something Interesting on my idea? If there is one I will share my idea.
Re: [sqlite] SQLite and ASP Classic
Try with the ODBC or use PHP (PHP is better than ASP and multi OS) On 8/1/06, Artie Pagan <[EMAIL PROTECTED]> wrote: Does anyone know what the connection string is for SQLite using ASP classic?
Re: [sqlite] Re: Optimization!
Cool! I will try that! Thanks Igor! On 7/31/06, Igor Tandetnik <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > How can I optimize this query > > select * from table where col1 = 5 && col2 = 15; > > If I know that col2 I have 15 rows and col1 I have just 100 > rows, I know that because I save that data in another table. > > How can I do for search first where is minus number of result? > > > The two columns are indexes. Try making it select * from table where col1 = 5 and +col2 = 15; The unary plus in front of col2 disqualifies it for use in an index, so SQLite is likely to use an index on col1. Igor Tandetnik
[sqlite] Optimization!
Hello to all! How can I optimize this query select * from table where col1 = 5 && col2 = 15; If I know that col2 I have 15 rows and col1 I have just 100 rows, I know that because I save that data in another table. How can I do for search first where is minus number of result? The two columns are indexes. Thanks to all.
[sqlite] Re: Project
I found to give a preference to select and a delay to insert. :D On 7/27/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: If a SQLite Db is LOCKED can i exec an TRIGER?
[sqlite] Re: Project
If a SQLite Db is LOCKED can i exec an TRIGER?
[sqlite] Project
Now i have another question! Is any way to serialize all the dates given a preference to SELECT and delay the insert and update. I am building a Small Library in C & SQLite that will be under GPL , is something like Lucene. Please help me how to give a preference to SELECT and a delay to INSERT or update. Thanks to all!
Re: [sqlite] UTF8
Thanks Daniel! Now i have another question! Is any way to serialize all the dates given a preference to SELECT a delay to the insert. I am building a Small Library in C & SQLite that will be under GPL, is something like Lucene. Please help me how to give a preference to SELECT and a delay to INSERT or update. Thanks to all!
Re: [sqlite] Re: UTF8
OK! I understand Igor! Thanks 4 your help! On 7/26/06, Igor Tandetnik <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > I wanted to ask how can i know if a given text is UTF8 or ISO-8859-1? You can't really. You need to have some metadata - some means outside the text itself to let you know what encoding the text is in. E.g. a combination of two bytes C3 A5 can be interpreted as two characters Ã¥ in ISO-8859-1, but it's also a valid UTF8 sequence representing Unicode character U+00E5 å . There's no way to tell from text alone. Igor Tandetnik
Re: [sqlite] UTF8
Thanks peter! :D On 7/26/06, Peter Cunderlik <[EMAIL PROTECTED]> wrote: > I wanted to ask how can i know if a given text is UTF8 or ISO-8859-1? If you need conversions, the simplest would be to do it manually using look-up tables. AFAIK none of the Latin-1 characters take more than 2 bytes in UTF-8, so having 2*256 bytes long table won't hurt. If you want to decode special Unicode things like right-to-left stuff, I'd recommend some serious library, such as ICU (icu.sourceforge.net). If you want to detect the encoding/codepage, I don't think it can be done in general, unless you know what text to expect. I might be wrong. Peter
Re: [sqlite] UTF8
I'm sorry! English is not my first language!! :D I wanted to ask how can i know if a given text is UTF8 or ISO-8859-1? Thanks and please forgive me for my english! :D On 7/26/06, Cory Nelson <[EMAIL PROTECTED]> wrote: ASCII is completely valid UTF-8, so no conversion is necessary. On 7/26/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > How can i know if a given text is UTF8 or ascii? and how can i convert > between ascii to UTF8? > > -- Cory Nelson http://www.int64.org
[sqlite] UTF8
How can i know if a given text is UTF8 or ascii? and how can i convert between ascii to UTF8?
Re: [sqlite] Sqlite Write and read a the same time
So, is imposible to read alway and write one per time... ? On 7/25/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: I just want to read always and write one time.. understand? is that imposible? On 7/25/06, Robert Simpson <[EMAIL PROTECTED] > wrote: > > > -Original Message- > > From: Cesar David Rodas Maldonado [mailto: [EMAIL PROTECTED] > > Sent: Tuesday, July 25, 2006 8:07 AM > > To: sqlite-users@sqlite.org > > Subject: [sqlite] Sqlite Write and read a the same time > > > > Hello! > > > > The weekend I was reading a book "Programming in Linux" and I found > > something for me very cool!. I so that you could Lock a File > > for write but > > just a part of the file. And I am wondering if in Linux > > SQLite would be able > > to lock just a Page of the B-tree when you are doing the > > insert and the > > update, that will be better I think that Lock all the File (database). > > > > The function is in the header < fcntl.h> and the function is: > > > > int fcntl(int fd, int cmd, struct flock *lock_type); > > > > The problem is that when SQLite is updating, it needs to lock a lot more > than just the page its updating. > > When pages are moved, rewritten, added, etc, all the references need to > be > written. The master pages need updating. You can't update all those > other > pages during a write op and expect readers to continue to be able to > read in > a consistent state. > > Robert > > >
Re: [sqlite] Sqlite Write and read a the same time
I just want to read always and write one time.. understand? is that imposible? On 7/25/06, Robert Simpson <[EMAIL PROTECTED]> wrote: > -Original Message- > From: Cesar David Rodas Maldonado [mailto:[EMAIL PROTECTED] > Sent: Tuesday, July 25, 2006 8:07 AM > To: sqlite-users@sqlite.org > Subject: [sqlite] Sqlite Write and read a the same time > > Hello! > > The weekend I was reading a book "Programming in Linux" and I found > something for me very cool!. I so that you could Lock a File > for write but > just a part of the file. And I am wondering if in Linux > SQLite would be able > to lock just a Page of the B-tree when you are doing the > insert and the > update, that will be better I think that Lock all the File (database). > > The function is in the header and the function is: > > int fcntl(int fd, int cmd, struct flock *lock_type); > The problem is that when SQLite is updating, it needs to lock a lot more than just the page its updating. When pages are moved, rewritten, added, etc, all the references need to be written. The master pages need updating. You can't update all those other pages during a write op and expect readers to continue to be able to read in a consistent state. Robert
[sqlite] Sqlite Write and read a the same time
Hello! The weekend I was reading a book "Programming in Linux" and I found something for me very cool!. I so that you could Lock a File for write but just a part of the file. And I am wondering if in Linux SQLite would be able to lock just a Page of the B-tree when you are doing the insert and the update, that will be better I think that Lock all the File (database). The function is in the header and the function is: int fcntl(int fd, int cmd, struct flock *lock_type); Thank you!
Re: [sqlite] A littel question...
Thanks very much to all of you! I am doing a project of fulltext with sqlite, and i will share the code when a i finish... thanks to all for your help. On 7/21/06, John Stanton <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > I have not a substring, I have a list of words (stemmed words of several > languages) and i just want to get the Id. The word is unique > In that case the sqlite B-Tree index is about as good as you will get. just make sure that the word is an index.
Re: [sqlite] A littel question...
I know that, but I would like to know if will be better first transform the word into a number (a hash function), after that select the number and after search with the index of the word... understand?. I am sorry for my english... On 7/21/06, Daniel van Ham Colchete <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado wrote: > Hello to everybody > > If I have a table with 100.000 unique words I am wondering if SQLite > select > if faster an cheaper (RAM, Processor, etc), or If i have to help SQLite > using a Hash function, and what could be that Hash function? > > Thanks. > Cesar, you should consider using an index: http://www.sqlite.org/lang_createindex.html Best regards, Daniel Colchete
Re: [sqlite] A littel question...
I have not a substring, I have a list of words (stemmed words of several languages) and i just want to get the Id. The word is unique
[sqlite] A littel question...
Hello to everybody If I have a table with 100.000 unique words I am wondering if SQLite select if faster an cheaper (RAM, Processor, etc), or If i have to help SQLite using a Hash function, and what could be that Hash function? Thanks.
Re: [sqlite] Compress function
D. Richard Hipp...
You are amazing!!! Thanks a lot for Sqlite and for help me!
God save D. Richard Hipp!
On Wed, 19 2006 17:44:46 -0400, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:
"Cesar David Rodas Maldonado" <[EMAIL PROTECTED]> wrote:
> I need a funcion from compress a row with Zlib and I am wondering if
SQLite
> support or if someone did it and want to share him or her code.
>
Here some code that might help:
/*
** SQL function to compress content into a blob using libz
*/
static void compressFunc(
sqlite3_context *context,
int argc,
sqlite3_value **argv
){
int nIn, nOut;
long int nOut2;
const unsigned char *inBuf;
unsigned char *outBuf;
assert( argc==1 );
nIn = sqlite3_value_bytes(argv[0]);
inBuf = sqlite3_value_blob(argv[0]);
nOut = 13 + nIn + (nIn+999)/1000;
outBuf = malloc( nOut+4 );
outBuf[0] = nIn>>24 & 0xff;
outBuf[1] = nIn>>16 & 0xff;
outBuf[2] = nIn>>8 & 0xff;
outBuf[3] = nIn & 0xff;
nOut2 = (long int)nOut;
compress(&outBuf[4], &nOut2, inBuf, nIn);
sqlite3_result_blob(context, outBuf, nOut2+4, free);
}
/*
** An SQL function to decompress.
*/
static void uncompressFunc(
sqlite3_context *context,
int argc,
sqlite3_value **argv
){
unsigned int nIn, nOut, rc;
const unsigned char *inBuf;
unsigned char *outBuf;
long int nOut2;
assert( argc==1 );
nIn = sqlite3_value_bytes(argv[0]);
if( nIn<=4 ){
return;
}
inBuf = sqlite3_value_blob(argv[0]);
nOut = (inBuf[0]<<24) + (inBuf[1]<<16) + (inBuf[2]<<8) + inBuf[3];
outBuf = malloc( nOut );
nOut2 = (long int)nOut;
rc = uncompress(outBuf, &nOut2, &inBuf[4], nIn);
if( rc!=Z_OK ){
free(outBuf);
}else{
sqlite3_result_blob(context, outBuf, nOut2, free);
}
}
/* Make the functions above accessible to SQLite as follows:
*/
sqlite3_create_function(db, "compress", 1, SQLITE_UTF8, 0,
compressFunc, 0, 0);
sqlite3_create_function(db, "uncompress", 1, SQLITE_UTF8, 0,
uncompressFunc, 0, 0);
--
D. Richard Hipp <[EMAIL PROTECTED]>
Re: [sqlite] Compress function
I compile SQLITE 3 source into my APP, but i will like to use like mysql uses ( the COMPRESS() function into the sql), understand?
Re: [sqlite] Compress function
Do you know for how much money? On 7/19/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: The author of Sqlite also sells a version that compresses and encrypts the database. On 7/19/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > Thanks Hugh, i think it will be useful for me... > > On Wed, 19 Jul 2006 16:07 +0100 (BST), Hugh Gibson <[EMAIL PROTECTED]> > wrote: > > > > You could try http://web.utk.edu/~jplyon/sqlite/code/sqaux-userfns.cbut > > it's a little old now.
Re: [sqlite] Compress function
Thanks Hugh, i think it will be useful for me... On Wed, 19 Jul 2006 16:07 +0100 (BST), Hugh Gibson <[EMAIL PROTECTED]> wrote: You could try http://web.utk.edu/~jplyon/sqlite/code/sqaux-userfns.c but it's a little old now. Hugh
[sqlite] Compress function
I need a funcion from compress a row with Zlib and I am wondering if SQLite support or if someone did it and want to share him or her code. Thanks to all
Re: [sqlite] This great!
Thanks Christian :D On 7/17/06, Christian Smith <[EMAIL PROTECTED]> wrote: Cesar David Rodas Maldonado uttered: > I am wondering if it will have a better performance if i split every index > and table into different files, i know that i will loose the LITE concept, > but i am wondering if it will have a better performance... > Not unless each individual file is on a different hard disk. The bottleneck for a hard disk is the head actuator and spindle speed. The OS will already optimise data IO to make best use of the harddisk, whether that be one one or many files. Your laptop will only have a single hard disk. You'll get no more performance splitting the file. Non-LITE databases that use table spaces for improved performance only improve performance when each tablespace is on a different device. Christian -- /"\ \ /ASCII RIBBON CAMPAIGN - AGAINST HTML MAIL X - AGAINST MS ATTACHMENTS / \
Re: [sqlite] This great!
I don't know I just was wondering... but i think it will be faster if you have a really great DB and when you and insert just will be locked the table where you are doing the insert not the whole DB... what do you think?
Re: [sqlite] This great!
I am wondering if it will have a better performance if i split every index and table into different files, i know that i will loose the LITE concept, but i am wondering if it will have a better performance...
[sqlite] This great!
Hello to everybody...!!! I was using my old notebook the weekend, and i was doing some programs in C to try SQLite performance, and I am happy, because i could insert 4.000.000rows in 10 minutes in my old notebook( Pentium II 400 MHZ 128 M.RAM). Thank for everybody who made it possible (share this coll DB), that was on my Windows XP... then I try on my Linux FC4, i could insert 8.000.000 of row in 15 minutes.. that's great faster that every DB engine that I know. And with the select it took about 10 ms to select 50 rows of 8.000.000 ( that's very cool!) I am wondering if it will have a better performance if i split every index and table into a file, i know that i will loose the LITE concept, but i am wondering if it will have a better performance... Thank to Dr. Hipp and everyone who did it possible! Cesar Rodas
Re: [sqlite] Question about database?
Richard Hipp : Thanks for explain me that... so what do you think will be the solution? what do you think about db in Clustering. On 7/13/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: "Cesar David Rodas Maldonado" <[EMAIL PROTECTED]> wrote: > About the concurrence, i don't know... about 2000 queries per second... Wich > db engine will be good?... i have a server with 2 GB ram, AMD sempron > 64bits, > You have 8 billion records and 2 billion bytes of ram. So your data will not fit in cache. That means it will have to be read from disk. Let's assume each query does a single disk access. Suppose you have a very high-performance disk drive with a 5ms access time. That gives you 200 queries per second - 1/10th of what you want. 200 queries per second is your speed-of-light. No software will allow you to go faster. You'll have to get better hardware. -- D. Richard Hipp <[EMAIL PROTECTED]>
Re: [sqlite] Question about database?
About the concurrence, i don't know... about 2000 queries per second... Wich db engine will be good?... i have a server with 2 GB ram, AMD sempron 64bits, On 7/12/06, John Stanton <[EMAIL PROTECTED]> wrote: Jay gave you the clue. You need to have software and hardware which will address data beyond 32 bits, i.e. 64 bit file addressing. The 64 bit file version of all the tools you mention should perform your job. Now you choose according to the scale of your application, Enterprise, Department or Embedded. Postgresql would work in the Enterprise and Sqlite for an embedded application. For a heavy duty application 64 bits hardware and OS would be the best. Cesar David Rodas Maldonado wrote: > I don't care about hardware... i will do cluster... but which DB motor do > think will be good for work with great velocity in select (sqlite, > postgresql or mysql). > ah.. i almost forgot... i will do a great number of select... > > On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > >> >> 32 bits, the size of the key, only holds numbers up to 2 or 4 billion. >> You said you have 8 billion rows. >> You need a 64 bit version or to split up the data into many tables. >> >> >> On 7/12/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: >> > So Jay... Do you think that i have to use a PC of 64 bits, or 32bits pc >> with >> > clustering? >> > >> > >> > On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: >> > > >> > > > Hello to everybody! >> > > > >> > > > I want to ask to the people something... If i have a table with >> about >> > > > 8.000.000.000 registers, and i have to do a select in a numeric row >> that >> > > > will have index. what db do you recommend to me for use? >> > > >> > > If you design the database correctly it should work, but I believe >> > > that large a total number of records will not be addressable on >> > > a personal computer. I think the 32 bit version is limited to 2^32 >> > > records. >> > > >> > >> > >> >> >> -- >> -- >> SqliteImporter and SqliteReplicator: Command line utilities for Sqlite >> http://www.reddawn.net/~jsprenkl/Sqlite >> >> Cthulhu Bucks! >> http://www.cthulhubucks.com >> >
Re: [sqlite] Question about database?
Gussimulator No entendi tu mensaje, podrias porfavor escribirmelo en español On 7/12/06, Gussimulator <[EMAIL PROTECTED]> wrote: Yeah and while we're at it, he could invest a few bucks on a couple twin diesel generators, a battery room, and whatnot, a group of hookers to save the night. - Original Message - From: "Jay Sprenkle" <[EMAIL PROTECTED]> To: Sent: Wednesday, July 12, 2006 3:15 PM Subject: Re: [sqlite] Question about database? > On 7/12/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: >> I don't care about hardware... i will do cluster... but which DB motor do >> think will be good for work with great velocity in select (sqlite, >> postgresql or mysql). >> ah.. i almost forgot... i will do a great number of select... > > I don't believe it makes a big difference on performance. > Have you thought about backups and availability?
Re: [sqlite] Question about database?
Yeah. I was reading a few of Mysql replications and stuff like that. Thanks for you help Jay On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: On 7/12/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > I don't care about hardware... i will do cluster... but which DB motor do > think will be good for work with great velocity in select (sqlite, > postgresql or mysql). > ah.. i almost forgot... i will do a great number of select... I don't believe it makes a big difference on performance. Have you thought about backups and availability?
Re: [sqlite] Question about database?
I don't care about hardware... i will do cluster... but which DB motor do think will be good for work with great velocity in select (sqlite, postgresql or mysql). ah.. i almost forgot... i will do a great number of select... On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: 32 bits, the size of the key, only holds numbers up to 2 or 4 billion. You said you have 8 billion rows. You need a 64 bit version or to split up the data into many tables. On 7/12/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > So Jay... Do you think that i have to use a PC of 64 bits, or 32bits pc with > clustering? > > > On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > > > > > Hello to everybody! > > > > > > I want to ask to the people something... If i have a table with about > > > 8.000.000.000 registers, and i have to do a select in a numeric row that > > > will have index. what db do you recommend to me for use? > > > > If you design the database correctly it should work, but I believe > > that large a total number of records will not be addressable on > > a personal computer. I think the 32 bit version is limited to 2^32 > > records. > > > > -- -- SqliteImporter and SqliteReplicator: Command line utilities for Sqlite http://www.reddawn.net/~jsprenkl/Sqlite Cthulhu Bucks! http://www.cthulhubucks.com
Re: [sqlite] Question about database?
So Jay... Do you think that i have to use a PC of 64 bits, or 32bits pc with clustering? On 7/12/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > Hello to everybody! > > I want to ask to the people something... If i have a table with about > 8.000.000.000 registers, and i have to do a select in a numeric row that > will have index. what db do you recommend to me for use? If you design the database correctly it should work, but I believe that large a total number of records will not be addressable on a personal computer. I think the 32 bit version is limited to 2^32 records.
[sqlite] Re: Question about database?
Hello to everybody! I want to ask to the people something... If i have a table with about 8.000.000.000 registers, and i have to do a select in a numeric row that will have index. what db do you recommend to me for use? Thanxs (:D) people!
[sqlite] Question about database?
Hello to everybody! I want to ask to the people something... If i have a table with about 8.000.000.000 registers, and i have to do a select in a numeric row that will have index. what db do you recommend to me for use? Thanxs (:D) people!
Re: [sqlite] Make a dll for .net
No se preocupen, los latinos estamos presentes en SQLite!!! arriba el español On 7/8/06, C.Peachment <[EMAIL PROTECTED]> wrote: Penso que el primer sitio es mas hoy en dia. No necessita dar disculpa para tu ingles. No tengamos problemas entender. Vosotro facilidad con ingles es mejor que nuestro espanol. Disculpame, estudio el espanol desde dos anos y no puedo hablar/escribir facilmente. :-) On Sat, 8 Jul 2006 15:31:21 +0300, Veysel Harun Sahin wrote: >Hi, >Take a look at the following sites. >http://sqlite.phxsoftware.com/ >http://adodotnetsqlite.sourceforge.net/ >On 7/8/06, Robinson Andres Hernandez Salas <[EMAIL PROTECTED]> >wrote: >> >> Hi. >> >>First, i dont speak english so sorry bout my "weird" way to write my >> question >> and try to understandme please. >> >>Well, im new with sqlite, but i think this is the solution for that i >> was >> looking for. A lite dbsm :). >> >>I need to make a program in Visual Studio 2005, using Visual Basic. (Vb >> can >> use dlls writed in other lenguages like C) >> >>I downloaded the .dll zip for windows and i cant include the dll to my >> proyect .. its say "this dll is not for .net framework" or something like >> that. >> Then, i go to microsoft to look for how to include a Dll writed in C, i >> found a >> page that describe how to make a dll write in c, includeable in vb. >> >> So, my next step is recompile the dll with the sqlite source, i >> downloaded >> the sqlite source for windows. that who say "all what you need for compile >> with >> any ordinary compiler in win" (or something like that) >> >> Well, i need help with compiling this sources in visual studio 2005 >> and make >> that dll. OR if the orginal downloable dll works in visual studio and >> should run >> fine, someone can tell me how to run it. >> >>Short question. ¿ how i run the sqlite dll in visual studio ? >> >> i hope someone can help me, and sorry bout my english :) bye. >> >>Robinson H. >> >> >> >-- >Veysel Harun Sahin
Re: [sqlite] sqlite too slow for me?
I have a question for every body... SQLite was very slow for my inserts (like 5 inserts), with out sincronization but when i put BEGIN; before start with my inserts is was faster... like 1000 times more... :D why is that? On 6/28/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: I dont know a lot about MySQL... but mysql is not so faster as you think... I have in my computer the mysql 5 is good, but sqlite is so faster too!!! but MySQL has a query cache so i think the cache make it seems more faster than sqlite... On 6/27/06, Péter Szabó <[EMAIL PROTECTED]> wrote: > > First, thank you all for the answers. > > >UNIQUE(col1, col4, col5, col2), > > Adding this would surely make the query run faster -- provided that > SQLite chooses the right index. But I also use the UNIQUE(col1, col4, > col5) constraint to ensure the uniqueness of these three columns. So > instead I should have both > > UNIQUE(col1, col4, col5), > UNIQUE(col1, col4, col5, col2), > > but this would waste my disk space. > > I am wondering how can MySQL 4.1 be so fast compared to SQLite 3? > MySQL answers my query in 0.02 seconds, and SQLite answers in more > than 28 seconds. > > I guess that MySQL doesn't do any magic either ( i.e. it operates in > O(Klog N) time, which appears to be just 0.02 seconds), but MySQL > recognises that it should use the UNIQUE(col1, col4, col5) index, > while SQLite poorly chooses some other index, maybe the PRIMARY > KEY(col1, col2, col3, col4, col5), which is just wrong. Can someone > confirm that the SQLite is using the wrong index? Is it possible to > deterministically rewrite the query to force SQLite use the right > index? >
Re: [sqlite] sqlite too slow for me?
I dont know a lot about MySQL... but mysql is not so faster as you think... I have in my computer the mysql 5 is good, but sqlite is so faster too!!! but MySQL has a query cache so i think the cache make it seems more faster than sqlite... On 6/27/06, Péter Szabó <[EMAIL PROTECTED]> wrote: First, thank you all for the answers. >UNIQUE(col1, col4, col5, col2), Adding this would surely make the query run faster -- provided that SQLite chooses the right index. But I also use the UNIQUE(col1, col4, col5) constraint to ensure the uniqueness of these three columns. So instead I should have both UNIQUE(col1, col4, col5), UNIQUE(col1, col4, col5, col2), but this would waste my disk space. I am wondering how can MySQL 4.1 be so fast compared to SQLite 3? MySQL answers my query in 0.02 seconds, and SQLite answers in more than 28 seconds. I guess that MySQL doesn't do any magic either (i.e. it operates in O(Klog N) time, which appears to be just 0.02 seconds), but MySQL recognises that it should use the UNIQUE(col1, col4, col5) index, while SQLite poorly chooses some other index, maybe the PRIMARY KEY(col1, col2, col3, col4, col5), which is just wrong. Can someone confirm that the SQLite is using the wrong index? Is it possible to deterministically rewrite the query to force SQLite use the right index?
Re: [sqlite] multithreading!!!
Thank Jay but i just asked if everyone want to share... i sorry for bother you! On 6/6/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: Cesar, you should look on Google for the word 'tutorial' and whatever you are interested in. On 6/6/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > Please i beg to every one > > some one can give me some link or a little of theory of how can i do for > write at same time in a database like the others databases??? > > please i want to do that..
[sqlite] multithreading!!!
Please i beg to every one some one can give me some link or a little of theory of how can i do for write at same time in a database like the others databases??? please i want to do that..
Re: [sqlite] SQlite
I am developing something for that. where can i send you my script? (is done in C) On 6/5/06, Stefan de Konink <[EMAIL PROTECTED]> wrote: On Mon, 5 Jun 2006, Cesar David Rodas Maldonado wrote: > i am interesting to do something for sqlite, and i was thinking to try to do > a multi threading for read and write at the same time, like MySQL, or i > would like to do something for fulltext search. > > Please people answer me giving me ideas!!! Fulltextsearch would be sweet :) Currently my database is too big to do a 'like' in reasonable time. Stefan
[sqlite] SQlite
hello i am interesting to do something for sqlite, and i was thinking to try to do a multi threading for read and write at the same time, like MySQL, or i would like to do something for fulltext search. Please people answer me giving me ideas!!!
Re: [sqlite] Most appropriate Web based database? (Newbie)
If you want to easy portability of your database use SQLite... but if you are a great site, doing every time insert and update use another like postgresql or mysql. and it depends of the language your are writing your web site, if you PHP you could use what ever between mysql,postgresql, sqlite or oracle if you have money... but i prefer sqlite On 4/24/06, Jim C. Nasby <[EMAIL PROTECTED]> wrote: > > On Mon, Apr 24, 2006 at 08:54:40PM -0400, Paul Malcher wrote: > > On 4/24/06, Jim C. Nasby <[EMAIL PROTECTED]> wrote: > > > > > > Keep in mind, there's *WAY* more Windows users than Linux users; that > > > doesn't mean Windows is a better OS. > > > > > > Indeed also keep in mind both Postgres and MySQL are cross platform as > well. > > Look back to the email I quoted: the user was giving the larger number > of google hits for MySQL vs PostgreSQL as a reason to choose MySQL over > PostgreSQL. My point was that just beacuse a lot of people use it > doesn't mean it's actually any good. > > MySQL: the WindowsME of databases... > > > One final thought: the support you'll be able to get from the PostgreSQL > > > community is absolutely top-notch, possibly even better than the > support > > > from the SQLite community (which is really saying something). I don't > > > believe the same can be said of MySQL. > > > > > > Haha, I have to agree. I've run into performance issues with MySQL in > some > > of projects, but never with Postgres. Keep in mind I'm a die hard > Postgres > > user and totally loath MySQL, because its had very annoying issues. > > Had? :P > -- > Jim C. Nasby, Sr. Engineering Consultant [EMAIL PROTECTED] > Pervasive Software http://pervasive.comwork: 512-231-6117 > vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 >
Re: [sqlite] what is faster?
Thanks Richard Hipp and it will be more easy to use all in one file... thanks for your help On 4/16/06, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > "Cesar David Rodas Maldonado" <[EMAIL PROTECTED]> wrote: > > any one can answer me? > > > > On 4/15/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > > Hello > > > > > > I have a software that uses four tables. > > > > > > that's ok.. but i wanna know if is faster if i use for every table a > > > database ( a file) or if is the same thing in velocity if a put all > the > > > tables in one file, couse every table uses a lot of data. > > > > > I expect them to be about the same speed. > -- > D. Richard Hipp <[EMAIL PROTECTED]> > >
[sqlite] Re: what is faster?
any one can answer me? On 4/15/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > Hello > > I have a software that uses four tables. > > that's ok.. but i wanna know if is faster if i use for every table a > database ( a file) or if is the same thing in velocity if a put all the > tables in one file, couse every table uses a lot of data. > > thanks >
[sqlite] what is faster?
Hello I have a software that uses four tables. that's ok.. but i wanna know if is faster if i use for every table a database ( a file) or if is the same thing in velocity if a put all the tables in one file, couse every table uses a lot of data. thanks
Re: [sqlite] how to fix problem of lock
Thanx fred On 4/4/06, Fred Williams <[EMAIL PROTECTED]> wrote: > > I would suggest as a beginning: > > www.hwaci.com/sw/sqlite/whentouse.html > > www.hwaci.com/sw/sqlite/lockingv3.html > > www.hwaci.com/sw/sqlite/faq.html#q7 > > www.hwaci.com/sw/sqlite/faq.html#q8 > > www.sqlite.org/cvstrac/wiki?p=MultiThreading > > AND > > www.hwaci.com/sw/sqlite/ > > has wealth of very helpful information about all things SQLite. > > Once you have digested all that information, perhaps you will be in a > better position to ask more detailed and to the point questions. > General cries for help pretty much go unnoticed here. > > Most everyone here does not have the time and especially the patience > required to teach an SQLite beginner how to write a Google replacement. > > Fred > > > -Original Message- > > From: Cesar David Rodas Maldonado [mailto:[EMAIL PROTECTED] > > Sent: Tuesday, April 04, 2006 1:23 PM > > To: sqlite-users@sqlite.org > > Subject: Re: [sqlite] how to fix problem of lock > > > > > > Please people help me :D, the project will be open source... > > > > On 4/4/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > > OK English is not my first language, i am from south America, from > > > Paraguay so i speak Spanish... > > > > > > I am doing a project in C multiplataform.. right it project > > like google, > > > for a Linux. > > > > > > the project uses SQ Lite for repository. > > > > > > The software is a server which listen connection UDP. The > > server could > > > index (INSERT) and search within the database (SELECT). > > > > > > The problem is when i do so much connection at the same > > time for do index > > > and search at the same time. > > > > > > Know is it clear? sorry for my english :D > > > > > > Thanxs > > > > > > > ... > >
Re: [sqlite] how to fix problem of lock
Please people help me :D, the project will be open source... On 4/4/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > OK English is not my first language, i am from south America, from > Paraguay so i speak Spanish... > > I am doing a project in C multiplataform.. right it project like google, > for a Linux. > > the project uses SQ Lite for repository. > > The software is a server which listen connection UDP. The server could > index (INSERT) and search within the database (SELECT). > > The problem is when i do so much connection at the same time for do index > and search at the same time. > > Know is it clear? sorry for my english :D > > Thanxs > > > > > On 4/3/06, John Stanton <[EMAIL PROTECTED]> wrote: > > > > Try to explain what you are doing. How do you access SQLITE? What > > language? What SQL are you using. How many concurrent users do you > > have? Are you getting a LOCK error because of multiple users? > > > > Cesar David Rodas Maldonado wrote: > > > please i need some help > > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > >>i insert numbers and select numbers, so what could be the solutions, > > >>couse i have to do that > > >> > > >> > > >>On 4/3/06, Pam Greene < [EMAIL PROTECTED] > wrote: > > >> > > >>>An INSERT can change the results of your SELECT, so the database has > > to > > >>>be > > >>>locked during INSERT. Otherwise, the result of your SELECT would > > depend > > >>>on > > >>>whether the INSERT had finished yet. (The INSERT might even have > > only > > >>>partly finished, which would mean the SELECT was looking at a > > database > > >>>in an > > >>>inconsistent state.) It's not good to have unpredictable results > > like > > >>>that. > > >>> > > >>>For more explanation of why what you want isn't a good idea, see any > > >>>discussion of an "ACID" database, for example > > >>>http://en.wikipedia.org/wiki/ACID . > > >>> > > >>>- Pam > > >>> > > >>>On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > >>> > > >>>>HElp me, couse i just need to do insert and select, i dont use > > delete > > >>> > > >>>or > > >>> > > >>>>replate or update > > >>>> > > >>>>On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED] > wrote: > > >>>> > > >>>>>thanx man > > >>>>> > > >>>>> > > >>>>>but is posible open several DATABASE with a programm and do > > >>> > > >>>transaccion > > >>> > > >>>>>without locked the table??? > > >>>>> > > >>>>>On 4/3/06, Jay Sprenkle < [EMAIL PROTECTED]> wrote: > > >>>>> > > >>>>> > > >>>>>>On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED] > wrote: > > >>>>>> > > >>>>>>>I have a database ok... i do a lot of insert and select, but > > >>> > > >>>>there > > >>>> > > >>>>>>is > > >>>>>> > > >>>>>>>sometime that i cant do the select couse the database is > > >>> > > >>>locked... > > >>> > > >>>>>>>i have to do a lot of insert every time, so how can i do for > > >>> > > >>>dont > > >>> > > >>>>lock > > >>>> > > >>>>>>the > > >>>>>> > > >>>>>>>database... > > >>>>>>> > > >>>>>>>understand guy? > > >>>>>> > > >>>>>>Try this: > > >>>>>>http://sqlite.org/lang_transaction.html > > >>>>>> > > >>>>> > > >>>>> > > >>>> > > >>> > > > > > > > >
Re: [sqlite] how to fix problem of lock
OK English is not my first language, i am from south America, from Paraguay so i speak Spanish... I am doing a project in C multiplataform.. right it project like google, for a Linux. the project uses SQ Lite for repository. The software is a server which listen connection UDP. The server could index (INSERT) and search within the database (SELECT). The problem is when i do so much connection at the same time for do index and search at the same time. Know is it clear? sorry for my english :D Thanxs On 4/3/06, John Stanton <[EMAIL PROTECTED]> wrote: > > Try to explain what you are doing. How do you access SQLITE? What > language? What SQL are you using. How many concurrent users do you > have? Are you getting a LOCK error because of multiple users? > > Cesar David Rodas Maldonado wrote: > > please i need some help > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > >>i insert numbers and select numbers, so what could be the solutions, > >>couse i have to do that > >> > >> > >>On 4/3/06, Pam Greene < [EMAIL PROTECTED]> wrote: > >> > >>>An INSERT can change the results of your SELECT, so the database has to > > >>>be > >>>locked during INSERT. Otherwise, the result of your SELECT would > depend > >>>on > >>>whether the INSERT had finished yet. (The INSERT might even have only > >>>partly finished, which would mean the SELECT was looking at a database > >>>in an > >>>inconsistent state.) It's not good to have unpredictable results like > >>>that. > >>> > >>>For more explanation of why what you want isn't a good idea, see any > >>>discussion of an "ACID" database, for example > >>>http://en.wikipedia.org/wiki/ACID . > >>> > >>>- Pam > >>> > >>>On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > >>> > >>>>HElp me, couse i just need to do insert and select, i dont use delete > >>> > >>>or > >>> > >>>>replate or update > >>>> > >>>>On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED] > wrote: > >>>> > >>>>>thanx man > >>>>> > >>>>> > >>>>>but is posible open several DATABASE with a programm and do > >>> > >>>transaccion > >>> > >>>>>without locked the table??? > >>>>> > >>>>>On 4/3/06, Jay Sprenkle < [EMAIL PROTECTED]> wrote: > >>>>> > >>>>> > >>>>>>On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED]> wrote: > >>>>>> > >>>>>>>I have a database ok... i do a lot of insert and select, but > >>> > >>>>there > >>>> > >>>>>>is > >>>>>> > >>>>>>>sometime that i cant do the select couse the database is > >>> > >>>locked... > >>> > >>>>>>>i have to do a lot of insert every time, so how can i do for > >>> > >>>dont > >>> > >>>>lock > >>>> > >>>>>>the > >>>>>> > >>>>>>>database... > >>>>>>> > >>>>>>>understand guy? > >>>>>> > >>>>>>Try this: > >>>>>>http://sqlite.org/lang_transaction.html > >>>>>> > >>>>> > >>>>> > >>>> > >>> > > > >
Re: [sqlite] how to fix problem of lock
please i need some help On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > i insert numbers and select numbers, so what could be the solutions, > couse i have to do that > > > On 4/3/06, Pam Greene < [EMAIL PROTECTED]> wrote: > > > > An INSERT can change the results of your SELECT, so the database has to > > be > > locked during INSERT. Otherwise, the result of your SELECT would depend > > on > > whether the INSERT had finished yet. (The INSERT might even have only > > partly finished, which would mean the SELECT was looking at a database > > in an > > inconsistent state.) It's not good to have unpredictable results like > > that. > > > > For more explanation of why what you want isn't a good idea, see any > > discussion of an "ACID" database, for example > > http://en.wikipedia.org/wiki/ACID . > > > > - Pam > > > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > > HElp me, couse i just need to do insert and select, i dont use delete > > or > > > replate or update > > > > > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > > > > thanx man > > > > > > > > > > > > but is posible open several DATABASE with a programm and do > > transaccion > > > > without locked the table??? > > > > > > > > On 4/3/06, Jay Sprenkle < [EMAIL PROTECTED]> wrote: > > > > > > > > > On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED]> wrote: > > > > > > I have a database ok... i do a lot of insert and select, but > > > > > there > > > > > is > > > > > > sometime that i cant do the select couse the database is > > locked... > > > > > > > > > > > > i have to do a lot of insert every time, so how can i do for > > dont > > > lock > > > > > the > > > > > > database... > > > > > > > > > > > > understand guy? > > > > > > > > > > Try this: > > > > > http://sqlite.org/lang_transaction.html > > > > > > > > > > > > > > > > > > > > > > > >
Re: [sqlite] how to fix problem of lock
i insert numbers and select numbers, so what could be the solutions, couse i have to do that On 4/3/06, Pam Greene <[EMAIL PROTECTED]> wrote: > > An INSERT can change the results of your SELECT, so the database has to be > locked during INSERT. Otherwise, the result of your SELECT would depend > on > whether the INSERT had finished yet. (The INSERT might even have only > partly finished, which would mean the SELECT was looking at a database in > an > inconsistent state.) It's not good to have unpredictable results like > that. > > For more explanation of why what you want isn't a good idea, see any > discussion of an "ACID" database, for example > http://en.wikipedia.org/wiki/ACID . > > - Pam > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > HElp me, couse i just need to do insert and select, i dont use delete or > > replate or update > > > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > > > > > thanx man > > > > > > > > > but is posible open several DATABASE with a programm and do > transaccion > > > without locked the table??? > > > > > > On 4/3/06, Jay Sprenkle < [EMAIL PROTECTED]> wrote: > > > > > > > On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED]> wrote: > > > > > I have a database ok... i do a lot of insert and select, but > > there > > > > is > > > > > sometime that i cant do the select couse the database is locked... > > > > > > > > > > i have to do a lot of insert every time, so how can i do for dont > > lock > > > > the > > > > > database... > > > > > > > > > > understand guy? > > > > > > > > Try this: > > > > http://sqlite.org/lang_transaction.html > > > > > > > > > > > > > > > >
Re: [sqlite] how to fix problem of lock
HElp me, couse i just need to do insert and select, i dont use delete or replate or update On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > thanx man > > > but is posible open several DATABASE with a programm and do transaccion > without locked the table??? > > On 4/3/06, Jay Sprenkle < [EMAIL PROTECTED]> wrote: > > > On 4/3/06, Cesar David Rodas Maldonado < [EMAIL PROTECTED]> wrote: > > > I have a database ok... i do a lot of insert and select, but there > > is > > > sometime that i cant do the select couse the database is locked... > > > > > > i have to do a lot of insert every time, so how can i do for dont lock > > the > > > database... > > > > > > understand guy? > > > > Try this: > > http://sqlite.org/lang_transaction.html > > > >
Re: [sqlite] how to fix problem of lock
thanx man but is posible open several DATABASE with a programm and do transaccion without locked the table??? On 4/3/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > I have a database ok... i do a lot of insert and select, but there > is > > sometime that i cant do the select couse the database is locked... > > > > i have to do a lot of insert every time, so how can i do for dont lock > the > > database... > > > > understand guy? > > Try this: > http://sqlite.org/lang_transaction.html >
Re: [sqlite] how to fix problem of lock
I have a database ok... i do a lot of insert and select, but there is sometime that i cant do the select couse the database is locked... i have to do a lot of insert every time, so how can i do for dont lock the database... understand guy? On 4/3/06, Jay Sprenkle <[EMAIL PROTECTED]> wrote: > > On 4/3/06, Cesar David Rodas Maldonado <[EMAIL PROTECTED]> wrote: > > I have a database that i do a lot of insert and select... really a lot > > > > but i have a problem with the lock database, couse when i do a lot of > insert > > i can do a select > > > > i know that that is normal, but how can i fix it?, using a memory for > insert > > or using another database like a mirror or how??? > > Your message isn't very clear. > Maybe you can read part 7 here: > http://www.sqlite.org/faq.html > > > --- > SqliteImporter: Command line fixed and delimited text import. > http://www.reddawn.net/~jsprenkl/Sqlite >
[sqlite] how to fix problem of lock
I have a database that i do a lot of insert and select... really a lot but i have a problem with the lock database, couse when i do a lot of insert i can do a select i know that that is normal, but how can i fix it?, using a memory for insert or using another database like a mirror or how??? thankx
Re: [sqlite] How to unsubscribe from this maillist ?
why do you want to unsuscribe? On 4/1/06, z-axis <[EMAIL PROTECTED]> wrote: > > thanks > >
[sqlite] Fwd: how to fix problem of lock
-- Forwarded message -- From: Cesar David Rodas Maldonado <[EMAIL PROTECTED]> Date: Apr 2, 2006 10:51 PM Subject: how to fix problem of lock To: SQLIte help <[EMAIL PROTECTED]> I have a database that i do a lot of insert and select... really a lot but i have a problem with the lock database, couse when i do a lot of insert i can do a select i know that that is normal, but how can i fix it?, using a memory for insert or using another database like a mirror or how??? thankx
