[sage-devel] Re: sqlite - update to the latest release
Dave, you ought to say at least how to get the new spkg Dima On Mar 3, 10:51 am, Dr. David Kirkby david.kir...@onetel.net wrote: If anyone has a minute, I would appreciate a review of http://trac.sagemath.org/sage_trac/ticket/8408 which is a simple update to the latest stable sqlite release. (There is one minor change to spkg-install, which tests for SAGE64 being only yes and not yes or 1 as previously the case.) The sqlite update fixes 5 test failures on Solaris - #8397, #8398, #8399 #8400 and #8401. Dave -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sage-devel URL: http://www.sagemath.org
Re: [sage-devel] Re: sqlite - update to the latest release
Hi Dima, On Wed, Mar 3, 2010 at 2:03 PM, Dima Pasechnik dimp...@gmail.com wrote: Dave, you ought to say at least how to get the new spkg From any computer outside of the Sage cluster: $ wget http://boxen.math.washington.edu/home/kirkby/Solaris-fixes/sqlite-3.6.22/sqlite-3.6.22.spkg From compute node within the Sage cluster: $ cp /home/kirkby/Solaris-fixes/sqlite-3.6.22/sqlite-3.6.22.spkg /home/username/ -- Regards Minh Van Nguyen -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sage-devel URL: http://www.sagemath.org
Re: [sage-devel] Re: sqlite - update to the latest release
Dima Pasechnik wrote: Dave, you ought to say at least how to get the new spkg Dima It was on the ticket, but as Ming has pointed out, it is at http://boxen.math.washington.edu/home/kirkby/Solaris-fixes/sqlite-3.6.22/sqlite-3.6.22.spkg Dave On Mar 3, 10:51 am, Dr. David Kirkby david.kir...@onetel.net wrote: If anyone has a minute, I would appreciate a review of http://trac.sagemath.org/sage_trac/ticket/8408 which is a simple update to the latest stable sqlite release. (There is one minor change to spkg-install, which tests for SAGE64 being only yes and not yes or 1 as previously the case.) The sqlite update fixes 5 test failures on Solaris - #8397, #8398, #8399 #8400 and #8401. Dave -- To post to this group, send an email to sage-devel@googlegroups.com To unsubscribe from this group, send an email to sage-devel+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/sage-devel URL: http://www.sagemath.org
[sage-devel] Re: sqlite
Hello, I also found this. The problem is here: tclsh ./tool/mksqlite3c.tcl gcc sqlite3.c -o sqlite3 /usr/lib/gcc/i686-pc-cygwin/3.4.4/../../../libcygwin.a(libcmain.o): (.text+0xab): undefined reference to [EMAIL PROTECTED]' sqlite3.c is build with the script ./tool/mksqlite3c.tcl - then compiled with a default rule for .c file. Because there is no main function in sqlite3.c the linked throws an error. sqlite3.exe is not build from sqlite3c, but from src/shell.c. I am digging around in makefile.in, but I haven't found a solution yet. Cheers, Michael --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
Hello, uncommenting line 306 307 in Makefile.in fixes it for me: #sqlite3.c: target_source $(TOP)/tool/mksqlite3c.tcl # tclsh $(TOP)/tool/mksqlite3c.tcl sqlite has been build successfully, but I am not sure if there will be problems down the road. Once I am done and run all the tests I can give you an update. I did not test this on platforms that are not cygwin, yet. Cheers, Michael --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
On Mon, Jan 22, 2007 at 09:01:57AM -0800, William Stein wrote: Yes. E.g., there is a large table of graphs that one person made, and another very large table of reflexive polytopes in dimension = 4. Both are best queried using SQL. Gonzalo Tornario once made a very nice SQLite database of Cremona's tables of elliptic curves. I have a lot of data that might best be stored as a SQL table. The database with Cremona's tables is up-to-date, I can contribute it and/or the scripts to generate it (bash+perl+wget+pari+sqlite+...). The database currently (conductor up to 130k) weights 500+ Mb, and it takes 2-3 hours to generate (it computes /all/ quadratic twists in the tables). I also have a database for some of William's data on newforms of weight 2, although it is more limited (I believe up to level 5k or so). There is also a database of ternary quadratic forms computed by myself. The data is online at http://www.ma.utexas.edu/users/tornaria/cnt/; unfortunately you cannot do sql queries on the databases, but you can browse around, including taking quadratic twists, etc. Best, Gonzalo --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
On Monday 22 January 2007 17:14, William Stein wrote: Hello, For a while now I've been considering including a relational database in SAGE, since in the long run this will make it much much easier to create certain types of databases that are easy to query. Probably the obvious best choice would be: http://www.sqlite.org/ QUESTIONS: (1) Try sage -i sqlite-3.3.11 to install it into SAGE. Any problems? sage: import sqlite3 sage: sqlite3.version works fine (Debian Etch/AMD64 on Core 2 Duo) (2) Assuming sqlite installs OK for everyone, the constraint to adding it standard to SAGE is that it increases the build time by 1-2 minutes and the tarball size by 1.7MB (with the sqlite tests included). Is it worth it? Am I right that ZODB (shipped with SAGE) is an object oriented database? I am not very into databases thus I ask: What advantage does sqlite (being a relational database) over ZODB? Martin -- name: Martin Albrecht _pgp: http://pgp.mit.edu:11371/pks/lookup?op=getsearch=0x8EF0DC99 _www: http://www.informatik.uni-bremen.de/~malb _jab: [EMAIL PROTECTED] --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
William Stein wrote: (1) Try sage -i sqlite-3.3.11 to install it into SAGE. Any problems? sage: import sqlite3 sage: sqlite3.version Builds and installs fine on FC 5 sage: from pysqlite2 import dbapi2 as sqlite sage: (2) Assuming sqlite installs OK for everyone, the constraint to adding it standard to SAGE is that it increases the build time by 1-2 minutes and the tarball size by 1.7MB (with the sqlite tests included). Is it worth it? ??? Jaap --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
On Mon, 22 Jan 2007 08:28:31 -0800, Martin Albrecht [EMAIL PROTECTED] wrote: Am I right that ZODB (shipped with SAGE) is an object oriented database? Yes. I am not very into databases thus I ask: What advantage does sqlite (being a relational database) over ZODB? It's a completely different thing, and solves different problems. Basically, ZODB is very good at making large data structures (basically B-tree dictionaries) persistent on disk. You can make a 10GB dictionary, and work with it like it is in memory, but in fact maybe only 1GB of RAM is used instead of 10GB. But all modifications get appended to the end of the file (so ZODB sucks if one does a lot of updating to the data, but is good for reading). One problem is the data is only readable by Python via ZODB. A nice feature that doesn't get used in SAGE yet is that ZODB databases can be served over the internet directly. Relational databases are much different because they offer a very sophisticated query language and automated creation of indexes. ZODB doesn't give you nearly the same level of querying functionality, except what you might add yourself. Moreover data stored in a sqlite database can be queried without using Python. Based on past experience, I think sqlite will scale much better to large datasets than ZODB. The datasets used in math computations are mostly large read-only tables, so a heavier database (mysql or postgresql) is total overkill. William --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
Relational databases are much different because they offer a very sophisticated query language and automated creation of indexes. I had my fair share of SQL queries, so I agree on that :-) I just didn't know that ZODB was so limited with respect to querying. The datasets used in math computations are mostly large read-only tables, so a heavier database (mysql or postgresql) is total overkill. I agree. Is there any data yet that would be put in a sqlite database? I would say the inclusion of a database is worth the compile time space if there is any interesting data in the database. I assume most math packages don't put their data in SQL tables. Also, we should probably set up a SAGE SQL master server (this could be postgresql) such that clients can query the online database and avoid downloading 10GB worth of data? Martin -- name: Martin Albrecht _pgp: http://pgp.mit.edu:11371/pks/lookup?op=getsearch=0x8EF0DC99 _www: http://www.informatik.uni-bremen.de/~malb _jab: [EMAIL PROTECTED] --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
I have done some small tests with using pysqlite from Twisted and it was very easy and convient, so I vote +1 for sqlite. Alex --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
[sage-devel] Re: sqlite
such that clients can query the online database and avoid downloading 10GB worth of data? Definitely. Having recently struggled with the database interface, it would be _great_ if there was a networked db class that loaded data from sage.math. Then I could only download the (few) class polynomials I need rather than the full 77meg db. This might also be a good time to standardize the database implementations; they are all subtly different internally. Nick --~--~-~--~~~---~--~~ To post to this group, send email to sage-devel@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/sage-devel URLs: http://sage.scipy.org/sage/ and http://modular.math.washington.edu/sage/ -~--~~~~--~~--~--~---
