[sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread Ludvig Strigeus

Does Sqlite support databases larger than 2GB on FAT filesystems?

If not, how hard would it be to add so it uses additional files for the
pages that don't fit in the first file?

Thanks
Ludvig


RE: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread Samuel R. Neff

You can break up the db into multiple databases and attach them to the same
connection.  That would be easiest approach (as long as one individual table
is not bigger than 2gb).

Sam 


---
We're Hiring! Seeking a passionate developer to join our team building
products. Position is in the Washington D.C. metro area. If interested
contact [EMAIL PROTECTED]
 
-Original Message-
From: Ludvig Strigeus [mailto:[EMAIL PROTECTED] 
Sent: Friday, April 13, 2007 2:32 PM
To: [EMAIL PROTECTED]
Subject: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

Does Sqlite support databases larger than 2GB on FAT filesystems?

If not, how hard would it be to add so it uses additional files for the
pages that don't fit in the first file?

Thanks
Ludvig


-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread John Stanton
It is limited by the maximum file size on your OS.  You can make a 
multiple file database by ATTACHing more than one database.


Ludvig Strigeus wrote:

Does Sqlite support databases larger than 2GB on FAT filesystems?

If not, how hard would it be to add so it uses additional files for the
pages that don't fit in the first file?

Thanks
Ludvig




-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread Ludvig Strigeus

I would like to have a single table larger than 2GB...though.

/Ludvig

On 4/13/07, John Stanton <[EMAIL PROTECTED]> wrote:


It is limited by the maximum file size on your OS.  You can make a
multiple file database by ATTACHing more than one database.

Ludvig Strigeus wrote:
> Does Sqlite support databases larger than 2GB on FAT filesystems?
>
> If not, how hard would it be to add so it uses additional files for the
> pages that don't fit in the first file?
>
> Thanks
> Ludvig
>



-
To unsubscribe, send email to [EMAIL PROTECTED]

-




Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread John Stanton

Use a file system with 64 bit addressing.

Ludvig Strigeus wrote:

I would like to have a single table larger than 2GB...though.

/Ludvig

On 4/13/07, John Stanton <[EMAIL PROTECTED]> wrote:



It is limited by the maximum file size on your OS.  You can make a
multiple file database by ATTACHing more than one database.

Ludvig Strigeus wrote:
> Does Sqlite support databases larger than 2GB on FAT filesystems?
>
> If not, how hard would it be to add so it uses additional files for the
> pages that don't fit in the first file?
>
> Thanks
> Ludvig
>



- 


To unsubscribe, send email to [EMAIL PROTECTED]

- 









-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-13 Thread Roger Binns
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Ludvig Strigeus wrote:
> I would like to have a single table larger than 2GB...though.

FAT16 has a maximum file size of 2GB.  FAT32 (the most common one in use
today) has a maximum file size of 4GB.  It is impossible to have single
files larger than those sizes.  See
http://en.wikipedia.org/wiki/File_Allocation_Table

SQLite does not support splitting the database across multiple files
behind the scenes.  (Other database implementations such as Postgres
can, but they aren't 'lite').

You can partition your table across multiple databases, each less than
2GB but all of your SQL code will have to be aware of that.  An
alternative is to use virtual tables which will let you present the
impression of a single table, while accessing the partitioned table
behind the scenes.

http://www.sqlite.org/cvstrac/wiki?p=VirtualTables

Roger
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iD8DBQFGIFqjmOOfHg372QQRApLSAJ4kanFb0aEaXSdzV+UXG/2PNFIWmQCeO3O1
dqatDP3qYpoU4QRne554f4w=
=jJdQ
-END PGP SIGNATURE-

-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-14 Thread drh
"Ludvig Strigeus" <[EMAIL PROTECTED]> wrote:
> Does Sqlite support databases larger than 2GB on FAT filesystems?

SQLite supports large databases just fine.  It is FAT that does
not support large files.

> 
> If not, how hard would it be to add so it uses additional files for the
> pages that don't fit in the first file?
> 

The OS interface in SQLite is modular and interchangable.
If you compile with -DSQLITE_ENABLE_REDEF_IO=1, you can
even interchange the OS interface layer at runtime.

I suggest you write a new OS interface layer specifically
for FAT that allows the SQLite core to open, read, and write
a single file, but which splits the reads and writes across
multiple files where each of the multiple files is less than
2GB.

--
D. Richard Hipp <[EMAIL PROTECTED]>


-
To unsubscribe, send email to [EMAIL PROTECTED]
-



Re: [sqlite] Supporting databases larger than 2GB on FAT filesystems?

2007-04-14 Thread Ludvig Strigeus

Alright thanks! I will look into that.

/Ludvig


On 4/14/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote:


"Ludvig Strigeus" <[EMAIL PROTECTED]> wrote:
> Does Sqlite support databases larger than 2GB on FAT filesystems?

SQLite supports large databases just fine.  It is FAT that does
not support large files.

>
> If not, how hard would it be to add so it uses additional files for the
> pages that don't fit in the first file?
>

The OS interface in SQLite is modular and interchangable.
If you compile with -DSQLITE_ENABLE_REDEF_IO=1, you can
even interchange the OS interface layer at runtime.

I suggest you write a new OS interface layer specifically
for FAT that allows the SQLite core to open, read, and write
a single file, but which splits the reads and writes across
multiple files where each of the multiple files is less than
2GB.

--
D. Richard Hipp <[EMAIL PROTECTED]>



-
To unsubscribe, send email to [EMAIL PROTECTED]

-