I think many people would tell you not to store your images in your database. Just store a filepath to them. That will speed things up quite a bit and even possibly prevent having to use an SSD.
With the filepath your processing apps can use file locking too if you need it. -----Original Message----- From: sqlite-users-boun...@sqlite.org [mailto:sqlite-users-boun...@sqlite.org] On Behalf Of Jeff Archer Sent: Friday, March 29, 2013 2:18 PM To: SQLite-user.org Subject: [sqlite] How to achieve fastest possible write performance for a strange and limited case I have previously made an apparently bad assumption about this so now I would like to go back to the beginning of the problem and ask the most basic question first without any preconceived ideas. This use case is from an image processing application. I have a large amount of intermediate data (way exceeds physical memory on my 24GB machine). So, I need to store it temporarily on disk until getting to next phase of processing. I am planning to use a large SSD dedicated to holding this temporary data. I do not need any recoverability in case of hardware, power or other failure. Each item to be stored is 9 DWORDs, 4 doubles and 2 variable sized BLOBS which are images. I could write directly to a file myself. But I would need to provide some minimal indexing, some amount of housekeeping to manage variable sized BLOBS and some minimal synchronization so that multiple instances of the same application could operate simultaneously on a single set of data. So, then I though that SQLite could manage these things nicely for me so that I don't have to write and debug indexing and housekeeping code that already exists in SQLite. So, question is: What is the way to get the fastest possible performance from SQLite when I am willing to give up all recoverability guarantees? Or, is it simple that I should just write directly to file myself? _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
