I'm trying to see if SQLite is suitable for large databases ( > 1 gb, millions of rows in each of several tables). Initially, the memory usage was outrageous (~ 500 mb for a 1.3 gb db), but I got that down to < 30 mb by setting the cache size to 0 and setting a low soft heap limit. That works when I'm reading from the database, but when I am inserting these rows, the memory usage grows back into the ~500 mb range. My goal is to never have the application use more than 100 mb of memory, preferably much less than that. Does anyone have any suggestions?
Josh