Re: [sqlite] Improve query performance using a join

2014-08-19 Thread Paul Dillon
Thanks to all that replied to my post and sorry for the delayed response. I had trouble joining the list and had not realised that my post went through until I tried to join the list again. Simon Slavin slavins at bigfraud.org wrote: What you might find increases your speed is to make sure

Re: [sqlite] Improve query performance using a join

2014-08-19 Thread Paul Dillon
Jim Callahan jim.callahan.orlando at gmail.com wrote: 1. My condolences with those dimensions you are heading for big data/hadoop land. Heheh thanks, I am so determined not to go there! SQLite has been such a nice simple database to use, I will do anything to avoid all the complexity of

[sqlite] Improve query performance using a join

2014-08-07 Thread Paul Dillon
Hello, I would like to know if splitting a big table into two smaller ones, and then using a join in my queries would speed up performance. My table is 100-300GB in size and has about 150 columns. There are 8 fields that I frequently use in my queries, which require full table scans to