Hello, I would like to know if splitting a big table into two smaller ones, and then using a join in my queries would speed up performance.
My table is 100-300GB in size and has about 150 columns. There are 8 fields that I frequently use in my queries, which require full table scans to complete. I usually query each field once per data load, so the time to index them is not worth it. (FYI I am data mining). So my questions are: 1. Will moving these 8 query fields to a smaller table improve query performance when joined to the larger table? My logic is that this small table would only be about 5% the size of the full table, so the full table scan to service the query might be faster. 2. Would it be worthwhile having that smaller table in a separate .db file, so that the data is closer together on my SSD drive? 3. Would the data loading performance be heavily impacted if I had to insert into two tables instead of one? I use "INSERT OR REPLACE" for my loading, with a single index. Many Thanks, Paul _______________________________________________ sqlite-users mailing list sqlite-users@sqlite.org http://sqlite.org:8080/cgi-bin/mailman/listinfo/sqlite-users
