Hi All, For one of the websites i have developed (/am developing), i have a dataset that i must refer to for some of the dynamic pages.
The data is planetary data that is pretty much in spreadsheet format, aka, i have just under 800,000 "rows" of data. I don't do any copmlex searches or functions on the data. I simply need to look at certain columns at certain times. sample data set: planet | date | right_ascension | declination | distance | altitude | azimuth | visibility ---------+------------+-----------------+-------------+----------+----------+----------+------------ jupiter | 1900-01-01 | 15h 57m 7s | -19° 37.2' | 6.108 | 10.199 | 39.263 | up mars | 1900-01-01 | 19h 2m 20s | -23° 36.7' | 2.401 | 14.764 | -4.65 | up mercury | 1900-01-01 | 17h 15m 16s | -21° 59.7' | 1.151 | 14.041 | 20.846 | up moon | 1900-01-01 | 18h 41m 17s | -21° 21.8' | 58.2 | 17.136 | 0.343 | transit neptune | 1900-01-01 | 5h 39m 18s | +22° 4.0' | 28.922 | -15.128 | -164.799 | set I need to be able to say: * Lookup the _distance_ for the planet _mercury_ on the date _1900-01-01_ Currently i do this using a postgres database, however, my question is, is there a quicker way to do this in mod_perl - would a DB_File or some other structure be better? I would be interested in knowing if others have dealt with large data sets as above and what solutions they have used. A DB is quick, but is there something one can use in mod_perl that would be quicker? perhaps something such as copying the whole 800,000 rows to memory (as a hash?) on apache startup? simran.
