This all jives with my experience doing this same sort of thing. Processing (reprojection and tiling) can also be offloaded to Amazon as well by using many instances in parallel (the way I usually do it).
Serving is not the issue, we just need disk and bandwidth, CPU and Memory are not horribly important here. Jeff On Wed, Dec 9, 2009 at 5:47 PM, Maurizio <[email protected]> wrote: > the more disks, the faster the raid, the quicker the tiling. > write speed is the key: should aim at least for 200Gb/sec write speed, no > point in CPU being able to process more tiles than can be writen. > ram is cheap: choose a board which can take as much ram as you might dream > of. > > on my (single) quad 2.83Ghz tiler (22 x 1Tb zfs) I tile at average of 150 > tiles / sec .... that's over half a million tiles per hour or 13 million > tiles per day. Any faster processor than this and I would have to slow the > process down. > Warning: lots of tiles which can kill a fs in no time unless they are > properly managed. > > ... or was the question about serving? well, there is little CPU usage in > serving tiles, > http://mt0.afrigis.co.za/admin/stats/ > even a pentium 4 could handle such a load > > (that is if what you wish to generate and serve tiles. I still must figure > out this for sure). > > Ciao > > Maurizio > > ----- Original Message ----- > From: Anthony > To: Jeffrey Johnson > Cc: talk > Sent: Thursday, December 10, 2009 3:22 AM > Subject: Re: [OAM-talk] Moving forward (was: Completing the OAM PSC > electionprocess) > On Wed, Dec 9, 2009 at 12:41 PM, Jeffrey Johnson <[email protected]> wrote: >> >> 1) Buy/Build a machine with a decent amount of disk to get this thing >> off the ground. Once built, it would require somewhere to host it, but >> that could be less of a problem than putting the machine together at >> first. By 'decent' ... I mean at least 10TB probably as much as 20 or >> 30 just to get the ball rolling here, otherwise we quickly >> (immediately) run into resource issues. This kind of machine (30TB >> disk) can be built for roughly $7.5-10k. It seems to me that this kind >> of $ could be raised if we had an appropriate plan. > > What if we got 8 machines with 4 terabytes each, or 4 machines with 8 > terabytes each? What kind of CPU would we need in each? > > ________________________________ > > _______________________________________________ > talk mailing list > [email protected] > http://openaerialmap.org/mailman/listinfo/talk_openaerialmap.org > _______________________________________________ talk mailing list [email protected] http://openaerialmap.org/mailman/listinfo/talk_openaerialmap.org
