Some background...
We have Objects
r1, r2 ... r1600 Which each have (~1600) regions
d1, d2 ... d500 Which each have (~500) datapoints
So, roughly we have around 786,000 datapoints on a given object.
Typically, we might take 15 or so regions and take data from each of their
The file size limits are imposed by the operating system, so one thing
you might consider is some of the linux filesystems that do not have
that limitation, (IIRC, XFS doesn't have that limit), or the use of a
solaris machine, which (again, IIRC :)) doesn't have that limitation,
either.
Others
