Hi,
I'm trying to work out whether OODT is the right framework for me.
I have a radio astronomy application. Data rate is roughly 12 TB/day.
Data format it a custom one with all sorts of metadata flying around
(including sky direction in lat/long coordinates).
The raw data is pretty huge, and I can't store it on an OODT machine.
The big disk I have access to won't run OODT>
Basically I want to:
1. Save the metadata of the raw data into an index somewhere.
2. Run some GPU codes over the raw data. The GPU code parameters should
be set based on the metadata.
3. Save the GPU results in an archive, with even more metadata
4. Copy the raw data to a remote disk with a long-running bbcp task.
5. Delete the raw data, but keep the GPU results and all the metadata
I'm having trouble finding the right documentation the describes how I
can do this. Can you give me a top level page? (I've looked at the wiki,
but it's a bit tricky to work out where to start).
K
--
KEITH BANNISTER | Principal Research Engineer
CSIRO Astronomy and Space Science
T +61 2 9372 4295
E [email protected]
