Alex Goodman created CLIMATE-825:
------------------------------------

             Summary: Coalesce data sources into one module
                 Key: CLIMATE-825
                 URL: https://issues.apache.org/jira/browse/CLIMATE-825
             Project: Apache Open Climate Workbench
          Issue Type: Improvement
          Components: data sources
    Affects Versions: 1.0.0
            Reporter: Alex Goodman
            Assignee: Huikyo Lee
             Fix For: 1.2


Kyo and I will be working on overhauling the way data loading is handled in the 
current RCMES workflow. Right now, the user manually specifies the sources for 
each dataset which are currently separated into three categories: local files 
on disk, the RCMES database (RCMED), and the Earth System Grid (ESGF). These 
cases are currently handled in separate modules / function calls, but it would 
be most ideal in the future to create one universal function call for all the 
data loading. An example schematic would be something like:

datasets = load(sources, ...)

Here datasets would be a list of OCW Dataset objects, sources would be a list 
of source specifications for each requested dataset (eg, 'esgf', 'local', or 
'rcmed'). Ideally we would also like better support for handling datasets 
spanned by multiple files as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to