Alex Goodman created CLIMATE-904:
------------------------------------
Summary: New ESGF loader
Key: CLIMATE-904
URL: https://issues.apache.org/jira/browse/CLIMATE-904
Project: Apache Open Climate Workbench
Issue Type: Improvement
Components: regridding/data processing
Reporter: Alex Goodman
Assignee: Alex Goodman
Fix For: 1.3.0
Our current ESGF loader currently has several limitations:
- Only one dataset can be downloaded / processed at a time
- Datasets must be specified by dataset_id, which requires users to perform
manual searches to obtain
- Lack of customization options in search
Since our original loader was designed, ESGF's REST API
(https://www.earthsystemcog.org/projects/cog/esgf_search_restful_api) has come
a long way in terms of ease of use and extensibility. It can be used to
automatically generate a shell script which can download all of the data. This
can be easily done using either our own simple implementation or
esgf-pyclient's search API.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)