RKuttruff opened a new pull request, #82:
URL: https://github.com/apache/incubator-sdap-ingester/pull/82
SDAP-477: Added a preprocessor to reshape datasets wherein the data_vars are
1 dimensional arrays as opposed to 2 dimensional arrays
Specified in the collection config:
```yaml
preprocess:
- name: trajectory
dimension: xyz # <--- 1D dimension name
```
NOTE: The processed result will have its dimensions named to `ROWS` and
`COLS`, so make slicer entries accordingly:
```yaml
slices:
ROWS: 15
COLS: 15
```
SDAP-478: I've encountered [some
datasets](https://podaac.jpl.nasa.gov/announcements/2023-06-28-SWOT-L2-Nadir-Altimeter-and-Advanced-Microwave-Radiometer-Dataset-Release)
wherein all the data variables are stored in a subgroup (not root group).
Xarray does not open these groups unless specified (opens root by default) so
we need a way to have the user specify (in the collection config) which group
they want. If unspecified it defaults to root.
```yaml
- id: dataset
path: <some path>
group: subgroup
...
```
Currently, this allows focus on ONLY ONE subgroup, if the data exists across
different groups, something else must be done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
