[GitHub] climate pull request: CLIMATE-508: added a class 'Downscaling' and...

2015-04-28 Thread kwhitehall
Github user kwhitehall commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97084414
  
Ack @chrismattmann  and @MJJoyce. Thanks for the advice, still learning!



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CLIMATE-508) Adding statistical downscaling capability

2015-04-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517096#comment-14517096
 ] 

ASF GitHub Bot commented on CLIMATE-508:


Github user kwhitehall commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97084414
  
Ack @chrismattmann  and @MJJoyce. Thanks for the advice, still learning!



> Adding statistical downscaling capability
> -
>
> Key: CLIMATE-508
> URL: https://issues.apache.org/jira/browse/CLIMATE-508
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: metrics
>Affects Versions: 0.5
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
> Fix For: 1.0.0
>
>
> Three metrics will be added for statistically downscaling model outputs with 
> observational data.
> 1. Delta method
> 2. Quantile mapping
> 3. Quantile regression



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: CLIMATE-508: added a class 'Downscaling' and...

2015-04-28 Thread MJJoyce
Github user MJJoyce commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97133727
  
NP @kwhitehall. We can just include a reference to this in a future merge 
commit if @huikyole doesn't beat us to closing it. Easy peasy.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CLIMATE-508) Adding statistical downscaling capability

2015-04-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517374#comment-14517374
 ] 

ASF GitHub Bot commented on CLIMATE-508:


Github user MJJoyce commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97133727
  
NP @kwhitehall. We can just include a reference to this in a future merge 
commit if @huikyole doesn't beat us to closing it. Easy peasy.


> Adding statistical downscaling capability
> -
>
> Key: CLIMATE-508
> URL: https://issues.apache.org/jira/browse/CLIMATE-508
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: metrics
>Affects Versions: 0.5
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
> Fix For: 1.0.0
>
>
> Three metrics will be added for statistically downscaling model outputs with 
> observational data.
> 1. Delta method
> 2. Quantile mapping
> 3. Quantile regression



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: Merra loader

2015-04-28 Thread huikyole
GitHub user huikyole opened a pull request:

https://github.com/apache/climate/pull/194

Merra loader

https://issues.apache.org/jira/browse/CLIMATE-632

The loader has been tested with 3-hourly MERRA reanalysis data. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/huikyole/climate merra_loader

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/climate/pull/194.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #194


commit 5a471ce006ab16247fe305b611a5089beeaafa58
Author: huikyole 
Date:   2015-04-28T06:25:21Z

A loader to read MERRA reanalysis HDF-EOS files has been added

commit ed8b6695331e8e9fe8d046cd66ebf1afafe1c498
Author: huikyole 
Date:   2015-04-28T16:52:00Z

comments have been added




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (CLIMATE-632) Adding loaders to handle multiple MERRA reanalysis HDF files stored on a local disk

2015-04-28 Thread Huikyo Lee (JIRA)
Huikyo Lee created CLIMATE-632:
--

 Summary: Adding loaders to handle multiple MERRA reanalysis HDF 
files stored on a local disk
 Key: CLIMATE-632
 URL: https://issues.apache.org/jira/browse/CLIMATE-632
 Project: Apache Open Climate Workbench
  Issue Type: Improvement
  Components: data sources
Affects Versions: 1.0.0
Reporter: Huikyo Lee
Assignee: Huikyo Lee
Priority: Trivial
 Fix For: 1.0.0


Original MERRA reanalysis data are in HDF-EOS format. Current file loaders 
cannot read hourly MERRA data files at all without file conversion and 
pre-processing. By adding a simple loader for MERRA data (load_merra_3d_files), 
OCW users can easily read and create an OCW dataset object.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: Merra loader

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/194#issuecomment-97137682
  
 Merged build triggered. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CLIMATE-632) Adding loaders to handle multiple MERRA reanalysis HDF files stored on a local disk

2015-04-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517415#comment-14517415
 ] 

ASF GitHub Bot commented on CLIMATE-632:


GitHub user huikyole opened a pull request:

https://github.com/apache/climate/pull/194

Merra loader

https://issues.apache.org/jira/browse/CLIMATE-632

The loader has been tested with 3-hourly MERRA reanalysis data. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/huikyole/climate merra_loader

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/climate/pull/194.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #194


commit 5a471ce006ab16247fe305b611a5089beeaafa58
Author: huikyole 
Date:   2015-04-28T06:25:21Z

A loader to read MERRA reanalysis HDF-EOS files has been added

commit ed8b6695331e8e9fe8d046cd66ebf1afafe1c498
Author: huikyole 
Date:   2015-04-28T16:52:00Z

comments have been added




> Adding loaders to handle multiple MERRA reanalysis HDF files stored on a 
> local disk
> ---
>
> Key: CLIMATE-632
> URL: https://issues.apache.org/jira/browse/CLIMATE-632
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: data sources
>Affects Versions: 1.0.0
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
>Priority: Trivial
> Fix For: 1.0.0
>
>
> Original MERRA reanalysis data are in HDF-EOS format. Current file loaders 
> cannot read hourly MERRA data files at all without file conversion and 
> pre-processing. By adding a simple loader for MERRA data 
> (load_merra_3d_files), OCW users can easily read and create an OCW dataset 
> object.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: Merra loader

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/194#issuecomment-97137698
  
Merged build started. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] climate pull request: Merra loader

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/194#issuecomment-97137949
  
Merged build finished. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] climate pull request: CLIMATE-508: added a class 'Downscaling' and...

2015-04-28 Thread chrismattmann
Github user chrismattmann commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97177215
  
Yep no worries I just call them tickle commits change spacing on s text 
file then add commit msg all good!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CLIMATE-508) Adding statistical downscaling capability

2015-04-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517847#comment-14517847
 ] 

ASF GitHub Bot commented on CLIMATE-508:


Github user chrismattmann commented on the pull request:

https://github.com/apache/climate/pull/112#issuecomment-97177215
  
Yep no worries I just call them tickle commits change spacing on s text 
file then add commit msg all good!


> Adding statistical downscaling capability
> -
>
> Key: CLIMATE-508
> URL: https://issues.apache.org/jira/browse/CLIMATE-508
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: metrics
>Affects Versions: 0.5
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
> Fix For: 1.0.0
>
>
> Three metrics will be added for statistically downscaling model outputs with 
> observational data.
> 1. Delta method
> 2. Quantile mapping
> 3. Quantile regression



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CLIMATE-632) Adding a loader to handle multiple MERRA reanalysis HDF files stored on a local disk

2015-04-28 Thread Huikyo Lee (JIRA)

 [ 
https://issues.apache.org/jira/browse/CLIMATE-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Huikyo Lee updated CLIMATE-632:
---
Summary: Adding a loader to handle multiple MERRA reanalysis HDF files 
stored on a local disk  (was: Adding loaders to handle multiple MERRA 
reanalysis HDF files stored on a local disk)

> Adding a loader to handle multiple MERRA reanalysis HDF files stored on a 
> local disk
> 
>
> Key: CLIMATE-632
> URL: https://issues.apache.org/jira/browse/CLIMATE-632
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: data sources
>Affects Versions: 1.0.0
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
>Priority: Trivial
> Fix For: 1.0.0
>
>
> Original MERRA reanalysis data are in HDF-EOS format. Current file loaders 
> cannot read hourly MERRA data files at all without file conversion and 
> pre-processing. By adding a simple loader for MERRA data 
> (load_merra_3d_files), OCW users can easily read and create an OCW dataset 
> object.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CLIMATE-633) Adding a loader to handle WRF output stored on a local disk

2015-04-28 Thread Huikyo Lee (JIRA)
Huikyo Lee created CLIMATE-633:
--

 Summary: Adding a loader to handle WRF output stored on a local 
disk
 Key: CLIMATE-633
 URL: https://issues.apache.org/jira/browse/CLIMATE-633
 Project: Apache Open Climate Workbench
  Issue Type: Improvement
  Components: data sources
Affects Versions: 1.0.0
Reporter: Huikyo Lee
Assignee: Huikyo Lee
Priority: Trivial
 Fix For: 1.0.0


In order to handle multiple output files of 2-dimensional fields from Weather 
Research and Forecasting (WRF) model, a new loader called load_WRF_2d_files is 
proposed. This WRF loader includes a time parser only applicable to WRF output 
files. Original WRF output files use curvilinear grid points whose latitudes 
and longitudes are two dimensional arrays and their values do not increase or 
decrease monotonically. So there are some updates in the OCW dataset validation 
process. The loader has been tested using hourly WRF output on NCCS's 
linux-based supercomputers.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: A loader to handle Weather Research and Fore...

2015-04-28 Thread huikyole
GitHub user huikyole opened a pull request:

https://github.com/apache/climate/pull/195

A loader to handle Weather Research and Forecasting model's two-dimensional 
output file

Please refer to https://issues.apache.org/jira/browse/CLIMATE-633.
1. There is a special time parser for WRF data.
2. This loader handles multiple files whose names have common patterns.
3. Now latitudes and longitudes do not have to be one dimensional arrays 
with monotonic increase. This update allows OCW to handle data on a curvilinear 
grid. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/huikyole/climate WRF_loader

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/climate/pull/195.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #195


commit ee3854e4a0253de7fae707f705b1457f8b6cb82f
Author: Huikyo Lee 
Date:   2015-04-28T19:39:46Z

Initial commit




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] climate pull request: A loader to handle Weather Research and Fore...

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/195#issuecomment-97188981
  
Merged build started. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (CLIMATE-633) Adding a loader to handle WRF output stored on a local disk

2015-04-28 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517902#comment-14517902
 ] 

ASF GitHub Bot commented on CLIMATE-633:


GitHub user huikyole opened a pull request:

https://github.com/apache/climate/pull/195

A loader to handle Weather Research and Forecasting model's two-dimensional 
output file

Please refer to https://issues.apache.org/jira/browse/CLIMATE-633.
1. There is a special time parser for WRF data.
2. This loader handles multiple files whose names have common patterns.
3. Now latitudes and longitudes do not have to be one dimensional arrays 
with monotonic increase. This update allows OCW to handle data on a curvilinear 
grid. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/huikyole/climate WRF_loader

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/climate/pull/195.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #195


commit ee3854e4a0253de7fae707f705b1457f8b6cb82f
Author: Huikyo Lee 
Date:   2015-04-28T19:39:46Z

Initial commit




> Adding a loader to handle WRF output stored on a local disk
> ---
>
> Key: CLIMATE-633
> URL: https://issues.apache.org/jira/browse/CLIMATE-633
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: data sources
>Affects Versions: 1.0.0
>Reporter: Huikyo Lee
>Assignee: Huikyo Lee
>Priority: Trivial
> Fix For: 1.0.0
>
>
> In order to handle multiple output files of 2-dimensional fields from Weather 
> Research and Forecasting (WRF) model, a new loader called load_WRF_2d_files 
> is proposed. This WRF loader includes a time parser only applicable to WRF 
> output files. Original WRF output files use curvilinear grid points whose 
> latitudes and longitudes are two dimensional arrays and their values do not 
> increase or decrease monotonically. So there are some updates in the OCW 
> dataset validation process. The loader has been tested using hourly WRF 
> output on NCCS's linux-based supercomputers.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] climate pull request: A loader to handle Weather Research and Fore...

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/195#issuecomment-97188953
  
 Merged build triggered. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] climate pull request: A loader to handle Weather Research and Fore...

2015-04-28 Thread OCWJenkins
Github user OCWJenkins commented on the pull request:

https://github.com/apache/climate/pull/195#issuecomment-97189299
  
Merged build finished. Test Failed.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---