Third opendapps patch

2012-01-21 Thread Cinquini, Luca (3880)
Hi all,
I submitted a new patch to the opendapps module for review by the 
Apache committers, which provides functionality needed by the CMDS project.

The main purpose of this patch is to improve the richness and consistency of 
metadata extracted from the THREDDS catalogs and OpenDAP streams, and to check 
that the required information is indeed present in the resulting OODT metadata 
profiles. More details can be found in the patch description itself:

https://issues.apache.org/jira/browse/OODT-371

as usual, thanks for reviewing the patch,
Luca

Re: OODT Primary Key Business Drivers

2012-01-21 Thread BW
Thanks!

BW

On Jan 21, 2012, at 10:28 AM, Mattmann, Chris A (388J) 
chris.a.mattm...@jpl.nasa.gov wrote:

 Hi BW,
 
 On Jan 20, 2012, at 10:17 PM, B W wrote:
 
 Concur with the ones listed below ?
 Any other aside from the ones below?
 
 Provide an architectural framework that can be continuously improved upon
 in an efficient manner.
 
 +1.
 
 
 In an efficient and interoperable manner provide support for scientific
 disparate data that needs to be managed, archived and distributed among
 scientists and engineers.
 
 +1.
 
 
 In an efficient, interoperable and transparent manner support the need for
 scientists and engineers to collectively collaborate, search, store,
 retrieve and analyze scientific resources from anywhere in the world.
 
 
 +1. 
 
 I think these capture both the information integration goals of the system
 as well as the science data processing.
 
 Cheers,
 Chris
 
 ++
 Chris Mattmann, Ph.D.
 Senior Computer Scientist
 NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
 Office: 171-266B, Mailstop: 171-246
 Email: chris.a.mattm...@nasa.gov
 WWW:   http://sunset.usc.edu/~mattmann/
 ++
 Adjunct Assistant Professor, Computer Science Department
 University of Southern California, Los Angeles, CA 90089 USA
 ++
 


Re: Communication Infrastructure

2012-01-21 Thread B W
So how does the grid back end of web-grid know about the other grid peers?

Is there a root node that's configured to push out the configuration?


On Thu, Jan 19, 2012 at 11:01 AM, BW b.du...@gmail.com wrote:



 BW

 On Jan 19, 2012, at 10:40 AM, Mattmann, Chris A (388J) 
 chris.a.mattm...@jpl.nasa.gov wrote:

  Hi BW,
 
  On Jan 19, 2012, at 10:11 AM, BW wrote:
 
  So, ?
  Web-Grid and CAS
  Intra: synchronous xml-rpc
  Inter: synchronous REST
 
  CAS:
  Intra: asynchronous and synchronous xml-rpc
  Inter: asynchronous and synchronous REST
 
  Web-Grid:
  Intra: synchronous procedure calls
 localy but xml-rpc when to non-local distributed component?
  Inter: synchronous REST
 
  HTH!
 Thx!
 
  Cheers,
  Chris
 
  ++
  Chris Mattmann, Ph.D.
  Senior Computer Scientist
  NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
  Office: 171-266B, Mailstop: 171-246
  Email: chris.a.mattm...@nasa.gov
  WWW:   http://sunset.usc.edu/~mattmann/
  ++
  Adjunct Assistant Professor, Computer Science Department
  University of Southern California, Los Angeles, CA 90089 USA
  ++
 



Re:Plugging-In-Serving

2012-01-21 Thread B W
So, the standard method for serving the data/control
through the grid substrate is to implement the grid server component
using OPeNDAP?


Re: Plugging-In-Serving

2012-01-21 Thread Mattmann, Chris A (388J)
Hi BW,

On Jan 21, 2012, at 7:25 PM, B W wrote:

 So, the standard method for serving the data/control
 through the grid substrate is to implement the grid server component
 using OPeNDAP?

Well OPeNDAP is one of our grid substrates (for science datasets in 
HDF and in NetCDF) -- but we also 
leverage other product services (e.g., XMLPS, and others).

Cheers,
Chris

++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattm...@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++



Re: Review Request: XMLPS should be able to stream large results

2012-01-21 Thread Chris Mattmann

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3543/#review4520
---



trunk/grid/src/main/java/org/apache/oodt/grid/ProductQueryServlet.java
https://reviews.apache.org/r/3543/#comment10119

were you seeing an issue with web grid not flushing the result?



trunk/grid/src/main/java/org/apache/oodt/grid/ProductQueryServlet.java
https://reviews.apache.org/r/3543/#comment10120

Does Tomcat6 (or Tomcat5) set the container length?



trunk/xmlps/pom.xml
https://reviews.apache.org/r/3543/#comment10121

EasyMock ships under ALv2: http://easymock.org/ Nice Ricky. 



trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/DBMSExecutor.java
https://reviews.apache.org/r/3543/#comment10122

anal retentive me -- can we keep the imports organized? *smile*



trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/XMLPSProductHandler.java
https://reviews.apache.org/r/3543/#comment10123

imports organized *smile*


- Chris


On 2012-01-19 02:54:44, Ricky Nguyen wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/3543/
 ---
 
 (Updated 2012-01-19 02:54:44)
 
 
 Review request for oodt.
 
 
 Summary
 ---
 
 See OODT-341: https://issues.apache.org/jira/browse/OODT-341
 
 * CDEResult extends org.apache.oodt.xmlquery.Result
 * CDEResult mimetype is always text/plain
 * CDEResult size is always 0
 * CDEResult inputstream is CDEResultInputStream
 * CDEResultInputStream has IO methods and wraps a CDEResult
 * CDEResult wraps a ResultSet and returns rows as Strings, applying 
 MappingFuncs if a Mapping is provided, and appending constant fields if a 
 List of CDEValues is provided.
 * ProductQueryServlet relies on servlet container to handle Content-Length 
 (and possibly Transfer-Encoding: chunked)
 
 
 This addresses bug OODT-341.
 https://issues.apache.org/jira/browse/OODT-341
 
 
 Diffs
 -
 
   trunk/grid/src/main/java/org/apache/oodt/grid/ProductQueryServlet.java 
 1183564 
   trunk/xmlps/pom.xml 1233127 
   trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/DBMSExecutor.java 
 1233127 
   
 trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/XMLPSProductHandler.java
  1233127 
   trunk/xmlps/src/main/java/org/apache/oodt/xmlps/structs/CDEResult.java 
 1233127 
   
 trunk/xmlps/src/main/java/org/apache/oodt/xmlps/structs/CDEResultInputStream.java
  PRE-CREATION 
   trunk/xmlps/src/test/java/org/apache/oodt/xmlps/structs/TestCDEResult.java 
 PRE-CREATION 
   
 trunk/xmlps/src/test/java/org/apache/oodt/xmlps/structs/TestCDEResultInputStream.java
  PRE-CREATION 
 
 Diff: https://reviews.apache.org/r/3543/diff
 
 
 Testing
 ---
 
 Runs in Tomcat 7. I've used it at CHLA.
 NOT tested in other app servers. Which other app servers should I test?
 NOT tested MappingFuncs. Is it necessary?
 Added 2 unit tests: TestCDEResult and TestCDEResultInputStream, which both 
 pass.
 
 
 Thanks,
 
 Ricky
 




Re: Review Request: XMLPS should be able to stream large results

2012-01-21 Thread Chris Mattmann

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3543/#review4521
---

Ship it!


Ricky great job. Some minor nits, nothing that is a blocker. Review em' and if 
you have time would appreciate addressing them but if not, I'm not going to 
stand in your way. +1.

- Chris


On 2012-01-19 02:54:44, Ricky Nguyen wrote:
 
 ---
 This is an automatically generated e-mail. To reply, visit:
 https://reviews.apache.org/r/3543/
 ---
 
 (Updated 2012-01-19 02:54:44)
 
 
 Review request for oodt.
 
 
 Summary
 ---
 
 See OODT-341: https://issues.apache.org/jira/browse/OODT-341
 
 * CDEResult extends org.apache.oodt.xmlquery.Result
 * CDEResult mimetype is always text/plain
 * CDEResult size is always 0
 * CDEResult inputstream is CDEResultInputStream
 * CDEResultInputStream has IO methods and wraps a CDEResult
 * CDEResult wraps a ResultSet and returns rows as Strings, applying 
 MappingFuncs if a Mapping is provided, and appending constant fields if a 
 List of CDEValues is provided.
 * ProductQueryServlet relies on servlet container to handle Content-Length 
 (and possibly Transfer-Encoding: chunked)
 
 
 This addresses bug OODT-341.
 https://issues.apache.org/jira/browse/OODT-341
 
 
 Diffs
 -
 
   trunk/grid/src/main/java/org/apache/oodt/grid/ProductQueryServlet.java 
 1183564 
   trunk/xmlps/pom.xml 1233127 
   trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/DBMSExecutor.java 
 1233127 
   
 trunk/xmlps/src/main/java/org/apache/oodt/xmlps/product/XMLPSProductHandler.java
  1233127 
   trunk/xmlps/src/main/java/org/apache/oodt/xmlps/structs/CDEResult.java 
 1233127 
   
 trunk/xmlps/src/main/java/org/apache/oodt/xmlps/structs/CDEResultInputStream.java
  PRE-CREATION 
   trunk/xmlps/src/test/java/org/apache/oodt/xmlps/structs/TestCDEResult.java 
 PRE-CREATION 
   
 trunk/xmlps/src/test/java/org/apache/oodt/xmlps/structs/TestCDEResultInputStream.java
  PRE-CREATION 
 
 Diff: https://reviews.apache.org/r/3543/diff
 
 
 Testing
 ---
 
 Runs in Tomcat 7. I've used it at CHLA.
 NOT tested in other app servers. Which other app servers should I test?
 NOT tested MappingFuncs. Is it necessary?
 Added 2 unit tests: TestCDEResult and TestCDEResultInputStream, which both 
 pass.
 
 
 Thanks,
 
 Ricky