Hi All,
So, I'm phasing off of the New Horizons project for now and I am back to my
science data pipeline work. I am in the process of trying to pick up where I
left off a few months ago - but with a twist J I graduated from RADiX and now
I am trying to get my pipeline system set up to run with the 'regular' OODT. I
have made extremely good progress so far. I have pretty much replicated all of
the functionality of filemgr and workflow manager that I had been using with
RADiX, with the exception of one thing that doesn't seem to be working the way
it used too. And I'm hoping someone out there can give me some ideas on how to
fix it.
I have a catalog query in one of my PGE config files. I copied the syntax for
the query statement directly from one of Chris' PGE config files
(PgeConfig_RatAggregator.xml) in the 'drat-master' application.
Here is Chris' statement:
<metadata key="InputFiles"
val="SQL(FORMAT='$FileLocation/$Filename',SORT_BY='CAS.ProductReceivedTime'){SELECT
FileLocation,Filename,CAS.ProductReceivedTime FROM RatLog}"/>
Here is my statement:
<metadata key="InitialDirList"
val="SQL(FORMAT='$FileLocation/$Filename',SORT_BY='CAS.ProductReceivedTime'){SELECT
FileLocation,Filename,CAS.ProductReceivedTime FROM ScienceFile}"/>
And here are the results from the query:
$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,$FileLocation/$Filename,
And those results are not exactly what I wanted J
So I ran some experiments with ./filemgr-client on the command line to make
sure the files I expected to be in the catalog were in fact in the catalog.
The following operation worked just as expected. The expected number of
products were listed.
./filemgr-client --url http://localhost:9016 --operation --getFirstPage
--productTypeName ScienceFile
However, this query gave some unexpected results. And this may be related the
problem with the query in my PGE config file, but I am not sure.
./filemgr-client --url http://localhost:9016 --operation -sqlQuery -query
"SELECT FileLocation,Filename FROM ScienceFile"
That query only outputs several blank lines to the screen and nothing else.
I am not very familiar with all of the catalog related code yet so I am not
sure where to start looking for the problem. If you know this area of the code
well and have some debugging ideas, please let me know.
Thanks so much!
Val
