Thanks to both you and Brian. I'll give it a try!
Ryan Gerard Columbus Technologies and Services, Inc. (978) 235 5972 7500 Greenway Center Drive Suite 1600 Greenbelt, MD 20770 | www.columbususa.com -----Original Message----- From: Mattmann, Chris A (388J) [mailto:chris.a.mattm...@jpl.nasa.gov] Sent: Wednesday, March 28, 2012 10:39 AM To: dev@oodt.apache.org Subject: Re: pushpull from 0.3 Hey Ryan, I think the specific error below is due to the fact that the RemoteSpecs file references an ExternalSources file (think of it like a specification of the properties of the RemoteSites) via CAS environment variable replacement, and you are likely missing that environment variable information. Cameron Goodale started a page on the OODT wiki about getting CAS Push Pull up and running, and Brian sent along the link to his guide. Please check those out and if you need more help let us know and we will be there for ya. Here's Cameron's page: https://cwiki.apache.org/confluence/display/OODT/OODT+Push-Pull+User+Guide Thanks! Cheers, Chris On Mar 27, 2012, at 12:45 PM, Gerard, Ryan S. (GSFC-586.0)[COLUMBUS TECHNOLOGIES AND SERVICES INC] wrote: > I'm having a bit of trouble getting the 0.3 pushpull component to work out of > the box. It seems to have an issue reading the example sources files. Have I > missed something in my configuration? > > Many thanks, > Ryan > > [root@localhost bin]# ./pushpull > Mar 13, 2012 2:23:15 PM > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure > INFO: Configuring DaemonLauncher. . . > Mar 13, 2012 2:23:16 PM org.apache.oodt.cas.pushpull.config.Config > loadProtocolTypes > INFO: Associating protocol types with ProtocolFactories . . . > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'ftp' with class 'class > org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory' > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'ftp' with class 'class > org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClientFactory' > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'http' with class 'class > org.apache.oodt.cas.pushpull.protocol.http.HttpClientFactory' > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'sftp' with class 'class > org.apache.oodt.cas.pushpull.protocol.sftp.JschSftpClientFactory' > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'imaps' with class 'class > org.apache.oodt.cas.pushpull.protocol.imaps.ImapsClientFactory' > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType > INFO: Assiging protocol 'file' with class 'class > org.apache.oodt.cas.pushpull.protocol.local.LocalClientFactory' > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config > loadParserInfo > INFO: Associating parsers with RetrievalMethods . . . > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo > loadParserInfo > INFO: Assiging parser > 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser' > with retrievalmethod > 'org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler' > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo > loadParserInfo > INFO: Assiging parser > 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.FileListParser' with > retrievalmethod 'org.apache.oodt.cas.pushpull.retrievalmethod.ListRetriever' > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo > loadParserInfo > INFO: Assiging parser > 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.ClassNoaaEmailParser' > with retrievalmethod > 'org.apache.oodt.cas.pushpull.retrievalmethod.ListRetriever' > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config > loadIngester > INFO: Configuring and building ingester: > [org.apache.oodt.cas.filemgr.ingest.StdIngester]: data transfer: > [org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory]: > to ingest to file manager: [http://localhost:9000] Mar 13, 2012 > 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config loadIngester > INFO: Configuring Ingester cache: [] > TRANSFER: > org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory > Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config > loadProductTypeDetection > INFO: Loading product type detection file: > /usr/local/cas-pushpull-0.3/policy/mimetypes.xml > Mar 13, 2012 2:23:17 PM > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure > INFO: Loading SiteInfo file > '/usr/local/cas-pushpull-0.3/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml' > org.apache.oodt.cas.pushpull.exceptions.ConfigException: [RemoteSpecs] Failed > to load external source info : null > at > org.apache.oodt.cas.pushpull.config.RemoteSpecs.parseAndStoreLoginInfo(RemoteSpecs.java:334) > at > org.apache.oodt.cas.pushpull.config.RemoteSpecs.loadRemoteSpecs(RemoteSpecs.java:73) > at > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.configure(DaemonLauncher.java:106) > at > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.<init>(DaemonLauncher.java:78) > at > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.main(DaemonLauncher > .java:180) Mar 13, 2012 2:23:18 PM > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure > SEVERE: Failed to configure DaemonLauncher : [RemoteSpecs] Failed to > load crawl elements : [RemoteSpecs] Failed to load external source > info : null Mar 13, 2012 2:23:18 PM > org.apache.oodt.cas.pushpull.daemon.DaemonLauncher launchDaemons > INFO: Launching Daemons . . . > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
