hey ryan,
The example pushpull RemoteSpecs.xml file requires setting some environment variables:
CAS_PP_RESOURCES = should be set to absolute path to your pushpull etc directory
CAS_PP_TEMP_PROPS = temporary directory for examples which download pushpull config files
You might be able to get a few of the examples to work... however they are more just examples than "working examples"... i would more recommend starting by reading the user guide I wrote a while back: https://svn.apache.org/repos/asf/oodt/trunk/pushpull/src/main/resources/documentation/Push-Pull-User-Manual_2008-02-12.doc
Do you have a particular site you are looking to download files from?... give the user guide a once over and if you still have any questions about getting the pushpull up and running just hit this list up again and i'll be happy to help you through the process of getting it setup-brianOn Mar 27, 2012, at 12:45 PM, "Gerard, Ryan S. (GSFC-586.0)[COLUMBUS TECHNOLOGIES AND SERVICES INC]" <ryan.s.ger...@nasa.gov> wrote:
I'm having a bit of trouble getting the 0.3 pushpull component to work out of the box. It seems to have an issue reading the example sources files. Have I missed something in my configuration?
Many thanks,
Ryan
[root@localhost bin]# ./pushpull
Mar 13, 2012 2:23:15 PM org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure
INFO: Configuring DaemonLauncher. . .
Mar 13, 2012 2:23:16 PM org.apache.oodt.cas.pushpull.config.Config loadProtocolTypes
INFO: Associating protocol types with ProtocolFactories . . .
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'ftp' with class 'class org.apache.oodt.cas.pushpull.protocol.ftp.CogJGlobusFtpClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'ftp' with class 'class org.apache.oodt.cas.pushpull.protocol.ftp.CommonsNetFtpClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'http' with class 'class org.apache.oodt.cas.pushpull.protocol.http.HttpClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'sftp' with class 'class org.apache.oodt.cas.pushpull.protocol.sftp.JschSftpClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'imaps' with class 'class org.apache.oodt.cas.pushpull.protocol.imaps.ImapsClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ProtocolInfo addClassForType
INFO: Assiging protocol 'file' with class 'class org.apache.oodt.cas.pushpull.protocol.local.LocalClientFactory'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config loadParserInfo
INFO: Associating parsers with RetrievalMethods . . .
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo loadParserInfo
INFO: Assiging parser 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.DirStructXmlParser' with retrievalmethod 'org.apache.oodt.cas.pushpull.retrievalmethod.RemoteCrawler'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo loadParserInfo
INFO: Assiging parser 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.FileListParser' with retrievalmethod 'org.apache.oodt.cas.pushpull.retrievalmethod.ListRetriever'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.ParserInfo loadParserInfo
INFO: Assiging parser 'org.apache.oodt.cas.pushpull.filerestrictions.parsers.ClassNoaaEmailParser' with retrievalmethod 'org.apache.oodt.cas.pushpull.retrievalmethod.ListRetriever'
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config loadIngester
INFO: Configuring and building ingester: [org.apache.oodt.cas.filemgr.ingest.StdIngester]: data transfer: [org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory]: to ingest to file manager: [http://localhost:9000]
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config loadIngester
INFO: Configuring Ingester cache: []
TRANSFER: org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.config.Config loadProductTypeDetection
INFO: Loading product type detection file: /usr/local/cas-pushpull-0.3/policy/mimetypes.xml
Mar 13, 2012 2:23:17 PM org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure
INFO: Loading SiteInfo file '/usr/local/cas-pushpull-0.3/etc/examples/RemoteSpecsFiles/RemoteSpecs.xml'
org.apache.oodt.cas.pushpull.exceptions.ConfigException: [RemoteSpecs] Failed to load external source info : null
at org.apache.oodt.cas.pushpull.config.RemoteSpecs.parseAndStoreLoginInfo(RemoteSpecs.java:334)
at org.apache.oodt.cas.pushpull.config.RemoteSpecs.loadRemoteSpecs(RemoteSpecs.java:73)
at org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.configure(DaemonLauncher.java:106)
at org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.<init>(DaemonLauncher.java:78)
at org.apache.oodt.cas.pushpull.daemon.DaemonLauncher.main(DaemonLauncher.java:180)
Mar 13, 2012 2:23:18 PM org.apache.oodt.cas.pushpull.daemon.DaemonLauncher configure
SEVERE: Failed to configure DaemonLauncher : [RemoteSpecs] Failed to load crawl elements : [RemoteSpecs] Failed to load external source info : null
Mar 13, 2012 2:23:18 PM org.apache.oodt.cas.pushpull.daemon.DaemonLauncher launchDaemons
INFO: Launching Daemons . . .
