Hi Chris and Sheryl, I understood my mistake after modifying a wrong URL with the "/". But there is the wrong URL that is used as an option of crawler_launcher in the apache oodt homepage(http://oodt.apache.org/components/maven/crawler/user/). --filemgrUrl http://localhost:9000/ \ So it made me confused.
I tried to run the command mentioned below according to the home page of apache oodt. $ ./crawler_launcher --crawlerId MetExtractorProductCrawler ERROR: Invalid option: 'crawlerId' But the error described above was occurred. Is the option 'crawlerid' obsolete ? Thanks, Yunhee 2012/8/7 Mattmann, Chris A (388J) <[email protected]>: > Perfect, Sheryl, my thoughts exactly. > > Cheers, > Chris > > On Aug 6, 2012, at 10:01 AM, Sheryl John wrote: > >> Hi Yunhee, >> >> Check out this OODT wiki for crawler : >> https://cwiki.apache.org/confluence/display/OODT/OODT+Crawler+Help >> >> Did you try giving 'http://localhost:8000' without the "/" in the end? >> Also, specify >> 'org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferFactory' >> for 'clientTransferer' option. >> >> >> On Mon, Aug 6, 2012 at 9:46 AM, YunHee Kang <[email protected]> wrote: >> >>> Hi Chris, >>> >>> I got an error message when I tried to run crawler_launcher by using a >>> shell script. The error message may be caused by a wrong URL of >>> filemgr. >>> $ ./crawler_launcher.sh >>> ERROR: Validation Failures: - Value 'http://localhost:8000/' is not >>> allowed for option >>> [longOption='filemgrUrl',shortOption='fm',description='File Manager >>> URL'] - Allowed values = [http://.*:\d*] >>> >>> The following is the shell script that I wrote: >>> $ cat crawler_launcher.sh >>> #!/bin/sh >>> export STAGE_AREA=/home/yhkang/oodt-0.5/cas-pushpull/staging/TESL2CO2 >>> ./crawler_launcher \ >>> -op --launchStdCrawler \ >>> --productPath $STAGE_AREA\ >>> --filemgrUrl http://localhost:8000/\ >>> --failureDir /tmp \ >>> --actionIds DeleteDataFile MoveDataFileToFailureDir Unique \ >>> --metFileExtension tmp \ >>> --clientTransferer >>> org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferer >>> >>> I am wondering if there is a problem in the URL of the filemgr or elsewhere >>> >>> Thanks, >>> Yunhee >>> >> >> >> >> -- >> -Sheryl > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Chris Mattmann, Ph.D. > Senior Computer Scientist > NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA > Office: 171-266B, Mailstop: 171-246 > Email: [email protected] > WWW: http://sunset.usc.edu/~mattmann/ > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > Adjunct Assistant Professor, Computer Science Department > University of Southern California, Los Angeles, CA 90089 USA > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >
