Yep woot! Committed! ------------------------ Chris Mattmann chris.mattm...@gmail.com
-----Original Message----- From: Lewis John Mcgibbney <lewis.mcgibb...@gmail.com> Reply-To: <dev@oodt.apache.org> Date: Thursday, October 9, 2014 at 12:01 AM To: MengYing Wang <mengyingwa...@gmail.com> Cc: Chris Mattmann <chris.a.mattm...@jpl.nasa.gov>, Paul M Ramirez <paul.m.rami...@jpl.nasa.gov>, "dev@oodt.apache.org" <dev@oodt.apache.org> Subject: Re: HttpClient NoClassDefFoundError For the url-downloader Script of the Apache OODT Crawler >Dynamite Angela. >Thanks for your persistence. > >On Sat, Oct 4, 2014 at 8:22 PM, MengYing Wang <mengyingwa...@gmail.com> >wrote: > >> Dear Lewis, >> >> Done. This is the jira url: >>https://issues.apache.org/jira/browse/OODT-756 >> >> Best, >> Mengying Wang >> >> On Tue, Sep 30, 2014 at 6:59 PM, Lewis John Mcgibbney < >> lewis.mcgibb...@gmail.com> wrote: >> >>> Ok it sounds like we need to file an issue for this. >>> Can you possibly of an issue in Jira? >>> If someone else can reproduce then it is a bug which we need to fix. >>> Thank you >>> Lewis >>> >>> >>> On Tuesday, September 30, 2014, MengYing Wang <mengyingwa...@gmail.com> >>> wrote: >>> >>>> Dear Lewis, >>>> >>>> By the way, no need to change any code in the script url-downloader. >>>> >>>> Thank you. >>>> >>>> Best, >>>> Angela Wang >>>> >>>> On Tue, Sep 30, 2014 at 1:29 PM, MengYing Wang >>>><mengyingwa...@gmail.com> >>>> wrote: >>>> >>>>> Dear Lewis, >>>>> >>>>> The problem has been solved! *~* >>>>> >>>>> I just noticed that the class >>>>> org.apache.oodt.cas.pushpull.protocol.http.HttpClient does exist in >>>>> cas-pushpull-0.2.jar, but disappeared in cas-pushpull-0.6 (Why?). So >>>>>I just >>>>> downloaded the cas-pushpull-0.2.jar file from >>>>> http://www.java2s.com/Code/Jar/c/Downloadcaspushpull02jar.htm, and >>>>> threw it into my pushpull lib directory. Then I can start the >>>>> url-downloader script normally. Thank you! >>>>> >>>>> Best, >>>>> Angela Wang >>>>> >>>>> On Tue, Sep 30, 2014 at 8:28 AM, Lewis John Mcgibbney < >>>>> lewis.mcgibb...@gmail.com> wrote: >>>>> >>>>>> Hi Angela, >>>>>> If this is a change against the code base and you think that is an >>>>>> improvement can you possibly log an issue in our issue tracking >>>>>>system? >>>>>> >>>>>> >>>>>> >>>>>>https://issues.apache.org/jira/browse/OODT/?selectedTab=com.atlassian >>>>>>.jira.jira-projects-plugin:summary-panel >>>>>> >>>>>> The usual process is to create a Jira account, log in, create an >>>>>>issue. >>>>>> We would encourage you to be as verbose as possible when logging >>>>>> issues. It really helps to describe what was wrong, how it can be >>>>>> reproduced and what your suggested fix is. >>>>>> >>>>>> If you are able to attach a patch for fixing the issue then this is >>>>>> the cherry on the cake. >>>>>> Thanks >>>>>> Lewis >>>>>> >>>>>> On Monday, September 29, 2014, MengYing Wang >>>>>><mengyingwa...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Dear Lewis, >>>>>>> >>>>>>> Thank you for your help. I have modified the url-downloader script >>>>>>> to add all jar files into the classpath. Following is the new >>>>>>>content. >>>>>>> >>>>>>> >>>>>>> >>>>>>>-------------------------------------------------------------------- >>>>>>>---------------------------------- >>>>>>> >>>>>>> set LIB_DEPS >>>>>>> >>>>>>> foreach file (`find ../lib/*.jar`) >>>>>>> >>>>>>> set LIB_DEPS = "${file}:${LIB_DEPS}" >>>>>>> >>>>>>> end >>>>>>> >>>>>>> >>>>>>> set >>>>>>> >>>>>>>JAVA_HOME="/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Conten >>>>>>>ts/Home" >>>>>>> >>>>>>> >>>>>>> ${JAVA_HOME}/bin/java -cp ${LIB_DEPS} -Djava.ext.dirs=../lib \ >>>>>>> >>>>>>> -Djava.util.logging.config.file=../etc/logging.properties \ >>>>>>> >>>>>>> org.apache.oodt.cas.pushpull.protocol.http.HttpClient \ >>>>>>> >>>>>>> --url $1 \ >>>>>>> >>>>>>> --downloadToDir $2 >>>>>>> >>>>>>> >>>>>>> >>>>>>>-------------------------------------------------------------------- >>>>>>>---------------------------------- >>>>>>> >>>>>>> >>>>>>> Thank you! >>>>>>> >>>>>>> >>>>>>> Best, >>>>>>> >>>>>>> Angela Wang >>>>>>> >>>>>>> >>>>>>> >>>>>>> On Mon, Sep 29, 2014 at 12:52 AM, Lewis John Mcgibbney < >>>>>>> lewis.mcgibb...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi Angela, >>>>>>>> The problem is pretty straight forward to address. >>>>>>>> The offending classes are not present on your classpath at >>>>>>>>runtime... >>>>>>>> Can you maybe explain how you added all of the jar's in lib to >>>>>>>>your >>>>>>>> classpath? >>>>>>>> Thanks, we will get there eventually. >>>>>>>> Thank you >>>>>>>> Lewis >>>>>>>> >>>>>>>> On Sun, Sep 28, 2014 at 11:10 PM, AngelaWang < >>>>>>>> mengyingwa...@gmail.com> wrote: >>>>>>>> >>>>>>>>> Dear Prof. Mattmann, >>>>>>>>> >>>>>>>>> Sorry for the late response, since I just join the mailing list. >>>>>>>>> Following are the jar files that are in my $PUSHPULL_HOME/lib >>>>>>>>>directory: >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>>------------------------------------------------------------------ >>>>>>>>>------------------------------------------------------------------ >>>>>>>>>-- >>>>>>>>> antlr-2.7.6.jar ehcache-1.2.3.jar solr-commons-csv-1.3.0.jar >>>>>>>>> aopalliance-1.0.jar fontbox-1.3.1.jar solr-core-1.3.0.jar >>>>>>>>> asm-3.1.jar geronimo-activation_1.1_spec-1.1.jar >>>>>>>>> solr-lucene-analyzers-1.3.0.jar >>>>>>>>> asm-attrs-1.5.3.jar geronimo-javamail_1.4_mail-1.8.1.jar >>>>>>>>> solr-lucene-highlighter-1.3.0.jar >>>>>>>>> bcmail-jdk15-1.45.jar geronimo-stax-api_1.0_spec-1.0.1.jar >>>>>>>>> solr-lucene-queries-1.3.0.jar >>>>>>>>> bcprov-jdk15-1.45.jar guava-10.0.1.jar >>>>>>>>> solr-lucene-snowball-1.3.0.jar >>>>>>>>> boilerpipe-1.1.0.jar hibernate-3.2.5.ga.jar >>>>>>>>> solr-lucene-spellchecker-1.3.0.jar >>>>>>>>> cas-cli-0.6.jar hsqldb-1.8.0.7.jar solr-solrj-1.3.0.jar >>>>>>>>> cas-filemgr-0.6.jar jdom-1.0.jar spring-aop-3.0.5.RELEASE.jar >>>>>>>>> cas-metadata-0.6.jar jempbox-1.3.1.jar >>>>>>>>>spring-asm-3.0.5.RELEASE.jar >>>>>>>>> cas-protocol-api-0.6.jar jsch-0.1.42.jar >>>>>>>>> spring-beans-3.0.5.RELEASE.jar >>>>>>>>> cas-protocol-ftp-0.6.jar jsr305-1.3.9.jar >>>>>>>>> spring-context-3.0.5.RELEASE.jar >>>>>>>>> cas-protocol-http-0.6.jar jug-2.0.0-asl.jar >>>>>>>>> spring-core-3.0.5.RELEASE.jar >>>>>>>>> cas-protocol-imaps-0.6.jar junit-3.8.2.jar spring-dao-2.0.8.jar >>>>>>>>> cas-protocol-sftp-0.6.jar jython-2.2-beta1.jar >>>>>>>>> spring-expression-3.0.5.RELEASE.jar >>>>>>>>> cas-pushpull-0.6.jar lucene-core-2.0.0.jar >>>>>>>>> spring-hibernate3-2.0.8.jar >>>>>>>>> cglib-2.1_3.jar metadata-extractor-2.4.0-beta-1.jar >>>>>>>>> spring-jdbc-2.0.8.jar >>>>>>>>> cog-jglobus-1.8.0.jar mina-core-2.0.4.jar stax-1.2.0.jar >>>>>>>>> commons-cli-1.2.jar nekohtml-1.9.6.2.jar stax-api-1.0.1.jar >>>>>>>>> commons-codec-1.3.jar netcdf-4.2.jar stax-utils-20040917.jar >>>>>>>>> commons-collections-2.1.jar oodt-commons-0.6.jar tagsoup-1.2.jar >>>>>>>>> commons-compress-1.1.jar oro-2.0.8.jar tika-core-0.8.jar >>>>>>>>> commons-dbcp-1.2.1.jar pcs-input-0.6.jar tika-parsers-0.8.jar >>>>>>>>> commons-fileupload-1.2.jar pdfbox-1.3.1.jar xercesImpl-2.9.1.jar >>>>>>>>> commons-httpclient-3.0.jar poi-3.7.jar xml-apis-1.0.b2.jar >>>>>>>>> commons-io-1.4.jar poi-ooxml-3.7.jar xmlbeans-2.3.0.jar >>>>>>>>> commons-lang-2.3.jar poi-ooxml-schemas-3.7.jar xmlrpc-2.0.1.jar >>>>>>>>> commons-logging-1.0.3.jar poi-scratchpad-3.7.jar >>>>>>>>> xpp3_min-1.1.4c.jar >>>>>>>>> commons-net-1.4.0.jar rome-0.9.jar xstream-1.3.1.jar >>>>>>>>> commons-pool-1.2.jar slf4j-api-1.6.1.jar >>>>>>>>> dom4j-1.6.1.jar solr-common-1.3.0.jar >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>>------------------------------------------------------------------ >>>>>>>>>------------------------------------------------------------------ >>>>>>>>>-- >>>>>>>>> >>>>>>>>> @Lewis, the version of oodt is 0.6. I have added the the >>>>>>>>> commons-httpclient library to the Pom.xml file (which is in the >>>>>>>>>pushpull >>>>>>>>> directory) and rebuild the pushpull module using maven. Still I >>>>>>>>>get the >>>>>>>>> same error. >>>>>>>>> >>>>>>>>> @Paul, I also tried to add all the jar files in the lib directory >>>>>>>>> to the classpath, Still the same error. Also I am running >>>>>>>>> the url-downloader script from the cas-pushpull/bin directory. >>>>>>>>> >>>>>>>>> Thank you for your help! >>>>>>>>> >>>>>>>>> Best, >>>>>>>>> Angela Wang >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> *Lewis* >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Best, >>>>>>> Mengying (Angela) Wang >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *Lewis* >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Best, >>>>> Mengying (Angela) Wang >>>>> >>>> >>>> >>>> >>>> -- >>>> Best, >>>> Mengying (Angela) Wang >>>> >>> >>> >>> -- >>> *Lewis* >>> >>> >> >> >> -- >> Best, >> Mengying (Angela) Wang >> > > > >-- >*Lewis*
