date:20120722

Re: Trouble when installing "PushPull protocol plugins"

2012-07-22 Thread Mattmann, Chris A (388J)

Hi Yunee,

See: http://pastebin.com/36krXVZZ

I was able to do this from scratch and it worked fine.

Can you please let me know what the specific error
you are getting is?

Cheers,
Chris

On Jul 22, 2012, at 7:42 AM, YunHee Kang wrote:

> Hi Chris,
> 
> Firstly, I checked out the revision 8 of oodt-pushpull-plugins. Then I
> tried to run the command "mvn install" for building  this plugins.
> Unfortunately  I got the same error before I had.
> 
> Thanks,
> 
> Yunee
> 
> 2012/7/22 Mattmann, Chris A (388J) :
>> Hi YunHee,
>> 
>> On Jul 20, 2012, at 3:00 AM, YunHee Kang wrote:
>> 
>>> Hi Chris,
>>> 
>>> To handle a problem occurred when downloading  remote files by using a
>>> script 'pushpull',  I tried to install   "Push Pull protocol plugins"
>>> based on  the following steps:
>>> 1) svn export 
>>> http://svn.codespot.com/a/apache-extras.org/oodt-pushpull-plugins/trunk/
>>> oodt-pushpull-plugins
>>> 2) cd oodt-pushpull-plugins
>>> 3) mvn install
>>> 
>>> But I didn't get  a Jar file called
>>> oodt-pushpull-plugins-core-0.4-SNAPSHOT.jar.
>>> Instead of the jar file, I got the following message.
>>> 
>>> 
>>> yhkang@yunhee-kisti:~/oodt-pushpull-plugins$ mvn install
>>> [INFO] Scanning for projects...
>>> [INFO] Reactor build order:
>>> [INFO]   Apache CAS PushPull Plugins Dependency Fixer
>>> [INFO]   CAS Push-Pull-Framework Plugins Core Libs
>>> [INFO]   Apache OODT CAS PushPull Plugins
>>> [INFO] 
>>> --- -
>>> [INFO] Building Apache CAS PushPull Plugins Dependency Fixer
>>> [INFO]task-segment: [install]
>>> [INFO] 
>>> 
>>> [INFO] [antrun:run {execution: jvftpdownload}]
>>> [INFO] Executing tasks
>>> 
>>> main:
>>> 
>>> all:
>>> [get] Getting:
>>> http://downloads.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fjvftp%2F&ts=1325111584&use_mirror=iweb
>>> [get] To:
>>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-bin-0_73.zip
>>> [get] 
>>> http://downloads.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fjvftp%2F&ts=1325111584&use_mirror=iweb
>>> moved to 
>>> http://iweb.dl.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip
>>>   [unzip] Expanding:
>>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-bin-0_73.zip
>>> into /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-0_73
>>>[move] Moving 1 file to
>>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-0_73/jvftp/lib
>>> [INFO] Executed tasks
>>> [INFO] [site:attach-descriptor {execution: default-attach-descriptor}]
>>> [INFO] [install:install {execution: default-install}]
>>> [INFO] Installing /home/yhkang/oodt-pushpull-plugins/depfixer/pom.xml
>>> to 
>>> /home/yhkang/.m2/repository/org/apacheextras/oodt/oodt-pushpull-plugins-depfixer/0.4-SNAPSHOT/oodt-pushpull-plugins-depfixer-0.4-SNAPSHOT.pom
>>> [INFO] 
>>> 
>>> [INFO] Building CAS Push-Pull-Framework Plugins Core Libs
>>> [INFO]task-segment: [install]
>>> [INFO] 
>>> 
>>> [INFO] [resources:resources {execution: default-resources}]
>>> [WARNING] Using platform encoding (UTF-8 actually) to copy filtered
>>> resources, i.e. build is platform dependent!
>>> [INFO] skip non existing resourceDirectory
>>> /home/yhkang/oodt-pushpull-plugins/core/src/main/resources
>>> Downloading: 
>>> http://repo1.maven.org/maven2/ftp4che/ftp4che/0.7.1/ftp4che-0.7.1.pom
>>> [INFO] Unable to find resource 'ftp4che:ftp4che:pom:0.7.1' in
>>> repository central (http://repo1.maven.org/maven2)
>>> Downloading: 
>>> http://repo1.maven.org/maven2/ftp4che/ftp4che/0.7.1/ftp4che-0.7.1.jar
>>> [INFO] Unable to find resource 'ftp4che:ftp4che:jar:0.7.1' in
>>> repository central (http://repo1.maven.org/maven2)
>>> [INFO] 
>>> 
>>> [ERROR] BUILD ERROR
>>> [INFO] 
>>> 
>>> [INFO] Failed to resolve artifact.
>>> 
>>> Missing:
>>> --
>>> 1) org.apache.oodt:cas-pushpull:jar:0.4-SNAPSHOT
>>> 
>>> Try downloading the file manually from the project website.
>>> 
>>> Then, install it using the command:
>>> mvn install:install-file -DgroupId=org.apache.oodt
>>> -DartifactId=cas-pushpull -Dversion=0.4-SNAPSHOT -Dpackaging=jar
>>> -Dfile=/path/to/file
>>> 
>>> Alternatively, if you host your own repository you can deploy the file 
>>> there:
>>> mvn deploy:deploy-file -DgroupId=org.apache.oodt
>>> -DartifactId=cas-pushpull -Dversion=0.4-SNAPSHOT -Dpackaging=jar
>>> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>>> 
>>> Path to dependen

Re: Trouble when installing "PushPull protocol plugins"

2012-07-22 Thread YunHee Kang

Hi Chris,

Firstly, I checked out the revision 8 of oodt-pushpull-plugins. Then I
tried to run the command "mvn install" for building  this plugins.
Unfortunately  I got the same error before I had.

Thanks,

Yunee

2012/7/22 Mattmann, Chris A (388J) :
> Hi YunHee,
>
> On Jul 20, 2012, at 3:00 AM, YunHee Kang wrote:
>
>> Hi Chris,
>>
>> To handle a problem occurred when downloading  remote files by using a
>> script 'pushpull',  I tried to install   "Push Pull protocol plugins"
>> based on  the following steps:
>> 1) svn export 
>> http://svn.codespot.com/a/apache-extras.org/oodt-pushpull-plugins/trunk/
>> oodt-pushpull-plugins
>> 2) cd oodt-pushpull-plugins
>> 3) mvn install
>>
>> But I didn't get  a Jar file called
>> oodt-pushpull-plugins-core-0.4-SNAPSHOT.jar.
>> Instead of the jar file, I got the following message.
>>
>>
>> yhkang@yunhee-kisti:~/oodt-pushpull-plugins$ mvn install
>> [INFO] Scanning for projects...
>> [INFO] Reactor build order:
>> [INFO]   Apache CAS PushPull Plugins Dependency Fixer
>> [INFO]   CAS Push-Pull-Framework Plugins Core Libs
>> [INFO]   Apache OODT CAS PushPull Plugins
>> [INFO] 
>> --- -
>> [INFO] Building Apache CAS PushPull Plugins Dependency Fixer
>> [INFO]task-segment: [install]
>> [INFO] 
>> 
>> [INFO] [antrun:run {execution: jvftpdownload}]
>> [INFO] Executing tasks
>>
>> main:
>>
>> all:
>>  [get] Getting:
>> http://downloads.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fjvftp%2F&ts=1325111584&use_mirror=iweb
>>  [get] To:
>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-bin-0_73.zip
>>  [get] 
>> http://downloads.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip?r=http%3A%2F%2Fsourceforge.net%2Fprojects%2Fjvftp%2F&ts=1325111584&use_mirror=iweb
>> moved to 
>> http://iweb.dl.sourceforge.net/project/jvftp/jvftp/0.73%20for%20java%201.5%2B/jvftp-bin-0_73.zip
>>[unzip] Expanding:
>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-bin-0_73.zip
>> into /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-0_73
>> [move] Moving 1 file to
>> /home/yhkang/oodt-pushpull-plugins/depfixer/target/jvftp/jvftp-0_73/jvftp/lib
>> [INFO] Executed tasks
>> [INFO] [site:attach-descriptor {execution: default-attach-descriptor}]
>> [INFO] [install:install {execution: default-install}]
>> [INFO] Installing /home/yhkang/oodt-pushpull-plugins/depfixer/pom.xml
>> to 
>> /home/yhkang/.m2/repository/org/apacheextras/oodt/oodt-pushpull-plugins-depfixer/0.4-SNAPSHOT/oodt-pushpull-plugins-depfixer-0.4-SNAPSHOT.pom
>> [INFO] 
>> 
>> [INFO] Building CAS Push-Pull-Framework Plugins Core Libs
>> [INFO]task-segment: [install]
>> [INFO] 
>> 
>> [INFO] [resources:resources {execution: default-resources}]
>> [WARNING] Using platform encoding (UTF-8 actually) to copy filtered
>> resources, i.e. build is platform dependent!
>> [INFO] skip non existing resourceDirectory
>> /home/yhkang/oodt-pushpull-plugins/core/src/main/resources
>> Downloading: 
>> http://repo1.maven.org/maven2/ftp4che/ftp4che/0.7.1/ftp4che-0.7.1.pom
>> [INFO] Unable to find resource 'ftp4che:ftp4che:pom:0.7.1' in
>> repository central (http://repo1.maven.org/maven2)
>> Downloading: 
>> http://repo1.maven.org/maven2/ftp4che/ftp4che/0.7.1/ftp4che-0.7.1.jar
>> [INFO] Unable to find resource 'ftp4che:ftp4che:jar:0.7.1' in
>> repository central (http://repo1.maven.org/maven2)
>> [INFO] 
>> 
>> [ERROR] BUILD ERROR
>> [INFO] 
>> 
>> [INFO] Failed to resolve artifact.
>>
>> Missing:
>> --
>> 1) org.apache.oodt:cas-pushpull:jar:0.4-SNAPSHOT
>>
>>  Try downloading the file manually from the project website.
>>
>>  Then, install it using the command:
>>  mvn install:install-file -DgroupId=org.apache.oodt
>> -DartifactId=cas-pushpull -Dversion=0.4-SNAPSHOT -Dpackaging=jar
>> -Dfile=/path/to/file
>>
>>  Alternatively, if you host your own repository you can deploy the file 
>> there:
>>  mvn deploy:deploy-file -DgroupId=org.apache.oodt
>> -DartifactId=cas-pushpull -Dversion=0.4-SNAPSHOT -Dpackaging=jar
>> -Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
>>
>>  Path to dependency:
>>1) org.apacheextras.oodt:oodt-pushpull-plugins-core:jar:0.4-SNAPSHOT
>>2) org.apache.oodt:cas-pushpull:jar:0.4-SNAPSHOT
>>
>> 2) ftp4che:ftp4che:jar:0.7.1
>>
>>  Try downloading the file manually from the project website.
>>
>>  Then, install it using the command:
>>  mvn install:install-file -DgroupId=ftp4che -DartifactId=ftp4che
>> -

Re: Downloading error when running the script "pushpull" in oodt-0.4

2012-07-22 Thread YunHee Kang

Hi Chris,

> I had a thought: it would be really cool to make a quick PushPull
> command line tool that simply wraps ExpressionValidator and examines
> the RemoteSpecs directory to validate all the regexes in that file.
>
> I've filed: https://issues.apache.org/jira/browse/OODT-475
>
> to track my thoughts on the issue.

I agree. That's one of  must-have tools.

Thanks,
Yunhee

2012/7/23 Mattmann, Chris A (388J) :
> Hi Yunee,
>
>
> On Jul 21, 2012, at 9:24 PM, YunHee Kang wrote:
>
>> Hi Chris,
>>
>> I tried to validate the following two regular expressions by a program
>> ExpressionValidator:
>> 1) TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
>> 2) TES-Aura\_L2-CO2-Nadir\_r\d{10}\w{2}\d{2}\w\d{2}\.he5
>>
>> The following input string is inputed :
>> TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
>>
>> But the program ExpressionValidator said "true".
>> So I think that  there is no problem when validating the regular
>> expressions for given input string.
>
> Yep that means your regex look fine, thanks!
>
> I had a thought: it would be really cool to make a quick PushPull
> command line tool that simply wraps ExpressionValidator and examines
> the RemoteSpecs directory to validate all the regexes in that file.
>
> I've filed: https://issues.apache.org/jira/browse/OODT-475
>
> to track my thoughts on the issue.
>
> Cheers,
> Chris
>>
>>
>> 2012/7/22 Mattmann, Chris A (388J) :
>>> Hi YunHee,
>>>
>>> On Jul 19, 2012, at 6:14 PM, YunHee Kang wrote:
>>>
 HI Chris,

 I made correct  a corresponding ProtocolFactory for ftp Protocol  in
 the file  policy/ProtocolFactoryInfo for running a script "pushpull".
 I think  I fixed the problem related with a ftp connection to a remote 
 site.

 But I got the follow a part of  the error message when I ran the script.
 SEVERE: Failed to finish downloading per property files
 /home/yhkang/oodt/cas-pushpull/etc/examples/DirStructXmlParserFiles/TESL2CO2.xml
 : null

 Is there any problem in the file "TESL2CO2.xml" ?

 
   
   
   
   
   >>> name="TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5"/>
   
   
 
>>>
>>> I *think* (but could be wrong) that you need to prefix
>>> the '_' with a '\'.
>>>
>>> There is a program called ExpressionValidator that we ship with
>>> Pushpull:
>>>
>>> java -Djava.ext.dirs=../lib 
>>> org.apache.oodt.cas.pushpull.util.ExpressionValidator
>>>
>>> That you can use to validate your regexes.
>>>
>>> Give that a shot and let us know!
>>>
>>> Cheers,
>>> Chris
>>>
>>> ++
>>> Chris Mattmann, Ph.D.
>>> Senior Computer Scientist
>>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>>> Office: 171-266B, Mailstop: 171-246
>>> Email: chris.a.mattm...@nasa.gov
>>> WWW:   http://sunset.usc.edu/~mattmann/
>>> ++
>>> Adjunct Assistant Professor, Computer Science Department
>>> University of Southern California, Los Angeles, CA 90089 USA
>>> ++
>>>
>
>
> ++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++
>

Re: Problem when running pushpull

2012-07-22 Thread Cameron Goodale

YunHee,

Thank you for testing out the PushPull User Guide.  I have been waiting for
someone to run through it and have success (which it appears you have).  I
just added in a small block about how to Launch the PushPull Daemon, but it
seems that you got it running already.

If there is anything that you think should be added to the User Guide, or
if any part was confusing I would appreciate hearing from you.

Cheers!


Cameron

On Sat, Jul 21, 2012 at 10:15 PM, YunHee Kang  wrote:

> HI chris,
>
> > Ahh gotcha. You've found a config file bug in oodt0.4. Can you please:
> >
> > 1. Create yourself an account at our JIRA issue tracker:
> > https://issues.apache.org/jira/browse/OODT
> >
> > 2. File an issue (create a new issue/bug) against oodt 0.4 (set the
> affects
> > version to 0.4)
> >
> I just created  the isse named "OODT-474"  related with config file
> bug in oodt0.4.
> It is the first time to write an issue report.  Can you check the
> issue that I wrote ?
>
>
> > Ahh, what FTP site are you trying to access? That way I can try and
> > test this myself in my own local checkout.
>
> I tried to test downloading a file  based on WIKI site
> "https://cwiki.apache.org/OODT/oodt-push-pull-user-guide.html";. There
> is no problem to download the file  as follows:
>  $ ftp l4ftl01.larc.nasa.gov
> Connected to l4ftl01.larc.nasa.gov.
> 220-
> 220--=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
> 220-
> 220- This US Government computer is for authorized users only.
> 220- By accessing this system you are consenting to complete
> 220- monitoring with no expectation of privacy. Unauthorized
> 220- access or use may subject you to disciplinary action and
> 220- criminal prosecution.
> 220-
> 220--=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
> 220-
> 220-
> 220-
> 220 FTP server ready.
> Name (l4ftl01.larc.nasa.gov:yhkang): anonymous
> 331 Guest login ok, send your complete e-mail address as password.
> Password:
> 230 Guest login ok, access restrictions apply.
> Remote system type is UNIX.
> Using binary mode to transfer files.
> ftp> cd /TES/TL2CO2N.005
> 250 CWD command successful.
> ftp> cd 2004.09.20
> 250 CWD command successful.
> ftp> get TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
> local: TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5 remote:
> TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
> 200 PORT command successful.
> 150 Opening BINARY mode data connection for
> TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5 (92150280 bytes).
> 226 Transfer complete. Checksum matched.
> 92150280 bytes received in 171.84 secs (523.7 kB/s)
>
>
> Thanks,
>
> Yunhee
>
> 2012/7/21 Mattmann, Chris A (388J) :
> > Hi YunHee,
> >
> > On Jul 19, 2012, at 11:19 AM, YunHee Kang wrote:
> >
> >> I just found a problem that is in a file
> >> "$CAS_PP_HOME/policy/ProtocolFactoryInfo.xml" in  oodt 0.4.
> >>
> >> The problem is caused by missing classes related with an element
> >> "protocolFactory" in the file described above.
> >> To fix this problem,  It needs to replace a wrong class name with  a
> >> correct class name.
> >> For example  there is no class named
> >> org.apache.oodt.cas.protocol.ftp.CogJGlobusFtpClientFactory in any jar
> >> file in the directory,  $CAS_PP_HOME/lib.  To run the script
> >> $CAS_PP_HOME/bin/pushpull,   CogJGlobusFtpClientFactory  needs to be
> >> replaced with CogJGlobusFtpProtocolFactory.
> >
> > Ahh gotcha. You've found a config file bug in oodt0.4. Can you please:
> >
> > 1. Create yourself an account at our JIRA issue tracker:
> > https://issues.apache.org/jira/browse/OODT
> >
> > 2. File an issue (create a new issue/bug) against oodt 0.4 (set the
> affects
> > version to 0.4)
> >
> > If you are willing to, we'd love to have a patch file from you that fixes
> > this config file. The patch process would be something like:
> >
> > 1. svn co http://svn.apache.org/repos/asf/oodt/trunk oodt0.5
> > 2. edit
> odot0.5/pushpull/src/main/resources/policy/ProtocolFactoryInfo.xml and
> > fix XML policy file.
> > 3. svn diff > OODT-xxx.ykang.yyMMdd.patch.txt
> >
> > where xxx is the JIRA issue ID from #2 above.
> > 4. attach your patch to the JIRA issue from #2.
> >
> >>
> >> But I don't know how to replace
> >> org.apache.oodt.cas.protocol.local.LocalClientFactory.
> >
> > I'm not sure you have to -- this is probably OK.
> >
> >> To be honest, I am not familiar with OODT.
> >>
> >>
> >> 
> >>
> >>
> >> >> class="org.apache.oodt.cas.protocol.ftp.CogJGlobusFtpProtocolFactory"/>
> >>
> >> >> class="org.apache.oodt.cas.protocol.ftp.CommonsNetFtpProtocolFactory"/>
> >>
> >>
> >> 
> >>
> >>
> >> >> class="org.apache.oodt.cas.protocol.http.HttpProtocolFactory"/>
> >>
> >>
> >>
> >>
> >>
> >> >> class="org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory"/>
> >>
> >>
> >>
> >>
> >>
> >> >> class="org.apache.oodt.cas.protocol.imaps.ImapsProtocolFactory"/>
> >>

Build failed in Jenkins: oodt-trunk #557

2012-07-22 Thread Apache Jenkins Server

See 

--
Started by timer
Building remotely on ubuntu2 in workspace 

hudson.util.IOException2: remote file operation failed: 
 at 
hudson.remoting.Channel@75e1e1a9:ubuntu2
at hudson.FilePath.act(FilePath.java:838)
at hudson.FilePath.act(FilePath.java:824)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:743)
at hudson.scm.SubversionSCM.checkout(SubversionSCM.java:685)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1256)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:589)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:88)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:494)
at hudson.model.Run.execute(Run.java:1488)
at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:477)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:236)
Caused by: java.io.IOException: Remote call on ubuntu2 failed
at hudson.remoting.Channel.call(Channel.java:672)
at hudson.FilePath.act(FilePath.java:831)
... 11 more
Caused by: java.lang.LinkageError: loader (instance of  
hudson/remoting/RemoteClassLoader): attempted  duplicate class definition for 
name: "hudson/model/AbstractDescribableImpl"
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at java.lang.ClassLoader.defineClass(ClassLoader.java:480)
at 
hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:152)
at 
hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:131)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:634)
at java.lang.ClassLoader.defineClass(ClassLoader.java:480)
at 
hudson.remoting.RemoteClassLoader.loadClassFile(RemoteClassLoader.java:152)
at 
hudson.remoting.RemoteClassLoader.findClass(RemoteClassLoader.java:131)
at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2444)
at java.lang.Class.getDeclaredMethod(Class.java:1952)
at 
java.io.ObjectStreamClass.getPrivateMethod(ObjectStreamClass.java:1396)
at java.io.ObjectStreamClass.access$1700(ObjectStreamClass.java:69)
at java.io.ObjectStreamClass$2.run(ObjectStreamClass.java:455)
at java.security.AccessController.doPrivileged(Native Method)
at java.io.ObjectStreamClass.(ObjectStreamClass.java:430)
at java.io.ObjectStreamClass.lookup(ObjectStreamClass.java:327)
at java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:564)
at 
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1600)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1513)
at 
java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1600)
at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1513)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1749)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at 
java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1963)
at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1887)
at 
java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1770)
at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1346)
at java.io.ObjectInputStream.readObject(ObjectInputStream.java:368)
at hudson.remoting.UserRequest.deserialize(UserRequest.java:182)
at hudson.remoting.UserRequest.perform(UserRequest.java:98)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:326)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
Retrying after 10 seconds
hudson.util.IOException2: remote file operation f

Re: Problem when running pushpull

2012-07-22 Thread YunHee Kang

HI chris,

> Ahh gotcha. You've found a config file bug in oodt0.4. Can you please:
>
> 1. Create yourself an account at our JIRA issue tracker:
> https://issues.apache.org/jira/browse/OODT
>
> 2. File an issue (create a new issue/bug) against oodt 0.4 (set the affects
> version to 0.4)
>
I just created  the isse named "OODT-474"  related with config file
bug in oodt0.4.
It is the first time to write an issue report.  Can you check the
issue that I wrote ?


> Ahh, what FTP site are you trying to access? That way I can try and
> test this myself in my own local checkout.

I tried to test downloading a file  based on WIKI site
"https://cwiki.apache.org/OODT/oodt-push-pull-user-guide.html";. There
is no problem to download the file  as follows:
 $ ftp l4ftl01.larc.nasa.gov
Connected to l4ftl01.larc.nasa.gov.
220-
220--=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
220-
220- This US Government computer is for authorized users only.
220- By accessing this system you are consenting to complete
220- monitoring with no expectation of privacy. Unauthorized
220- access or use may subject you to disciplinary action and
220- criminal prosecution.
220-
220--=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
220-
220-
220-
220 FTP server ready.
Name (l4ftl01.larc.nasa.gov:yhkang): anonymous
331 Guest login ok, send your complete e-mail address as password.
Password:
230 Guest login ok, access restrictions apply.
Remote system type is UNIX.
Using binary mode to transfer files.
ftp> cd /TES/TL2CO2N.005
250 CWD command successful.
ftp> cd 2004.09.20
250 CWD command successful.
ftp> get TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
local: TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5 remote:
TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
200 PORT command successful.
150 Opening BINARY mode data connection for
TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5 (92150280 bytes).
226 Transfer complete. Checksum matched.
92150280 bytes received in 171.84 secs (523.7 kB/s)


Thanks,

Yunhee

2012/7/21 Mattmann, Chris A (388J) :
> Hi YunHee,
>
> On Jul 19, 2012, at 11:19 AM, YunHee Kang wrote:
>
>> I just found a problem that is in a file
>> "$CAS_PP_HOME/policy/ProtocolFactoryInfo.xml" in  oodt 0.4.
>>
>> The problem is caused by missing classes related with an element
>> "protocolFactory" in the file described above.
>> To fix this problem,  It needs to replace a wrong class name with  a
>> correct class name.
>> For example  there is no class named
>> org.apache.oodt.cas.protocol.ftp.CogJGlobusFtpClientFactory in any jar
>> file in the directory,  $CAS_PP_HOME/lib.  To run the script
>> $CAS_PP_HOME/bin/pushpull,   CogJGlobusFtpClientFactory  needs to be
>> replaced with CogJGlobusFtpProtocolFactory.
>
> Ahh gotcha. You've found a config file bug in oodt0.4. Can you please:
>
> 1. Create yourself an account at our JIRA issue tracker:
> https://issues.apache.org/jira/browse/OODT
>
> 2. File an issue (create a new issue/bug) against oodt 0.4 (set the affects
> version to 0.4)
>
> If you are willing to, we'd love to have a patch file from you that fixes
> this config file. The patch process would be something like:
>
> 1. svn co http://svn.apache.org/repos/asf/oodt/trunk oodt0.5
> 2. edit odot0.5/pushpull/src/main/resources/policy/ProtocolFactoryInfo.xml and
> fix XML policy file.
> 3. svn diff > OODT-xxx.ykang.yyMMdd.patch.txt
>
> where xxx is the JIRA issue ID from #2 above.
> 4. attach your patch to the JIRA issue from #2.
>
>>
>> But I don't know how to replace
>> org.apache.oodt.cas.protocol.local.LocalClientFactory.
>
> I'm not sure you have to -- this is probably OK.
>
>> To be honest, I am not familiar with OODT.
>>
>>
>> 
>>
>>
>>> class="org.apache.oodt.cas.protocol.ftp.CogJGlobusFtpProtocolFactory"/>
>>
>>> class="org.apache.oodt.cas.protocol.ftp.CommonsNetFtpProtocolFactory"/>
>>
>>
>> 
>>
>>
>>> class="org.apache.oodt.cas.protocol.http.HttpProtocolFactory"/>
>>
>>
>>
>>
>>
>>> class="org.apache.oodt.cas.protocol.sftp.JschSftpProtocolFactory"/>
>>
>>
>>
>>
>>
>>> class="org.apache.oodt.cas.protocol.imaps.ImapsProtocolFactory"/>
>>
>>
>>
>>
>
> Brian Foster -- any idea here?
>
>> But  up to now I am having a trouble to run the script
>> $CAS_PP_HOME/bin/pushpull  after I changed the file
>> "$CAS_PP_HOME/policy/ProtocolFactoryInfo.xml".
>>
>> The following is the part of the error message when running the script.
>> SEVERE: Failed to finish downloading per property files
>> /home/yhkang/oodt/cas-pushpull/etc/examples/DirStructXmlParserFiles/TESL2CO2.xml
>> : null
>

>
>>
>> I think that the error may occur the file RetrievalSetup.java in the
>> following directory:
>> ./apache-oodt-0.4-src/pushpull/src/main/java/org/apache/oodt/cas/pushpull/retrievalsystem/RetrievalSetup.java
>
> Yep might be -- the problem is that many remote FTP sites have their
> own intricacies and s

Re: Downloading error when running the script "pushpull" in oodt-0.4

2012-07-22 Thread YunHee Kang

Hi Chris,

I tried to validate the following two regular expressions by a program
ExpressionValidator:
1) TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
2) TES-Aura\_L2-CO2-Nadir\_r\d{10}\w{2}\d{2}\w\d{2}\.he5

The following input string is inputed :
TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5

But the program ExpressionValidator said "true".
So I think that  there is no problem when validating the regular
expressions for given input string.

Thanks,

Yunee


2012/7/22 Mattmann, Chris A (388J) :
> Hi YunHee,
>
> On Jul 19, 2012, at 6:14 PM, YunHee Kang wrote:
>
>> HI Chris,
>>
>> I made correct  a corresponding ProtocolFactory for ftp Protocol  in
>> the file  policy/ProtocolFactoryInfo for running a script "pushpull".
>> I think  I fixed the problem related with a ftp connection to a remote site.
>>
>> But I got the follow a part of  the error message when I ran the script.
>> SEVERE: Failed to finish downloading per property files
>> /home/yhkang/oodt/cas-pushpull/etc/examples/DirStructXmlParserFiles/TESL2CO2.xml
>> : null
>>
>> Is there any problem in the file "TESL2CO2.xml" ?
>>
>> 
>>
>>
>>
>>
>>
>>
>>
>> 
>
> I *think* (but could be wrong) that you need to prefix
> the '_' with a '\'.
>
> There is a program called ExpressionValidator that we ship with
> Pushpull:
>
> java -Djava.ext.dirs=../lib 
> org.apache.oodt.cas.pushpull.util.ExpressionValidator
>
> That you can use to validate your regexes.
>
> Give that a shot and let us know!
>
> Cheers,
> Chris
>
> ++
> Chris Mattmann, Ph.D.
> Senior Computer Scientist
> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
> Office: 171-266B, Mailstop: 171-246
> Email: chris.a.mattm...@nasa.gov
> WWW:   http://sunset.usc.edu/~mattmann/
> ++
> Adjunct Assistant Professor, Computer Science Department
> University of Southern California, Los Angeles, CA 90089 USA
> ++
>

Re: Downloading error when running the script "pushpull" in oodt-0.4

2012-07-22 Thread Mattmann, Chris A (388J)

Hi Yunee,


On Jul 21, 2012, at 9:24 PM, YunHee Kang wrote:

> Hi Chris,
> 
> I tried to validate the following two regular expressions by a program
> ExpressionValidator:
> 1) TES-Aura_L2-CO2-Nadir_r\d{10}\w{2}\d{2}\w\d{2}\.he5
> 2) TES-Aura\_L2-CO2-Nadir\_r\d{10}\w{2}\d{2}\w\d{2}\.he5
> 
> The following input string is inputed :
> TES-Aura_L2-CO2-Nadir_r002147_F06_09.he5
> 
> But the program ExpressionValidator said "true".
> So I think that  there is no problem when validating the regular
> expressions for given input string.

Yep that means your regex look fine, thanks!

I had a thought: it would be really cool to make a quick PushPull
command line tool that simply wraps ExpressionValidator and examines
the RemoteSpecs directory to validate all the regexes in that file.

I've filed: https://issues.apache.org/jira/browse/OODT-475 

to track my thoughts on the issue.

Cheers,
Chris
> 
> 
> 2012/7/22 Mattmann, Chris A (388J) :
>> Hi YunHee,
>> 
>> On Jul 19, 2012, at 6:14 PM, YunHee Kang wrote:
>> 
>>> HI Chris,
>>> 
>>> I made correct  a corresponding ProtocolFactory for ftp Protocol  in
>>> the file  policy/ProtocolFactoryInfo for running a script "pushpull".
>>> I think  I fixed the problem related with a ftp connection to a remote site.
>>> 
>>> But I got the follow a part of  the error message when I ran the script.
>>> SEVERE: Failed to finish downloading per property files
>>> /home/yhkang/oodt/cas-pushpull/etc/examples/DirStructXmlParserFiles/TESL2CO2.xml
>>> : null
>>> 
>>> Is there any problem in the file "TESL2CO2.xml" ?
>>> 
>>> 
>>>   
>>>   
>>>   
>>>   
>>>   
>>>   
>>>   
>>> 
>> 
>> I *think* (but could be wrong) that you need to prefix
>> the '_' with a '\'.
>> 
>> There is a program called ExpressionValidator that we ship with
>> Pushpull:
>> 
>> java -Djava.ext.dirs=../lib 
>> org.apache.oodt.cas.pushpull.util.ExpressionValidator
>> 
>> That you can use to validate your regexes.
>> 
>> Give that a shot and let us know!
>> 
>> Cheers,
>> Chris
>> 
>> ++
>> Chris Mattmann, Ph.D.
>> Senior Computer Scientist
>> NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
>> Office: 171-266B, Mailstop: 171-246
>> Email: chris.a.mattm...@nasa.gov
>> WWW:   http://sunset.usc.edu/~mattmann/
>> ++
>> Adjunct Assistant Professor, Computer Science Department
>> University of Southern California, Los Angeles, CA 90089 USA
>> ++
>> 


++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattm...@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++

Re: Trouble when installing "PushPull protocol plugins"

Re: Trouble when installing "PushPull protocol plugins"

Re: Downloading error when running the script "pushpull" in oodt-0.4

Re: Problem when running pushpull

Build failed in Jenkins: oodt-trunk #557

Re: Problem when running pushpull

Re: Downloading error when running the script "pushpull" in oodt-0.4

Re: Downloading error when running the script "pushpull" in oodt-0.4

8 matches

Site Navigation

Mail list logo

Footer information