Re: question on push pull

2012-03-01 Thread Mattmann, Chris A (388J)
Hi Luca and Cam, Yep, no problem. And Luca, yep, the plan is to use this on SKA... Cheers, Chris On Mar 1, 2012, at 5:00 AM, Cinquini, Luca (3880) wrote: > Thanks Chris and Cameron, I'll give it a try - off course, that is we decide > to use push-pull for the SKA project, Chris. > I appreciate

Re: question on push pull

2012-03-01 Thread Cinquini, Luca (3880)
Thanks Chris and Cameron, I'll give it a try - off course, that is we decide to use push-pull for the SKA project, Chris. I appreciate both of you guys' help, Luca On Feb 29, 2012, at 9:03 AM, Mattmann, Chris A (388J) wrote: > Hey Guys, > > Just wanted to loop in on this. Yes, push pull does su

Re: question on push pull

2012-02-29 Thread Brian Foster
hey Luca, Ya pushpull can download full directories... do you have a distruct XML file for downloading individual files?... paste it into a message on this thread and let me know which directory you would like to download and i can do the mods or help you through making the mods to the file...

Re: question on push pull

2012-02-29 Thread Cameron Goodale
Luca, Good catch. I was typing faster than my brain was working. I meant to say Push Pull instead of Crawler. Sorry for the confusion. Chris laid it all out really well. Guess I was just a little to excited to answer you and goofed in my haste. To answer your question, I am not sure where th

Re: question on push pull

2012-02-29 Thread Cinquini, Luca (3880)
Hi Cameron, Maybe I am confused, but I was actually asking about the push-pull capabilities - does the crawler plug into the push-pull framework ? (sorry about my ignorance here). If push-pull supports scp, would you know the name of the protocol transfer factory to use - I haven't found

Re: question on push pull

2012-02-29 Thread Mattmann, Chris A (388J)
Hey Guys, Just wanted to loop in on this. Yes, push pull does support download of full directory trees. Probably the best guide to check out is Brian's documentation on the DirFileStructXML here: http://s.apache.org/yz I also wrote a static user guide here: http://s.apache.org/10Z One thing to

Re: question on push pull

2012-02-28 Thread Cameron Goodale
Luca, I haven't tried this exact use case within Crawler, but Crawler does support scp and I have used 'scp -r' to recursively download a folder and all content housed within. I can only imagine ftp has a similar recursive option as well. Maybe another more Crawler Savy dev can shine some light

question on push pull

2012-02-28 Thread Cinquini, Luca (3880)
Hi all, I have a quick question concerning the pushpull framework : is there any way to transfer full directory trees, as opposed to single files ? And which of the currently implemented transfer protocols would allow that ? I haven't see any examples on that, though I might have missed