Re: [brlug-general] transferring large data sets to multiple points
On Thu, Nov 13, 2008 at 11:50 AM, mat branyon <[EMAIL PROTECTED]> wrote: > Also, is there a reason you pointed to the 3.2 release instead of 4.0? Nope. It's the page that google turned up. Can't ever remember the homepage for the globus toolkit. > > On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: >> >> http://www.globus.org/toolkit/docs/3.2/gridftp/ >> >> The "over a VPN" part is likely one of many potential bottlenecks. >> >> On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> >> wrote: >> > Hey guys, >> > >> > It's been a while. Just a quick update, I am in Denver, CO now, getting >> > paid for those skills I learned after so many years of hanging out with >> > you >> > guys and reading the list. I have an interesting problem to solve, and >> > the >> > solutions I see kind of suck. >> > >> > I have a large data set (80gigs or so a week) that I need to transfer >> > fairly >> > quickly to multiple geographically distinct locations (over a vpn). My >> > main >> > restriction is that these points cannot directly access each other (so, >> > sadly, bittorrent is out). >> > >> > I really don't see an option other than multicast ftp/rsync or >> > something. >> > Is there anything else out there? I am willing to entertain commercial >> > solutions. >> > >> > ___ >> > General mailing list >> > General@brlug.net >> > http://mail.brlug.net/mailman/listinfo/general_brlug.net >> > >> > >> >> ___ >> General mailing list >> General@brlug.net >> http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
Also, is there a reason you pointed to the 3.2 release instead of 4.0? On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: > http://www.globus.org/toolkit/docs/3.2/gridftp/ > > The "over a VPN" part is likely one of many potential bottlenecks. > > On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> > wrote: > > Hey guys, > > > > It's been a while. Just a quick update, I am in Denver, CO now, getting > > paid for those skills I learned after so many years of hanging out with > you > > guys and reading the list. I have an interesting problem to solve, and > the > > solutions I see kind of suck. > > > > I have a large data set (80gigs or so a week) that I need to transfer > fairly > > quickly to multiple geographically distinct locations (over a vpn). My > main > > restriction is that these points cannot directly access each other (so, > > sadly, bittorrent is out). > > > > I really don't see an option other than multicast ftp/rsync or something. > > Is there anything else out there? I am willing to entertain commercial > > solutions. > > > > ___ > > General mailing list > > General@brlug.net > > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
We have some pretty nice connections to the end points. The VPN is sadly necessary :( On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: > http://www.globus.org/toolkit/docs/3.2/gridftp/ > > The "over a VPN" part is likely one of many potential bottlenecks. > > On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> > wrote: > > Hey guys, > > > > It's been a while. Just a quick update, I am in Denver, CO now, getting > > paid for those skills I learned after so many years of hanging out with > you > > guys and reading the list. I have an interesting problem to solve, and > the > > solutions I see kind of suck. > > > > I have a large data set (80gigs or so a week) that I need to transfer > fairly > > quickly to multiple geographically distinct locations (over a vpn). My > main > > restriction is that these points cannot directly access each other (so, > > sadly, bittorrent is out). > > > > I really don't see an option other than multicast ftp/rsync or something. > > Is there anything else out there? I am willing to entertain commercial > > solutions. > > > > ___ > > General mailing list > > General@brlug.net > > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
http://www.globus.org/toolkit/docs/3.2/gridftp/ The "over a VPN" part is likely one of many potential bottlenecks. On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> wrote: > Hey guys, > > It's been a while. Just a quick update, I am in Denver, CO now, getting > paid for those skills I learned after so many years of hanging out with you > guys and reading the list. I have an interesting problem to solve, and the > solutions I see kind of suck. > > I have a large data set (80gigs or so a week) that I need to transfer fairly > quickly to multiple geographically distinct locations (over a vpn). My main > restriction is that these points cannot directly access each other (so, > sadly, bittorrent is out). > > I really don't see an option other than multicast ftp/rsync or something. > Is there anything else out there? I am willing to entertain commercial > solutions. > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
[brlug-general] transferring large data sets to multiple points
Hey guys, It's been a while. Just a quick update, I am in Denver, CO now, getting paid for those skills I learned after so many years of hanging out with you guys and reading the list. I have an interesting problem to solve, and the solutions I see kind of suck. I have a large data set (80gigs or so a week) that I need to transfer fairly quickly to multiple geographically distinct locations (over a vpn). My main restriction is that these points cannot directly access each other (so, sadly, bittorrent is out). I really don't see an option other than multicast ftp/rsync or something. Is there anything else out there? I am willing to entertain commercial solutions. ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
