Re: [brlug-general] transferring large data sets to multiple points
http://www.globus.org/toolkit/docs/3.2/gridftp/ The "over a VPN" part is likely one of many potential bottlenecks. On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> wrote: > Hey guys, > > It's been a while. Just a quick update, I am in Denver, CO now, getting > paid for those skills I learned after so many years of hanging out with you > guys and reading the list. I have an interesting problem to solve, and the > solutions I see kind of suck. > > I have a large data set (80gigs or so a week) that I need to transfer fairly > quickly to multiple geographically distinct locations (over a vpn). My main > restriction is that these points cannot directly access each other (so, > sadly, bittorrent is out). > > I really don't see an option other than multicast ftp/rsync or something. > Is there anything else out there? I am willing to entertain commercial > solutions. > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
We have some pretty nice connections to the end points. The VPN is sadly necessary :( On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: > http://www.globus.org/toolkit/docs/3.2/gridftp/ > > The "over a VPN" part is likely one of many potential bottlenecks. > > On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> > wrote: > > Hey guys, > > > > It's been a while. Just a quick update, I am in Denver, CO now, getting > > paid for those skills I learned after so many years of hanging out with > you > > guys and reading the list. I have an interesting problem to solve, and > the > > solutions I see kind of suck. > > > > I have a large data set (80gigs or so a week) that I need to transfer > fairly > > quickly to multiple geographically distinct locations (over a vpn). My > main > > restriction is that these points cannot directly access each other (so, > > sadly, bittorrent is out). > > > > I really don't see an option other than multicast ftp/rsync or something. > > Is there anything else out there? I am willing to entertain commercial > > solutions. > > > > ___ > > General mailing list > > General@brlug.net > > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
Also, is there a reason you pointed to the 3.2 release instead of 4.0? On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: > http://www.globus.org/toolkit/docs/3.2/gridftp/ > > The "over a VPN" part is likely one of many potential bottlenecks. > > On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> > wrote: > > Hey guys, > > > > It's been a while. Just a quick update, I am in Denver, CO now, getting > > paid for those skills I learned after so many years of hanging out with > you > > guys and reading the list. I have an interesting problem to solve, and > the > > solutions I see kind of suck. > > > > I have a large data set (80gigs or so a week) that I need to transfer > fairly > > quickly to multiple geographically distinct locations (over a vpn). My > main > > restriction is that these points cannot directly access each other (so, > > sadly, bittorrent is out). > > > > I really don't see an option other than multicast ftp/rsync or something. > > Is there anything else out there? I am willing to entertain commercial > > solutions. > > > > ___ > > General mailing list > > General@brlug.net > > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
[brlug-general] Replacing my firewall
Continuing my quest for a lower power consumption router/wifi interface after Gustav, I finally ordered some off the shelf parts together with a pfSense image loaded on the 512Mb CF card - http://www.netgate.com/product_info.php?cPath=60_88&products_id=652 - I used pfSense because the old (power hungry) PC firewall used pfSense. 1 x m1n1wall wireless ready 3E 2D3 with USB w/ 512Mb CF card. 1 x 802.11a/b/g WLM54SAG mPCI card, 2 dual band antenna (KIT-ALIX-WLM54SAG-DUAL) Assembly took about 10-15 minutes - it booted straight up, and after messing about for a while I got a set of rules up and running that filter all the traffic to and from the modem (I'm on BellSouth DSL). I screwed up the rules once and restored the system defaults via the serial port so it's definitely luser friendly. Overall I'm very happy with the box - its power consumption is much lower than the old PC (~20W instead of ~300W I think) which was mainly what I wanted. The WiFi performance is much better than the old Netgear WGR box too - so both the PC firewall and the WiFi box have been retired. Edmund Cramp -- I picked up a Magic 8-Ball the other day and it said 'Outlook not so good.' I said 'Sure, but Microsoft still ships it.' -- Anonymous ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
Re: [brlug-general] transferring large data sets to multiple points
On Thu, Nov 13, 2008 at 11:50 AM, mat branyon <[EMAIL PROTECTED]> wrote: > Also, is there a reason you pointed to the 3.2 release instead of 4.0? Nope. It's the page that google turned up. Can't ever remember the homepage for the globus toolkit. > > On Thu, Nov 13, 2008 at 8:29 AM, Shannon Roddy <[EMAIL PROTECTED]> wrote: >> >> http://www.globus.org/toolkit/docs/3.2/gridftp/ >> >> The "over a VPN" part is likely one of many potential bottlenecks. >> >> On Wed, Nov 12, 2008 at 6:04 PM, mat branyon <[EMAIL PROTECTED]> >> wrote: >> > Hey guys, >> > >> > It's been a while. Just a quick update, I am in Denver, CO now, getting >> > paid for those skills I learned after so many years of hanging out with >> > you >> > guys and reading the list. I have an interesting problem to solve, and >> > the >> > solutions I see kind of suck. >> > >> > I have a large data set (80gigs or so a week) that I need to transfer >> > fairly >> > quickly to multiple geographically distinct locations (over a vpn). My >> > main >> > restriction is that these points cannot directly access each other (so, >> > sadly, bittorrent is out). >> > >> > I really don't see an option other than multicast ftp/rsync or >> > something. >> > Is there anything else out there? I am willing to entertain commercial >> > solutions. >> > >> > ___ >> > General mailing list >> > General@brlug.net >> > http://mail.brlug.net/mailman/listinfo/general_brlug.net >> > >> > >> >> ___ >> General mailing list >> General@brlug.net >> http://mail.brlug.net/mailman/listinfo/general_brlug.net > > > ___ > General mailing list > General@brlug.net > http://mail.brlug.net/mailman/listinfo/general_brlug.net > > ___ General mailing list General@brlug.net http://mail.brlug.net/mailman/listinfo/general_brlug.net
