Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-07 Thread Bill McGonigle
On Sep 5, 2008, at 17:19, Ted Roche wrote: > Cool! Have you got an RSS feed for your podcast yet? Then we can > subscribe! http://dlslug.org/podcast -Bill - Bill McGonigle, Owner Work: 603.448.4440 BFC Computing, LLC Home: 603.448.1668 [EMAIL PROTECTED]

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-05 Thread Ted Roche
Bill McGonigle wrote: > Bill Stearns covered it briefly at DLSLUG a few months back: > >http://dlslug.org/downloads/podcast/dlslug_200806_stearns_fuse.mp3 > Cool! Have you got an RSS feed for your podcast yet? Then we can subscribe! -- Ted Roche Ted Roche & Associates, LLC http://www.tedr

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-05 Thread Bill McGonigle
I'd reflexively reach for rsync as well, but GlusterFS may do some of what you need automagically: http://www.gluster.org/docs/index.php/ Install_and_run_GlusterFS_v1.3_in_10mins Bill Stearns covered it briefly at DLSLUG a few months back: http://dlslug.org/downloads/podcast/dlslug_2008

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-05 Thread Darrell Michaud
Using rsync or unisom or any of the improvements on top of rsync as a direct replacement for FTP would be a low-hanging fruit improvement. Tunneling it over an encrypted layer such as SSH improves security as well. You're absolutely right that if you have a cluster of machines in the DMZ, a more s

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-05 Thread Andy Bair
On Thu, Sep 04, 2008 at 08:17:02PM -0400, Andy Bair wrote: > Have you looked into rsync vs. ftp? I've used rsync in many situations > to move files and it has many great options and handles interrupted > transfers, etc. > > You can find it here: > > http://samba.anu.edu.au/rsync/ Another thing

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-05 Thread Ben Scott
On Thu, Sep 4, 2008 at 6:42 PM, Flaherty, Patrick <[EMAIL PROTECTED]> wrote: > I have a cluster of machine producing 20k small files (30kbytes or so) > inside our lan. After the files are created, they are pushed to a few > web servers in the DMZ using ftp. If practical, you may want to experime

Re: Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-04 Thread Andy Bair
Have you looked into rsync vs. ftp? I've used rsync in many situations to move files and it has many great options and handles interrupted transfers, etc. You can find it here: http://samba.anu.edu.au/rsync/ Sincerely, Andy KoreLogic Security 603.465.3236 (Office) 603.340.2498 (Mobile) http://

Lan + DMZ + LargeNumOfFiles = headaches AKA: plz halp and donate ur brain!!

2008-09-04 Thread Flaherty, Patrick
I've been soliciting solutions from everyone I can think of on moving a large number of files from inside our lan to a dmz on a regular basis. I have a cluster of machine producing 20k small files (30kbytes or so) inside our lan. After the files are created, they are pushed to a few web servers i