[BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Sorin Srbu
Hi all, I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync over ssh. Running iperf below I notice the network should theoretically be capable of a bit more than that. I understand that ssh adds quite a bit of bottleneck. [root@titan ~]# iperf -c cyndane ---

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Koen Vermeer
What about testing the speed over the ssh tunnel? That may tell you whether ssh is slowing down your transfers or that it's due to rsync. If it is ssh, you could trade encryption strength for speed. Best, Koen On October 16, 2014 2:25:53 PM CEST, Sorin Srbu wrote: >Hi all, > >I'm seeing

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Colin Shorts
You may wish to prevent ssh from using compression when using a fast link, the overhead probably isn't worth it and may give you a reasonable boost in throughput. Like Koen said, you'll want to benchmark the different scenarios. Regards, Colin On 16/10/14 16:28, Koen Vermeer wrote: What abo

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Les Mikesell
On Thu, Oct 16, 2014 at 7:25 AM, Sorin Srbu wrote: > > I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync > over ssh. > That sounds pretty good. But unless you have a lot of new files created daily, the bottleneck is usually disk speed, especially merging a lot of small

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
> -Original Message- > From: Koen Vermeer [mailto:k...@vermeer.tv] > Sent: den 16 oktober 2014 17:29 > To: General list for user discussion, questions and support > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > What about testing the speed over

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
> -Original Message- > From: Colin Shorts [mailto:c.sho...@intrallect.com] > Sent: den 16 oktober 2014 17:58 > To: backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > You may wish to prevent ssh from using com

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
> -Original Message- > From: Les Mikesell [mailto:lesmikes...@gmail.com] > Sent: den 16 oktober 2014 18:09 > To: General list for user discussion, questions and support > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > > I'm seeing netwo

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
> -Original Message- > From: Les Mikesell [mailto:lesmikes...@gmail.com] > Sent: den 16 oktober 2014 18:09 > To: General list for user discussion, questions and support > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > > I'm seeing netwo

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Holger Parplies
Hi, Sorin Srbu wrote on 2014-10-16 12:25:53 + [[BackupPC-users] Using NFS to increase backup speed]: > I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync > over ssh. it is a frequent misconception that you *want* to see anything close to the speed the

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Les Mikesell
On Fri, Oct 17, 2014 at 5:38 AM, Sorin Srbu wrote: >> >> That sounds pretty good. But unless you have a lot of new files >> created daily, the bottleneck is usually disk speed, especially >> merging a lot of small changes into a big existing file. > > Not too many new files daily, the reading is

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
> -Original Message- > From: Les Mikesell [mailto:lesmikes...@gmail.com] > Sent: den 17 oktober 2014 14:55 > To: General list for user discussion, questions and support > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > > Not too many new fil

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Les Mikesell
On Fri, Oct 17, 2014 at 8:29 AM, Sorin Srbu wrote: > > I was worried the full backup wouldn't complete in the limited time the BPC > server in online. > For practical reasons (well, because of the hd-space available really), the > server used is off during nights in order to save some electricit

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Koen Vermeer
On 10/17/2014 09:40 AM, Sorin Srbu wrote: >> What about testing the speed over the ssh tunnel? That may tell you >> whether ssh is slowing down your transfers or that it's due to rsync. If it >> is >> ssh, you could trade encryption strength for speed. > Would the below do? > > [root@cyndane ~]# y

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-20 Thread Sorin Srbu
> -Original Message- > From: Koen Vermeer [mailto:k...@vermeer.tv] > Sent: den 17 oktober 2014 21:49 > To: backuppc-users@lists.sourceforge.net > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > > [root@cyndane ~]# yes | pv | ssh titan "c

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-20 Thread Sorin Srbu
> -Original Message- > From: Les Mikesell [mailto:lesmikes...@gmail.com] > Sent: den 17 oktober 2014 16:57 > To: General list for user discussion, questions and support > Subject: Re: [BackupPC-users] Using NFS to increase backup speed > > > I was worried the full