Re: [BackupPC-users] BackupPC 3.0, rsyncd and UTF-8 support?
Tomasz writes:
> Is BackupPC 3.0 capable of transferring different UTF-8 characters, like
> German umlauts, using cygwin-rsyncd 2.6.8_0 available on BackupPC
> download site (running on Windows)?
Yes.
> Or is it still needed to use a patched cygwin1.dll version, containing
> UTF-8 hacks - like the one available on
> http://www.okisoft.co.jp/esc/utf8-cygwin/index.html ?
>
>
> From a couple of tests I made, it seems that one still needs a patched
> version.
Rsync uses the native client charset coding (ie: it doesn't change anything).
On a windows machine that is typically cp1250.
BackupPC 3.0 uses utf8 on the server and can optionally translate
to/from the client charset coding by setting $Conf{ClientCharset},
eg:
$Conf{ClientCharset} = 'cp1250';
In western europe you might need to use cp1252.
Unlike rsync, samba by default converts to/from utf8, so there is
no need to have BackupPC 3.0 do any conversion for smb.
Craig
-
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/backuppc-users
http://backuppc.sourceforge.net/
Re: [BackupPC-users] Cannot queue restores
Jacob writes: > I am running BackupPC 2.1.2pl2. I have a problem that I cannot queue > multiple restores. I request a direct restore of a users files, and that > job qoes into the queue. I then request another restore while the first > one is running. I get a message: > > but a job is currently running, so this request will start later. > > I then look in the 'current queues' areas and it is empty - suggesting > there are no other jobs in the queue. But I know there are because I just > requested one. I look in the pc's folder, and see various > restoreReq.xx files. Every time I request another queued restore, a > restoreReq file appears with the correct restore info. > > But the queue is empty, and no scheduled restores complete ever, only > those I request when there are none others running. > > The restoreRequests just stay in the folder and nothing happens. > > How can I get the restores to be correctly scheduled ? I have 40 > different files to restore after a disk failure. Sorry about the delay in replying. This bug is fixed in BackupPC 3.0.0beta. If you need a fix for 2.1.2 I can tell you what to change. Craig - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Tuning BackupPC
What about using 2 BackupPC servers. Split all the backups over two physical servers. 1 server does 100 PC's the other server does the other 100. James Ward wrote: > In an effort to reduce the time spent doing the BackupPC_nightly, I > upped the number done in parallel from 2 to 8. Now the system is 99% > wait. What is the best mix, half wait and half CPU bound? > > I'm concerned about performance because I am backing up over 200 > machines and so far, I'm only getting around to each machine about > once a week. Any performance tuning ideas you can give me would be > appreciated. As I said before, I also eliminated the blackout window. > > - > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/backuppc-users > http://backuppc.sourceforge.net/ > > - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Tuning BackupPC
On Sun, 2006-10-29 at 12:19, James Ward wrote: > In an effort to reduce the time spent doing the BackupPC_nightly, I > upped the number done in parallel from 2 to 8. Now the system is 99% > wait. What is the best mix, half wait and half CPU bound? Disk head motion is bound to be the bottleneck here and that's pretty much single threaded. The only large improvements could come from sorting the operations in inode order (didn't someone do that some time ago?) or spreading the disk operations over more heads with raid0 or LVM. If you are using raid5, that's probably the main problem. > I'm concerned about performance because I am backing up over 200 > machines and so far, I'm only getting around to each machine about > once a week. Any performance tuning ideas you can give me would be > appreciated. As I said before, I also eliminated the blackout window. The other thing that might be improved is the backup speed. Rsync can be slow even for incrementals if the runs span huge numbers of files. Splitting them into separate filesystem or directory runs might help. If that's not possible, adding RAM to the server might help. If you have the bandwidth, tar might be faster on the incrementals - and you can stagger the fulls or try to get them on weekends. -- Les Mikesell [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
[BackupPC-users] Tuning BackupPC
In an effort to reduce the time spent doing the BackupPC_nightly, I upped the number done in parallel from 2 to 8. Now the system is 99% wait. What is the best mix, half wait and half CPU bound? I'm concerned about performance because I am backing up over 200 machines and so far, I'm only getting around to each machine about once a week. Any performance tuning ideas you can give me would be appreciated. As I said before, I also eliminated the blackout window. - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
On Sun, 2006-10-29 at 09:38, Tomasz Chmielewski wrote: > > > >>> Out of curiosity how long did it take and how big was the entire data > >>> size on the first run? did it eat up all the cpu time when running? > >> As I remember, it took a couple of hours; but I was copying from one HDD > >> to another. > >> It was about 80 GB or so, full of hardlinks. > >> > >> The machine was pretty responsive, but I had to increase the swap size > >> several times and start from scratch again. > > > > Did you use the -H option with rsync to maintain the hardlinks? > > Yes. The time is probably more related to the number of files with links than the size of the archive. I tried this with an archive of about 100 GB and gave up after it ran for 3 days without completing. -- Les Mikesell [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
Les Mikesell wrote: > On Sun, 2006-10-29 at 04:13, Tomasz Chmielewski wrote: > >>> Out of curiosity how long did it take and how big was the entire data >>> size on the first run? did it eat up all the cpu time when running? >> As I remember, it took a couple of hours; but I was copying from one HDD >> to another. >> It was about 80 GB or so, full of hardlinks. >> >> The machine was pretty responsive, but I had to increase the swap size >> several times and start from scratch again. > > Did you use the -H option with rsync to maintain the hardlinks? Yes. -- Tomasz Chmielewski http://wpkg.org - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
On Sun, 2006-10-29 at 04:13, Tomasz Chmielewski wrote: > > Out of curiosity how long did it take and how big was the entire data > > size on the first run? did it eat up all the cpu time when running? > > As I remember, it took a couple of hours; but I was copying from one HDD > to another. > It was about 80 GB or so, full of hardlinks. > > The machine was pretty responsive, but I had to increase the swap size > several times and start from scratch again. Did you use the -H option with rsync to maintain the hardlinks? -- Les Mikesell [EMAIL PROTECTED] - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
Les Stott wrote: I know of people who do it; but they're doing it on machines with more memory and fewer files. >> Just add lots of swap. >> >> I was able to rsync an archive with several million files on a machine >> with just 256 MB RAM; it had several gigabytes of swap. >> >> >> > Out of curiosity how long did it take and how big was the entire data > size on the first run? did it eat up all the cpu time when running? As I remember, it took a couple of hours; but I was copying from one HDD to another. It was about 80 GB or so, full of hardlinks. The machine was pretty responsive, but I had to increase the swap size several times and start from scratch again. -- Tomasz Chmielewski http://wpkg.org - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
>>> I know of people who do it; but they're doing it on machines with more >>> memory and fewer files. >>> > > Just add lots of swap. > > I was able to rsync an archive with several million files on a machine > with just 256 MB RAM; it had several gigabytes of swap. > > > Out of curiosity how long did it take and how big was the entire data size on the first run? did it eat up all the cpu time when running? les - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
Re: [BackupPC-users] Back-up to another host
Rodrigo Real wrote: > Carl Wilhelm Soderstrom <[EMAIL PROTECTED]> writes: > >> On 10/28 10:23 , Rodrigo Real wrote: >>> Can't you install rsync on 10.0.0.254? That should be the easiest way, >>> rsync can preserve hard links with the -H option, additionally it >>> would transfer only the differences between the two hosts. >> on the topic of server replication; the problem with using rsync is that it >> uses a tremendous amount of memory when dealing with millions of files. I >> tried it once; rsync'ing a 100GB pool (with perhaps 5 or 6 million files) >> from one disk to another on a box with 512MB RAM and perhaps 1GB swap. > > I had never tryed that, but I can't think of another way of doing > it. I am sure it is hard to rsync two huge mass of files. Maybe it is > possible to split the rsync process in some parts, but it will still > be hard. > > Best wishes, > Rodrigo > >> the box eventually ran out of memory to the point that I had to power-cycle >> it to regain control. it's the only time in recent memory that I can think >> of a linux box needing to be rebooted for a software problem. >> >> I know of people who do it; but they're doing it on machines with more >> memory and fewer files. Just add lots of swap. I was able to rsync an archive with several million files on a machine with just 256 MB RAM; it had several gigabytes of swap. -- Tomasz Chmielewski http://wpkg.org - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/backuppc-users http://backuppc.sourceforge.net/
