[BackupPC-users] Viewing detail of a backup in progress?
Is it possible/how to view details on a backup in progress - for example, it would be great to see what file it is backing up, how many/how big the backup is so far. Totals would be nice, like 100 files totaling 200MB backed up out of 500 files totaling 2GB. I have a slow backup and I have no idea how far along it is. -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
On 04/03 05:56 , Scott wrote: > Is it possible/how to view details on a backup in progress - for example, it > would be great to see what file it is backing up, how many/how big the > backup is so far. Totals would be nice, like 100 files totaling 200MB > backed up out of 500 files totaling 2GB. > > I have a slow backup and I have no idea how far along it is. go to /var/lib/backuppc/pc/ and type 'ls -lart' to see which files have changed most recently. If XferLOG.z has been updated recently (which it should have, if your backup has been transferring files), you can run this command to see what file it's on. /usr/share/backuppc/bin/BackupPC_zcat XferLOG.z |tail Might be cool if the next BackupPC version could include the output of this in the web interface somewhere. (If you're lazy like me you'll have 'ls -lart --color' aliased to 'lart' because you use it a lot). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
On Mon, 2011-04-04 at 09:41 -0500, Carl Wilhelm Soderstrom wrote: > /usr/share/backuppc/bin/BackupPC_zcat XferLOG.z |tail Note that the the log files, like XferLOG.z, are buffered. They may not show files currently copying, if the log write buffer hasn't filled. Regards, Tyler -- "It's not given to anyone to have no regrets; only to decide, through the choices we make, which regrets we'll have." -- David Weber -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
Hi, Tyler J. Wagner wrote on 2011-04-04 15:54:00 +0100 [Re: [BackupPC-users] Viewing detail of a backup in progress?]: > On Mon, 2011-04-04 at 09:41 -0500, Carl Wilhelm Soderstrom wrote: > > /usr/share/backuppc/bin/BackupPC_zcat XferLOG.z |tail > > Note that the the log files, like XferLOG.z, are buffered. They may not > show files currently copying, if the log write buffer hasn't filled. in particular, they are compressed, so the end of the file is in my experience usually a considerable amount behind the file currently copying. This is also the reason you can't simply "switch off buffering" for the log files (compression needs reasonably sized chunks to operate on for efficient results). It might make sense to think about (optionally) writing log files uncompressed and compressing them after the backup has finished. Wanting to follow backup progress seems to be a frequent enough requirement. Putting the log files on a disk separate from the pool FS should probably be encouraged in this case ;-). Regards, Holger -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
On 04/04 07:14 , Holger Parplies wrote: > in particular, they are compressed, so the end of the file is in my experience > usually a considerable amount behind the file currently copying. This is also > the reason you can't simply "switch off buffering" for the log files > (compression needs reasonably sized chunks to operate on for efficient > results). It might make sense to think about (optionally) writing log files > uncompressed and compressing them after the backup has finished. Wanting to > follow backup progress seems to be a frequent enough requirement. Putting the > log files on a disk separate from the pool FS should probably be encouraged in > this case ;-). These are all terribly good points. Perhaps the current file can simply be stored in memory and presented via the web interface? Is there a variable that already exists and can be read by the web interface to present the current file being copied? -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- Create and publish websites with WebMatrix Use the most popular FREE web apps or write code yourself; WebMatrix provides all the features you need to develop and publish your website. http://p.sf.net/sfu/ms-webmatrix-sf ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
Carl Wilhelm Soderstrom wrote:
> On 04/04 07:14 , Holger Parplies wrote:
>> in particular, they are compressed, so the end of the file is in my
>> experience usually a considerable amount behind the file currently
>> copying. This is also the reason you can't simply "switch off buffering"
>> for the log files (compression needs reasonably sized chunks to operate
>> on for efficient results). It might make sense to think about
>> (optionally) writing log files uncompressed and compressing them after
>> the backup has finished. Wanting to follow backup progress seems to be a
>> frequent enough requirement. Putting the log files on a disk separate
>> from the pool FS should probably be encouraged in this case ;-).
>
> These are all terribly good points.
>
> Perhaps the current file can simply be stored in memory and presented via
> the web interface? Is there a variable that already exists and can be read
> by the web interface to present the current file being copied?
>
Not realy, not yet. But it will counted during backup and BackupPC_dump get
them at the end of an backup:
my @results = $xfer->run();
$tarErrs += $results[0];
$nFilesExist += $results[1];
$sizeExist += $results[2];
$sizeExistComp += $results[3];
$nFilesTotal += $results[4];
$sizeTotal += $results[5];
Furthermore BackupPC_dump use eventhandler like:
$SIG{TTIN} = \&catch_signal;
So it should be no problem to add an additional eventhandler
$SIG{IO} = \&write_status;
which than will collect the actual transfer rates and write them into a
file.
But maybee - it is possibly a problem to write in a file if the event occurs
during writing in a file.
Any Ideas?
br
Matthias
--
Don't Panic
--
Xperia(TM) PLAY
It's a major breakthrough. An authentic gaming
smartphone on the nation's most reliable network.
And it wants your games.
http://p.sf.net/sfu/verizon-sfdev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
Hi Scott,
> Is it possible/how to view details on a backup in progress - for
> example, it would be great to see what file it is backing up, how
> many/how big the backup is so far. Totals would be nice, like 100
> files totaling 200MB backed up out of 500 files totaling 2GB.
>
> I have a slow backup and I have no idea how far along it is.
I don't any suggestions on measuring % completion or throughput, but
if you are using rsync on an OS that has strace available, you can do
something like:
# strace -fp `pidof rsync` -e open
[..]
open("usr/lib/chromium-browser/xdg-mime", O_RDONLY) = 3
open("usr/lib/chromium-browser/xdg-settings", O_RDONLY) = 3
open("usr/lib/cli/Mono.Addins-0.2/Mono.Addins.dll", O_RDONLY) = 3
[..]
on the host you are backing up.
You can do something similar on the backuppc server but you'll see I/O activity
on the file pool path, which may or may not be of use to you.
Hope that helps.
Regards,
Chris Bennett (cgb)
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
On Mon, Apr 18, 2011 at 12:01:06AM +0930, Chris Bennett wrote:
> > Is it possible/how to view details on a backup in progress - for
> > example, it would be great to see what file it is backing up, how
> > many/how big the backup is so far. Totals would be nice, like 100
> > files totaling 200MB backed up out of 500 files totaling 2GB.
> >
> > I have a slow backup and I have no idea how far along it is.
>
> I don't any suggestions on measuring % completion or throughput, but
> if you are using rsync on an OS that has strace available, you can do
> something like:
> # strace -fp `pidof rsync` -e open
> [..]
> open("usr/lib/chromium-browser/xdg-mime", O_RDONLY) = 3
> open("usr/lib/chromium-browser/xdg-settings", O_RDONLY) = 3
> open("usr/lib/cli/Mono.Addins-0.2/Mono.Addins.dll", O_RDONLY) = 3
> [..]
>
> on the host you are backing up.
>
> You can do something similar on the backuppc server but you'll see
> I/O activity on the file pool path, which may or may not be of use to you.
Also lsof -p can show you which files are open. Similarly
for the server on the backuppc system.
--
-- rouilj
John Rouillard System Administrator
Renesys Corporation 603-244-9084 (cell) 603-643-9300 x 111
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Viewing detail of a backup in progress?
Determine how far along the backup is in terms of % would require some sort
of total size determination before the backup begins. I'm not sure if this
is something BPC does already on the backend or not. At least keeping track
of how many kilobytes/megabytes/gigabytes have been xfered so far and making
that readily displayed in the web interface would be very nice. It doesn't
have to be super precise.
Jake Wilson
On Sun, Apr 17, 2011 at 5:40 PM, John Rouillard wrote:
> On Mon, Apr 18, 2011 at 12:01:06AM +0930, Chris Bennett wrote:
> > > Is it possible/how to view details on a backup in progress - for
> > > example, it would be great to see what file it is backing up, how
> > > many/how big the backup is so far. Totals would be nice, like 100
> > > files totaling 200MB backed up out of 500 files totaling 2GB.
> > >
> > > I have a slow backup and I have no idea how far along it is.
> >
> > I don't any suggestions on measuring % completion or throughput, but
> > if you are using rsync on an OS that has strace available, you can do
> > something like:
> > # strace -fp `pidof rsync` -e open
> > [..]
> > open("usr/lib/chromium-browser/xdg-mime", O_RDONLY) = 3
> > open("usr/lib/chromium-browser/xdg-settings", O_RDONLY) = 3
> > open("usr/lib/cli/Mono.Addins-0.2/Mono.Addins.dll", O_RDONLY) = 3
> > [..]
> >
> > on the host you are backing up.
> >
> > You can do something similar on the backuppc server but you'll see
> > I/O activity on the file pool path, which may or may not be of use to
> you.
>
> Also lsof -p can show you which files are open. Similarly
> for the server on the backuppc system.
>
>
> --
>-- rouilj
>
> John Rouillard System Administrator
> Renesys Corporation 603-244-9084 (cell) 603-643-9300 x 111
>
>
> --
> Benefiting from Server Virtualization: Beyond Initial Workload
> Consolidation -- Increasing the use of server virtualization is a top
> priority.Virtualization can reduce costs, simplify management, and improve
> application availability and disaster protection. Learn more about boosting
> the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
--
Benefiting from Server Virtualization: Beyond Initial Workload
Consolidation -- Increasing the use of server virtualization is a top
priority.Virtualization can reduce costs, simplify management, and improve
application availability and disaster protection. Learn more about boosting
the value of server virtualization. http://p.sf.net/sfu/vmware-sfdev2dev___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
