Re: [BackupPC-users] What is it doing? How to see progess?
Boniforti Flavio wrote: > > I've now run a simple full backup of about 300MB using ssh tunnel. On my > Linux server, where BackupPC runs and stores the data it retrieves from > remote (Windows) clients, I see that the tunnel is open and running > > backuppc 26351 4.5 0.3 6032 1724 ?Ss 16:31 1:12 ssh -fC > administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 20 > > What I'm missing is an rsync process, is this ok? > Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" > folder, and in it "fprofilo": why has there been an "f" added in front > of the rsync module name? > > Last but not least: how do I check the progress status of my backup? A 'du -s' on that "new" directory will give you an approximation of how much has been copied. "ls -lR would show more than you probably want to know. The 'f' file mangling is done to avoid collisions with the attrib file that backuppc adds in every directory. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 05:02 , Boniforti Flavio wrote: > Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" > folder, and in it "fprofilo": why has there been an "f" added in front > of the rsync module name? it's just part of the storage format. the files there are compressed, and not in their original form. > Last but not least: how do I check the progress status of my backup? it's not easy; but you can sort of keep an eye on it by watching new directories appear under /var/lib/backuppc/pc//new; and monitoring how much data has appeared there with 'du -sch'. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 19:24, "Les Mikesell" ha scritto: > A 'du -s' on that "new" directory will give you an approximation of how > much has been copied. "ls -lR would show more than you probably want to > know. The 'f' file mangling is done to avoid collisions with the attrib > file that backuppc adds in every directory. I already used those two commands, there is no evidence of growing data, thus I wanted to have a better and deeper insight on what's going on... Any advices? -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 19:14, "Carl Wilhelm Soderstrom" ha scritto: > On 04/08 05:02 , Boniforti Flavio wrote: >> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" >> folder, and in it "fprofilo": why has there been an "f" added in front >> of the rsync module name? > > it's just part of the storage format. the files there are compressed, and > not in their original form. Ah, well... So I can't copy or access those files when they're synced over? >> Last but not least: how do I check the progress status of my backup? > > it's not easy; but you can sort of keep an eye on it by watching new > directories appear under /var/lib/backuppc/pc//new; and monitoring > how much data has appeared there with 'du -sch'. The problem is that there are *no new* directories created under "new", simply this (out of more than 300MB): storebox:/var/lib/backuppc/pc/mail.omvsa.ch/new# tree . `-- fprofilo `-- fangelo `-- fApplication Data `-- fMicrosoft `-- fForms That leads me to believe, something is *not* working. No rsync process is running on my Linux box, but after 4 hours, the ssh tunnel is still open! Need help... Thanks, Flavio Boniforti. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Boniforti Flavio wrote: > > > Il 08.04.09 19:14, "Carl Wilhelm Soderstrom" ha > scritto: > >> On 04/08 05:02 , Boniforti Flavio wrote: >>> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" >>> folder, and in it "fprofilo": why has there been an "f" added in front >>> of the rsync module name? >> it's just part of the storage format. the files there are compressed, and >> not in their original form. > > Ah, well... So I can't copy or access those files when they're synced over? > >>> Last but not least: how do I check the progress status of my backup? >> it's not easy; but you can sort of keep an eye on it by watching new >> directories appear under /var/lib/backuppc/pc//new; and monitoring >> how much data has appeared there with 'du -sch'. > > The problem is that there are *no new* directories created under "new", > simply this (out of more than 300MB): > > storebox:/var/lib/backuppc/pc/mail.omvsa.ch/new# tree > . > `-- fprofilo > `-- fangelo > `-- fApplication Data > `-- fMicrosoft > `-- fForms > > That leads me to believe, something is *not* working. No rsync process is > running on my Linux box, but after 4 hours, the ssh tunnel is still open! > > Need help... Try monitoring network traffic with something like bwm for bandwidth, iptraf for connections and sniffit for data streams. Maybe it's stuck on a large file? -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Johan Ehnberg wrote: > Boniforti Flavio wrote: >> >> Il 08.04.09 19:14, "Carl Wilhelm Soderstrom" ha >> scritto: >> >>> On 04/08 05:02 , Boniforti Flavio wrote: Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" folder, and in it "fprofilo": why has there been an "f" added in front of the rsync module name? >>> it's just part of the storage format. the files there are compressed, and >>> not in their original form. >> Ah, well... So I can't copy or access those files when they're synced over? >> Last but not least: how do I check the progress status of my backup? >>> it's not easy; but you can sort of keep an eye on it by watching new >>> directories appear under /var/lib/backuppc/pc//new; and monitoring >>> how much data has appeared there with 'du -sch'. >> The problem is that there are *no new* directories created under "new", >> simply this (out of more than 300MB): >> >> storebox:/var/lib/backuppc/pc/mail.omvsa.ch/new# tree >> . >> `-- fprofilo >> `-- fangelo >> `-- fApplication Data >> `-- fMicrosoft >> `-- fForms >> >> That leads me to believe, something is *not* working. No rsync process is >> running on my Linux box, but after 4 hours, the ssh tunnel is still open! >> >> Need help... > > Try monitoring network traffic with something like bwm for bandwidth, > iptraf for connections and sniffit for data streams. Maybe it's stuck on > a large file? For a quick network-use check, just use ifconfig and look at RX bytes, and the difference after a short interval - or to look at the traffic with the target, use 'tcpdump hostname'. -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 02:04 , Les Mikesell wrote: > Johan Ehnberg wrote: > > Try monitoring network traffic with something like bwm for bandwidth, > > iptraf for connections and sniffit for data streams. Maybe it's stuck on > > a large file? > > For a quick network-use check, just use ifconfig and look at RX bytes, > and the difference after a short interval - or to look at the traffic > with the target, use 'tcpdump hostname'. I prefer iftop. Best tool I've found for seeing how much data is moving between which ports on which machines. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 08:22 , Boniforti Flavio wrote: > > it's just part of the storage format. the files there are compressed, and > > not in their original form. > > Ah, well... So I can't copy or access those files when they're synced over? if they're compressed, you'll need the backuppc tools to uncompress them (unless you implement your own equivalents with perl; which may not be difficult for an experienced perlmonger -- I don't know). > The problem is that there are *no new* directories created under "new", > simply this (out of more than 300MB): > > storebox:/var/lib/backuppc/pc/mail.omvsa.ch/new# tree > . > `-- fprofilo > `-- fangelo > `-- fApplication Data > `-- fMicrosoft > `-- fForms > > That leads me to believe, something is *not* working. No rsync process is > running on my Linux box, but after 4 hours, the ssh tunnel is still open! does 'find' give you the same output? What happens when you 'su -' to backuppc and run /usr/share/backuppc/bin/BackupPC_dump -f -v ? you should see how your backup is doing. -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 20:49, "Johan Ehnberg" ha scritto:
>> Need help...
>
> Try monitoring network traffic with something like bwm for bandwidth,
> iptraf for connections and sniffit for data streams. Maybe it's stuck on
> a large file?
No large files in this case.
Here some extracts of the log file, after I stopped the running BackupPC
process:
Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -fC
administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 20
SSH Tunnel started successfully.
full backup started for directory profilo
Connected to localhost:8874, remote version 30
Negotiated protocol version 28
Connected to module profilo
Sending args: --server --sender -rtvz --port=8874 --delete --ignore-errors
--numeric-ids --delete-excluded --stats --progress --block-size=2048
--ignore-times . .
Checksum seed is 1239201106
Got checksumSeed 0x49dcb552Executing DumpPreUserCmd:
/var/lib/backuppc/tunnel.sh -fC administra...@mail.omvsa.ch -L
8874:127.0.0.1:873 sleep 20
SSH Tunnel started successfully.
full backup started for directory profilo
Connected to localhost:8874, remote version 30
Negotiated protocol version 28
Connected to module profilo
Sending args: --server --sender -rtvz --port=8874 --delete --ignore-errors
--numeric-ids --delete-excluded --stats --progress --block-size=2048
--ignore-times . .
Checksum seed is 1239201106
Got checksumSeed 0x49dcb552
Got file (0 of 144): .
Got file (1 of 144): angelo
Got file (2 of 144): carola
Got file (3 of 144): ivo
Got file (4 of 144): lorenzina
Got file (5 of 144): luca
Got file (6 of 144): musky
Got file (7 of 144): pasquale
Got file (8 of 144): riserva
Got file (9 of 144): test
Got file (10 of 144): vito
Got file (0 of 144): .
Got file (1 of 144): angelo
Got file (2 of 144): carola
Got file (3 of 144): ivo
Got file (4 of 144): lorenzina
Got file (5 of 144): luca
Got file (6 of 144): musky
Got file (7 of 144): pasquale
Got file (8 of 144): riserva
Got file (9 of 144): test
Got file (10 of 144): vito
[cut]
Got file list: 5211 entries
Child PID is 26364
Xfer PIDs are now 26364
Sending csums, cnt = 5211, phase = 0
Sending empty csums for angelo/Application Data/Microsoft/Forms/RefEdit.exd
Sending empty csums for angelo/Cookies/ang...@m.webtrends[1].txt
Sending empty csums for angelo/Cookies/index.dat
[cut]
Sending empty csums for vito/Sti_Trace.log
Sending empty csums for vito/intlname.ols
Sending empty csums for vito/ntuser.dat.LOG
Sending empty csums for vito/ntuser.ini
Sending csums, cnt = 0, phase = 1
Read EOF:
Tried again: got 0 bytes
Child is sending done
Got done from child
Got stats: 3579597837 204684981 75895600 0 ('errorCnt' => 0,'ExistFileSize'
=> 0,'ExistFileCnt' => 0,'TotalFileCnt' => 0,'ExistFileCompSize' =>
0,'TotalFileSize' => 0)
finish: removing in-process file angelo/Application
Data/Microsoft/Forms/RefEdit.exd
attribWrite(dir=fprofilo/angelo/Application Data/Microsoft) ->
/var/lib/backuppc/pc/mail.omvsa.ch/new/fprofilo/fangelo/fApplication
Data/fMicrosoft/attrib
attribWrite(dir=fprofilo/angelo/Application Data) ->
/var/lib/backuppc/pc/mail.omvsa.ch/new/fprofilo/fangelo/fApplication
Data/attrib
attribWrite(dir=fprofilo/angelo) ->
/var/lib/backuppc/pc/mail.omvsa.ch/new/fprofilo/fangelo/attrib
attribWrite(dir=fprofilo) ->
/var/lib/backuppc/pc/mail.omvsa.ch/new/fprofilo/attrib
attribWrite(dir=) -> /var/lib/backuppc/pc/mail.omvsa.ch/new//attrib
Child is aborting
Got exit from child
Done: 0 files, 0 bytes
Got fatal error during xfer (No files dumped for share profilo)
Backup aborted (No files dumped for share profilo)
Saving this as a partial backup, replacing the prior one (got 1 and 0 files
versus 0)
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Boniforti Flavio wrote: > >>> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" >>> folder, and in it "fprofilo": why has there been an "f" added in front >>> of the rsync module name? >> it's just part of the storage format. the files there are compressed, and >> not in their original form. > > Ah, well... So I can't copy or access those files when they're synced over? After they are moved to the pc/hostname/backup#/directory, you can browse them with the web interface, download through the browser, or restore them. Meanwhile BackuPC_zcat would be able to expand them: http://backuppc.sourceforge.net/faq/BackupPC.html -- Les Mikesell lesmikes...@gmail.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 21:31, "Carl Wilhelm Soderstrom" ha scritto: > On 04/08 08:22 , Boniforti Flavio wrote: >>> it's just part of the storage format. the files there are compressed, and >>> not in their original form. >> >> Ah, well... So I can't copy or access those files when they're synced over? > > if they're compressed, you'll need the backuppc tools to uncompress them > (unless you implement your own equivalents with perl; which may not be > difficult for an experienced perlmonger -- I don't know). Why do you say "IF" they're compressed? How do I define if they get stored in compressed format, while still maintaining compression during the transfer? > does 'find' give you the same output? I'm not used to use "find", will do it next time... > What happens when you 'su -' to backuppc and run > /usr/share/backuppc/bin/BackupPC_dump -f -v > ? > you should see how your backup is doing. OK, as posted in my other message (the one with the log excerpts), running as you suggested (manually), I got the process being somehow stuck at: Sending empty csums for vito/ntuser.ini Sending csums, cnt = 0, phase = 1 What do you think? Thanks again, Flavio Boniforti PIRAMIDE INFORMATICA SAGL Via Ballerini 21 6600 Locarno Switzerland Phone: +41 91 751 68 81 Fax: +41 91 751 69 14 Url: http://www.piramide.ch E-mail: fla...@piramide.ch-- -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 21:39, "Les Mikesell" ha scritto: > Boniforti Flavio wrote: >> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" folder, and in it "fprofilo": why has there been an "f" added in front of the rsync module name? >>> it's just part of the storage format. the files there are compressed, and >>> not in their original form. >> >> Ah, well... So I can't copy or access those files when they're synced over? > > After they are moved to the pc/hostname/backup#/directory, you can > browse them with the web interface, download through the browser, or > restore them. Meanwhile BackuPC_zcat would be able to expand them: > http://backuppc.sourceforge.net/faq/BackupPC.html OK, nice... And what do I have to do if I don't want them to be stored in compressed form? -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Boniforti Flavio wrote:
>
>
> Il 08.04.09 21:39, "Les Mikesell" ha scritto:
>
>> Boniforti Flavio wrote:
> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new"
> folder, and in it "fprofilo": why has there been an "f" added in front
> of the rsync module name?
it's just part of the storage format. the files there are compressed, and
not in their original form.
>>> Ah, well... So I can't copy or access those files when they're synced over?
>> After they are moved to the pc/hostname/backup#/directory, you can
>> browse them with the web interface, download through the browser, or
>> restore them. Meanwhile BackuPC_zcat would be able to expand them:
>> http://backuppc.sourceforge.net/faq/BackupPC.html
>
> OK, nice... And what do I have to do if I don't want them to be stored in
> compressed form?
>
The same link http://backuppc.sourceforge.net/faq/BackupPC.html shows
all the options. Look for $Conf{CompressLevel}.
It will still mangle the filenames, though. They aren't really intended
to be accessed directly.
--
Les Mikesell
lesmikes...@gmail.com
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 09:50 , Boniforti Flavio wrote: > Why do you say "IF" they're compressed? How do I define if they get stored > in compressed format, while still maintaining compression during the > transfer? it's a setting in /etc/backuppc/config.pl read through the file; it's worthwhile documentation for the whole program. > OK, as posted in my other message (the one with the log excerpts), running > as you suggested (manually), I got the process being somehow stuck at: > > Sending empty csums for vito/ntuser.ini > Sending csums, cnt = 0, phase = 1 not seen that before. what are the lines before it? -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 22:27, "Carl Wilhelm Soderstrom" ha
scritto:
> On 04/08 09:50 , Boniforti Flavio wrote:
>> Why do you say "IF" they're compressed? How do I define if they get stored
>> in compressed format, while still maintaining compression during the
>> transfer?
>
> it's a setting in /etc/backuppc/config.pl
> read through the file; it's worthwhile documentation for the whole program.
As I'm lookin at the file, I discovered
$Conf{ArchiveComp} = 'gzip';
$Conf{CompressLevel} = '3';
Should I put *both* of them respectively to 'none' and '0'?
>> OK, as posted in my other message (the one with the log excerpts), running
>> as you suggested (manually), I got the process being somehow stuck at:
>>
>> Sending empty csums for vito/ntuser.ini
>> Sending csums, cnt = 0, phase = 1
>
> not seen that before.
> what are the lines before it?
There are only "Sending empty csums" for each file that has been found and
put in the filelist. You can see the excerpt in my post with timestamp
21:43...
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 22:16, "Les Mikesell" ha scritto:
> The same link http://backuppc.sourceforge.net/faq/BackupPC.html shows
> all the options. Look for $Conf{CompressLevel}.
>
> It will still mangle the filenames, though. They aren't really intended
> to be accessed directly.
Man, this is unfair... :-/ As soon as my backups will be running, there will
be needed many hours or days to completely sync 20 GB or more..
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 10:43 , Boniforti Flavio wrote: > > It will still mangle the filenames, though. They aren't really intended > > to be accessed directly. > > Man, this is unfair... :-/ As soon as my backups will be running, there will > be needed many hours or days to completely sync 20 GB or more.. why do you need to access them directly? in any case, a simple use of BackupPC_zcat or BackupPC_tarCreate will allow you access to them. I do realize it's not quite as convenient, but the system is optimized for the common case, which is making backups (doing recovery is hopefully a rare thing). -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Il 08.04.09 22:50, "Carl Wilhelm Soderstrom" ha scritto: > why do you need to access them directly? I'm not necessarily thinking of accessing them directly: I'm concerned about moving 20GB or more data from my actual rsnapshots to BackupPC. But Les Mikesell has "illuminated" me: I'll let BackupPC take the first (full) backup from my actual rsnapshot-folders, afterwards I'll be backing up my remote host. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Carl Wilhelm Soderstrom wrote at about 14:31:07 -0500 on Wednesday, April 8, 2009: > On 04/08 08:22 , Boniforti Flavio wrote: > > > it's just part of the storage format. the files there are compressed, and > > > not in their original form. > > > > Ah, well... So I can't copy or access those files when they're synced over? > > if they're compressed, you'll need the backuppc tools to uncompress them > (unless you implement your own equivalents with perl; which may not be > difficult for an experienced perlmonger -- I don't know). It's not hard to do (i've done it and i'm no perl monk), but you can just use BackupPC_zcat and pipe the output to wherever you want it. > -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Boniforti Flavio wrote at about 20:22:10 +0200 on Wednesday, April 8, 2009: > > > > Il 08.04.09 19:14, "Carl Wilhelm Soderstrom" ha > scritto: > > > On 04/08 05:02 , Boniforti Flavio wrote: > >> Also, when looking into /var/lib/backuppc/pc/mail.omvsa.ch I see a "new" > >> folder, and in it "fprofilo": why has there been an "f" added in front > >> of the rsync module name? > > > > it's just part of the storage format. the files there are compressed, and > > not in their original form. > > Ah, well... So I can't copy or access those files when they're synced over? > > >> Last but not least: how do I check the progress status of my backup? > > > > it's not easy; but you can sort of keep an eye on it by watching new > > directories appear under /var/lib/backuppc/pc//new; and > > monitoring > > how much data has appeared there with 'du -sch'. > > The problem is that there are *no new* directories created under "new", > simply this (out of more than 300MB): > > storebox:/var/lib/backuppc/pc/mail.omvsa.ch/new# tree > . > `-- fprofilo > `-- fangelo > `-- fApplication Data > `-- fMicrosoft > `-- fForms > Are you using rsync or rsyncd? Because rsync has problems when syncing to Windows systems (this is a problem with protocol 28 that is resolved in protocol 30 but backuppc does not yet support protocol 30). If so, then try using rsyncd instead (and look at the archives for more details). > That leads me to believe, something is *not* working. No rsync process is > running on my Linux box, but after 4 hours, the ssh tunnel is still open! > > Need help... > > Thanks, > Flavio Boniforti. > > > -- > This SF.net email is sponsored by: > High Quality Requirements in a Collaborative Environment. > Download a free trial of Rational Requirements Composer Now! > http://p.sf.net/sfu/www-ibm-com > ___ > BackupPC-users mailing list > BackupPC-users@lists.sourceforge.net > List:https://lists.sourceforge.net/lists/listinfo/backuppc-users > Wiki:http://backuppc.wiki.sourceforge.net > Project: http://backuppc.sourceforge.net/ > -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Carl Wilhelm Soderstrom wrote: > On 04/08 02:04 , Les Mikesell wrote: >> Johan Ehnberg wrote: >>> Try monitoring network traffic with something like bwm for bandwidth, >>> iptraf for connections and sniffit for data streams. Maybe it's stuck on >>> a large file? >> For a quick network-use check, just use ifconfig and look at RX bytes, >> and the difference after a short interval - or to look at the traffic >> with the target, use 'tcpdump hostname'. > > I prefer iftop. Best tool I've found for seeing how much data is moving > between which ports on which machines. Just to add a totally different option/perspective to this... One I use frequently is to find the pid of the backuppc process ps axf |grep -i backuppc Then look at the files it is working on: ls -l /proc//fd If you want, this one is nice too: watch "ls -l /proc//fd | grep backuppc" Basically don't show the other entries you aren't interested in, also a "|cut -c 40-" or similar could be added to the end to make it look more pretty... Regards, Adam -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkndOAQACgkQGyoxogrTyiW0PwCg1vi3Pdgu5Jsi1vKPKLFrzV7f EicAoIjH9udYkBJPgqA3X6SrMEr1OmAj =BxXs -END PGP SIGNATURE- -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
> Are you using rsync or rsyncd? I'm using rsyncd (XferMethod=rsyncd), in an ssh-tunnel (I repeat this because maybe that could be the culprit): Here the commands used: Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -f administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 20 > Because rsync has problems when syncing to Windows systems > (this is a problem with protocol 28 that is resolved in > protocol 30 but backuppc does not yet support protocol 30). > If so, then try using rsyncd instead (and look at the > archives for more details). As you talk about "protocol 28 and 30", look at this log output: Executing DumpPreUserCmd: /var/lib/backuppc/tunnel.sh -f administra...@mail.omvsa.ch -L 8874:127.0.0.1:873 sleep 20 SSH Tunnel started successfully. full backup started for directory profilo Connected to localhost:8874, remote version 30 Negotiated protocol version 28 - Do you see that there is this thing mentioned? Is there the problem? After above lines, I get: Connected to module profilo Sending args: --server --sender -rtvz --port=8874 --delete --ignore-errors --numeric-ids --delete-excluded --stats --progress --block-size=2048 --ignore-times . . Checksum seed is 1239221555 Got checksumSeed 0x49dd0533 -- Then it goes on with getting files, creates the list, starts to send "empty checksums" and in the end it remains stuck at: Sending csums, cnt = 0, phase = 1 Any other clues? Thanks, Flavio Boniforti. -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
> If you want, this one is nice too: > watch "ls -l /proc//fd | grep backuppc" Look: Every 2.0s: ls -la /proc/27161/fd |grep backuppc Thu Apr 9 08:44:36 2009 dr-x-- 2 backuppc backuppc 0 9 apr 08:43 . dr-xr-xr-x 7 backuppc backuppc 0 9 apr 08:42 .. l-wx-- 1 backuppc backuppc 64 9 apr 08:43 0 -> /dev/null l-wx-- 1 backuppc backuppc 64 9 apr 08:43 1 -> pipe:[5257127] l-wx-- 1 backuppc backuppc 64 9 apr 08:43 2 -> pipe:[5257127] l-wx-- 1 backuppc backuppc 64 9 apr 08:43 3 -> /var/lib/backuppc/pc/mail.omvsa.ch/LOG.042009 l-wx-- 1 backuppc backuppc 64 9 apr 08:43 4 -> /var/lib/backuppc/pc/mail.omvsa.ch/XferLOG.z l-wx-- 1 backuppc backuppc 64 9 apr 08:43 5 -> /var/lib/backuppc/pc/mail.omvsa.ch/NewFileList lrwx-- 1 backuppc backuppc 64 9 apr 08:43 6 -> socket:[5257182] No files are being transferred... :-/ -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
> Are you using rsync or rsyncd? > Because rsync has problems when syncing to Windows systems > (this is a problem with protocol 28 that is resolved in > protocol 30 but backuppc does not yet support protocol 30). > If so, then try using rsyncd instead (and look at the > archives for more details). Uhm, *now* as I was re-reading through this, I need to ask: where do you intend me to use rsyncd? Because my actual setup is like rsyncd running on the Windows client... -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/08 10:41 , Boniforti Flavio wrote:
> As I'm lookin at the file, I discovered
>
> $Conf{ArchiveComp} = 'gzip';
> $Conf{CompressLevel} = '3';
>
> Should I put *both* of them respectively to 'none' and '0'?
no, just one or the other should suffice.
In any case, you really do want compression in most cases.
the only exception that I use, is when you're backing up the local machine.
This way you can still recover the files even without backuppc. (It would be
silly to need backuppc to recover the backuppc config files, wouldn't it?)
--
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com
--
This SF.net email is sponsored by:
High Quality Requirements in a Collaborative Environment.
Download a free trial of Rational Requirements Composer Now!
http://p.sf.net/sfu/www-ibm-com
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
Hi, Carl Wilhelm Soderstrom wrote on 2009-04-13 11:48:40 -0500 [Re: [BackupPC-users] What is it doing? How to see progess?]: > In any case, you really do want compression in most cases. > the only exception that I use, is when you're backing up the local machine. > This way you can still recover the files even without backuppc. (It would be > silly to need backuppc to recover the backuppc config files, wouldn't it?) no, not really. You can recover compressed files from a backup with BackupPC_zcat. Simple enough. So you could install BackupPC on a newly installed machine, BackupPC_zcat the configuration into place and then use BackupPC to recover whatever else you want to. Not that that is very automatic, but you would need to pick out the config files and rename them into place even with an uncompressed backup. In either case, it is probably simpler to set up BackupPC just as far as you need to to be able to restore, and then restore the configuration. I would expect the complex parts of your configuration to be things like a multitude of individual host config files, pre- and post-commands, backup schedules, blackout periods, ssh tunnels to remote sites, special arguments for remote backups and so on, not the restoration of localhost. That, I would expect, should almost work out of the box (you obviously need to supply the ShareName, which is simple enough to figure out, and the XferMethod, which is not smb ;-). You've got a good point for *the rest of /etc*, though. The BackupPC configuration files won't be needed unless you have installed BackupPC and want to use it, other files might be needed before you have the opportunity of installing BackupPC (on a dedicated backup server, that's probably the first thing you'll do, but not everyone has one). Regards, Holger -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] What is it doing? How to see progess?
On 04/13 10:00 , Holger Parplies wrote: > Carl Wilhelm Soderstrom wrote on 2009-04-13 11:48:40 -0500 [Re: > [BackupPC-users] What is it doing? How to see progess?]: > > In any case, you really do want compression in most cases. > > the only exception that I use, is when you're backing up the local machine. > > This way you can still recover the files even without backuppc. (It would be > > silly to need backuppc to recover the backuppc config files, wouldn't it?) > > You've got a good point for *the rest of /etc*, though. The BackupPC > configuration files won't be needed unless you have installed BackupPC > and want to use it, other files might be needed before you have the > opportunity of installing BackupPC (on a dedicated backup server, that's > probably the first thing you'll do, but not everyone has one). Yep. This is my point; that there may be files you need to recover, which then allow you to set up the box to recover the rest of your files. It would be a royal PITA to recover all the files in /etc directly out of the backuppc pool; but at least it's *possible* if the files are uncompressed. (Sometimes, bad things happen to good people, and it pays to be prepared for that eventuality, even if it never happesns.) -- Carl Soderstrom Systems Administrator Real-Time Enterprises www.real-time.com -- This SF.net email is sponsored by: High Quality Requirements in a Collaborative Environment. Download a free trial of Rational Requirements Composer Now! http://p.sf.net/sfu/www-ibm-com ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
