Re: [BackupPC-users] Backups very slow after upgrade to squeeze
On Wed, Sep 7, 2011 at 3:10 PM, James L. Evans wrote: > > xvda1 10GB Operating system (24% used) > xvdb1 536MB Swap partition > xvbc1 214GB backup storage (72% used) > > I'm not sure how to tell what a "fragmented VM image" would look like. Did the location or allocation change as part of the upgrade? If the partitions are mapped straight from the host, I wouldn't expect them to, but something seems to have made writing very slow. Or perhaps you have concurrent activity on a different VM or application that competes with the physical disk head location. -- Les Mikesell lesmikes...@gmail.com -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] excluding files from backup
Hi,
SSzretter wrote on 2011-09-07 13:33:24 -0700 [[BackupPC-users] excluding files
from backup]:
> So what is the proper syntax for excluding files backed up via smb from a
> windows box (folders too)?
ask smbclient. I was going to recommend reading smbclient(1), but it isn't
very explicit on the syntax of its excludes (in contrast to rsync(1)).
> I have this currently, and I have tried adding a wildcard '/WINDOWS/*' ,
> no difference :
>
> $Conf{BackupFilesExclude} = {
> '*' => [
> '/Documents and Settings/*/Local Settings/Temporary Internet Files/',
> [...]
> ]
> };
that would seem to be syntactically correct. In any case, the exclude would
apply, since you've got no other exclude for a share, and '*' would match any
share without an exclude.
> I found this thread which seems to imply my slashes need to go the other
> way ??like '\WINDOWS\' ??
Almost. In general, you should be able to use either '/' or '\\' as path
separator, but depending on who handles exclusions and how, it might only work
with the native path separator (if it's just a plain string comparison,
"/WINDOWS/" obviously won't match "\\WINDOWS\\"; it *shouldn't* be a plain
string comparison, but I haven't checked the code, and it might not even be
the smbclient side handling the excludes).
Note how I tend to quote the backslash character; you'll have to do that, too,
in a config file (the web interface may or may not do it for you).
> http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/backupfilesexclude-via-smb-for-windows-shares-solved-90560/
Sorry, I refuse to follow that reference.
> This thread has similar information:
> http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg08889.html
Does it? I read it as a simple issue of spelling error in the configuration.
Yes, if you misspell variable names, they won't be interpolated correctly.
Earlier, you had written:
> In the latest xfer log for this morning, just a SMALL sampling:
>
> create d 755 0/0 0 System Volume Information
> create d 755 0/0 0 temp
Ah, yes. That's the lines immediately following the interesting ones. I had
thought it was obvious. My mistake. What *smbclient command invocation* does
the log file show? What excludes are passed?
Even before that, you had written:
> After further investigation, I believe my file exclusions are not working in
> backuppc. I checked some random machine transfer logs and I see lots of
> entries for /WINDOWS/...
> In my config.pl this (and other) directories should be exuded. I am using
> SMB to do backups (xp machines mostly):
>
> Do I need anything besides this: ?
To which I had, sometime in between, replied:
> err, beside the question mark?
>
> You need to not have set BackupFilesOnly. What does your log file say?
Just for those readers who were gnirednow (that's "wondering", but backwards)
about the context.
Regards,
Holger (who will soon need a sanity break from this list)
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] check if user is still logged on before shutting down client after dump
Hi,
Kenneth wrote on 2011-08-29 11:53:01 +0200 [[BackupPC-users] check if user is
still logged on before shutting down client after dump]:
> Hello, I'd like to shutdown my linux workstation after a dump, but it
> shouldn't shutdown the workstation when a user is still logged in.
> However, my scripts do not seem to work when called from backuppc.
sorry for the delay in responding.
In which way does the script not work when called from BackupPC? Please give
as much detail as you can (e.g. quotes from log files). Your problem is not
apparent from what you write.
> However, it works when I call wrapper.sh from the shell by entering
> ./wrapper.sh "HOSTNAME" as user backuppc.
> [...]
> config exerpt:
> $Conf{DumpPostUserCmd} = 'wrapper.sh $host';
You should supply the path to wrapper.sh here. I'm not sure what directories
would be searched without path, but I wouldn't rely on it being the correct
ones.
Does your HOSTNAME contain any unusual characters? I'm just asking because you
quoted it on the command line.
> wrapper.sh contains:
> HOSTNAME=$1
> ssh root@$HOSTNAME 'bash' < /etc/backuppc/shutdown.sh
The only real difference I can see at the moment is that stdin for ssh will be
a tty when you call that from the command line, while it won't when BackupPC
calls it. I don't think that makes any difference, though.
> shutdown.sh contains:
> #!/bin/bash
>
> # Read logged users
> USERCOUNT=`who | wc -l`;
> # No Shutdown if there are any users logged in
> if (($USERCOUNT>0))
> then exit
> else shutdown -h now
> fi
> exit 0
Depending on the nature of "it doesn't work", you could try giving the code
inline to bash rather than via input redirection ... something like
ssh root@$HOSTNAME '[ `who | wc -l` == 0 ] && shutdown -h now'
(you might need an additional "|| true" at the end, not sure). Or you could
use Perl. It's not something obvious like ssh asking you for a password, I
guess?
Hope that helps.
Regards,
Holger
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] check if user is still logged on before shutting down client
Hi,
bobwdn wrote on 2011-09-07 12:13:24 -0700 [[BackupPC-users] check if user is
still logged on before shutting down client]:
> I like your idea.
which of my ideas?
> However, if your shutdown script is run simply as
> $Conf{DumpPostUserCmd} = 'shutdown.sh'.
I don't have a shutdown script, and this does not appear to be a full sentence.
> Would not that work with greater efficiency than your 'wrapper' shell script
> calling another shell script.
This seems to be a question, although it ends with a full stop.
Actually, it's an *extremely* stupid question, if you *read* the actual
message you are replying to (you should always do that before responding).
> Maybe I am wrong,
Very much so.
> [...]
> +--
> |This was sent by re...@bellsouth.net via Backup Central.
> |Forward SPAM to ab...@backupcentral.com.
> +--
Ah, that explains things. It's a pity that more brain is required for reading
a sticky "PLEASE READ BEFORE POSTING" message at the top (really hard to miss)
than for writing messages. I really suggest we re-open the discussion.
Regards,
Holger
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
[BackupPC-users] excluding files from backup
So what is the proper syntax for excluding files backed up via smb from a
windows box (folders too)?
I have this currently, and I have tried adding a wildcard '/WINDOWS/*' , no
difference :
$Conf{BackupFilesExclude} = {
'*' => [
'/Documents and Settings/*/Local Settings/Temporary Internet Files/',
'/Documents and Settings/*/Local Settings/Temp/',
'/Documents and Settings/*/NTUSER.DAT',
'/Documents and Settings/*/ntuser.dat.LOG',
'/Documents and Settings/*/Local Settings/Application
Data/Microsoft/Windows/UsrClass.dat',
'/Documents and Settings/*/Local Settings/Application
Data/Microsoft/Windows/UsrClass.dat.LOG',
'/Documents and Settings/*/Local Settings/Application
Data/Mozilla/Firefox/Profiles/*/Cache/',
'/Documents and Settings/*/Local Settings/Application
Data/Mozilla/Firefox/Profiles/*/OfflineCache/',
'/Documents and Settings/*/Recent/',
'*.lock',
'Thumbs.db',
'IconCache.db',
'Cache',
'cache',
'/WINDOWS/',
'/RECYCLER/',
'/MSOCache/',
'/System Volume Information/',
'/AUTOEXEC.BAT',
'/BOOTSECT.BAK',
'/CONFIG.SYS',
'/hiberfil.sys',
'/pagefile.sys',
'/WINNT/'
]
};
I found this thread which seems to imply my slashes need to go the other way ??
like '\WINDOWS\' ??
http://www.backupcentral.com/phpBB2/two-way-mirrors-of-external-mailing-lists-3/backuppc-21/backupfilesexclude-via-smb-for-windows-shares-solved-90560/
This thread has similar information:
http://www.mail-archive.com/backuppc-users@lists.sourceforge.net/msg08889.html
SO, what IS the proper way to define excludes so it's not going to back up the
windows folder and similar?
HISTORY:
It's set to :
$Conf{BackupFilesOnly} = {};
My file count / reuse summary is basically not changed (which I would expect
some numbers to drop) in the web admin for the machine's latest backup.
In the latest xfer log for this morning, just a SMALL sampling:
create d 755 0/0 0 System Volume Information
create d 755 0/0 0 temp
create d 755 0/0 0 TempEI4
create d 755 0/0 0 WINDOWS
create d 755 0/0 0 WINDOWS/$968930Uinstall_KB968930$
create d 755 0/0 0 WINDOWS/$968930Uinstall_KB968930$/spuninst
create d 755 0/0 0 WINDOWS/$hf_mig$
create d 755 0/0 0 WINDOWS/$hf_mig$/KB2079403
create d 755 0/0 0 WINDOWS/$hf_mig$/KB2079403/SP3QFE
create d 755 0/0 0 WINDOWS/$hf_mig$/KB2079403/update
create d 755 0/0 0 WINDOWS/$hf_mig$/KB2115168
pool 644 0/0 30216 WINDOWS/Prefetch/MOFCOMP.EXE-01718E95.pf
pool 644 0/0 55314 WINDOWS/Prefetch/MRT.EXE-1B4A8D49.pf
pool 644 0/0 7844 WINDOWS/Prefetch/MRTSTUB.EXE-0574A4ED.pf
create 644 0/0 110134 WINDOWS/Prefetch/MSACCESS.EXE-175F0AD1.pf
pool 644 0/0 171224 WINDOWS/Prefetch/MSCORSVW.EXE-1366B4F5.pf
SSzretter wrote on 2011-08-31 13:37:13 -0400 [[BackupPC-users] excluding files
from backup]:
After further investigation, I believe my file exclusions are not working in
backuppc. I checked some random machine transfer logs and I see lots of
entries for /WINDOWS/...
In my config.pl this (and other) directories should be exuded. I am using
SMB to do backups (xp machines mostly):
Do I need anything besides this: ?
--- reply:
err, beside the question mark?
You need to not have set BackupFilesOnly. What does your log file say?
Regards,
Holger
+--
|This was sent by sszret...@hotmail.com via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backups very slow after upgrade to squeeze
There are three LVMs provided by XenServer 5.6 to the VM: xvda1 10GBOperating system (24% used) xvdb1 536MB Swap partition xvbc1 214GB backup storage (72% used) I'm not sure how to tell what a "fragmented VM image" would look like. Jim -Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: Wednesday, September 07, 2011 3:10 PM To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Backups very slow after upgrade to squeeze On Wed, Sep 7, 2011 at 1:19 PM, James L. Evans wrote: > I have been running backuppc 3.1.0-4 on Debian lenny (Xen VM) for several > years with no problems. > > Suddenly, after upgrading to squeeze and backuppc 3.1.0-9, nightly backup > take very long (50 times) or never finish. If I start them manually from the > web interface they run just fine. > > Also, when the unfinished backups are still running, the machine responds > very slowly even though the backuppc processes are using less than 1% of the > CPU. > > Any suggestions? > > Jim > > I'm also seeing some messages like the following the kernal logs: > > Sep 7 03:14:13 backup kernel: [57960.076042] INFO: task kjournald:384 > blocked for more than 120 seconds. What's the underlying physical disk look like? Could you have fragmented the VM image in the upgrade process? -- Les Mikesell lesmikes...@gmail.com -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/ -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] check if user is still logged on before shutting down client
I like your idea. However, if your shutdown script is run simply as
$Conf{DumpPostUserCmd} = 'shutdown.sh'. Would not that work with greater
efficiency than your 'wrapper' shell script calling another shell script.
Maybe I am wrong, but the $Conf{DumpPostUserCmd} is run by backuppc user when
sending commands to the host. Which ever host it is communicating with.
+--
|This was sent by re...@bellsouth.net via Backup Central.
|Forward SPAM to ab...@backupcentral.com.
+--
--
Using storage to extend the benefits of virtualization and iSCSI
Virtualization increases hardware utilization and delivers a new level of
agility. Learn what those decisions are and how to modernize your storage
and backup environments for virtualization.
http://www.accelacomm.com/jaw/sfnl/114/51434361/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Backups very slow after upgrade to squeeze
On Wed, Sep 7, 2011 at 1:19 PM, James L. Evans wrote: > I have been running backuppc 3.1.0-4 on Debian lenny (Xen VM) for several > years with no problems. > > Suddenly, after upgrading to squeeze and backuppc 3.1.0-9, nightly backup > take very long (50 times) or never finish. If I start them manually from the > web interface they run just fine. > > Also, when the unfinished backups are still running, the machine responds > very slowly even though the backuppc processes are using less than 1% of the > CPU. > > Any suggestions? > > Jim > > I'm also seeing some messages like the following the kernal logs: > > Sep 7 03:14:13 backup kernel: [57960.076042] INFO: task kjournald:384 > blocked for more than 120 seconds. What's the underlying physical disk look like? Could you have fragmented the VM image in the upgrade process? -- Les Mikesell lesmikes...@gmail.com -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backups very slow after upgrade to squeeze
I have been running backuppc 3.1.0-4 on Debian lenny (Xen VM) for several years with no problems. Suddenly, after upgrading to squeeze and backuppc 3.1.0-9, nightly backup take very long (50 times) or never finish. If I start them manually from the web interface they run just fine. Also, when the unfinished backups are still running, the machine responds very slowly even though the backuppc processes are using less than 1% of the CPU. Any suggestions? Jim I'm also seeing some messages like the following the kernal logs: Sep 7 03:14:13 backup kernel: [57960.076042] INFO: task kjournald:384 blocked for more than 120 seconds. Sep 7 03:14:13 backup kernel: [57960.076060] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Sep 7 03:14:13 backup kernel: [57960.076074] kjournald D f9ff470b 0 384 2 0x Sep 7 03:14:13 backup kernel: [57960.076094] c218f740 0246 001f2362 f9ff470b 001f2362 c145ee20 c145ee20 001f2362 Sep 7 03:14:13 backup kernel: [57960.076129] c218f8fc c3170e20 6eabc211 3480 0056c047 00026cae c13f7f00 Sep 7 03:14:13 backup kernel: [57960.076163] 0cda2623 c218f8fc 488d1fe0 0cda2623 c20e0648 0018b708 Sep 7 03:14:13 backup kernel: [57960.076196] Call Trace: Sep 7 03:14:13 backup kernel: [57960.076208] [] ? io_schedule+0x5f/0x98 Sep 7 03:14:13 backup kernel: [57960.076217] [] ? sync_buffer+0x30/0x33 Sep 7 03:14:13 backup kernel: [57960.076225] [] ? __wait_on_bit+0x33/0x58 Sep 7 03:14:13 backup kernel: [57960.076232] [] ? sync_buffer+0x0/0x33 Sep 7 03:14:13 backup kernel: [57960.076239] [] ? out_of_line_wait_on_bit+0xb5/0xbd Sep 7 03:14:13 backup kernel: [57960.076247] [] ? sync_buffer+0x0/0x33 Sep 7 03:14:13 backup kernel: [57960.076255] [] ? wake_bit_function+0x0/0x3c Sep 7 03:14:13 backup kernel: [57960.076263] [] ? __wait_on_buffer+0x16/0x18 Sep 7 03:14:13 backup kernel: [57960.076274] [] ? journal_commit_transaction+0x83c/0xd56 [jbd] Sep 7 03:14:13 backup kernel: [57960.076283] [] ? xen_force_evtchn_callback+0xc/0x10 Sep 7 03:14:13 backup kernel: [57960.076291] [] ? xen_restore_fl_direct_end+0x0/0x1 Sep 7 03:14:13 backup kernel: [57960.076300] [] ? _spin_unlock_irqrestore+0xd/0xf Sep 7 03:14:13 backup kernel: [57960.076308] [] ? try_to_del_timer_sync+0x4f/0x56 Sep 7 03:14:13 backup kernel: [57960.076316] [] ? kjournald+0xb9/0x1e0 [jbd] Sep 7 03:14:13 backup kernel: [57960.076324] [] ? autoremove_wake_function+0x0/0x2d Sep 7 03:14:13 backup kernel: [57960.076333] [] ? kjournald+0x0/0x1e0 [jbd] Sep 7 03:14:13 backup kernel: [57960.076340] [] ? kthread+0x61/0x66 Sep 7 03:14:13 backup kernel: [57960.076347] [] ? kthread+0x0/0x66 Sep 7 03:14:13 backup kernel: [57960.076355] [] ? kernel_thread_helper+0x7/0x10 -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
[BackupPC-users] Backup Summary 'Start Date' field
Hi, The start date field in a backup summary shows month/day and time. Is there anything I can do to have it also show the year? Thanks, Gerald -- Using storage to extend the benefits of virtualization and iSCSI Virtualization increases hardware utilization and delivers a new level of agility. Learn what those decisions are and how to modernize your storage and backup environments for virtualization. http://www.accelacomm.com/jaw/sfnl/114/51434361/ ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
