[BackupPC-users] Pool is 0.00GB comprising 0 files and 0 directories....

2009-05-27 Thread Ralf Gross
Hi,

I use BackupPC since many years without hassle. But something seems to
be broken now.

BackupPC 3.1 (source)
Debian Etch
xfs fs


Recently the pool was running full and I added some additional disks to the
raid volume. backuppc showed the pool size before as 0.00GB, but I didn't
realize that there might be a problem.


#  Other info:
* 0 pending backup requests from last scheduled wakeup,
* 0 pending user backup requests,
* 0 pending command requests,
* Pool is 0.00GB comprising 0 files and 0 directories (as of 5/18 14:00),
* Pool hashing gives 0 repeated files with longest chain 0,
* Nightly cleanup removed 0 files of size 0.00GB (around 5/18 14:00),
* Pool file system was recently at 60% (5/27 08:56), today's max is 100% 
(5/18 14:00) and yesterday's max was 100%. 


$ grep TopDir /etc/BackupPC/config.pl
 $Conf{TopDir} = '/data/BackupPC';


$ df -h | grep data
 /dev/sdc  6,9T  4,1T  2,8T  60% /data/BackupPC


The pool and the pc directory are on the same filesystem, so that shouldn't be
a problem.

$ ls -l /data/BackupPC/
insgesamt 16
drwxrwxr-x 18 backuppc backuppc   134 2009-05-27 08:56 cpool
drwxrwxr-x 24 backuppc backuppc 16384 2009-05-27 08:56 pc
drwxr-x---  2 backuppc backuppc 6 2009-05-18 13:12 trash

/data/BackupPC/ was the TopDir since I started with backuppc, and I sure
pooling/linking did work once.

logfile:

2009-05-18 14:00:02 Pool nightly clean removed 0 files of size 0.00GB
2009-05-18 14:00:02 Pool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max 
links), 0 directories
2009-05-18 14:00:02 Cpool nightly clean removed 0 files of size 0.00GB
2009-05-18 14:00:02 Cpool is 0.00GB, 0 files (0 repeated, 0 max chain, 0 max 
links), 4369 directories



BackupPC_nightly finished way too fast (5 sec) and does nothing.

$ /usr/local/BackupPC/bin/BackupPC_nightly 0 255
BackupPC_stats 0 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 1 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 2 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 3 = pool,0,0,0,0,0,0,0,0,0,0,
[...]
BackupPC_stats 253 = cpool,0,17,0,0,0,0,0,0,0,0,
BackupPC_stats 254 = cpool,0,17,0,0,0,0,0,0,0,0,
BackupPC_stats 255 = cpool,0,17,0,0,0,0,0,0,0,0,
BackupPC_nightly lock_off


BackupPC: Host Summary

Hosts with good Backups

There are 22 hosts that have been backed up, for a total of:

* 260 full backups of total size 31110.73GB (prior to pooling and 
compression),
* 183 incr backups of total size 409.15GB (prior to pooling and 
compression). 



I've no idea what is going on. The clients are backed up and I can access the
backups and restore them.


Any idea what to check next?

Ralf

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Pool is 0.00GB comprising 0 files and 0 directories....

2009-05-27 Thread Bernhard Ott
Ralf Gross wrote:
 Hi,
 
 I use BackupPC since many years without hassle. But something seems to
 be broken now.
 
 BackupPC 3.1 (source)
 Debian Etch
 xfs fs
 

Hi Ralf,
look for the thread no cpool info shown on web interface (2008-04)in 
the archives, Tino Schwarze found a solution for a xfs-related issue:

 I found a fix for lib/BackupPC/Lib.pm (the line with map {...} is
 the relevant one):
 
 --- lib/BackupPC/Lib.pm 2007-11-26 04:00:07.0 +0100
 +++ lib/BackupPC/Lib.pm   2008-04-13 12:52:03.938619979 +0200
 @@ -485,10 +485,15 @@
  
  from_to($path, utf8, $need-{charsetLegacy})
  if ( $need-{charsetLegacy} ne  );
 -return if ( !opendir(my $fh, $path) );
 +my ($fh);
 +if ( !opendir($fh, $path) ) {
 +   print log ERROR: opendir ($path) failed\n;
 +   return;
 +}
 +
  if ( $IODirentOk ) {
  @entries = sort({ $a-{inode} = $b-{inode} } readdirent($fh));
 -map { $_-{type} = 0 + $_-{type} } @entries;   # make type numeric
 +map { $_-{type} = 0 + $_-{type}; $_-{type} = undef if ($_-{type} 
 eq BPC_DT_UNKNOWN); } @entries;   # make type numeric, unset unknown types
  } else {
  @entries = map { { name = $_} } readdir($fh);
  }
 @@ -553,9 +559,11 @@
  return if ( !chdir($dir) );
  my $entries = $bpc-dirRead(., {inode = 1, type = 1});
  #print Dumper($entries);
 +#print (log got ,scalar(@$entries), entries for $dir\n);
  foreach my $f ( @$entries ) {
  next if ( $f-{name} eq .. || $f-{name} eq .  $dontDoCwd );
  $param-{wanted}($f-{name}, $dir/$f-{name});
 +#if ( $f-{type} != BPC_DT_DIR ) { print (log skipping 
 non-directory , $f-{name},  type: , $f-{type}, \n); }
  next if ( $f-{type} != BPC_DT_DIR || $f-{name} eq . );
  chdir($f-{name});
  $bpc-find($param, $dir/$f-{name}, 1);


HTH,
Bernhard

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] smb error on ubuntu

2009-05-27 Thread Guillaume
Hello,

There seems to be a bug in version 3.1.0 for ubuntu
Connecting to smb shares fails.
I can make it work only if I hardcode credentials in the smbclient 
command inside config.pl

How can I fix it ?

Thanks for your help

Guillaume

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Pool is 0.00GB comprising 0 files and 0 directories....

2009-05-27 Thread Ralf Gross
Bernhard Ott schrieb:
  I use BackupPC since many years without hassle. But something seems to
  be broken now.
  
  BackupPC 3.1 (source)
  Debian Etch
  xfs fs
  
 
 Hi Ralf,
 look for the thread no cpool info shown on web interface (2008-04)in 
 the archives, Tino Schwarze found a solution for a xfs-related issue:

thanks, this seems to solve the problem:

[...]
BackupPC_stats 254 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 255 = pool,0,0,0,0,0,0,0,0,0,0,
BackupPC_stats 0 = cpool,18221,18,5134732,829336,5368848,5799,3,4,3,7063,333254
BackupPC_stats 1 = 
cpool,18230,17,7346812,878464,2342356,5666,12,5,2,31999,836449
BackupPC_stats 2 = 
cpool,18249,17,7228044,2254536,2028604,5658,3,2,2,5199,1158229
[...]

Slowly I'm getting back some free space too.

Ralf

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Pool is 0.00GB comprising 0 files and 0 directories....

2009-05-27 Thread Craig Barratt
Ralf writes:

 thanks, this seems to solve the problem:

Sounds like you have the IO::Dirent + xfs problem.  It's fixed
in 3.2.0 beta0.

Craig

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Pool is 0.00GB comprising 0 files and 0 directories....

2009-05-27 Thread Chris Robertson
Bernhard Ott wrote:
 Ralf Gross wrote:
   
 Hi,

 I use BackupPC since many years without hassle. But something seems to
 be broken now.

 BackupPC 3.1 (source)
 Debian Etch
 xfs fs

 

 Hi Ralf,
 look for the thread no cpool info shown on web interface (2008-04)in 
 the archives, Tino Schwarze found a solution for a xfs-related issue:

   
 I found a fix for lib/BackupPC/Lib.pm (the line with map {...} is
 the relevant one):

 --- lib/BackupPC/Lib.pm 2007-11-26 04:00:07.0 +0100
 +++ lib/BackupPC/Lib.pm   2008-04-13 12:52:03.938619979 +0200
 @@ -485,10 +485,15 @@
  
  from_to($path, utf8, $need-{charsetLegacy})
  if ( $need-{charsetLegacy} ne  );
 -return if ( !opendir(my $fh, $path) );
 +my ($fh);
 +if ( !opendir($fh, $path) ) {
 +   print log ERROR: opendir ($path) failed\n;
 +   return;
 +}
 +
  if ( $IODirentOk ) {
  @entries = sort({ $a-{inode} = $b-{inode} } readdirent($fh));
 -map { $_-{type} = 0 + $_-{type} } @entries;   # make type numeric
 +map { $_-{type} = 0 + $_-{type}; $_-{type} = undef if 
 ($_-{type} eq BPC_DT_UNKNOWN); } 

For what it's worth, this line is the only change that is needed.  
Replacing return if ( !opendir(my $fh, $path) ); above just makes your 
log file larger.

 @entries;   # make type numeric, unset unknown types
  } else {
  @entries = map { { name = $_} } readdir($fh);
  }
 @@ -553,9 +559,11 @@
  return if ( !chdir($dir) );
  my $entries = $bpc-dirRead(., {inode = 1, type = 1});
  #print Dumper($entries);
 +#print (log got ,scalar(@$entries), entries for $dir\n);
  foreach my $f ( @$entries ) {
  next if ( $f-{name} eq .. || $f-{name} eq .  $dontDoCwd );
  $param-{wanted}($f-{name}, $dir/$f-{name});
 +#if ( $f-{type} != BPC_DT_DIR ) { print (log skipping 
 non-directory , $f-{name},  type: , $f-{type}, \n); }
  next if ( $f-{type} != BPC_DT_DIR || $f-{name} eq . );
  chdir($f-{name});
  $bpc-find($param, $dir/$f-{name}, 1);
 


 HTH,
 Bernhard

Chris

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Backup Central this mailing list

2009-05-27 Thread Les Mikesell
cpreston wrote:
 
 Any reason not to compromise and provide read-only access to the
 threads but add a sticky that explains and shows people how to post by
 subscribing to the listserv? 
 
 
 The biggest reason would be the purpose of the forum gateway in the first 
 place, which is that some people prefer the forum interface in a community 
 like this one.

But oddly, they only prefer to ask questions that way.  Isn't is a bit 
strange that the community you claim to attract almost never supplies 
answers through the forum?  If they did, the mail list response would be 
somewhat irrelevant.

-- 
   Les Mikesell
lesmikes...@gmail.com

--
Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT 
is a gathering of tech-side developers  brand creativity professionals. Meet
the minds behind Google Creative Lab, Visual Complexity, Processing,  
iPhoneDevCamp as they present alongside digital heavyweights like Barbarian 
Group, R/GA,  Big Spaceship. http://p.sf.net/sfu/creativitycat-com 
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/