[BackupPC-users] Error when backing up 1.4TB files
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting some
errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize' =
0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/fkbmatrix_snomed_10/attrib
attribWrite(dir=f%2fmnt%2fdata/mysql) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/attrib
attribWrite(dir=f%2fmnt%2fdata) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/attrib
attribWrite(dir=) - /var/lib/backuppc/pc/indexing-vm/new//attrib
Child is aborting
Got exit from child
Done: 3383 files, 964645288896 bytes
Executing DumpPostUserCmd: /usr/share/backuppc/bin/endbkpemail.sh prem.kumar 0
indexing-vm full DumpPostUserCmd
Got fatal error during xfer (aborted by signal=ALRM)
Backup aborted by user signal
Saving this as a partial backup, replacing the prior one (got 3383 and 3383
files versus 0)--
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest
that you create a static snapshot of the folder/mount point, maybe using
LVM tools, provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text
file), then use BackupPC to backup this file. You should put exclusion for
MYD and MYR file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting
some errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize'
= 0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/fkbmatrix_snomed_10/attrib
attribWrite(dir=f%2fmnt%2fdata/mysql) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/attrib
attribWrite(dir=f%2fmnt%2fdata) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/attrib
attribWrite(dir=) - /var/lib/backuppc/pc/indexing-vm/new//attrib
Child is aborting
Got exit from child
Done: 3383 files, 964645288896 bytes
Executing DumpPostUserCmd: /usr/share/backuppc/bin/endbkpemail.sh prem.kumar
0 indexing-vm full DumpPostUserCmd
Got fatal error during xfer (aborted by signal=ALRM)
Backup aborted by user signal
Saving this as a partial backup, replacing the prior one (got 3383 and 3383
files versus 0)
--
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, PHP application. Start your 15-day FREE TRIAL of AppDynamics
Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/
--
Sharuzzaman Ahmat Raslan
--
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Sharuzzaman,
Thank you for the details but isnt rsync clever enough to dump all the files?
The thing is the files are not being used hence there should be likely no
activities.
As for the error below: I checked the troubleshooting page and its about the
$Conf{ClientTimeout} settings, which is at default set to 72000 (around 20
hrs), I have changed to 20 but have yet to try. I hope no other
implications by doing so.
(aborted by signal=ALRM)
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com; General list for user discussion, questions
and support backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 10:54 AM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest that
you create a static snapshot of the folder/mount point, maybe using LVM tools,
provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text file),
then use BackupPC to backup this file. You should put exclusion for MYD and MYR
file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting some
errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize' =
0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/fkbmatrix_snomed_10/attrib
attribWrite(dir=f%2fmnt%2fdata/mysql) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/attrib
attribWrite(dir=f%2fmnt%2fdata) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/attrib
attribWrite(dir=) - /var/lib/backuppc/pc/indexing-vm/new//attrib
Child is aborting
Got exit from child
Done: 3383 files, 964645288896 bytes
Executing DumpPostUserCmd: /usr/share/backuppc/bin/endbkpemail.sh prem.kumar 0
indexing-vm full DumpPostUserCmd
Got fatal error during xfer (aborted by signal=ALRM)
Backup aborted by user signal
Saving this as a partial backup, replacing the prior one (got 3383 and 3383
files versus 0)
--
Rapidly troubleshoot problems before they affect your business. Most IT
organizations don't have a clear picture of how application performance
affects their revenue. With AppDynamics, you get 100% visibility into your
Java,.NET, PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro!
http://pubads.g.doubleclick.net/gampad/clk?id=84349831iu=/4140/ostg.clktrk
Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
rsync only work best with static file.
Even though you mentioned that the file (table) is not being used, but
usually MySQL always refreshing the file, maybe doing indexing or something.
That is why proprietary backup software have agent for MySQL to read the
binary data, and dump is as static file for the backup.
Thanks.
On Thu, Dec 26, 2013 at 11:55 AM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
Thank you for the details but isnt rsync clever enough to dump all the
files? The thing is the files are not being used hence there should be
likely no activities.
As for the error below: I checked the troubleshooting page and its about
the $Conf{ClientTimeout} settings, which is at default set to 72000
(around 20 hrs), I have changed to 20 but have yet to try. I hope no
other implications by doing so.
(aborted by signal=ALRM)
--
*From:* Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
*To:* Prem squirr...@yahoo.com; General list for user discussion,
questions and support backuppc-users@lists.sourceforge.net
*Sent:* Thursday, December 26, 2013 10:54 AM
*Subject:* Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest
that you create a static snapshot of the folder/mount point, maybe using
LVM tools, provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text
file), then use BackupPC to backup this file. You should put exclusion for
MYD and MYR file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting
some errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize'
= 0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/fkbmatrix_snomed_10/attrib
attribWrite(dir=f%2fmnt%2fdata/mysql) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/attrib
attribWrite(dir=f%2fmnt%2fdata) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/attrib
attribWrite(dir=) - /var/lib/backuppc/pc/indexing-vm/new//attrib
Child is aborting
Got exit from child
Done: 3383 files, 964645288896 bytes
Executing DumpPostUserCmd: /usr/share/backuppc/bin/endbkpemail.sh prem.kumar
0 indexing-vm full DumpPostUserCmd
Got fatal error during xfer (aborted by signal=ALRM)
Backup aborted by user signal
Saving this as a partial backup, replacing the prior one (got 3383 and 3383
files versus 0
Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Sharuzzaman,
As per my checking, the apps is not really running any DBs. Is there anything
else to look at in this case?
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com
Cc: General list for user discussion, questions and support
backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 12:03 PM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
rsync only work best with static file.
Even though you mentioned that the file (table) is not being used, but usually
MySQL always refreshing the file, maybe doing indexing or something.
That is why proprietary backup software have agent for MySQL to read the binary
data, and dump is as static file for the backup.
Thanks.
On Thu, Dec 26, 2013 at 11:55 AM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
Thank you for the details but isnt rsync clever enough to dump all the files?
The thing is the files are not being used hence there should be likely no
activities.
As for the error below: I checked the troubleshooting page and its about the
$Conf{ClientTimeout} settings, which is at default set to 72000 (around 20
hrs), I have changed to 20 but have yet to try. I hope no other
implications by doing so.
(aborted by signal=ALRM)
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com; General list for user discussion, questions
and support backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 10:54 AM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest that
you create a static snapshot of the folder/mount point, maybe using LVM tools,
provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text file),
then use BackupPC to backup this file. You should put exclusion for MYD and
MYR file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting some
errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize' =
0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/fkbmatrix_snomed_10/attrib
attribWrite(dir=f%2fmnt%2fdata/mysql) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/fmysql/attrib
attribWrite(dir=f%2fmnt%2fdata) -
/var/lib/backuppc/pc/indexing-vm/new/f%2fmnt%2fdata/attrib
attribWrite(dir=) - /var/lib/backuppc/pc
Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
If your apps is not running any DB, you can stop the MySQL server, and the
file will be static.
BackupPC will be able to finish after that.
Thanks.
On Thu, Dec 26, 2013 at 2:50 PM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
As per my checking, the apps is not really running any DBs. Is there
anything else to look at in this case?
--
*From:* Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
*To:* Prem squirr...@yahoo.com
*Cc:* General list for user discussion, questions and support
backuppc-users@lists.sourceforge.net
*Sent:* Thursday, December 26, 2013 12:03 PM
*Subject:* Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
rsync only work best with static file.
Even though you mentioned that the file (table) is not being used, but
usually MySQL always refreshing the file, maybe doing indexing or something.
That is why proprietary backup software have agent for MySQL to read the
binary data, and dump is as static file for the backup.
Thanks.
On Thu, Dec 26, 2013 at 11:55 AM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
Thank you for the details but isnt rsync clever enough to dump all the
files? The thing is the files are not being used hence there should be
likely no activities.
As for the error below: I checked the troubleshooting page and its about
the $Conf{ClientTimeout} settings, which is at default set to 72000
(around 20 hrs), I have changed to 20 but have yet to try. I hope no
other implications by doing so.
(aborted by signal=ALRM)
--
*From:* Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
*To:* Prem squirr...@yahoo.com; General list for user discussion,
questions and support backuppc-users@lists.sourceforge.net
*Sent:* Thursday, December 26, 2013 10:54 AM
*Subject:* Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest
that you create a static snapshot of the folder/mount point, maybe using
LVM tools, provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text
file), then use BackupPC to backup this file. You should put exclusion for
MYD and MYR file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting
some errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match (12866581504 vs 0)
Child is sending done
Got done from child
Got stats: 16821515 1936615698 1634885492 0 ('errorCnt' = 0,'ExistFileSize'
= 0,'ExistFileCnt' = 31,'TotalFileCnt' = 3383,'ExistFileCompSize' =
0,'TotalFileSize' = '964645288896')
finish: removing in-process file mysql/kbmatrix_snomed_10/matrixipi6.MYI
attribWrite(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10) -
/var/lib/backuppc/pc
Re: [BackupPC-users] Error when backing up 1.4TB files
yes you are right...it is running mysql...I will try and stop the service and
attempt the backup again...thank you for guide. :)
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com
Cc: General list for user discussion, questions and support
backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 2:59 PM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
If your apps is not running any DB, you can stop the MySQL server, and the file
will be static.
BackupPC will be able to finish after that.
Thanks.
On Thu, Dec 26, 2013 at 2:50 PM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
As per my checking, the apps is not really running any DBs. Is there anything
else to look at in this case?
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com
Cc: General list for user discussion, questions and support
backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 12:03 PM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
rsync only work best with static file.
Even though you mentioned that the file (table) is not being used, but usually
MySQL always refreshing the file, maybe doing indexing or something.
That is why proprietary backup software have agent for MySQL to read the
binary data, and dump is as static file for the backup.
Thanks.
On Thu, Dec 26, 2013 at 11:55 AM, Prem squirr...@yahoo.com wrote:
Hi Sharuzzaman,
Thank you for the details but isnt rsync clever enough to dump all the files?
The thing is the files are not being used hence there should be likely no
activities.
As for the error below: I checked the troubleshooting page and its about the
$Conf{ClientTimeout} settings, which is at default set to 72000 (around 20
hrs), I have changed to 20 but have yet to try. I hope no other
implications by doing so.
(aborted by signal=ALRM)
From: Sharuzzaman Ahmat Raslan sharuzza...@gmail.com
To: Prem squirr...@yahoo.com; General list for user discussion, questions
and support backuppc-users@lists.sourceforge.net
Sent: Thursday, December 26, 2013 10:54 AM
Subject: Re: [BackupPC-users] Error when backing up 1.4TB files
Hi Prem,
MYD and MYI are files for MySQL. I believe the file is keep changing, thus
BackupPC cannot determine that the size and the hash is correct, during and
after the transfer.
If you really want to backup this binary database file, I would suggest that
you create a static snapshot of the folder/mount point, maybe using LVM
tools, provided that the file is inside an LVM logical volume.
Or, you could perform an daily dump of the MySQL table (which is a text
file), then use BackupPC to backup this file. You should put exclusion for
MYD and MYR file if use this method.
Thanks.
On Thu, Dec 26, 2013 at 9:17 AM, Prem squirr...@yahoo.com wrote:
Hi,
I am trying to backup a 1.4TB folder in Linux but somehow I am getting some
errors and the backup only completes partially.
Appreciate any help on this:
Here are the errors:
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYD,
size=4488979624, placeholder=)
Starting file 3429 (mysql/kbmatrix_snomed_10/matrixipi5.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.MYI: size doesn't match (12861890560 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.MYI got digests
6137db179868cdc52c7407c56fafaa5e vs 6137db179868cdc52c7407c56fafaa5e
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.MYI,
size=12861890560, placeholder=)
Starting file 3430 (mysql/kbmatrix_snomed_10/matrixipi5.frm), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi5.frm: size doesn't match (8782 vs 0)
mysql/kbmatrix_snomed_10/matrixipi5.frm got digests
8d7348ccff2108423f12fca06c39b994 vs 8d7348ccff2108423f12fca06c39b994
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi5.frm,
size=8782, placeholder=)
Starting file 3431 (mysql/kbmatrix_snomed_10/matrixipi6.MYD), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYD: size doesn't match (4488768644 vs 0)
mysql/kbmatrix_snomed_10/matrixipi6.MYD got digests
bb526c0f4a40072b51c09ac9dec23fa8 vs bb526c0f4a40072b51c09ac9dec23fa8
[ skipped 1 lines ]
attribSet: dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10 exists
attribSet(dir=f%2fmnt%2fdata/mysql/kbmatrix_snomed_10, file=matrixipi6.MYD,
size=4488768644, placeholder=)
Starting file 3432 (mysql/kbmatrix_snomed_10/matrixipi6.MYI), blkCnt=0,
blkSize=2048, remainder=0
mysql/kbmatrix_snomed_10/matrixipi6.MYI: size doesn't match
