[PLUG] Error reading files

2023-11-27 Thread Rich Shepard

Last Wednesday I copied a large set of data files to a different partition
on this desktop host. Since then my dirvish backup reports show errors
reading the copied files; files in the original location are backed up just
fine. Here's one day's report:

Subject: ### ERR ### - Backup-salmo:/data1 (backupserver): Rsync: error Pre: OK,
Post: OK

=
ERROR:   salmo:/media/bkup1/salmo-data1/20231124-0030/tree/..
=

=
Status : Rsync: error Pre: OK, Post: OK
=
directory: /media/bkup1/salmo-data1/20231124-0030/tree/..
Summary (/media/bkup1/salmo-data1/20231124-0030/tree/../summary):
=
SUM:  client: salmo
SUM:  tree: /data1
SUM:  rsh: ssh
SUM:  Server: salmo
SUM:  Bank: /media/bkup1
SUM:  vault: salmo-data1
SUM:  branch: default
SUM:  Image: 20231124-0030
SUM:  Reference: 20231122-0030
SUM:  Image-now: 2023-11-24 00:30:00
SUM:  Expire: +1 month == 2023-12-24 00:30:00
SUM:  Expire-rule: **   *   *   1-6 +1 month
SUM:  exclude:
SUM:- .kde/share/cache/*
SUM:- .mozilla/firefox/*.default/Cache/*
SUM:- *~
SUM:- *.bak
SUM:- *.lock
SUM:- lost+found
SUM:  SET permissions devices numeric-ids stats xdev SUM:  UNSET checksum init
sparse whole-file zxfer SUM: SUM: SUM:  ACTION: rsync -vrltH --delete -x
--numeric-ids -pgo -D --stats
--exclude-from=/media/bkup1/salmo-data1/20231124-0030/exclude
--link-dest=/media/bkup1/salmo-data1/20231122-0030/tree /data1/
/media/bkup1/salmo-data1/20231124-0030/tree
SUM:  Backup-begin: 2023-11-24 00:31:13

=
Rsync-Errors (/media/bkup1/salmo-data1/20231124-0030/tree/../rsync_error):
=
RSYNC_ERR: RSYNC_ERR: RSYNC_ERR:*** Execution cycle 0 ***
RSYNC_ERR: RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/2012_bass_baseline.csv": Input/output error
(5)
RSYNC_ERR:WARNING: willamette-river/data/biota/2012_bass_baseline.csv
failed verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/2012_pcbs.csv": Input/output error (5)
RSYNC_ERR:WARNING: willamette-river/data/biota/2012_pcbs.csv failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/pdx-cyanobact.csv": Input/output error (5)
RSYNC_ERR:WARNING: willamette-river/data/biota/pdx-cyanobact.csv failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/geochem/pdx-chl-a.csv": Input/output error (5)
RSYNC_ERR:WARNING: willamette-river/data/geochem/pdx-chl-a.csv failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/geochem/pdx-dom.csv": Input/output error (5)
...

There are no changes to these files other than their presence in the new
location. File sizes are the same in the source directories.

The destination partition has available 85% of its capacity.

How do I find why these errors occur?

TIA,

Rich


Re: [PLUG] Error reading files

2023-11-27 Thread Ted Mittelstaedt
Is it a single drive that's the destination or multiple drives in an array?

Single mag media drives that do that - what I do is assume they are bad -
backup all data on them - then if I am not trusting the software I dd zeros
over the entire drive, then run SMART to see what the drive reports.

SSD's I don't dd over the entire drive.  Instead, I run the manufacturer's
SSD utility.  Most decent M.2 SSD's have them.  Unfortunately, many are
windows-only.  As of yet I have not committed a production Linux or FreeBSD
system to SSD and I have little inclination to do so, since in general I use
those as servers where having it boot fast is pointless.

Ted

-Original Message-
From: PLUG  On Behalf Of Rich Shepard
Sent: Monday, November 27, 2023 7:39 AM
To: plug@lists.pdxlinux.org
Subject: [PLUG] Error reading files

Last Wednesday I copied a large set of data files to a different partition
on this desktop host. Since then my dirvish backup reports show errors
reading the copied files; files in the original location are backed up just
fine. Here's one day's report:

Subject: ### ERR ### - Backup-salmo:/data1 (backupserver): Rsync: error Pre:
OK,
Post: OK

=
ERROR:   salmo:/media/bkup1/salmo-data1/20231124-0030/tree/..
=

=
Status : Rsync: error Pre: OK, Post: OK
=
directory: /media/bkup1/salmo-data1/20231124-0030/tree/..
Summary (/media/bkup1/salmo-data1/20231124-0030/tree/../summary):
=
SUM:  client: salmo
SUM:  tree: /data1
SUM:  rsh: ssh
SUM:  Server: salmo
SUM:  Bank: /media/bkup1
SUM:  vault: salmo-data1
SUM:  branch: default
SUM:  Image: 20231124-0030
SUM:  Reference: 20231122-0030
SUM:  Image-now: 2023-11-24 00:30:00
SUM:  Expire: +1 month == 2023-12-24 00:30:00
SUM:  Expire-rule: **   *   *   1-6 +1 month
SUM:  exclude:
SUM:- .kde/share/cache/*
SUM:- .mozilla/firefox/*.default/Cache/*
SUM:- *~
SUM:- *.bak
SUM:- *.lock
SUM:- lost+found
SUM:  SET permissions devices numeric-ids stats xdev SUM:  UNSET checksum
init sparse whole-file zxfer SUM: SUM: SUM:  ACTION: rsync -vrltH --delete
-x --numeric-ids -pgo -D --stats
--exclude-from=/media/bkup1/salmo-data1/20231124-0030/exclude
--link-dest=/media/bkup1/salmo-data1/20231122-0030/tree /data1/
/media/bkup1/salmo-data1/20231124-0030/tree
SUM:  Backup-begin: 2023-11-24 00:31:13

=
Rsync-Errors (/media/bkup1/salmo-data1/20231124-0030/tree/../rsync_error):
=
RSYNC_ERR: RSYNC_ERR: RSYNC_ERR:*** Execution cycle 0 ***
RSYNC_ERR: RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/2012_bass_baseline.csv": Input/output
error
(5)
RSYNC_ERR:WARNING:
willamette-river/data/biota/2012_bass_baseline.csv
failed verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/2012_pcbs.csv": Input/output error (5)
RSYNC_ERR:WARNING: willamette-river/data/biota/2012_pcbs.csv failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/biota/pdx-cyanobact.csv": Input/output error
(5)
RSYNC_ERR:WARNING: willamette-river/data/biota/pdx-cyanobact.csv
failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/geochem/pdx-chl-a.csv": Input/output error (5)
RSYNC_ERR:WARNING: willamette-river/data/geochem/pdx-chl-a.csv
failed
verification -- update discarded (will try again).
RSYNC_ERR:rsync: [sender] read errors mapping
"/data1/willamette-river/data/geochem/pdx-dom.csv": Input/output error (5)
...

There are no changes to these files other than their presence in the new
location. File sizes are the same in the source directories.

The destination partition has available 85% of its capacity.

How do I find why these errors occur?

TIA,

Rich