[DNG] data reliability (was: Home server replacement hardware suggestions?)

2018-07-09 Thread spiralofhope
On Sun, 8 Jul 2018 05:09:36 +0200
Adam Borowski  wrote:

> Do not use the words "USB" and "disk" together, please -- in any
> context that involves basic reliability, and, especially, not
> corrupting data.

I understand there are problems with USB sticks, but what's wrong with
that connection for a drive?  (assuming cabling won't get kicked out)

I've had the problem of file corruption on my mind for some time, and
the only solution I've come across is btrfs, and that had some
nightmarish issues for me, so I've moved away from it.  I'm still
wondering if an encryption partition also a mechanism to help mitigate
file corruption issues, but I haven't looked into that.

zfs needs fuse on Linux, and ext checksumming doesn't exist (though I
heard a rumour of encryption support so who knows about the future)

Beyond a checksumming filesystem would be backups which keep diffs, but
that requires auditing every file with every backup to check for
corruption, or keeping many many backups to restore from very early
revisions before a corruption.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng


Re: [DNG] data reliability (was: Home server replacement hardware suggestions?)

2018-07-14 Thread spiralofhope
On Sat, 7 Jul 2018 20:56:46 -0700
spiralofhope  wrote:

> I understand there are problems with USB sticks, but what's wrong with
> that connection for a drive?  (assuming cabling won't get kicked
> out)  

This isn't Devuan-related, but as I had been given a flat dictate I did
some research and hoped to bend an ear on this.  What I can tell these
are the main issues:

- Storage reliability
- Storage temperature
  (e.g. sustained-usage storage is not properly cooled and will cook)
- Temperature of the USB area itself
- Frail cabling or seating of the device
- Device removal without unmounting/ejecting
- Device removal while the device/area is hot

So for a low-quality server, it seems to me that this is the chain:

computer -> usb 3.1 -> drive (dock)

The only problems I would have with this are:

- Temperature of the USB area on the computer
- eSata adapter or USB dock trustworthiness
- Hard drive cooling
  (Is a passively-cooled vertical drive okay?)

Am I missing something?  With backups, I'd be fine with the above risks.

Also, I reproduced a heat issue with the worst offender and worst
conditions I could manage.. a shit usb 2.0 key in a 3.1 port situated
above a battery.  Heat issues were solved using either a cable or a
hub.  I can only guess why that worked..


--


An M.2 to SATA hack was mentioned, but basic searching for a simple
conversion method came up dry.  I'll keep that in mind for when I
retire my low-end laptop and convert it into a torrent box.
___
Dng mailing list
Dng@lists.dyne.org
https://mailinglists.dyne.org/cgi-bin/mailman/listinfo/dng