Thanks for: F17: trying to diagnose problem with external USB drive
On Wed, Jul 18, 2012 22:39:16 PM -0500, Mikkel L. Ellertson wrote: > If you are trying to put 110 GB on a 128 GB drive, you are probably > running out of room. Run "df -h" when the drive is mounted, and see > how much space the drive has after things like the space used by > formatting the drive, and possible differences in how 1 GB is > figured are taken into account. sorry, I forgot to answer this! I have not checked yet (haven't had that drive with me in the last weeks, that's why), but thinking to what kind of files were being transferred, you're very likely right, and I just need a bigger drive. Thanks to everybody who helped! Marco -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
Re: F17: trying to diagnose problem with external USB drive
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/18/2012 02:18 PM, M. Fioretti wrote: > On Wed, Jul 18, 2012 07:54:15 AM -0400, G.Wolfe Woodbury wrote: >> On 07/18/2012 08:03 AM, M. Fioretti wrote: >>> rsync -rpvt --delete /photo/ /media/LACIE/photo >>> >>> the drives ALWAYS becomes read-only at some point, thus making rsync fail >>> >>> dmesg says (complete output below) that: >>> >>> [625087.410234] FAT-fs (sdb1): error, fat_free_clusters: deleting FAT entry beyond EOF >>> [625087.410239] FAT-fs (sdb1): Filesystem has been set read-only >>> >> Looks to me like there are too many files for the sinple FAT16 >> directory structure on the device. > > I understand what you say, but: > > the folder that I am backing up contains <25k files total, in lots of > folders and subfolders, and afaik the max number of files for vfat > (both 16 and 32) is well above that number > > above all, I was doing this backup on two different USB external > drives of different size (500 and 128 GB), both with enough space to > host that folder (which is ~110 GB) and both vfat. But there was no > problem with the bigger drive. > > If the number of files is the problem, why would it happen only on the > smallest drive? Simply because it is smaller, e.g. with less blocks, > even if the number of files is well below the vfat maximum? > > Thanks, > Marco > > > If you are trying to put 110 GB on a 128 GB drive, you are probably running out of room. Run "df -h" when the drive is mounted, and see how much space the drive has after things like the space used by formatting the drive, and possible differences in how 1 GB is figured are taken into account. Then there is all the wasted space on files that are not exact multiples of the allocation size. Remember, a 2 byte file still uses up one allocation block. So does a directory. Depending on the file system, you can run out of allocation units before running out of disk space. The fact that it is VFAT does not tell you anything about the underlying file system. VFAT is a way to use long file names on a FAT file system. It can be any size FAT file system. The underlying file system determines how many files you can have, and the allocation unit size. - From the error message, it looks like you are running out of allocation units. The system tried to allocate more FAT entries that there were on the drive. "deleting FAT entry beyond EOF" Just for fun, what does "fdisk -l " tell you about the file system? Mikkel - -- Do not meddle in the affairs of dragons, for thou art crunchy and taste good with Ketchup! -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.12 (GNU/Linux) iEYEARECAAYFAlAHgVsACgkQqbQrVW3JyMTLoACfWNuiV8YAgMmwH5zG10ZZqKn9 8yQAn3qZ1vGNbItiZx5BhFgoBdGY0BHL =kyBu -END PGP SIGNATURE- -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
Re: F17: trying to diagnose problem with external USB drive
On Wed, Jul 18, 2012 10:40:02 AM -0700, Joe Zeff wrote: > On 07/18/2012 12:18 PM, M. Fioretti wrote: > >the folder that I am backing up contains <25k files total, in lots of > >folders and subfolders, and afaik the max number of files for vfat > >(both 16 and 32) is well above that number > > How many of those files/folders are being put in the root directory > of the drive? none. the root directory only has very few subdirectories, like: photo documents software logs and almost all the files are photos, organized by date, something like: photo/2009 photo/2010 photo/2011 photo/2012/20120101 photo/2012/20120209 etc etc I am on a different pc right now so I cannot give exact numbers, but I don't think any directory has more than ~500 files and subdirectories in it. marco -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
Re: F17: trying to diagnose problem with external USB drive
On 07/18/2012 12:18 PM, M. Fioretti wrote: the folder that I am backing up contains <25k files total, in lots of folders and subfolders, and afaik the max number of files for vfat (both 16 and 32) is well above that number How many of those files/folders are being put in the root directory of the drive? I'm not sure about vfat, but I do know that on a FAT filesystem the root directory is limited to one cluster, limiting the number of files you can put there. Directories in subdirectories, however, are extendable as needed. (This is one reason Windows started putting all programs in C:\Program Files; every program wanted to create its own directory and this way you weren't going to run out of entries.) -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
Re: F17: trying to diagnose problem with external USB drive
On Wed, Jul 18, 2012 07:54:15 AM -0400, G.Wolfe Woodbury wrote: > On 07/18/2012 08:03 AM, M. Fioretti wrote: > >rsync -rpvt --delete /photo/ /media/LACIE/photo > > > >the drives ALWAYS becomes read-only at some point, thus making rsync fail > > > >dmesg says (complete output below) that: > > > >[625087.410234] FAT-fs (sdb1): error, fat_free_clusters: deleting FAT entry > >beyond EOF > >[625087.410239] FAT-fs (sdb1): Filesystem has been set read-only > > > Looks to me like there are too many files for the sinple FAT16 > directory structure on the device. I understand what you say, but: the folder that I am backing up contains <25k files total, in lots of folders and subfolders, and afaik the max number of files for vfat (both 16 and 32) is well above that number above all, I was doing this backup on two different USB external drives of different size (500 and 128 GB), both with enough space to host that folder (which is ~110 GB) and both vfat. But there was no problem with the bigger drive. If the number of files is the problem, why would it happen only on the smallest drive? Simply because it is smaller, e.g. with less blocks, even if the number of files is well below the vfat maximum? Thanks, Marco -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
Re: F17: trying to diagnose problem with external USB drive
On 07/18/2012 08:03 AM, M. Fioretti wrote: rsync -rpvt --delete /photo/ /media/LACIE/photo the drives ALWAYS becomes read-only at some point, thus making rsync fail dmesg says (complete output below) that: [625087.410234] FAT-fs (sdb1): error, fat_free_clusters: deleting FAT entry beyond EOF [625087.410239] FAT-fs (sdb1): Filesystem has been set read-only Looks to me like there are too many files for the sinple FAT16 directory structure on the device. -- redwolfe (proventesters) -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
F17: trying to diagnose problem with external USB drive
Greetings, I'm running F17 x86_64, and I have a problem with one of the external USB drives I use for backups. Changing _cable_ doesn't make any difference. The problem never happens with my other drives, so the most likely explanation is that this one is slowly breaking, and it is time to replace it. However, I'd like your opinion, to be 100% sure that this is the case, instead of some weird software issue, to understand exactly what is happening, and if/how the drive can be recovered. I formatted the drive with mkdosfs -F 32 /dev/sdb1 when I run commands like this (the MMDD directory contains several files not over 2GB each): cp -r -p /backups/20120717 /media/LACIE/backups nothing bad happens. But when I rsync my photo backup folder: rsync -rpvt --delete /photo/ /media/LACIE/photo the drives ALWAYS becomes read-only at some point, thus making rsync fail dmesg says (complete output below) that: [625087.410234] FAT-fs (sdb1): error, fat_free_clusters: deleting FAT entry beyond EOF [625087.410239] FAT-fs (sdb1): Filesystem has been set read-only So, is this surely an hw failure, or may it be something else? And why it always happens with rsync, but never with cp -r? Thanks, Marco [622009.923795] sd 13:0:0:0: [sdb] Attached SCSI disk [624919.873452] usb 2-2: USB disconnect, device number 10 [624974.082689] usb 2-2: new high-speed USB device number 11 using ehci_hcd [624974.199631] usb 2-2: New USB device found, idVendor=04b4, idProduct=6830 [624974.199635] usb 2-2: New USB device strings: Mfr=56, Product=72, SerialNumber=91 [624974.199638] usb 2-2: Product: Lacie Mobile Drive [624974.199640] usb 2-2: Manufacturer: Lacie Group. SA [624974.199642] usb 2-2: SerialNumber: DEF10DFCA811 [624974.351335] scsi14 : usb-storage 2-2:1.0 [624974.351433] usbcore: registered new interface driver ums-cypress [624975.354748] scsi 14:0:0:0: Direct-Access WDC WD12 00BEVE-11UYT0 PQ: 0 ANSI: 0 [624975.356027] sd 14:0:0:0: Attached scsi generic sg2 type 0 [624975.358354] sd 14:0:0:0: [sdb] 234441648 512-byte logical blocks: (120 GB/111 GiB) [624975.359350] sd 14:0:0:0: [sdb] Write Protect is off [624975.359355] sd 14:0:0:0: [sdb] Mode Sense: 27 00 00 00 [624975.360348] sd 14:0:0:0: [sdb] No Caching mode page present [624975.360353] sd 14:0:0:0: [sdb] Assuming drive cache: write through [624975.363849] sd 14:0:0:0: [sdb] No Caching mode page present [624975.363854] sd 14:0:0:0: [sdb] Assuming drive cache: write through [624975.413127] sdb: sdb1 [624975.416025] sd 14:0:0:0: [sdb] No Caching mode page present [624975.416030] sd 14:0:0:0: [sdb] Assuming drive cache: write through [624975.416033] sd 14:0:0:0: [sdb] Attached SCSI disk [625087.410234] FAT-fs (sdb1): error, fat_free_clusters: deleting FAT entry beyond EOF [625087.410239] FAT-fs (sdb1): Filesystem has been set read-only -- Your own civil rights and the quality of your life heavily depend on how software is used *around* you:http://digifreedom.net/node/84 -- users mailing list users@lists.fedoraproject.org To unsubscribe or change subscription options: https://admin.fedoraproject.org/mailman/listinfo/users Guidelines: http://fedoraproject.org/wiki/Mailing_list_guidelines Have a question? Ask away: http://ask.fedoraproject.org
