Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi David, On Tue, 29 May 2012, David Burgess wrote: > That said, I purchased a 128GB Petrol to upgrade a client's laptop. > Less than a week later the thing had secure-erased itself. I wasn't > too bothered by it, after all, some percentage of anything is going to > fail at some point, and I'm not one to judge a brand by a single > failure. This all changed though when I went looking at the reviews of > this particular drive. Seems I'm not the only one. > > http://www.newegg.ca/Product/ProductList.aspx?Submit=ENE&DEPA=0&Order=BESTMATCH&N=16551&isNodeId=1&Description=ocz+petrol&x=12&y=11 > > I have continued to purchase and be satisfied with the OCZ SSDs, but I > will not touch another Petrol until this issue is acknowledged and > fixed. Thanks for letting me know about that. When I finally figured out how to access the reviews on NewEgg, I found there are a LOT of them (106 reviews) for this drive, mostly negative. I know there is a negative bias in online reviews generally, but this feedback is way more negative than I would expect. Looks like the Petrol was a bad choice. Cheers, Chris. -- Aptivate | http://www.aptivate.org | Phone: +44 1223 967 838 Future Business, Cam City FC, Milton Rd, Cambridge, CB4 1UY, UK Aptivate is a not-for-profit company registered in England and Wales with company number 04980791. ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi Chris, On Tue, 29 May 2012, Chris Cappuccio wrote: > The drive wasn't responding. It's likely to be the drive itself, not > some failure on the controller or magic in the wire. SSDs are not the > ultra-reliable machines they're made out to be, in my experience. The > firmware probably crashed. And if that's what happened, it'll happen > again under certain conditions -- that is until you get an update that > breaks the firmware in some new and bizarre way. Thanks for that. I'm coming round to the idea that the drive is at fault. But a drive crash doesn't explain the data corruption and I/O errors that I saw before it crashed, and can still reproduce. I take it that nobody else has seen problems with drives misbehaving on the net6501 that worked fine in other machines? Cheers, Chris. -- Aptivate | http://www.aptivate.org | Phone: +44 1223 967 838 Future Business, Cam City FC, Milton Rd, Cambridge, CB4 1UY, UK Aptivate is a not-for-profit company registered in England and Wales with company number 04980791. ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
On Tue, May 29, 2012 at 10:41 AM, Chris Wilson wrote: > I'm testing my first net6501 with an OCZ Petrol SSD. Everything seemed OK, got > the OS installed, then I started getting checksum mismatches from rsync, then > I/O errors, and then the drive stopped working completely. I've used and deployed dozens of SSDs, the vast majority of them OCZ. In fact, the first SSD I ever bought was a Vertex 30GB, and it still lives today in a netbook, after doing the rounds in two or three other computers. OCZ SSDs are the best value proposition in consumer SSDs on the market in my estimation. That said, I purchased a 128GB Petrol to upgrade a client's laptop. Less than a week later the thing had secure-erased itself. I wasn't too bothered by it, after all, some percentage of anything is going to fail at some point, and I'm not one to judge a brand by a single failure. This all changed though when I went looking at the reviews of this particular drive. Seems I'm not the only one. http://www.newegg.ca/Product/ProductList.aspx?Submit=ENE&DEPA=0&Order=BESTMATCH&N=16551&isNodeId=1&Description=ocz+petrol&x=12&y=11 I have continued to purchase and be satisfied with the OCZ SSDs, but I will not touch another Petrol until this issue is acknowledged and fixed. db ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
On Wed, 30 May 2012 11:49:29 +0100 (BST), Chris Wilson wrote: > Thanks for that data point. What exact kernel are you running? Chris, I am using the the (almost) stock Debian Wheezy kernel which is Linux 3.2 I say 'almost', because I have to recompile to get pch_uart tty driver out of the way, otherwise the 2nd serial port won't work, but apart from that it is vanilla Debian. Latest Debian Wheezy is based on upstream Linux 3.2.17, I am a bit behind and still on 3.2.4... Regards, -- Philippe ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi Philippe, On Tue, 29 May 2012, Philippe Vanhaesendonck wrote: > This probably does not help too much, but FYI I am running Debian Wheezy > on my net6501 with an OCZ Vertex-3 SSD, and no problem encountered so > far... Thanks for that data point. What exact kernel are you running? Cheers, Chris. -- Aptivate | http://www.aptivate.org | Phone: +44 1223 967 838 Future Business, Cam City FC, Milton Rd, Cambridge, CB4 1UY, UK Aptivate is a not-for-profit company registered in England and Wales with company number 04980791. ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi Bob, On Tue, 29 May 2012, Bob Bishop wrote: > On 29 May 2012, at 17:41, Chris Wilson wrote: > >> [...]So I suspect there's nothing wrong with the drive; it may be a firmware >> bug, >> but I was unable to apply firmware fixes using OCZ's updater for Linux. [etc] > > You are running the latest firmware (3.12) so it's not that. Thanks for confirming that. It's not at all clear from the OCZ website what the latest firmware actually is. The Linux firmware updater is confusingly called ocz_tools_316.zip, which made me suspect that there might be a firmware version 3.16. Cheers, Chris. -- Aptivate | http://www.aptivate.org | Phone: +44 1223 967 838 Future Business, Cam City FC, Milton Rd, Cambridge, CB4 1UY, UK Aptivate is a not-for-profit company registered in England and Wales with company number 04980791. ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Chris Wilson [chris-soek...@aptivate.org] wrote: > > But after a power off (not just a hard reset) the drive is fine again! > > Some people are seeing issues with Debian kernels (like this one) and > multiple > drives appearing to fail at the same time, but working fine after a reboot: > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=625922 > > So I suspect there's nothing wrong with the drive; it may be a firmware bug, > but I was unable to apply firmware fixes using OCZ's updater for Linux. Has > anyone seen anything like this? Anyone got a sense for whether it could be a > hardware bug with the AHCI controller or BIOS on the net6501? > The drive wasn't responding. It's likely to be the drive itself, not some failure on the controller or magic in the wire. SSDs are not the ultra-reliable machines they're made out to be, in my experience. The firmware probably crashed. And if that's what happened, it'll happen again under certain conditions -- that is until you get an update that breaks the firmware in some new and bizarre way. ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
As a matter of general troubleshooting, I'd recommend trying the drive in a
PC (or other machine) running Linux, trying the same thing with a different
hard drive with the Soekris board, and swapping out cables with new in both
scenarios... with those errors, seems likely that the drive controller is
fried, the bus controller is fried, or the cable is bad, and these tests
should isolate it... Good luck.
Regards,
Stephen J Alexander
MPBX, LLC
http://mpbx.com
832-713-6729
On Tue, May 29, 2012 at 11:41 AM, Chris Wilson
wrote:
> Hi all,
>
> I'm testing my first net6501 with an OCZ Petrol SSD. Everything seemed OK,
> got
> the OS installed, then I started getting checksum mismatches from rsync,
> then
> I/O errors, and then the drive stopped working completely.
>
> The rsync errors started like this:
> + rsync -avP --delete --exclude /dev --exclude /proc --exclude /sys
> --exclude
> /tmp --exclude /var/tmp --exclude /var/log --exclude /var/run --exclude
> /var/lib/postfix 10.0.156.222::root/ /mnt/target/
>
> media/hdb1/system-imager/image/usr/lib/locale/en_CA.utf8/LC_TIMEWARNING:
> media/hdb1/system-imager/image/usr/lib/locale/en_IE.utf8/LC_CTYPE failed
> verification -- update discarded (will try again).
> WARNING: media/hdb1/system-imager/image/usr/lib/locale/en_NZ.utf8/LC_CTYPE
> failed verification -- update discarded (will try again).
> WARNING: media/hdb1/system-imager/image/usr/lib/locale/en_PH.utf8/LC_CTYPE
> failed verification -- update discarded (will try again).
>
> Nothing in dmesg at this point. Then it went like this:
>
> rsync:
>
> readlink_stat("/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/16/application-vnd.ms-powerpoint.svg")
> failed: Input/output error (5)
> rsync: recv_generator: failed to stat
>
> "/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/16/application-vnd.ms-powerpoint.svg":
> Input/output error (5)
> rsync: symlink
>
> "/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/48/application-x-tar.svg"
> -> "tar.svg" failed: Input/output error (5)
>
> I checked the drive for hardware errors using smartctl, and it status
> seemed
> good:
>
> root@system-imager:~# smartctl -a /dev/sda
> smartctl 5.40 2010-07-12 r3124 [i686-pc-linux-gnu] (local build)
> Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net
>
> === START OF INFORMATION SECTION ===
> Device Model: OCZ-PETROL
> Serial Number:OCZ-25G7LV2577Z5OGG8
> Firmware Version: 3.12
> User Capacity:128,035,676,160 bytes
> Device is:Not in smartctl database [for details use: -P showall]
> ATA Version is: 8
> ATA Standard is: Exact ATA specification draft version not indicated
> Local Time is:Wed Jan 2 05:47:24 1980 GMT
> SMART support is: Available - device has SMART capability.
> SMART support is: Enabled
>
> === START OF READ SMART DATA SECTION ===
> SMART overall-health self-assessment test result: PASSED
>
> General SMART Values:
> Offline data collection status: (0x00) Offline data collection activity
>was never started.
>Auto Offline Data Collection:
> Disabled.
> Self-test execution status: ( 249) Self-test routine in progress...
>90% of test remaining.
> Total time to complete Offline
> data collection: ( 0) seconds.
> Offline data collection
> capabilities:(0x1d) SMART execute Offline immediate.
>No Auto Offline data collection
> support.
>Abort Offline collection upon new
>command.
>Offline surface scan supported.
>Self-test supported.
>No Conveyance Self-test supported.
>No Selective Self-test supported.
> SMART capabilities:(0x0003) Saves SMART data before entering
>power-saving mode.
>Supports SMART auto save timer.
> Error logging capability:(0x00) Error logging supported.
>General Purpose Logging supported.
> Short self-test routine
> recommended polling time:( 0) minutes.
> Extended self-test routine
> recommended polling time:( 0) minutes.
>
> SMART Attributes Data Structure revision number: 18
> Vendor Specific SMART Attributes with Thresholds:
> ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED
> WHEN_FAILED RAW_VALUE
> 1 Raw_Read_Error_Rate 0x 006 000 000Old_age Offline -
> 6
> 3 Spin_Up_Time0x 100 100 000Old_age Offline -
> 0
> 4 Start_Stop_Count0x 100 100 000Old_age Offline -
> 0
> 5 Reallocat
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi, On 29 May 2012, at 17:41, Chris Wilson wrote: > [...]So I suspect there's nothing wrong with the drive; it may be a firmware > bug, > but I was unable to apply firmware fixes using OCZ's updater for Linux. [etc] You are running the latest firmware (3.12) so it's not that. -- Bob Bishop r...@gid.co.uk ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
Re: [Soekris] net6501, Linux, SSD/kernel/hardware failure?
This probably does not help too much, but FYI I am running Debian Wheezy on my net6501 with an OCZ Vertex-3 SSD, and no problem encountered so far... -- Philippe On 29/05/12 18:41, Chris Wilson wrote: > Hi all, > > I'm testing my first net6501 with an OCZ Petrol SSD. Everything seemed OK, got > the OS installed, then I started getting checksum mismatches from rsync, then > I/O errors, and then the drive stopped working completely. > > ___ Soekris-tech mailing list Soekris-tech@lists.soekris.com http://lists.soekris.com/mailman/listinfo/soekris-tech
[Soekris] net6501, Linux, SSD/kernel/hardware failure?
Hi all,
I'm testing my first net6501 with an OCZ Petrol SSD. Everything seemed OK, got
the OS installed, then I started getting checksum mismatches from rsync, then
I/O errors, and then the drive stopped working completely.
The rsync errors started like this:
+ rsync -avP --delete --exclude /dev --exclude /proc --exclude /sys --exclude
/tmp --exclude /var/tmp --exclude /var/log --exclude /var/run --exclude
/var/lib/postfix 10.0.156.222::root/ /mnt/target/
media/hdb1/system-imager/image/usr/lib/locale/en_CA.utf8/LC_TIMEWARNING:
media/hdb1/system-imager/image/usr/lib/locale/en_IE.utf8/LC_CTYPE failed
verification -- update discarded (will try again).
WARNING: media/hdb1/system-imager/image/usr/lib/locale/en_NZ.utf8/LC_CTYPE
failed verification -- update discarded (will try again).
WARNING: media/hdb1/system-imager/image/usr/lib/locale/en_PH.utf8/LC_CTYPE
failed verification -- update discarded (will try again).
Nothing in dmesg at this point. Then it went like this:
rsync:
readlink_stat("/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/16/application-vnd.ms-powerpoint.svg")
failed: Input/output error (5)
rsync: recv_generator: failed to stat
"/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/16/application-vnd.ms-powerpoint.svg":
Input/output error (5)
rsync: symlink
"/mnt/target/media/hdb1/system-imager/image/usr/share/icons/Humanity/mimes/48/application-x-tar.svg"
-> "tar.svg" failed: Input/output error (5)
I checked the drive for hardware errors using smartctl, and it status seemed
good:
root@system-imager:~# smartctl -a /dev/sda
smartctl 5.40 2010-07-12 r3124 [i686-pc-linux-gnu] (local build)
Copyright (C) 2002-10 by Bruce Allen, http://smartmontools.sourceforge.net
=== START OF INFORMATION SECTION ===
Device Model: OCZ-PETROL
Serial Number:OCZ-25G7LV2577Z5OGG8
Firmware Version: 3.12
User Capacity:128,035,676,160 bytes
Device is:Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: Exact ATA specification draft version not indicated
Local Time is:Wed Jan 2 05:47:24 1980 GMT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 249) Self-test routine in progress...
90% of test remaining.
Total time to complete Offline
data collection: ( 0) seconds.
Offline data collection
capabilities:(0x1d) SMART execute Offline immediate.
No Auto Offline data collection
support.
Abort Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
No Selective Self-test supported.
SMART capabilities:(0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:(0x00) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time:( 0) minutes.
Extended self-test routine
recommended polling time:( 0) minutes.
SMART Attributes Data Structure revision number: 18
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED
WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x 006 000 000Old_age Offline -
6
3 Spin_Up_Time0x 100 100 000Old_age Offline -
0
4 Start_Stop_Count0x 100 100 000Old_age Offline -
0
5 Reallocated_Sector_Ct 0x 100 100 000Old_age Offline -
0
9 Power_On_Hours 0x 100 100 000Old_age Offline -
5
12 Power_Cycle_Count 0x 100 100 000Old_age Offline -
8
232 Available_Reservd_Space 0x 100 100 000Old_age Offline -
160
233 Media_Wearout_Indicator 0x 100 000 000Old_age Offline -
100
SMART Error Log Version: 0
No Errors Logged
So I thought "filesystem corruption", and tried to unmount the drive for a
fsck, which took forever, and then I started seeing errors in the system logs:
[15179.138794] ata1.00: exception Emask 0x0 SAct 0x1 SErr 0x0 action 0x6 frozen
[15179.142753
