Re: Intel RST driver -> SSD bug ?
On 10/24/20, David Christensen wrote: > On 2020-10-24 09:56, A. Kapetanovic wrote: >> David Christensen writes: >>> Do you own the four books I previously recommended? > >> Have please someone a advice for me ? > > Buy, read, enter all or part of the examples, and solve all or part of > the exercises in "Learning Perl". The more examples and exercises you > work on, the more you will learn. > > > Find and join a community of Perl programmers. Researching for signs of any Perl Mongers groups near one's location might help. What I've seen of them over a LONG period of time is that they can be a very supportive group. That does depend on the combined personality of each singular group, though. https://www.pm.org/ There's also Perlweekly: https://perlweekly.com/ A quick peek at their archives there might land a website lead that allows for asking Perl-based questions. For either source, Users do have to have at least tried to work through things on their own via online tutorials and books such as those David has suggested. Having said that: Maybe some creative searching using the word "beginner" and Perl lists might land something handy, too. In that case, it's not about the "beginner" aspect. It's about finding a place that dedicates itself to breaking things down to the absolute bottom base step upon which ALL the rest is then built. Cindy :) -- Cindy-Sue Causey Talking Rock, Pickens County, Georgia, USA * runs with birdseed *
Re: Intel RST driver -> SSD bug ?
On 2020-10-24 09:56, A. Kapetanovic wrote: David Christensen writes: Do you own the four books I previously recommended? Have please someone a advice for me ? Buy, read, enter all or part of the examples, and solve all or part of the exercises in "Learning Perl". The more examples and exercises you work on, the more you will learn. Find and join a community of Perl programmers. david
Re: Intel RST driver -> SSD bug ?
David Christensen writes: Do you own the four books I previously recommended? I wrote their names on a postit, for the moment. I will begin by looking on Test::Most Thanks lot for these information. Have you considered hiring a tutor or consultant? I want absolutely do this script myself. Please condense your script down to a short example that demonstrates the bug, post your code, explain what you expect the code to do, post a sample run, explain what happened, and explain why what happened does not match your expectations. I have found the reason of sometimes : amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl 2020-01-01 - 2020-08-31 And sometimes : amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. Is is simply the effect of the mixture of : 1. The keys of a hash given by keys() function come in different order (in different executions of a program). 2. I did a mistake : 'last' but should be 'next' in the loop on the keys above. But the questions of the SSD is always here, I really would like a "true" diagnostic. I did smartctl -x But the result is instantaneous : # smartctl -x /dev/nvme0n1p5 smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-52-generic] (local build) Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Number: SAMSUNG MZVLQ512HALU-0 Serial Number: S4Y4NF0N221020 Firmware Version: FXV7000Q PCI Vendor/Subsystem ID:0x144d IEEE OUI Identifier:0x002538 Total NVM Capacity: 512’110’190’592 [512 GB] Unallocated NVM Capacity: 0 Controller ID: 5 Number of Namespaces: 1 Namespace 1 Size/Capacity: 512’110’190’592 [512 GB] Namespace 1 Utilization:171’792’056’320 [171 GB] Namespace 1 Formatted LBA Size: 512 Namespace 1 IEEE EUI-64:002538 a201b2a36d Local Time is: Sat Oct 24 18:52:07 2020 CEST Firmware Updates (0x16):3 Slots, no Reset required Optional Admin Commands (0x0017): Security Format Frmw_DL Self_Test Optional NVM Commands (0x005f): Comp Wr_Unc DS_Mngmt Wr_Zero Sav/Sel_Feat Timestmp Maximum Data Transfer Size: 512 Pages Warning Comp. Temp. Threshold: 82 Celsius Critical Comp. Temp. Threshold: 85 Celsius Supported Power States St Op Max Active Idle RL RT WL WT Ent_Lat Ex_Lat 0 + 4.83W --0 0 0 00 0 1 + 3.54W --1 1 1 10 0 2 + 3.04W --2 2 2 20 500 3 - 0.0500W --3 3 3 3 2101200 4 - 0.0050W --4 4 4 4 10009000 Supported LBA Sizes (NSID 0x1) Id Fmt Data Metadt Rel_Perf 0 + 512 0 0 === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature:12 Celsius Available Spare:100% Available Spare Threshold: 10% Percentage Used:0% Data Units Read:1’960’412 [1.00 TB] Data Units Written: 2’023’052 [1.03 TB] Host Read Commands: 16’052’101 Host Write Commands:27’571’627 Controller Busy Time: 704 Power Cycles: 187 Power On Hours: 74 Unsafe Shutdowns: 31 Media and Data Integrity Errors:0 Error Information Log Entries: 74 Warning Comp. Temperature Time:0 Critical Comp. Temperature Time:0 Temperature Sensor 1: 12 Celsius Error Information (NVMe Log 0x01, max 64 entries) No Errors Logged # df Sys. de fichiers blocs de 1K Utilisé Disponible Uti% Monté sur udev 8055688 08055688 0% /dev tmpfs1619780 20321617748 1% /run /dev/nvme0n1p5 224554636 108702560 104375648 52% / tmpfs80988842986367800248 4% /dev/shm tmpfs 5120 4 5116 1% /run/lock tmpfs8098884 08098884 0% /sys/fs/cgroup /dev/loop1 56704 56704 0 100% /snap/core18/1885 /dev/loop3261760261760 0 100% /snap/gnome-3-34-1804/36 /dev/loop2166784166784 0 100% /snap/gnome-3-28-1804/145 /dev/loop4223232223232 0 100% /snap/gnome-3-34-1804/60 /dev/loop0 56320 56320 0 100% /snap/core18/1880 /dev/loop5 51968 51968 0 100% /snap/snap-store/481 /dev/loop6 63616 63616 0 100% /snap/gtk-common- themes/1506 /dev/loop7 31744 31744 0 100%
Re: Intel RST driver -> SSD bug ?
On 2020-10-22 21:48, A. Kapetanovic wrote: 23 oct. 2020 04:27:38 David Christensen : Who wrote algo- B1.pl? Who designed the database? Are they for a personal project, for a business, or something else? I designed all and it is for a personal business Okay. Do you own the four books I previously recommended? Have you considered hiring a tutor or consultant? On 2020-10-22 22:06, A. Kapetanovic wrote: >> Then the problem is the Perl script and/or how the Perl script interacts with your database. > > But a function vanished from my file... Does the source code of your script change when you run the script? If so, is this by design? Please condense your script down to a short example that demonstrates the bug, post your code, explain what you expect the code to do, post a sample run, explain what happened, and explain why what happened does not match your expectations. David
Re: Intel RST driver -> SSD bug ?
> Then the problem is the Perl script and/or how the Perl script interacts with > your database. But a function vanished from my file... Amer
Re: Intel RST driver -> SSD bug ?
23 oct. 2020 04:27:38 David Christensen : > Who wrote algo- B1.pl? Who designed the database? Are they for a personal > project, for a business, or something else? I designed all and it is for a personal business
Re: Intel RST driver -> SSD bug ?
On 2020-10-22 03:01, A. Kapetanovic wrote: One second please, I have discovered something else : the problem is the same on a external HDD USB drive. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. We knows that algo-B1.pl uses a PG database on the SDD, but lisblocage function was in the algo-B1.pl file. So I wonder if this new information changes all ? It seems to me. Otherwise, I will run smartctl, etc... Thanks :) Amer Then the problem is the Perl script and/or how the Perl script interacts with your database. Who wrote algo- B1.pl? Who designed the database? Are they for a personal project, for a business, or something else? David
Re: Intel RST driver -> SSD bug ?
One second please, I have discovered something else : the problem is the same on a external HDD USB drive. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo- B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. We knows that algo-B1.pl uses a PG database on the SDD, but lisblocage function was in the algo-B1.pl file. So I wonder if this new information changes all ? It seems to me. Otherwise, I will run smartctl, etc... Thanks :) Amer
Re: Intel RST driver -> SSD bug ?
Alexander V. Makartsev writes: Could you tell us exact model of your laptop? ASUS VivoBook 15 X512JA What type of filesystem do you use? ext4 Is it possible dataloss was a consequence for unexpected laptop freeze or shutdown or power loss or failed sleep\hibernation? I never note such a thing. I've looked up your SSD on Samsung web site and it appears to be EoL already. As usual ASUS build their ultra modern laptops from outdated previous gen scrap parts. I never thought that before for ASUS, it's an important information for me. What should have have bought ? Lenovo ? Something else ? Thanks :) Amer
Re: Intel RST driver -> SSD bug ?
On 2020-10-21 10:21, A. Kapetanovic wrote: David Christensen writes: Intel hardware RAID is best supported on Windows -- install a driver that includes an administration GUI, and you can see what the hardware is doing. I used smartctl, short and long test. Both seems to be OK (the shell is at the end of this message), but one strange thing : both test are finished quite at the same I run them. 'smartctl -t ...' starts a test in the background. Short tests can take seconds or minutes to complete, depending upon the drive. Long tests can take minutes or hours. Monitor progress with 'smartctl -x ...' (I prefer '-x' rather than '-a'). See below. I will look for a driver that includes an administration GUI, I have no knowledge about. I meant that Intel provides RAID drivers and tools for Windows: https://downloadcenter.intel.com/product/55005/Intel-Rapid-Storage-Technology-Intel-RST- Intel supports Linux through open-source software: https://software.intel.com/content/www/us/en/develop/topics/open-source.html I now use ZFS exclusively for RAID. This means I need to set the disk drive mode to AHCI in the motherboard firmware. Can this filesystem help me ? Yes, but ZFS is not supported OOTB on Debian. Given a single 512 GB SSD, I would use the Debian installer and put Debian into the first ~14 GB using ext4. Once the system is up, I would install the ZFS packages: zfs-dkms zfsutils-linux Then, create a partition using the rest of the SSD. Then, create a ZFS pool using that partition with the options: -O compress=lz4 -O atime=off -O copies=2 Now you can add ZFS filesystems and/or volumes as desired, such as for /home or for PostGreSQL. Are parts of your Perl program disappearing? If so, describe the steps required to reproduce the bug and view the effects. Look this shell : amel@laptopasus:~/fp/test.algoB$ perl -c algo-B1.pl algo-B1.pl syntax OK amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl 2020-01-01 - 2020-08-31 amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161. I didn't change anything in algo-B1.pl between these shells. Some hours before that, I had the same problem : a function of algo-B1.pl vanished, I'm not sure, It is very possible it's the same. Are parts of a file accessed by your Perl program disappearing? If so, describe the steps required to reproduce the bug and view the effects. This program access a postgresql database, impossible for me to say something, the main table has millions of records, the little tables are ok. We cannot comment unless you post an example script and/or database that demonstrates the bug. Do you have a test suite for your Perl program? https://www.perl.org/about/whitepapers/perl-testing.html Create a test script that elicits the bug. Then, move your Perl program and test script to another machine without RST and run the test script. That should tell you if you have an issue with your Perl program or an issue with RST. I will take a look of perl-testing.html ; bu there, I have only my laptop... Test-driven development is a software engineering process. You can use any computer. A new Asus laptop with an NVMe drive, Debian, and Perl should work very well: https://en.wikipedia.org/wiki/Test-driven_development "Intermediate Perl" explains modules, distributions, testing, and other useful subjects: https://www.oreilly.com/library/view/intermediate-perl/0596102062/ If you are serious about Perl, you will want these books: https://www.oreilly.com/library/view/learning-perl-7th/9781491954317/ https://www.oreilly.com/library/view/perl-cookbook-2nd/0596003137/ https://www.oreilly.com/library/view/programming-perl-4th/9781449321451/ # smartctl -t short -a /dev/nvme0n1p5 SMART overall-health self-assessment test result: PASSED This is the result of whatever test smartctl ran previously. # smartctl -t long -a /dev/nvme0n1p5 SMART overall-health self-assessment test result: PASSED This is the result of the smartctl 'short' test, started above. Run 'smartctl -x /dev/nvme0n1p5' to see the result of the 'long' test. David
Re: Intel RST driver -> SSD bug ?
On 21.10.2020 22:21, A. Kapetanovic wrote: > David Christensen writes: >> >> If you think your SSD is dying, backup your data and be sure to >> preserve old backups. > > That's done. My laptop is quite new (2 months old), Asus. > Could you tell us exact model of your laptop? What type of filesystem do you use? Is it possible dataloss was a consequence for unexpected laptop freeze or shutdown or power loss or failed sleep\hibernation? I've looked up your SSD on Samsung web site and it appears to be EoL already. As usual ASUS build their ultra modern laptops from outdated previous gen scrap parts. And of course Samsung being all hush-hush about exact specifications for their SSD products, not even telling NAND type. You can try to search ASUS support web site for a possible firmware update for your SSD. Not so long ago, SSDs with poorly written\tested firmwares had similar symptoms like partial data loss or worse. There is a quite recent firmware update for your SSD (PM991), but from Dell [1] and from Lenovo [2]. I'm not really sure if it will install on ASUS product, but even its existence is a good sign. [1] https://www.dell.com/support/home/en-ca/drivers/driversdetails?driverid=7mm5c=rt [2] https://pcsupport.lenovo.com/us/en/downloads/ds119265 -- With kindest regards, Alexander. ⢀⣴⠾⠻⢶⣦⠀ ⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system ⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org ⠈⠳⣄
Re: Intel RST driver -> SSD bug ?
On 2020-10-20 12:58, A. Kapetanovic wrote: Hi, I have a problem with my laptop, it looks like a SSD bug : some parts in a file vanishes (a function in a perl program). I have an asus laptop which uses intel RST technology (Rapid Storage Technology), and I wonder if the problem can come from that. Does someone have an unlucky experience with RST please ? If you think your SSD is dying, backup your data and be sure to preserve old backups. Intel hardware RAID is best supported on Windows -- install a driver that includes an administration GUI, and you can see what the hardware is doing. I now use ZFS exclusively for RAID. This means I need to set the disk drive mode to AHCI in the motherboard firmware. Are parts of your Perl program disappearing? If so, describe the steps required to reproduce the bug and view the effects. Are parts of a file accessed by your Perl program disappearing? If so, describe the steps required to reproduce the bug and view the effects. Do you have a test suite for your Perl program? https://www.perl.org/about/whitepapers/perl-testing.html Create a test script that elicits the bug. Then, move your Perl program and test script to another machine without RST and run the test script. That should tell you if you have an issue with your Perl program or an issue with RST. David