Re: Intel RST driver -> SSD bug ?

2020-10-24 Thread Cindy Sue Causey
On 10/24/20, David Christensen  wrote:
> On 2020-10-24 09:56, A. Kapetanovic wrote:
>> David Christensen writes:
>>> Do you own the four books I previously recommended?
> 
>> Have please someone a advice for me ?
>
> Buy, read, enter all or part of the examples, and solve all or part of
> the exercises in "Learning Perl".  The more examples and exercises you
> work on, the more you will learn.
>
>
> Find and join a community of Perl programmers.


Researching for signs of any Perl Mongers groups near one's location
might help. What I've seen of them over a LONG period of time is that
they can be a very supportive group. That does depend on the combined
personality of each singular group, though.

https://www.pm.org/

There's also Perlweekly:

https://perlweekly.com/

A quick peek at their archives there might land a website lead that
allows for asking Perl-based questions.

For either source, Users do have to have at least tried to work
through things on their own via online tutorials and books such as
those David has suggested.

Having said that: Maybe some creative searching using the word
"beginner" and Perl lists might land something handy, too. In that
case, it's not about the "beginner" aspect. It's about finding a place
that dedicates itself to breaking things down to the absolute bottom
base step upon which ALL the rest is then built.

Cindy :)
-- 
Cindy-Sue Causey
Talking Rock, Pickens County, Georgia, USA

* runs with birdseed *



Re: Intel RST driver -> SSD bug ?

2020-10-24 Thread David Christensen

On 2020-10-24 09:56, A. Kapetanovic wrote:

David Christensen writes:

Do you own the four books I previously recommended?



Have please someone a advice for me ?


Buy, read, enter all or part of the examples, and solve all or part of 
the exercises in "Learning Perl".  The more examples and exercises you 
work on, the more you will learn.



Find and join a community of Perl programmers.


david



Re: Intel RST driver -> SSD bug ?

2020-10-24 Thread A. Kapetanovic

David Christensen writes:

Do you own the four books I previously recommended?


I wrote their names on a postit, for the moment. I will begin by looking on  
Test::Most


Thanks lot for these information.


Have you considered hiring a tutor or consultant?


I want absolutely do this script myself.

Please condense your script down to a short example that demonstrates  
the bug, post your code, explain what you expect the code to do, post a  
sample run, explain what happened, and explain why what happened does  
not match your expectations.


I have found the reason of sometimes :
amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl
2020-01-01 - 2020-08-31

And sometimes :
amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl
Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.

Is is simply the effect of the mixture of :

1. The keys of a hash given by keys() function come in different order (in  
different executions of a program).
2. I did a mistake : 'last' but should be 'next' in the loop on the keys  
above.


But the questions of the SSD is always here, I really would like a "true"  
diagnostic.


I did

smartctl -x

But the result is instantaneous :

# smartctl -x /dev/nvme0n1p5
smartctl 7.1 2019-12-30 r5022 [x86_64-linux-5.4.0-52-generic] (local build)
Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Number:   SAMSUNG MZVLQ512HALU-0
Serial Number:  S4Y4NF0N221020
Firmware Version:   FXV7000Q
PCI Vendor/Subsystem ID:0x144d
IEEE OUI Identifier:0x002538
Total NVM Capacity: 512’110’190’592 [512 GB]
Unallocated NVM Capacity:   0
Controller ID:  5
Number of Namespaces:   1
Namespace 1 Size/Capacity:  512’110’190’592 [512 GB]
Namespace 1 Utilization:171’792’056’320 [171 GB]
Namespace 1 Formatted LBA Size: 512
Namespace 1 IEEE EUI-64:002538 a201b2a36d
Local Time is:  Sat Oct 24 18:52:07 2020 CEST
Firmware Updates (0x16):3 Slots, no Reset required
Optional Admin Commands (0x0017):   Security Format Frmw_DL Self_Test
Optional NVM Commands (0x005f): Comp Wr_Unc DS_Mngmt Wr_Zero  
Sav/Sel_Feat Timestmp

Maximum Data Transfer Size: 512 Pages
Warning  Comp. Temp. Threshold: 82 Celsius
Critical Comp. Temp. Threshold: 85 Celsius

Supported Power States
St Op Max   Active Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 + 4.83W   --0  0  0  00   0
 1 + 3.54W   --1  1  1  10   0
 2 + 3.04W   --2  2  2  20 500
 3 -   0.0500W   --3  3  3  3  2101200
 4 -   0.0050W   --4  4  4  4 10009000

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 + 512   0 0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02)
Critical Warning:   0x00
Temperature:12 Celsius
Available Spare:100%
Available Spare Threshold:  10%
Percentage Used:0%
Data Units Read:1’960’412 [1.00 TB]
Data Units Written: 2’023’052 [1.03 TB]
Host Read Commands: 16’052’101
Host Write Commands:27’571’627
Controller Busy Time:   704
Power Cycles:   187
Power On Hours: 74
Unsafe Shutdowns:   31
Media and Data Integrity Errors:0
Error Information Log Entries:  74
Warning  Comp. Temperature Time:0
Critical Comp. Temperature Time:0
Temperature Sensor 1:   12 Celsius

Error Information (NVMe Log 0x01, max 64 entries)
No Errors Logged

# df
Sys. de fichiers blocs de 1K   Utilisé Disponible Uti% Monté sur
udev 8055688 08055688   0% /dev
tmpfs1619780  20321617748   1% /run
/dev/nvme0n1p5 224554636 108702560  104375648  52% /
tmpfs80988842986367800248   4% /dev/shm
tmpfs   5120 4   5116   1% /run/lock
tmpfs8098884 08098884   0% /sys/fs/cgroup
/dev/loop1 56704 56704  0 100% /snap/core18/1885
/dev/loop3261760261760  0 100%  
/snap/gnome-3-34-1804/36
/dev/loop2166784166784  0 100%  
/snap/gnome-3-28-1804/145
/dev/loop4223232223232  0 100%  
/snap/gnome-3-34-1804/60

/dev/loop0 56320 56320  0 100% /snap/core18/1880
/dev/loop5 51968 51968  0 100% /snap/snap-store/481
/dev/loop6 63616 63616  0 100% /snap/gtk-common- 
themes/1506

/dev/loop7 31744 31744  0 100% 

Re: Intel RST driver -> SSD bug ?

2020-10-23 Thread David Christensen

On 2020-10-22 21:48, A. Kapetanovic wrote:

23 oct. 2020 04:27:38 David Christensen :

Who wrote algo- B1.pl?  Who designed the database?  Are they for a personal 
project, for a business, or something else?


I designed all and it is for a personal business


Okay.


Do you own the four books I previously recommended?


Have you considered hiring a tutor or consultant?


On 2020-10-22 22:06, A. Kapetanovic wrote:
>> Then the problem is the Perl script and/or how the Perl script 
interacts with your database.

>
> But a function vanished from my file...


Does the source code of your script change when you run the script?  If 
so, is this by design?



Please condense your script down to a short example that demonstrates 
the bug, post your code, explain what you expect the code to do, post a 
sample run, explain what happened, and explain why what happened does 
not match your expectations.



David



Re: Intel RST driver -> SSD bug ?

2020-10-22 Thread A. Kapetanovic
> Then the problem is the Perl script and/or how the Perl script interacts with 
> your database.

But a function vanished from my file...

Amer



Re: Intel RST driver -> SSD bug ?

2020-10-22 Thread A. Kapetanovic
23 oct. 2020 04:27:38 David Christensen :
> Who wrote algo- B1.pl?  Who designed the database?  Are they for a personal 
> project, for a business, or something else?

I designed all and it is for a personal business



Re: Intel RST driver -> SSD bug ?

2020-10-22 Thread David Christensen

On 2020-10-22 03:01, A. Kapetanovic wrote:
One second please, I have discovered something else : the problem is the 
same on a external HDD USB drive.


amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ 
./algo- B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.

We knows that algo-B1.pl uses a PG database on the SDD, but lisblocage 
function was in the algo-B1.pl file. So I wonder if this new information 
changes all ? It seems to me. Otherwise, I will run smartctl, etc...


Thanks :)

Amer



Then the problem is the Perl script and/or how the Perl script interacts 
with your database.



Who wrote algo- B1.pl?  Who designed the database?  Are they for a 
personal project, for a business, or something else?



David



Re: Intel RST driver -> SSD bug ?

2020-10-22 Thread A. Kapetanovic
One second please, I have discovered something else : the problem is the  
same on a external HDD USB drive.


amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

2020-01-01 - 2020-08-31
amel@laptopasus:/media/amel/c4e65f75-d3ed-46f3-950d-bf833b0b409c$ ./algo-  
B1.pl

Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.

We knows that algo-B1.pl uses a PG database on the SDD, but lisblocage  
function was in the algo-B1.pl file. So I wonder if this new information  
changes all ? It seems to me. Otherwise, I will run smartctl, etc...


Thanks :)

Amer



Re: Intel RST driver -> SSD bug ?

2020-10-22 Thread A. Kapetanovic

Alexander V. Makartsev writes:


Could you tell us exact model of your laptop?


ASUS VivoBook 15 X512JA


What type of filesystem do you use?


ext4


Is it possible dataloss was a consequence for unexpected laptop freeze
or shutdown or power loss or failed sleep\hibernation?


I never note such a thing.


I've looked up your SSD on Samsung web site and it appears to be EoL
already. As usual ASUS build their ultra modern laptops from outdated
previous gen scrap parts.


I never thought that before for ASUS, it's an important information for me.  
What should have have bought ? Lenovo ? Something else ?


Thanks :)

Amer



Re: Intel RST driver -> SSD bug ?

2020-10-21 Thread David Christensen

On 2020-10-21 10:21, A. Kapetanovic wrote:

David Christensen writes:


Intel hardware RAID is best supported on Windows -- install a driver 
that includes an administration GUI, and you can see what the hardware 
is doing.


I used smartctl, short and long test. Both seems to be OK (the shell is 
at the end of this message), but one strange thing : both test are 
finished quite at the same I run them.


'smartctl -t ...' starts a test in the background.  Short tests can take 
seconds or minutes to complete, depending upon the drive.  Long tests 
can take minutes or hours.  Monitor progress with 'smartctl -x ...' (I 
prefer '-x' rather than '-a').  See below.



I will look for a driver that includes an administration GUI, I have no 
knowledge about.


I meant that Intel provides RAID drivers and tools for Windows:

https://downloadcenter.intel.com/product/55005/Intel-Rapid-Storage-Technology-Intel-RST-


Intel supports Linux through open-source software:

https://software.intel.com/content/www/us/en/develop/topics/open-source.html


I now use ZFS exclusively for RAID. This means I need to set the disk 
drive mode to AHCI in the motherboard firmware.


Can this filesystem help me ?


Yes, but ZFS is not supported OOTB on Debian.


Given a single 512 GB SSD, I would use the Debian installer and put 
Debian into the first ~14 GB using ext4.  Once the system is up, I would 
install the ZFS packages:


zfs-dkms
zfsutils-linux


Then, create a partition using the rest of the SSD.


Then, create a ZFS pool using that partition with the options:

-O compress=lz4
-O atime=off
-O copies=2


Now you can add ZFS filesystems and/or volumes as desired, such as for 
/home or for PostGreSQL.



Are parts of your Perl program disappearing? If so, describe the steps 
required to reproduce the bug and view the effects.


Look this shell :

amel@laptopasus:~/fp/test.algoB$ perl -c algo-B1.pl
algo-B1.pl syntax OK
amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl
2020-01-01 - 2020-08-31
amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl
2020-01-01 - 2020-08-31
amel@laptopasus:~/fp/test.algoB$ ./algo-B1.pl
Undefined subroutine ::lisblocage called at ./algo-B1.pl line 161.

I didn't change anything in algo-B1.pl between these shells. Some hours 
before that, I had the same problem : a function of algo-B1.pl vanished, 
I'm not sure, It is very possible it's the same.




Are parts of a file accessed by your Perl program disappearing? If so, 
describe the steps required to reproduce the bug and view the effects.


This program access a postgresql database, impossible for me to say 
something, the main table has millions of records, the little tables are 
ok.


We cannot comment unless you post an example script and/or database that 
demonstrates the bug.




Do you have a test suite for your Perl program?

    https://www.perl.org/about/whitepapers/perl-testing.html

Create a test script that elicits the bug. Then, move your Perl 
program and test script to another machine without RST and run the 
test script. That should tell you if you have an issue with your Perl 
program or an issue with RST.


I will take a look of perl-testing.html ; bu there, I have only my 
laptop...


Test-driven development is a software engineering process.  You can use 
any computer.  A new Asus laptop with an NVMe drive, Debian, and Perl 
should work very well:


https://en.wikipedia.org/wiki/Test-driven_development


"Intermediate Perl" explains modules, distributions, testing, and other 
useful subjects:


https://www.oreilly.com/library/view/intermediate-perl/0596102062/


If you are serious about Perl, you will want these books:

https://www.oreilly.com/library/view/learning-perl-7th/9781491954317/

https://www.oreilly.com/library/view/perl-cookbook-2nd/0596003137/

https://www.oreilly.com/library/view/programming-perl-4th/9781449321451/



# smartctl -t short -a /dev/nvme0n1p5



SMART overall-health self-assessment test result: PASSED


This is the result of whatever test smartctl ran previously.



# smartctl -t long -a /dev/nvme0n1p5



SMART overall-health self-assessment test result: PASSED


This is the result of the smartctl 'short' test, started above.


Run 'smartctl -x /dev/nvme0n1p5' to see the result of the 'long' test.


David



Re: Intel RST driver -> SSD bug ?

2020-10-21 Thread Alexander V. Makartsev
On 21.10.2020 22:21, A. Kapetanovic wrote:
> David Christensen writes:
>>
>> If you think your SSD is dying, backup your data and be sure to
>> preserve old backups.
>
> That's done. My laptop is quite new (2 months old), Asus.
>
Could you tell us exact model of your laptop?
What type of filesystem do you use?
Is it possible dataloss was a consequence for unexpected laptop freeze
or shutdown or power loss or failed sleep\hibernation?
I've looked up your SSD on Samsung web site and it appears to be EoL
already. As usual ASUS build their ultra modern laptops from outdated
previous gen scrap parts.
And of course Samsung being all hush-hush about exact specifications for
their SSD products, not even telling NAND type.
You can try to search ASUS support web site for a possible firmware
update for your SSD. Not so long ago, SSDs with poorly written\tested
firmwares had similar symptoms like partial data loss or worse.
There is a quite recent firmware update for your SSD (PM991), but from
Dell [1] and from Lenovo [2]. I'm not really sure if it will install on
ASUS product, but even its existence is a good sign.

[1]
https://www.dell.com/support/home/en-ca/drivers/driversdetails?driverid=7mm5c=rt
[2] https://pcsupport.lenovo.com/us/en/downloads/ds119265

-- 
With kindest regards, Alexander.

⢀⣴⠾⠻⢶⣦⠀ 
⣾⠁⢠⠒⠀⣿⡁ Debian - The universal operating system
⢿⡄⠘⠷⠚⠋⠀ https://www.debian.org
⠈⠳⣄ 



Re: Intel RST driver -> SSD bug ?

2020-10-20 Thread David Christensen

On 2020-10-20 12:58, A. Kapetanovic wrote:

Hi,

I have a problem with my laptop, it looks like a SSD bug : some parts in 
a file vanishes (a function in a perl program). I have an asus laptop 
which uses intel RST technology (Rapid Storage Technology), and I wonder 
if the problem can come from that.


Does someone have an unlucky experience with RST please ?



If you think your SSD is dying, backup your data and be sure to preserve 
old backups.



Intel hardware RAID is best supported on Windows -- install a driver 
that includes an administration GUI, and you can see what the hardware 
is doing.



I now use ZFS exclusively for RAID.  This means I need to set the disk 
drive mode to AHCI in the motherboard firmware.



Are parts of your Perl program disappearing?  If so, describe the steps 
required to reproduce the bug and view the effects.



Are parts of a file accessed by your Perl program disappearing?  If so, 
describe the steps required to reproduce the bug and view the effects.



Do you have a test suite for your Perl program?

https://www.perl.org/about/whitepapers/perl-testing.html


Create a test script that elicits the bug.  Then, move your Perl program 
and test script to another machine without RST and run the test script. 
That should tell you if you have an issue with your Perl program or an 
issue with RST.



David