dr0ptp4kt added a comment.
Thanks @bking ! It looks like the NVMe in this one is not a higher speed one
for writes, and I'm also wondering if perhaps its write performance has
degraded with age. I'll paste in the results here, but this was slower than the
other servers, ironically (although not surprisingly because of the slower NVMe
and slightly slower processor). This slower write speed is atypical of the
other NVMes I've encountered. I believe the newer model ones are rated for 6000
MB/s for writes. But, I'm going to ping on task to see if we can get a
comparative read of disk throughput from one of the newer and faster cp####
NVMes.
dr0ptp4kt@wdqs1025:/srv/deployment/wdqs/wdqs-cache$ ls /srv/wdqs/
aliases.map wikidata.jnl wikidump-000000002.ttl.gz
wikidump-000000004.ttl.gz wikidump-000000006.ttl.gz wikidump-000000008.ttl.gz
dumps wikidump-000000001.ttl.gz wikidump-000000003.ttl.gz
wikidump-000000005.ttl.gz wikidump-000000007.ttl.gz wikidump-000000009.ttl.gz
dr0ptp4kt@wdqs1025:/srv/deployment/wdqs/wdqs-cache$ cd cache
dr0ptp4kt@wdqs1025:/srv/deployment/wdqs/wdqs-cache/cache$ time
./loadData.sh -n wdq -d /srv/wdqs -s 1 -e 9
Processing wikidump-000000001.ttl.gz
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd";><html><head><meta
http-equiv="Content-Type"
content="text/html;charset=UTF-8"><title>blazegraph™ by SYSTAP</title
></head
><body<p>totalElapsed=214282ms, elapsed=214279ms, connFlush=0ms,
batchResolve=0, whereClause=0ms, deleteClause=0ms, insertClause=0ms</p
><hr><p>COMMIT: totalElapsed=233942ms, commitTime=1709910647417,
mutationCount=22829952</p
></html
>Processing wikidump-000000002.ttl.gz
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd";><html><head><meta
http-equiv="Content-Type"
content="text/html;charset=UTF-8"><title>blazegraph™ by SYSTAP</title
></head
><body<p>totalElapsed=196470ms, elapsed=196469ms, connFlush=0ms,
batchResolve=0, whereClause=0ms, deleteClause=0ms, insertClause=0ms</p
><hr><p>COMMIT: totalElapsed=227786ms, commitTime=1709910874952,
mutationCount=15807617</p
></html
>Processing wikidump-000000003.ttl.gz
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd";><html><head><meta
http-equiv="Content-Type"
content="text/html;charset=UTF-8"><title>blazegraph™ by SYSTAP</title
></head
><body<p>totalElapsed=183111ms, elapsed=183110ms, connFlush=0ms,
batchResolve=0, whereClause=0ms, deleteClause=0ms, insertClause=0ms</p
><hr><p>COMMIT: totalElapsed=213965ms, commitTime=1709911089170,
mutationCount=12654001</p
></html
>Processing wikidump-000000004.ttl.gz
^C
real 14m4.855s
user 0m0.084s
sys 0m0.053s
dr0ptp4kt@wdqs1025:/srv/deployment/wdqs/wdqs-cache/cache$ cd /srv
dr0ptp4kt@wdqs1025:/srv$ df .
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/nvme0n1 1537157352 9508448 1449491832 1% /srv
dr0ptp4kt@wdqs1025:/srv$ sudo sync; sudo dd if=/dev/zero of=tempfile bs=25M
count=1024; sudo sync
1024+0 records in
1024+0 records out
26843545600 bytes (27 GB, 25 GiB) copied, 27.1995 s, 987 MB/s
dr0ptp4kt@wdqs1025:/srv$ sudo sync; sudo dd if=/dev/zero of=tempfile bs=25M
count=1024; sudo sync
1024+0 records in
1024+0 records out
26843545600 bytes (27 GB, 25 GiB) copied, 37.5448 s, 715 MB/s
dr0ptp4kt@wdqs1025:/srv$ lsblk -o MODEL,SERIAL,SIZE,STATE --nodeps
MODEL SERIAL SIZE STATE
...
Dell Express Flash PM1725a 1.6TB SFF S39XNX0JC01060 1.5T
TASK DETAIL
https://phabricator.wikimedia.org/T359062
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dr0ptp4kt
Cc: bking, dr0ptp4kt, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1,
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi,
Gq86, GoranSMilovanovic, QZanden, EBjune, KimKelting, LawExplorer, _jensen,
rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
_______________________________________________
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
