Re: System locks up while moving file

[John Elliot V]

On 25/06/17 20:13, to...@tuxteam.de wrote:
> You might try to play around with ionice. Something along the lines of
> 
>   ionice -c 3  mv /this/path /that/path

Thanks. I gave that a try. Didn't seem to help much. But...

On 25/06/17 20:19, Reco wrote:
> A known problem aka Linux 12309 bug.
>
> Try this:
>
> sysctl -w vm.dirty_ratio=5
> sysctl -w vm.dirty_background_ratio=5
>
> If it helps, put these kernel tunables into /etc/sysctl.d somewhere.

I did that a few weeks after trying the previous suggestion for a while,
and it seems to have solved the issue. Thanks!

-- 
E: j...@jj5.net
P: +61 4 3505 7839
W: https://www.jj5.net/
<>

Re: System locks up while moving file

[Reco]

Hi.

On Sun, 25 Jun 2017 19:54:17 +1000
John Elliot V  wrote:

> There seems to be plenty of RAM available, and plenty of CPU. So must be
> some I/O thing..? Anyway, I'm a bit stumped. I haven't tried running the
> mv command with nice, because it doesn't seem to be a CPU thing... but
> maybe I should..? Anyone got any ideas about how to keep my system
> responsive while the mv command is processed?

A known problem aka Linux 12309 bug.

Try this:

sysctl -w vm.dirty_ratio=5
sysctl -w vm.dirty_background_ratio=5

If it helps, put these kernel tunables into /etc/sysctl.d somewhere.

Reco

Re: System locks up while moving file

[tomas]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Sun, Jun 25, 2017 at 07:54:17PM +1000, John Elliot V wrote:
> Hey there. Maybe someone can help me with this.
> 
> I'm running Debian 9.0 (stretch). I have a few scripts which
> periodically create and then move a file from my 1TB M.2 drive to a MD
> RAID1 device comprised of 2x 6TB Seagate IronWolf drives. Full details
> are here [1].

[...]

> There seems to be plenty of RAM available, and plenty of CPU. So must be
> some I/O thing..? Anyway, I'm a bit stumped. I haven't tried running the
> mv command with nice, because it doesn't seem to be a CPU thing... but

You might try to play around with ionice. Something along the lines of

  ionice -c 3  mv /this/path /that/path

This would start the mv in the "idle" class (3), meaning it gets the
I/O breadcrumbs other processes leave on the table. More or less.

All of course untested. Consult the man page and move your pets to
a safe place first :)

Cheers
- -- tomás
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.12 (GNU/Linux)

iEYEARECAAYFAllPjN8ACgkQBcgs9XrR2kbDNQCfY3LVfiYJ91Yz18quc56c98Zy
USQAnRITcx01FZnlPltPGg6xmCrR+qzE
=Q1vL
-END PGP SIGNATURE-

System locks up while moving file

[John Elliot V]

Hey there. Maybe someone can help me with this.

I'm running Debian 9.0 (stretch). I have a few scripts which
periodically create and then move a file from my 1TB M.2 drive to a MD
RAID1 device comprised of 2x 6TB Seagate IronWolf drives. Full details
are here [1].

My disks look something like this:

jj5@tact:~$ df -h
Filesystem  Size  Used Avail Use% Mounted on
/dev/md0469G   86G  378G  19% /
/dev/md15.5T  4.0T  1.6T  73% /data
/dev/nvme0n1p1  931G   78G  853G   9% /data/fast

An example of the move command which locks everything up is:

 mv /data/fast/temp/blob-tact.tgz \
/data/temp/blob-tact.tgz.8157-12003.tmp

So while this mv command is being processed my mouse doesn't respond, my
KDE Plasma session locks up, everything grinds to a halt.

There seems to be plenty of RAM available, and plenty of CPU. So must be
some I/O thing..? Anyway, I'm a bit stumped. I haven't tried running the
mv command with nice, because it doesn't seem to be a CPU thing... but
maybe I should..? Anyone got any ideas about how to keep my system
responsive while the mv command is processed?

Regards,
John Elliot V

[1] https://www.jj5.net/sixsigma/Workstation#Disk

-- 
E: j...@jj5.net
P: +61 4 3505 7839
W: https://www.jj5.net/
<>