Re: How much is dnf's minimum memory requirement?

2018-11-26 Thread Richard W.M. Jones
On Sun, Nov 25, 2018 at 05:53:21PM +0100, Benjamin Kircher wrote:
> What are dnf’s minimum memory requirements?

I think "creeping upwards" is a fair description.  We have
occasionally seen trouble with virt-builder and virt-customize which
are using a smallish virtual machine.  In Fedora 28+ I have had to
increase the memory available to 1G (from 500M previously, note there
is no swap) to get package installation to work reliably.  I also
filed:

  https://bugzilla.redhat.com/show_bug.cgi?id=1432219

which is closed now, but I think the issue has returned since I closed
it.

> Anyway, is memory consumption a thing with the new libdnf-in-C++
> efforts?

No idea whether rewriting dnf has helped.  I'm not clear which version
of dnf is the rewritten one.

> Could a look into microdnf be a thing for me?

For Fedora/RISC-V, in the early days while we were getting all the
dependencies for full dnf ready, we used ‘tdnf’ which is another of
these cut down solvers (written in C IIRC).  I wouldn't recommend that
particular program as it has many shortcomings compared to regular
dnf.  I don't think we tried microdnf however.

I think a more productive way to resolve this will be to try to
diagnose what's consuming memory.  You can probably do this by getting
dnf (or python?) to core dump when it runs out of memory, then
examining the core dump file for strings to see if you can identify
what data is consuming the memory.

Another way would be to use an instrumented malloc implementation
such as https://github.com/memtt/malt

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
Fedora Windows cross-compiler. Compile Windows programs, test, and
build Windows installers. Over 100 libraries supported.
http://fedoraproject.org/wiki/MinGW
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


Re: How much is dnf's minimum memory requirement?

2018-11-25 Thread Peter Robinson
On Sun, Nov 25, 2018 at 4:54 PM Benjamin Kircher
 wrote:
>
> What are dnf’s minimum memory requirements? It came as a surprise to me that 
> a simple `dnf check-update` is getting OOM’ed by the kernel on a (ok, fairly 
> small) 512MB VM.
>
>
> [root@node ~]# dnf check-update
> Killed
>
> [root@node ~]# free -h
>   totalusedfree  shared  buff/cache   
> available
> Mem:  480Mi   137Mi   292Mi   0.0Ki50Mi   
> 329Mi
> Swap:0B  0B  0B
>
> [root@node ~]# cat /etc/os-release |grep -i pretty_name
> PRETTY_NAME="Fedora 29 (Server Edition)”
>
> [root@node ~]# dnf --version
> 4.0.4
>   Installed: dnf-0:4.0.4-1.fc29.noarch at Tue 30 Oct 2018 03:38:30 PM GMT
>   Built: Fedora Project at Mon 15 Oct 2018 12:00:52 PM GMT
>
>   Installed: rpm-0:4.14.2-1.fc29.x86_64 at Tue 30 Oct 2018 03:37:40 PM GMT
>   Built: Fedora Project at Wed 22 Aug 2018 08:07:47 AM GMT
>
>
> According to [1], 1GB is required for a Fedora (desktop?) install but right 
> underneath is a note that says only if I want to install it with lots of 
> packages selected upfront.
>
>
> With F28 Server (ships with dnf 2.7.5) this worked perfectly fine on an 
> equally sized VM.
>
> Anyway, is memory consumption a thing with the new libdnf-in-C++ efforts? 
> Could a look into microdnf be a thing for me?
>
> Any advice appreciated.

I've not seen issues with it running on ARM devices with 512 Mb of
RAM, and there are some that run it on devices with 256Mb but that
tends to be a minimal image with no graphics
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org


How much is dnf's minimum memory requirement?

2018-11-25 Thread Benjamin Kircher
What are dnf’s minimum memory requirements? It came as a surprise to me that a 
simple `dnf check-update` is getting OOM’ed by the kernel on a (ok, fairly 
small) 512MB VM.


[root@node ~]# dnf check-update
Killed

[root@node ~]# free -h
  totalusedfree  shared  buff/cache   available
Mem:  480Mi   137Mi   292Mi   0.0Ki50Mi   329Mi
Swap:0B  0B  0B

[root@node ~]# cat /etc/os-release |grep -i pretty_name
PRETTY_NAME="Fedora 29 (Server Edition)”

[root@node ~]# dnf --version
4.0.4
  Installed: dnf-0:4.0.4-1.fc29.noarch at Tue 30 Oct 2018 03:38:30 PM GMT
  Built: Fedora Project at Mon 15 Oct 2018 12:00:52 PM GMT

  Installed: rpm-0:4.14.2-1.fc29.x86_64 at Tue 30 Oct 2018 03:37:40 PM GMT
  Built: Fedora Project at Wed 22 Aug 2018 08:07:47 AM GMT


According to [1], 1GB is required for a Fedora (desktop?) install but right 
underneath is a note that says only if I want to install it with lots of 
packages selected upfront.


With F28 Server (ships with dnf 2.7.5) this worked perfectly fine on an equally 
sized VM.

Anyway, is memory consumption a thing with the new libdnf-in-C++ efforts? Could 
a look into microdnf be a thing for me?

Any advice appreciated.


[1]: 
https://docs.fedoraproject.org/en-US/fedora/f29/release-notes/welcome/Hardware_Overview/

BK
___
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: https://getfedora.org/code-of-conduct.html
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org