Re: AI

[gfp]

Am 31.03.26 um 15:55 schrieb Etienne B. Roesch:

Hi Gottfried,

     1.
        there is a package:

    https://packages.guix.gnu.org/packages/llama-cpp/0.0.0-b8445/
    <https://packages.guix.gnu.org/packages/llama-cpp/0.0.0-b8445/>
    but it needs additional stuff.
    What would I have to add?

Jean proposed that I can let AI run on my laptop
in order not to download always different stuff.

I could start with the smallest model to get the hang of it.

llama-cpp

https://huggingface.co/unsloth/Qwen3.5-0.8B-GGUF/resolve/main/Qwen3.5-0.8B-Q5_K_M.gguf?download=true

https://huggingface.co/unsloth/Qwen3.5-0.8B-GGUF/tree/main

So I am asking a basic question.

What does your package do? Just the ability to run llama models?

    2. What is your experience on AI?
    3. Is it safe to install it?
    4. Does somebody have experience with it?
    5. Somebody from Emacs Mailinglist, uses „llama-cpp“ regularly with
    Debian Sid.
    6. What offers Guix for AI?

I am not entirely sure what you mean; do you mean using packaged agentic systems, like openai Codex or openclaw?

I don´t know about that, so I can´t answer this question

Etienne

I am using both types of systems. Still playing around with everything, but I can see myself use it for production stuff. I am very picky though, and I’d want to double-check anything produced, review the code, etc. How safe it is, really depends on how you end up using it. It’s like most things, you need to understand your choices fully and predict what can go wrong. You can adjust your practice (e.g. not run openclaw on your company-provided laptop, or segregating it to a limited user account or a vm) and prepare mitigation (e.g. have monitoring jobs/ loops, make sure you understand security pipelines). I have working packaged version of ollama and openclaw on my Guix System, working continuously; currently working on optimising ollama for using my Nvidia GPU properly, because I have had enough of running out of tokens!

thanks

Gottfried

OpenPGP_0xAC95367953582A3C.asc
Description: OpenPGP public key

OpenPGP_signature.asc
Description: OpenPGP digital signature