bug#57581: Failing to build the website

[zimoun]

Hi Ludo,

On Tue, 13 Sep 2022 at 16:41, Ludovic Courtès  wrote:

>> I don’t know if there is a way to catch such mistakes early.  Field
>> sanitizers?
>
> Yes, we should do that.  We can arrange to have most checks done at
> compile time, similar to how the ‘synopsis’ and ‘description’ sanitizers
> work (well, with extra macro magic).

For the record, please see this thread [1] opening a discussion on the
topic.

1: 


Cheers,
simon

bug#57581: Failing to build the website

[Ludovic Courtès]

Hi,

"pelzflorian (Florian Pelz)"  skribis:

> zimoun  writes:
>> The culprit seems the package ’qtserialport’ in ’packages-builder’ from
>> (apps packages builder).  Maybe introduced by commit
>> 1ef04fb2288dade3ad2883026ae286a68ef13a1e.
>
> This was a first failing commit for me too, but the reason the website
> does not build appears to be the license field of qtshadertools in
> commit 1d65ff8fdeb20cc2db956093f0ecb1f3f72afc0e (Cc to Maxim).  I could
> make a patch but not today.  Maxim, would you fix it?

Fixed in e61c581805b2338ea8feaac86617c5d7bff41c41, thanks for the
investigation!

> I don’t know if there is a way to catch such mistakes early.  Field
> sanitizers?

Yes, we should do that.  We can arrange to have most checks done at
compile time, similar to how the ‘synopsis’ and ‘description’ sanitizers
work (well, with extra macro magic).

Ludo’.

bug#57581: Failing to build the website

[zimoun]

Hi Julien,

Thanks for explaining.

On Wed, 07 Sep 2022 at 19:14, Julien Lepiller  wrote:
>
> No warning because the compiler has no way to know you don't want to
> do that. license is a field, and fields don't have a specific type
> except for convention.

Arf, it is where OCaml shines. ;-)


Cheers,
simon

bug#57581: Failing to build the website

[Julien Lepiller]

Le 7 septembre 2022 19:07:10 GMT+02:00, zimoun  a 
écrit :
>Hi,
>
>Well, the field reads,
>
>+(license (package-home-page qtbase
>
>so why is the compiler accepting that?  Is a warning raised?
>

No warning because the compiler has no way to know you don't want to do that. 
license is a field, and fields don't have a specific type except for convention.

package-home-page will read a field from another object, return a perfectly 
valid Scgeme object (a string) and Scheme is happy to put it in the license 
field. Why would it care? (:

It fails much later when something tries to read the license field and gets a 
string it treats as a license object.

bug#57581: Failing to build the website

[zimoun]

Hi,

On Wed, 07 Sep 2022 at 18:31, "pelzflorian (Florian Pelz)" 
 wrote:
> zimoun  writes:
>> The culprit seems the package ’qtserialport’ in ’packages-builder’ from
>> (apps packages builder).  Maybe introduced by commit
>> 1ef04fb2288dade3ad2883026ae286a68ef13a1e.
>
> This was a first failing commit for me too, but the reason the website
> does not build appears to be the license field of qtshadertools in
> commit 1d65ff8fdeb20cc2db956093f0ecb1f3f72afc0e (Cc to Maxim).  I could
> make a patch but not today.  Maxim, would you fix it?

>From my opinion, this

--8<---cut here---start->8---
+(home-page (package-home-page qtbase))
[...]
+(license (package-home-page qtbase
--8<---cut here---end--->8---

is a bad practise; instead ’(inherit qtbase)’ and rewrite all the others
fields is better.

> I don’t know if there is a way to catch such mistakes early.  Field
> sanitizers?

Well, the field reads,

+(license (package-home-page qtbase

so why is the compiler accepting that?  Is a warning raised?



Cheers,
simon

bug#57581: Failing to build the website

[pelzflorian (Florian Pelz)]

zimoun  writes:
> The culprit seems the package ’qtserialport’ in ’packages-builder’ from
> (apps packages builder).  Maybe introduced by commit
> 1ef04fb2288dade3ad2883026ae286a68ef13a1e.

This was a first failing commit for me too, but the reason the website
does not build appears to be the license field of qtshadertools in
commit 1d65ff8fdeb20cc2db956093f0ecb1f3f72afc0e (Cc to Maxim).  I could
make a patch but not today.  Maxim, would you fix it?

I don’t know if there is a way to catch such mistakes early.  Field
sanitizers?

Regards,
Florian

bug#57581: Failing to build the website

[zimoun]

Hi,

On dim., 04 sept. 2022 at 17:18, Julien Lepiller  wrote:

> srfi/srfi-1.scm:241:2: In procedure map:
> In procedure map: Wrong type argument: "https://www.qt.io/;
> building pages in '/tmp/gnu.org/software/guix'...
> Backtrace:
>2 (primitive-load "/gnu/store/qr419pk9hdvg692rkhdlyvr9zh0?")
> In ice-9/eval.scm:
> 619:8  1 (_ #f)
> In guix/build/utils.scm:
> 762:6  0 (invoke "/gnu/store/bgh62naj3w2367h46zv2waq26rs3aspp-h?" ?)
>
> guix/build/utils.scm:762:6: In procedure invoke:
> ERROR:
>   1. :
>   program:
> "/gnu/store/bgh62naj3w2367h46zv2waq26rs3aspp-haunt-0.2.6/bin/haunt"
> arguments: ("build") exit-status: 1
>   term-signal: #f
>   stop-signal: #f
> builder for
> `/gnu/store/sh3ihg22yr1s0cdfjqpsv5hqrfmvg646-guix-web-site-de_DE.drv'
> failed with exit code 1 la compilation de
> /gnu/store/sh3ihg22yr1s0cdfjqpsv5hqrfmvg646-guix-web-site-de_DE.drv a
> échoué

The culprit seems the package ’qtserialport’ in ’packages-builder’ from
(apps packages builder).  Maybe introduced by commit
1ef04fb2288dade3ad2883026ae286a68ef13a1e.  Well, the website probably
requires a tweak in ’package-t’, more or less here:

--8<---cut here---start->8---
(ul
 (@ (class "package-info"))
 ,(G_ `(li ,(G_ `(b "Website: "))
   (a (@ (href ,(package-home-page package)))
  ,(package-home-page package
--8<---cut here---end--->8---

but I do not know exactly what.  Maybe ’shtml’ somewhere?


Cheers,
simon

bug#57581: Failing to build the website

[Julien Lepiller]

Quoting my own email I think this is the relevant bit. I don't think it's an 
issue in haunt, but something with qt:

srfi/srfi-1.scm:241:2: In procedure map:
In procedure map: Wrong type argument: "https://www.qt.io/;
building pages in '/tmp/gnu.org/software/guix'...

Le 5 septembre 2022 14:04:10 GMT+02:00, zimoun  a 
écrit :
>Hi,
>
>On lun., 05 sept. 2022 at 12:59, "pelzflorian (Florian Pelz)" 
> wrote:
>> zimoun  writes:
>>> $ LANG=en_US.UTF-8 GUIX_WEB_SITE_LOCAL=yes guix environment -C -m 
>>> manifest.scm \
>>>   -E LANG -E GUIX_WEB_SITE_LOCAL  --share=/tmp  
>>>\
>>>   -- haunt build
>>
>> Yes but `guix build -f .guix.scm` fails for me too, perhaps because it
>> uses latest-guix from %default-channels.  It’s not fixed by using old
>> haunt, so I guess a change in guix makes the difference, but I have not
>> found the commit and will not continue looking for it immediately.
>
>The file manifest.scm contains:
>
>--8<---cut here---start->8---
>(define the-good-guile
>  (car (assoc-ref (package-native-inputs guix) "guile")))
>
>(define haunt-the-ghost
>  (package
>(inherit haunt)
>(name "haunt-for-guix-website")
>(inputs
> `(("guile" ,the-good-guile)
>   ,@(alist-delete "guile" (package-inputs haunt))
>--8<---cut here---end--->8---
>
>and the file .guix.scm contains
>
>--8<---cut here---start->8---
>(define latest-guix
>  ;; The latest Guix.  Using it rather than the 'guix' package ensures we
>  ;; build the latest package list.
>  (latest-channels %default-channels))
>
>(define (inferior-package spec)
>  (first (lookup-inferior-packages
>  (inferior-for-channels
>   (latest-channels-channels latest-guix))
>  spec)))
>
>;; Make sure that Haunt uses the same Guile as the one from
>;; "latest-guix". Otherwise there could be a mismatch between the Guile
>;; revision used by Haunt and the one from the latest Guix modules used by
>;; Haunt.
>(define haunt-with-latest-guile
>  (package
>(inherit haunt)
>(inputs
> `(("guile" ,(inferior-package "guile"))
>   ,@(package-inputs haunt)
>--8<---cut here---end--->8---
>
>so it should be the same Haunt.  I mean, there is no gap between the
>version of Guile of latest-guix and the package guix.  But, I am missing
>something because the failure comes from:
>
>--8<---cut here---start->8---
>(invoke #+(file-append haunt-with-latest-guile
>   "/bin/haunt")
>   "build")
>--8<---cut here---end--->8---
>
>It requires some investigations. :-)
>
>
>Cheers,
>simon

bug#57581: Failing to build the website

[zimoun]

Hi,

On lun., 05 sept. 2022 at 12:59, "pelzflorian (Florian Pelz)" 
 wrote:
> zimoun  writes:
>> $ LANG=en_US.UTF-8 GUIX_WEB_SITE_LOCAL=yes guix environment -C -m 
>> manifest.scm \
>>   -E LANG -E GUIX_WEB_SITE_LOCAL  --share=/tmp   
>>   \
>>   -- haunt build
>
> Yes but `guix build -f .guix.scm` fails for me too, perhaps because it
> uses latest-guix from %default-channels.  It’s not fixed by using old
> haunt, so I guess a change in guix makes the difference, but I have not
> found the commit and will not continue looking for it immediately.

The file manifest.scm contains:

--8<---cut here---start->8---
(define the-good-guile
  (car (assoc-ref (package-native-inputs guix) "guile")))

(define haunt-the-ghost
  (package
(inherit haunt)
(name "haunt-for-guix-website")
(inputs
 `(("guile" ,the-good-guile)
   ,@(alist-delete "guile" (package-inputs haunt))
--8<---cut here---end--->8---

and the file .guix.scm contains

--8<---cut here---start->8---
(define latest-guix
  ;; The latest Guix.  Using it rather than the 'guix' package ensures we
  ;; build the latest package list.
  (latest-channels %default-channels))

(define (inferior-package spec)
  (first (lookup-inferior-packages
  (inferior-for-channels
   (latest-channels-channels latest-guix))
  spec)))

;; Make sure that Haunt uses the same Guile as the one from
;; "latest-guix". Otherwise there could be a mismatch between the Guile
;; revision used by Haunt and the one from the latest Guix modules used by
;; Haunt.
(define haunt-with-latest-guile
  (package
(inherit haunt)
(inputs
 `(("guile" ,(inferior-package "guile"))
   ,@(package-inputs haunt)
--8<---cut here---end--->8---

so it should be the same Haunt.  I mean, there is no gap between the
version of Guile of latest-guix and the package guix.  But, I am missing
something because the failure comes from:

--8<---cut here---start->8---
(invoke #+(file-append haunt-with-latest-guile
   "/bin/haunt")
   "build")
--8<---cut here---end--->8---

It requires some investigations. :-)


Cheers,
simon

bug#57581: Failing to build the website

[zimoun]

On lun., 05 sept. 2022 at 12:27, Julien Lepiller  wrote:
> I used guix build -f .guix.scm. I'm on the latest guix-artwork but an
> older guix from maybe a month ago. GUIX_WEB_SITE_LOCAL doesn't build
> everything, only a subset of packages end up in the generated list. I
> think my issue is with qt, which probably isn't part of that subset.

It works with GUIX_WEB_SITE_LOCAL=no but indeed not using .guix.scm.

Cheers,
simon

bug#57581: Failing to build the website

[pelzflorian (Florian Pelz)]

zimoun  writes:
> $ LANG=en_US.UTF-8 GUIX_WEB_SITE_LOCAL=yes guix environment -C -m 
> manifest.scm \
>   -E LANG -E GUIX_WEB_SITE_LOCAL  --share=/tmp
>  \
>   -- haunt build

Yes but `guix build -f .guix.scm` fails for me too, perhaps because it
uses latest-guix from %default-channels.  It’s not fixed by using old
haunt, so I guess a change in guix makes the difference, but I have not
found the commit and will not continue looking for it immediately.

Thank you for looking at it.

Regards,
Florian

bug#57581: Failing to build the website

[Julien Lepiller]

I used guix build -f .guix.scm. I'm on the latest guix-artwork but an older 
guix from maybe a month ago. GUIX_WEB_SITE_LOCAL doesn't build everything, only 
a subset of packages end up in the generated list. I think my issue is with qt, 
which probably isn't part of that subset.

Le 5 septembre 2022 10:35:43 GMT+02:00, zimoun  a 
écrit :
>Hi Julien
>
>On dim., 04 sept. 2022 at 17:18, Julien Lepiller  wrote:
>
>> I tried to update the po files for the website today, but I was unable
>> to test. Trying to build the website from a clean checkout (without
>> updating translations) gives this error. I think it's related to the
>> code that generate the list of packages:
>
>Which revision of Guix do you use?  And which commit of guix-artwork?
>
>And how do you build the website?  It works for me with this procedure.
>
>--8<---cut here---start->8---
>$ git clone https://git.savannah.gnu.org/git/guix/guix-artwork.git
>Cloning into 'guix-artwork'...
>remote: Counting objects: 7281, done.
>remote: Compressing objects: 100% (2121/2121), done.
>remote: Total 7281 (delta 5043), reused 7273 (delta 5041)
>Receiving objects: 100% (7281/7281), 33.99 MiB | 17.80 MiB/s, done.
>Resolving deltas: 100% (5043/5043), done.
>
>$ builtin cd guix-artwork/website
>
>$ guix describe
>Generation 9   août 31 2022 14:51:40   (current)
>  guix 23152ff
>repository URL: https://git.savannah.gnu.org/git/guix.git
>branch: master
>commit: 23152ff70f0ed4966d8207846f54c793d7cb4f86
>
>$ git log --oneline -1
>ebc4a77 (HEAD -> master, origin/master, origin/HEAD) promotional: New 
>retractable banner designs.
>
>$ LANG=en_US.UTF-8 GUIX_WEB_SITE_LOCAL=yes guix environment -C -m manifest.scm 
>\
>  -E LANG -E GUIX_WEB_SITE_LOCAL  --share=/tmp 
> \
>  -- haunt build
>
>> > building pages in '/tmp/gnu.org/software/guix'...
>fatal: not a git repository (or any parent up to mount point /gnu/store)
>Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
>warning: page objects are deprecated; switch to serialized-artifact
>
>[...]
>
>build completed successfully
>--8<---cut here---end--->8---
>
>
>
>Cheers,
>simon

bug#57581: Failing to build the website

[zimoun]

Hi Julien

On dim., 04 sept. 2022 at 17:18, Julien Lepiller  wrote:

> I tried to update the po files for the website today, but I was unable
> to test. Trying to build the website from a clean checkout (without
> updating translations) gives this error. I think it's related to the
> code that generate the list of packages:

Which revision of Guix do you use?  And which commit of guix-artwork?

And how do you build the website?  It works for me with this procedure.

--8<---cut here---start->8---
$ git clone https://git.savannah.gnu.org/git/guix/guix-artwork.git
Cloning into 'guix-artwork'...
remote: Counting objects: 7281, done.
remote: Compressing objects: 100% (2121/2121), done.
remote: Total 7281 (delta 5043), reused 7273 (delta 5041)
Receiving objects: 100% (7281/7281), 33.99 MiB | 17.80 MiB/s, done.
Resolving deltas: 100% (5043/5043), done.

$ builtin cd guix-artwork/website

$ guix describe
Generation 9août 31 2022 14:51:40   (current)
  guix 23152ff
repository URL: https://git.savannah.gnu.org/git/guix.git
branch: master
commit: 23152ff70f0ed4966d8207846f54c793d7cb4f86

$ git log --oneline -1
ebc4a77 (HEAD -> master, origin/master, origin/HEAD) promotional: New 
retractable banner designs.

$ LANG=en_US.UTF-8 GUIX_WEB_SITE_LOCAL=yes guix environment -C -m manifest.scm \
  -E LANG -E GUIX_WEB_SITE_LOCAL  --share=/tmp \
  -- haunt build

> > building pages in '/tmp/gnu.org/software/guix'...
fatal: not a git repository (or any parent up to mount point /gnu/store)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
warning: page objects are deprecated; switch to serialized-artifact

[...]

build completed successfully
--8<---cut here---end--->8---



Cheers,
simon

bug#57581: Failing to build the website

[Julien Lepiller]

Hi Guix!

I tried to update the po files for the website today, but I was unable
to test. Trying to build the website from a clean checkout (without
updating translations) gives this error. I think it's related to the
code that generate the list of packages:

Backtrace:
In ice-9/eval.scm:
   177:49 19 (lp (# …))
   177:49 18 (lp (# …))
   177:49 17 (lp (# …))
   177:49 16 (lp (# …))
   177:49 15 (lp (# …))
   177:49 14 (lp (# …))
   177:49 13 (lp (# …))
   177:49 12 (lp (# …))
   177:32 11 (lp (#))
159:9 10 (_ #(#(#(#(#(#) …) …) …) …))
   174:20  9 (_ #(#(#(#(#(#) …) …) …) …))
   177:49  8 (lp (# …))
   177:32  7 (lp (# …))
   174:20  6 (_ #(#(#(#(#(#) …) …) …) …))
   177:32  5 (lp (# …))
   174:20  4 (_ #(#(#(#(#(#) …) …) …) …))
   177:49  3 (lp (# …))
   177:32  2 (lp (#))
159:9  1 (_ #(#(#) …))
In srfi/srfi-1.scm:
241:2  0 (map _ _)

srfi/srfi-1.scm:241:2: In procedure map:
In procedure map: Wrong type argument: "https://www.qt.io/;
building pages in '/tmp/gnu.org/software/guix'...
Backtrace:
   2 (primitive-load "/gnu/store/qr419pk9hdvg692rkhdlyvr9zh0?")
In ice-9/eval.scm:
619:8  1 (_ #f)
In guix/build/utils.scm:
762:6  0 (invoke "/gnu/store/bgh62naj3w2367h46zv2waq26rs3aspp-h?" ?)

guix/build/utils.scm:762:6: In procedure invoke:
ERROR:
  1. :
  program:
"/gnu/store/bgh62naj3w2367h46zv2waq26rs3aspp-haunt-0.2.6/bin/haunt"
arguments: ("build") exit-status: 1
  term-signal: #f
  stop-signal: #f
builder for
`/gnu/store/sh3ihg22yr1s0cdfjqpsv5hqrfmvg646-guix-web-site-de_DE.drv'
failed with exit code 1 la compilation de
/gnu/store/sh3ihg22yr1s0cdfjqpsv5hqrfmvg646-guix-web-site-de_DE.drv a
échoué