Re: [sage-devel] Re: Our github checks...

2023-10-16 Thread Oscar Benjamin
On Mon, 16 Oct 2023 at 23:22, Kwankyu Lee  wrote:
>
> On Tuesday, October 17, 2023 at 12:50:27 AM UTC+9 tobia...@gmx.de wrote:
>
> I've now set some of the github checks as "required", so they get a small tag 
> in the checks list. That should take care of (2).
>
> I am not sure if that helps or makes things worse, as that is one more thing 
> to look and think.
>
> Having some checks with "Required" and some without makes things look more 
> complicated. What should we think of a check not passed and not "Required". 
> Should we ignore it? We should aim at "requiring" all checks passed (or 
> skipped).

Marking checks as "required" is a fix for (5) not (2):

> (5) Some checks are broken at the base. I have to check the check.

If a job is required then a PR cannot be merged if the job fails with
the changes in the PR. Longer term that should mean that you can
depend on checks not being broken at the base because any PR that
might have broken those checks would not have been merged into the
base.

In general I would suggest aiming for having a (smaller if necessary)
set of checks that is always expected to pass unless a PR has broken
something. That can gradually be expanded but it is better if the
general expectation is that checks pass when nothing new is broken.
Currently Sage CI is just all red crosses everywhere which makes it
difficult to see whether any changes are fixing or breaking anything.

--
Oscar

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/CAHVvXxR5WtZyegV%2BHZpVRnJw8XYPtq-F7R%3DFcR1DiS3LaoEcwA%40mail.gmail.com.


[sage-devel] Re: Our github checks...

2023-10-16 Thread Kwankyu Lee


On Tuesday, October 17, 2023 at 12:50:27 AM UTC+9 tobia...@gmx.de wrote:

I've now set some of the github checks as "required", so they get a small 
tag in the checks list. That should take care of (2).


I am not sure if that helps or makes things worse, as that is one more 
thing to look and think.

Having some checks with "Required" and some without makes things look more 
complicated. What should we think of a check not passed and not "Required". 
Should we ignore it? We should aim at "requiring" all checks passed (or 
skipped).

Personally I am using the chrome extension mentioned above. That solves 
problems (1) and (3), and (2) is less a problem for me. The problems (1), 
(2), (3) seem basically problems that GitHub should solve by redesigning 
the checks list. I hope that they adopt the design of the chrome extension.


 

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/921a1f15-3b68-4fb8-8909-5762d04af91an%40googlegroups.com.


[sage-devel] Re: Our github checks...

2023-10-16 Thread tobia...@gmx.de
I've now set some of the github checks as "required", so they get a small 
tag in the checks list. That should take care of (2).

(Hopefully, it doesn't break Volker's workflow - it shouldn't, because he 
has the rights to overwrite any branch protection rules.)

On Monday, October 16, 2023 at 12:06:30 AM UTC+8 Frédéric Chapoton wrote:

> now it's a step related to codecov that takes more than 1h50 minutes, see
>
>
> https://github.com/sagemath/sage/actions/runs/6523545241/job/17714302017?pr=36463
> Le mardi 10 octobre 2023 à 16:29:01 UTC+2, Kwankyu Lee a écrit :
>
>> Hi,
>>
>> I am sorry to say this, but our github checks seem to be a mess.
>>
>> (1) There are two many checks. I have to scroll.
>> (2) Some checks look similar. I have to think to see which one is 
>> significant.
>> (3) They are not sorted. I don't know the order.
>> (4) Some checks are cancelled or skipped. I don't know why or what to do 
>> with them.
>> (5) Some checks are broken at the base. I have to check the check.
>>
>> I started to ignore them and  to check the PR branches on my own system 
>> locally, as in the old days.
>>
>> Any idea to improve the situation?
>>
>>
>>

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/fe183d63-c0f8-4f10-91e5-41788e16e6f7n%40googlegroups.com.


[sage-devel] Re: Our github checks...

2023-10-15 Thread Frédéric Chapoton
now it's a step related to codecov that takes more than 1h50 minutes, see

https://github.com/sagemath/sage/actions/runs/6523545241/job/17714302017?pr=36463
Le mardi 10 octobre 2023 à 16:29:01 UTC+2, Kwankyu Lee a écrit :

> Hi,
>
> I am sorry to say this, but our github checks seem to be a mess.
>
> (1) There are two many checks. I have to scroll.
> (2) Some checks look similar. I have to think to see which one is 
> significant.
> (3) They are not sorted. I don't know the order.
> (4) Some checks are cancelled or skipped. I don't know why or what to do 
> with them.
> (5) Some checks are broken at the base. I have to check the check.
>
> I started to ignore them and  to check the PR branches on my own system 
> locally, as in the old days.
>
> Any idea to improve the situation?
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/f311a861-4b7c-4e2d-9c54-c29b879d72c0n%40googlegroups.com.


[sage-devel] Re: Our github checks...

2023-10-11 Thread Kwankyu Lee
Someone who had the same problems made a Chrome extension:

https://github.com/orgs/community/discussions/48154#discussioncomment-6721631

On Tuesday, October 10, 2023 at 11:29:01 PM UTC+9 Kwankyu Lee wrote:

> Hi,
>
> I am sorry to say this, but our github checks seem to be a mess.
>
> (1) There are two many checks. I have to scroll.
> (2) Some checks look similar. I have to think to see which one is 
> significant.
> (3) They are not sorted. I don't know the order.
> (4) Some checks are cancelled or skipped. I don't know why or what to do 
> with them.
> (5) Some checks are broken at the base. I have to check the check.
>
> I started to ignore them and  to check the PR branches on my own system 
> locally, as in the old days.
>
> Any idea to improve the situation?
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/d84ce257-52e2-4ebc-bc78-2a19f36d5625n%40googlegroups.com.


[sage-devel] Re: Our github checks...

2023-10-10 Thread Matthias Koeppe
On Tuesday, October 10, 2023 at 7:29:01 AM UTC-7 Kwankyu Lee wrote:

I am sorry to say this, but our github checks seem to be a mess.


Yes, there are numerous issues. 

(1) There are two many checks. I have to scroll.
(2) Some checks look similar. I have to think to see which one is 
significant.
(3) They are not sorted. I don't know the order.


To improve (1)–(3), 
https://github.blog/2022-05-09-supercharging-github-actions-with-job-summaries/ 
may be a good approach. A PR would be most welcome. I don't plan to work on 
it myself, but I'll be happy to help if someone would like to take the lead 
on this.
 

(4) Some checks are cancelled or skipped. I don't know why or what to do 
with them.


It is safe to ignore skipped checks.

Checks are canceled when they take longer than 6 hours. There are 
unfortunately several situations in which this happens during our tests. 
One that is well understood:
- Downloading upstream tarballs can hang indefinitely when using unreliable 
mirrors. https://github.com/sagemath/sage/pull/36435 
and https://github.com/sagemath/sage/pull/36438 are going to improve this; 
work on https://github.com/sagemath/sage/issues/34411 would also be a 
welcome improvement.

(5) Some checks are broken at the base. I have to check the check.


Indeed. Currently consistently broken:

sage -t --long --random-seed=286735480429121101562228604801325644303 
sage/doctest/test.py  # 1 doctest failed
sage -t --long --random-seed=286735480429121101562228604801325644303 
sage/parallel/decorate.py  # 1 doctest failed

https://github.com/sagemath/sage/wiki/Sage-10.2-Release-Tour#open-blocker-prs-are-applied-automatically-in-ci-workflows
 
makes it possible for simple fixes of failures like this to take immediate 
effect during the same release cycle. I hope that this motivates more 
developers to analyze and fix these failures, rather than hoping that 
failures of this kind will just go away "when the next beta arrives in a 
week". 

-- 
You received this message because you are subscribed to the Google Groups 
"sage-devel" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to sage-devel+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/sage-devel/19de8dd8-99fc-454f-a12a-f5743c53d141n%40googlegroups.com.