Re: fresh Jenkins installation does not present the dashboard

[Matthias Apitz]

At the end of the day it turned out that IT had to enable a service "app 
google-base" to let curl and openssl to www.google.com working as they 
should, dont know what the diff is between HTTPS and "google-base" is 
and dont have access to the firewall.


Daniel, thanks for your helping hints;

--
Matthias Apitz
E-mail: g...@unixarea.de
WWW: http://www.unixarea.de/
phone: +49-170-4527211

Am 28.07.2023 12:32, schrieb 'Daniel Beck' via Jenkins Users:

On Fri, Jul 28, 2023 at 11:21 AM Matthias Apitz 
wrote:


* TLSv1.3 (OUT), TLS handshake, Client hello (1):

it hangs. Sould it says '404 bla not found"


This indicates that something other than Jenkins is broken, so it's a
system/environment issue. Fix that first, then try again with Jenkins.


 --
You received this message because you are subscribed to the Google
Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/jenkinsci-users/CAMo7Pt%2Bx9SKZcEifv4JPOJBNBd1WydQYcaMGcrXfBiNGwKWi%2Bg%40mail.gmail.com
[1].


Links:
--
[1] 
https://groups.google.com/d/msgid/jenkinsci-users/CAMo7Pt%2Bx9SKZcEifv4JPOJBNBd1WydQYcaMGcrXfBiNGwKWi%2Bg%40mail.gmail.com?utm_medium=email&utm_source=footer


--
You received this message because you are subscribed to the Google Groups "Jenkins 
Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/2b47a1482f742fb78a1beb623cd911bf%40unixarea.de.

Help and Input needed, repeatable k8s based CI for Apache Cassandra

[Mick Semb Wever]

Dear Jenkins User Community,

  In the Apache Cassandra community we have a significant project to 
improve our CI, with the aim of making it more accessible to every 
contributor.  The project is significant, with Cassandra's CI currently 
~50k tests of different types, with a backlog of tests to continue to add.  
Our current jenkins installation is at ci-cassandra.apache.org

  I'm reaching out for guidance and expertise in creating an initial 
top-level script that can clone the ci-cassandra.apache.org Jenkins 
installation.  



My questions to the list are…

   - Do you think the following can be done?
   - Do you know of other valuable examples to look at?
   - What Jenkins components/approach would you be using?
   - What challenges and concerns come to mind?
   - Are you interested in joining us?
   


** The Goal…


  From the command line we want to be able to set up on any k8s cluster a 
full ci-cassandra like installation, then run the Jenkinsfile CI pipeline, 
pull the results and then (optionally) tear it down. 

  We envision the use of the Jenkins-Operator (or the helm chart ??), the 
JSaC plugin, the jenkins-k8s-plugin, and some seeding groovy dsl along with 
our .jenkins/Jenkinsfile located in the Cassandra source repo (new wip 
version here 

).


** Brief Background…

  The CI pipeline’s ~50k tests are split to up to 850+ container runs.  We 
also take advantage of CircleCI, as a separate CI system: at least for 
those that can afford a premium plan; and it has proven to be a valuable 
reference point for us, being very fast, stable and intuitive to use.  In 
CircleCI unqueued it takes ~40 minutes. In our current jenkins environment: 
ci-cassandra.a.o; which has 100 containers (so must queue) it takes ~7 
hours. 


** The Goal in more detail…

  Our full objective is to create a reproducible jenkins k8s based CI 
environment that contributors, collaborating and downstream companies can 
easily clone.  We see this as important to building an inclusive 
open-source culture and leading in OSS as an example of how an 
early-majority complex distributed technology can do QA to a professionally 
high standard.

In the spirit of open source I believe it is an exciting project: one that 
will also be a great example of what Jenkins is capable of.   I am unaware 
of other such projects, if you are please let me know.  

A number of committers in the Cassandra project will be working on this.  
As with most OSS projects, we rely a lot on volunteers, so all and any help 
is welcome and highly appreciated. 

It is unusual to send out such a request for such significant scope to a 
volunteer based mailing list, but given it’s entirely OSS and could be 
quite prestigious to Jenkins, with room for volunteers in any shape or 
form, this unusual callout is being made nonetheless.  You’re also welcome 
to reach out to me 1:1 if you have private questions/info.


** A bit more technical info… 



   - 
   
   Further goals to the project are as follows:
   
1. Faster turnaround times, to match those of our CircleCI setup.

2. Ensure the CI implementation is intuitive and accessible to new 
contributors.

3. Establish an accepted "test result output" format that can certify a 
commit irrespective of the CI environment, and be permanently archived.


   - 
   
   We also wish to address several challenges that we currently face:
   
A. Easier to debug and tune the setup. Feeding back to a more stable 
ci-cassandra.a.o platform for our post-commit CI: which remains  as our 
canonical CI and runs on donated heterogeneous hardware around the world.

B. Make it easier to identify and debug our very rare flaky tests.

C. Be able to scale pre-commit testing using only OSS solutions.


   - 
   
   Tearing down the jenkins setup in k8s should be optional, making it easy 
   for devs involved testing cycles (i.e. re-using an already built setup).
   


More information can be found under the epic: 
https://issues.apache.org/jira/browse/CASSANDRA-18137 



regards,

Mick, on behalf of the Apache Cassandra PMC


-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/15063cba-57ec-4186-bb99-beeb5461b9aen%40googlegroups.com.

Jenkins / Unity / Guthub integration

['andrew stillie' via Jenkins Users]

I am  novice to using Unity and Jenkins.

I have setup a Jenkins Server on an AWS server.  This is integrated with 
github, such that when I commit code to the repo, it triggers jenkins to 
run my Unity test scripts.
However, if I introduce a bug to force the unity test to fail, the console 
output indicates the FAIL to that particular test, Jenkins pass the overall 
test as a pass.
I believe this is because Jenkins is detecting the "SUCCESS" keyword at the 
end of the console output.

test/TestEdmundCode.c:19:test_handleEdmundBehaviour_TestNoFalseExitsFromStateShutdown:PASS
test/TestEdmundCode.c:35:test_handleEdmundBehaviour_TestTrueExitsFromIdleState:PASS
 
test/TestEdmundCode.c:46:test_handleEdmundBehaviour_TestNoFalseExitsFromStatePoweringUp:PASS
 
test/TestEdmundCode.c:60:test_handleEdmundBehaviour_TestTrueExitsFromStatePoweringUp_behaviourEventButtonDownLT1000:PASS
 
test/TestEdmundCode.c:70:test_handleEdmundBehaviour_TestTrueExitsFromStatePoweringUp_behaviourEventButtonDownGT1000LT5000:FAIL:
 
Expected 5 Was 7 
test/TestEdmundCode.c:72:test_handleEdmundBehaviour_TestTrueExitsFromStatePoweringUp_behaviourEventButtonDownGT5000:PASS
 
test/TestEdmundCode.c:82:test_handleEdmundBehaviour_TestNoFalseExitsFrombehaviourStatePoweringDn:PASS
 
test/TestEdmundCode.c:97:test_handleEdmundBehaviour_TestTrueExitsFrombehaviourStatePoweringDn_behaviourEventLowBattery:PASS
 
test/TestEdmundCode.c:103:test_handleEdmundBehaviour_TestTrueExitsFrombehaviourStatePoweringDn_behaviourEventButtonDownGT2000Rleased:PASS
 
test/TestEdmundCode.c:114:test_handleEdmundBehaviour_TestNoFalseExitsFrombehaviourStatePoweringUpLowBattery:PASS
 
test/TestEdmundCode.c:128:test_handleEdmundBehaviour_TestTrue1ExitsFrombehaviourStatePoweringUpLowBattery_behaviourEventButtonDownLT1000:PASS
 
test/TestEdmundCode.c:134:test_handleEdmundBehaviour_TestTrue1ExitsFrombehaviourStatePoweringUpLowBattery_behaviourEventButtonDownGT1000LT5000:PASS
 
test/TestEdmundCode.c:140:test_handleEdmundBehaviour_TestTrue1ExitsFrombehaviourStatePoweringUpLowBattery_behaviourEventButtonDownGT5000:PASS
 
test/TestEdmundCode.c:150:test_handleEdmundBehaviour_TestNoFalseExitsFrombehaviourStateConnectedAuthApp:PASS
 
test/TestEdmundCode.c:166:test_handleEdmundBehaviour_TestTrueExitsFrombehaviourStateConnectedAuthApp:PASS
 
test/TestEdmundCode.c:175:test_handleEdmundBehaviour_TestNoFalseExitsFromStateAdvertising:PASS
 
test/TestEdmundCode.c:190:test_handleEdmundBehaviour_TestTrueExitsFromStateAdvertising_behaviourEventConnectedAuth:PASS
 
test/TestEdmundCode.c:196:test_handleEdmundBehaviour_TestTrueExitsFromStateAdvertising_behaviourEventButtonDownGT50:PASS
 
test/TestEdmundCode.c:206:test_handleEdmundBehaviour_TestNoFalseExitsFromConnectedUnAuthApp:PASS
 
test/TestEdmundCode.c:222:test_handleEdmundBehaviour_TestTrueExitsFromConnectedUnAuthApp:PASS
 
test/TestEdmundCode.c:232:test_handleEdmundBehaviour_TestNoFalseExitsFrombehaviourStateLowBattShutdown:PASS
 
--- 21 Tests 1 Failures 0 Ignored FAIL make: 
[makefile:57: default] Error 1 (ignored) + echo 0 0 [Set GitHub commit 
status (universal)] SUCCESS on repos [] (sha:6af4ca3) with 
context:TestJobGit Finished: SUCCESS


How do I get Unity/Jenkins to detect that the individual test has failed.  
The icing on the cake would be to somehow mark the git commit as a failure 
also.

Thank in advance.

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/b2d4daed-d906-4008-99fd-75185d1f0a27n%40googlegroups.com.

Re: fresh Jenkins installation does not present the dashboard

['Daniel Beck' via Jenkins Users]

On Fri, Jul 28, 2023 at 11:21 AM Matthias Apitz  wrote:

>
> * TLSv1.3 (OUT), TLS handshake, Client hello (1):
>
> it hangs. Sould it says '404 bla not found"
>

This indicates that something other than Jenkins is broken, so it's a
system/environment issue. Fix that first, then try again with Jenkins.

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAMo7Pt%2Bx9SKZcEifv4JPOJBNBd1WydQYcaMGcrXfBiNGwKWi%2Bg%40mail.gmail.com.

Re: fresh Jenkins installation does not present the dashboard

[Matthias Apitz]

El día viernes, julio 28, 2023 a las 10:37:54 +0200, 'Daniel Beck' via Jenkins 
Users escribió:

> > Our IT department will say: 443 outbound is all open
> >
> 
> Can you curl from the Jenkins controller system to e.g. google.com?
> 
> Any exceptions getting logged?

Please be more specific what you want me to test from the Jenkins
controller.

When I curl from the Linux cmd line:

$ curl --verbose https://www.google.com/bla
*   Trying 142.250.186.100...
* TCP_NODELAY set
* Connected to www.google.com (142.250.186.100) port 443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* successfully set certificate verify locations:
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* TLSv1.3 (OUT), TLS handshake, Client hello (1):

it hangs. Sould it says '404 bla not found"

the JSON is downloaded fine and fast:

$ curl https://updates.jenkins.io/current/update-center.json | wc -c
  % Total% Received % Xferd  Average Speed   TimeTime Time  Current
 Dload  Upload   Total   SpentLeft  Speed
100 2770k  100 2770k0 0  2823k  0 --:--:-- --:--:-- --:--:-- 2820k
2836543

matthias
-- 
Matthias Apitz, ✉ g...@unixarea.de, http://www.unixarea.de/ +49-176-38902045
Public GnuPG key: http://www.unixarea.de/key.pub

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/ZMOIgkB2dSnaoPGr%40pureos.

Re: fresh Jenkins installation does not present the dashboard

['Daniel Beck' via Jenkins Users]

On Fri, Jul 28, 2023 at 10:30 AM Matthias Apitz  wrote:

>
> [2023-07-28 09:50:31][SEVERE][hudson.model.UpdateCenter$DownloadJob run]
> Failed to install scm-api
> java.io.IOException: Failed to dynamically deploy this plugin
> at
> hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:2204)
> at
> hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1850)
> ...
>

Might have a number of causes, not all of them network-related.


> When I watch such a plugin update with tcpdump for all traffic to/from
> port 443 such fetch is very slow and lazy. I looked in the file for
> the update: the JSON file in https://updates.jenkins.io/update-center.json
> it has 3413 URLs for downloading and I understand now why this took
> always so long in the first initialization of Jenkins.
>

None of them are actually downloaded. The JSON file is basically all that's
being downloaded.


> Our IT department will say: 443 outbound is all open
>

Can you curl from the Jenkins controller system to e.g. google.com?

Any exceptions getting logged?

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/CAMo7PtJm9LSuzksOQBfae-HW6YT1Y%3DuiDSRnFLgvchMnyruqug%40mail.gmail.com.

Re: fresh Jenkins installation does not present the dashboard

[Matthias Apitz]

I used the moment when Jenkins in the browser said to me, that I'm
offline and if I want to continue without updating the plugins. I
created an account and when I now update plugins manually, some work
fine, sometimes it fails with a message in the log file, like:

[2023-07-28 09:50:31][SEVERE][hudson.model.UpdateCenter$DownloadJob run] Failed 
to install scm-api
java.io.IOException: Failed to dynamically deploy this plugin
at 
hudson.model.UpdateCenter$InstallationJob._run(UpdateCenter.java:2204)
at hudson.model.UpdateCenter$DownloadJob.run(UpdateCenter.java:1850)
...

It even says sometimes in the browser (like right now) that the update
of a given plugin was successful, but that a test to Google.com failed:

Download progress
Preparation 

Checking internet connectivity
Checking update center connectivity
Success
Failed to connect to https://www.google.com/. Perhaps you need to configure 
HTTP proxy?

Mina SSHD API :: Core   Downloaded Successfully. Will be activated during 
the next boot

When I watch such a plugin update with tcpdump for all traffic to/from
port 443 such fetch is very slow and lazy. I looked in the file for
the update: the JSON file in https://updates.jenkins.io/update-center.json
it has 3413 URLs for downloading and I understand now why this took
always so long in the first initialization of Jenkins.

What should I do. Our IT department will say: 443 outbound is all open
...

Thanks

matthias
-- 
Matthias Apitz, ✉ g...@unixarea.de, http://www.unixarea.de/ +49-176-38902045
Public GnuPG key: http://www.unixarea.de/key.pub

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/jenkinsci-users/ZMN8geHLnjhh1NAx%40pureos.