[
https://issues.apache.org/jira/browse/CASSANDRA-19558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17839287#comment-17839287
]
Michael Semb Wever edited comment on CASSANDRA-19558 at 4/23/24 7:31 PM:
-------------------------------------------------------------------------
A number of issues have been identified.
– need to capture the generateTestReports logs,
– fix ant version in centos7-build.docker
– remove docker login (if credentials exist then docker is logged in)
– prefetch docker images from jfrog (to reduce dockerhub pull rate limits)
– use scripts from cassandra-builds to clean and report on agents
– stream xz where possible (not an issue, just perf improvement)
The docker pull rate limit was the most serious, blocking.
patches…
1.
this is part of CASSANDRA-18594 (most of it is already running (manually
deployed) to ci-cassandra)
[https://github.com/apache/cassandra-builds/compare/trunk...thelastpickle:cassandra-builds:mck/18594]
( [https://github.com/apache/cassandra-builds/commit/eb3eb5e] )
2.
and for CASSANDRA-19558
[https://github.com/apache/cassandra-builds/compare/trunk...thelastpickle:cassandra-builds:mck/19558]
(
[https://github.com/thelastpickle/cassandra-builds/commit/9f8ae9dcacd0d744992cc4eaf50f29a8836ffdbd]
)
3.
and then (also for CASSANDRA-19558 ) but comes last (i can test it manually
once (2) is committed)
[https://github.com/apache/cassandra/commit/92c0cb7]
(this is on top of the previous commit (that already passed review) in
[https://github.com/apache/cassandra/compare/apache:cassandra:cassandra-5.0...thelastpickle:cassandra:mck/jenkinsfile-persist-parameters-5.0|https://github.com/apache/cassandra/compare/apache:cassandra:cassandra-5.0...thelastpickle:cassandra:mck/jenkinsfile-persist-parameters-5.0]
)
was (Author: michaelsembwever):
A number of issues have been identified.
– need to capture the generateTestReports logs,
– fix ant version in centos7-build.docker
– remove docker login (if credentials exist then docker is logged in)
– prefetch docker images from jfrog (to reduce dockerhub pull rate limits)
– use scripts from cassandra-builds to clean and report on agents
– stream xz where possible (not an issue, just perf improvement)
The docker pull rate limit was the most serious, blocking.
patches…
1.
this is part of CASSANDRA-18594 (most of it is already running (manually
deployed) to ci-cassandra)
[https://github.com/apache/cassandra-builds/compare/trunk...thelastpickle:cassandra-builds:mck/18594]
( [https://github.com/apache/cassandra-builds/commit/eb3eb5e] )
2.
and for CASSANDRA-19558
[https://github.com/thelastpickle/cassandra-builds/compare/mck/18594...thelastpickle:cassandra-builds:mck/19558]
(
[https://github.com/thelastpickle/cassandra-builds/commit/9f8ae9dcacd0d744992cc4eaf50f29a8836ffdbd]
)
3.
and then (also for CASSANDRA-19558 ) but comes last (i can test it manually
once (2) is committed)
[https://github.com/apache/cassandra/commit/92c0cb7]
(this is on top of the previous commit (that already passed review) in
[https://github.com/apache/cassandra/compare/apache:cassandra:cassandra-5.0...thelastpickle:cassandra:mck/jenkinsfile-persist-parameters-5.0|https://github.com/apache/cassandra/compare/apache:cassandra:cassandra-5.0...thelastpickle:cassandra:mck/jenkinsfile-persist-parameters-5.0]
)
> Standalone jenkinsfile first round bug fixes
> --------------------------------------------
>
> Key: CASSANDRA-19558
> URL: https://issues.apache.org/jira/browse/CASSANDRA-19558
> Project: Cassandra
> Issue Type: Bug
> Components: CI
> Reporter: Michael Semb Wever
> Assignee: Michael Semb Wever
> Priority: Normal
> Fix For: 5.0.x, 5.x
>
> Attachments: CASSANDRA-19558_50_#5_ci_summary.html,
> CASSANDRA-19558_50_#5_results_details.tar.xz,
> CASSANDRA-19558-5.0_#13_ci_summary.html,
> CASSANDRA-19558-5.0_#13_results_details.tar.xz,
> CASSANDRA-19558-5.0_#16_ci_summary.html,
> CASSANDRA-19558-5.0_#16_results_details.tar.xz,
> CASSANDRA-19558_#8_ci_summary.html, CASSANDRA-19558_#8_results_details.tar.xz
>
>
> A few follow up improvements and bug fixes for the standalone jenkinsfile.
> - add at top a list of test failures in ci_summary.html
> - docker scripts always try to login (as base images need to be pulled too)
> - move simulator-dtests to large containers (they need 8g just heap)
> - in ubuntu2004_test.docker make sure /home/cassandra exists and has correct
> perms (from marcuse)
> - persist the jenkinsfile parameters from run to run (important for the
> post-commit jobs to keep their non-default branch and profile values) (was
> CASSANDRA-19536)
> - increase jvm-dtest splits from 8 to 12
> - when on ci-cassandra, replace use of copyArtifacts in Jenkinsfile
> generateTestReports() with manual wget of test files, allowing the summary
> phase to be run on any agent (copyArtifact would take >4hrs otherwise) (was
> INFRA-25694)
> - copy ci_summary.html and results_details.tar.xz to nightlies
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org
