[ https://issues.apache.org/jira/browse/CASSANDRA-17930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627287#comment-17627287 ]
Ekaterina Dimitrova edited comment on CASSANDRA-17930 at 12/7/22 3:50 PM: -------------------------------------------------------------------------- Reassigned the ticket after a conversation with [~dchenbecker] . He will be looking into the improvements proposal he is doing and I will finish the rest of the work here around CircleCI. Despite the already linked tickets: CASSANDRA-17989, CASSANDRA-17671, CASSANDRA-17987 , CASSANDRA-17912 and CASSANDRA-17950, I did a check on what other tests we miss: - Burn tests - large Python DTests (with and without vnodes) miss on all branches. - CQLSHLIB with JDK11. - JVM distributed tests on J8/J11. I will open a ticket for that last part in a bit and link it here. I also identified a minor issue on our [testing webpage|https://cassandra.apache.org/_/development/testing.html#jvm_distributed_tests]. The tests missing in Jenkins are the simulator tests and the keyspaces one (there is already a ticket). *EDIT:* CASSANDRA-18001 opened for the rest of the CircleCI tests and CASSANDRA-18003 was opened for the simulator tests to be added to Jenkins was (Author: e.dimitrova): Reassigned the ticket after a conversation with [~dchenbecker] . He will be looking into the improvements proposal he is doing and I will finish the rest of the work here around CircleCI. Despite the already linked tickets: CASSANDRA-17989, CASSANDRA-17671, CASSANDRA-17987 , CASSANDRA-17912 and CASSANDRA-17950, I did a check on what other tests we miss: - Burn tests - large Python DTests (with and without vnodes) miss on all branches. - CQLSHLIB with JDK11. - JVM distributed tests on J8/J11. I will open a ticket for that last part in a bit and link it here. I also identified a minor issue on our [testing webpage|https://cassandra.apache.org/_/development/testing.html#jvm_distributed_tests]. The tests missing in Jenkins are the simulator tests and the keyspaces one (there is already a ticket). *EDIT:* CASSANDRA-18001 opened for the rest of the CircleCI tests and CASSANDRA-18003 was opened for the simulator tests to be added to CIrcleCI > Ensure CircleCI and ASF Jenkins CI are aligned > ---------------------------------------------- > > Key: CASSANDRA-17930 > URL: https://issues.apache.org/jira/browse/CASSANDRA-17930 > Project: Cassandra > Issue Type: Task > Components: CI > Reporter: Ekaterina Dimitrova > Assignee: Ekaterina Dimitrova > Priority: Normal > Fix For: 3.0.x, 3.11.x, 4.0.x, 4.1.x, 4.x > > > As discussed in this > [thread|https://lists.apache.org/list.html?d...@cassandra.apache.org] the > Cassandra community wants to see CircleCI and ASF CI being aligned - running > the same tests, configurations, all tests. > Exceptions: packaging. > A few examples of discrepancies we already noticed: > * utests_system_keyspace_directory run only in CircleCI - CASSANDRA-17145 > * dtest-large run only in Jenkins > * simulator tests run only in CircleCI > * In a quick skim I think I didn't see > [these|https://github.com/apache/cassandra-builds/blob/trunk/build-scripts/cassandra-dtest-pytest.sh#L84-L89] > runs too in CircleCI - dtest-offheap, dtest-large, dtest-large-novnode > * packaging is also only tested in CircleCI as far as I recall but that is > deterministic and we will rely on Jenkins about that. > And these are only a few examples on top of my mind. I am sure we will find > more. We also need to verify the way we call those tests is correct and > matches in both CIs. (I was looking to solve similar discrepancy in > CASSANDRA-17912) > Some info on our tests suites here - > [https://cassandra.apache.org/_/development/testing.html,] > [cassandra-builds repo|https://github.com/apache/cassandra-builds] where our > test images reside and the Jenkins build scripts, which I already referred > to. > CircleCI info can be found in the readme which resides in the in-tree folder > dedicated to configuration and scripts for Circle CI - > [https://github.com/apache/cassandra/tree/trunk/.circleci] > EDIT: More findings: > * burn tests missing in CircleIC > * cqlshlib in 3.11. > * 4.0+ we also need in-jvm JDK8 with 11, cqlshlib JDK8 with 11. > EDIT: Java distributed tests running with vnodes should be added to Jenkins > -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org