Source: openqa Version: 4.6.1732034221.ae34b08ff-2 Severity: minor Tags: trixie sid ftbfs User: lu...@debian.org Usertags: ftbfs-shuffle
Hi, GNU Make now has a --shuffle option that simulates non-deterministic ordering of target prerequisites. See https://trofi.github.io/posts/238-new-make-shuffle-mode.html and also previous work in Debian by Santiago Vila: https://people.debian.org/~sanvila/make-shuffle/ This package fails to build with make --shuffle=reverse. This is likely to be caused by a missing dependency in debian/rules or an upstream Makefile. More information about this mass bug filing is available at https://wiki.debian.org/qa.debian.org/FTBFS/Shuffle Relevant part (hopefully): > make[4]: Entering directory > '/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff' > + tr '\n' : > + cat tools/unstable_tests.txt > + grep suse /etc/os-release > Makefile:264: update target 'test-unit-and-integration' due to: target is > .PHONY > export > GLOBIGNORE="t/*tidy*:t/*compile*:t/25-cache-service.t:t/43-scheduling-and-worker-scalability.t:t/ui/01-list.t:t/ui/26-jobs_restart.t:t/ui/13-admin.t:";\ > export DEVEL_COVER_DB_FORMAT=JSON;\ > export PERL5OPT=" -It/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/external/os-autoinst-common/lib > -MOpenQA::Test::PatchDeparse";\ > RETRY=0 HOOK=./tools/delete-coverdb-folder timeout -s SIGINT -k 5 -v $((20 * > 2 * (0 + 1) ))m tools/retry prove -l t/api/*.t > + export > 'GLOBIGNORE=t/*tidy*:t/*compile*:t/25-cache-service.t:t/43-scheduling-and-worker-scalability.t:t/ui/01-list.t:t/ui/26-jobs_restart.t:t/ui/13-admin.t:' > + > GLOBIGNORE='t/*tidy*:t/*compile*:t/25-cache-service.t:t/43-scheduling-and-worker-scalability.t:t/ui/01-list.t:t/ui/26-jobs_restart.t:t/ui/13-admin.t:' > + export DEVEL_COVER_DB_FORMAT=JSON > + DEVEL_COVER_DB_FORMAT=JSON > + export 'PERL5OPT= -It/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/external/os-autoinst-common/lib > -MOpenQA::Test::PatchDeparse' > + PERL5OPT=' -It/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/lib > -I/build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/external/os-autoinst-common/lib > -MOpenQA::Test::PatchDeparse' > + RETRY=0 > + HOOK=./tools/delete-coverdb-folder > + timeout -s SIGINT -k 5 -v 40m tools/retry prove -l t/api/01-workers.t > t/api/02-assets.t t/api/02-iso-download.t t/api/02-iso-yaml.t t/api/02-iso.t > t/api/03-auth.t t/api/04-jobs.t t/api/05-machines.t t/api/06-products.t > t/api/07-testsuites.t t/api/08-jobtemplates.t t/api/09-comments.t > t/api/10-jobgroups.t t/api/11-bugs.t t/api/12-admin-workers.t > t/api/13-influxdb.t t/api/14-plugin_obs_rsync.t > t/api/14-plugin_obs_rsync_async.t t/api/15-search.t t/api/15-users.t > t/api/16-webhooks.t > t/api/01-workers.t ................. ok > t/api/02-assets.t .................. ok > t/api/02-iso-download.t ............ ok > > # Failed test 'error when YAML file is invalid' > # at t/api/02-iso-yaml.t line 41. > # 'YAML validation failed: > # GET http://json-schema.org/draft-04/schema: Can't connect: Temporary > failure in name resolution at /usr/share/perl5/JSON/Validator/Store.pm line > 190.' > # doesn't match '(?^s:YAML validation failed:.*machines: Expected > object - got null.*products: Expected object - got null)' > # 0 > > # Failed test 'error when YAML is invalid' > # at t/api/02-iso-yaml.t line 47. > # 'YAML validation failed: > # GET http://json-schema.org/draft-04/schema: Can't connect: Temporary > failure in name resolution at /usr/share/perl5/JSON/Validator/Store.pm line > 190.' > # doesn't match '(?^s:YAML validation failed:.*machines: Expected > object - got null.*products: Expected object - got null)' > # 0 > # Looks like you failed 2 tests of 12. > > # Failed test 'schedule from yaml file: error cases' > # at t/api/02-iso-yaml.t line 49. > > # Failed test '200 OK' > # at > /build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/api/../lib/OpenQA/Test/Utils.pm > line 603. > # got: '400' > # expected: '200' > > # Failed test 'two jobs were scheduled' > # at t/api/02-iso-yaml.t line 56. > # got: '0' > # expected: '2' > # 0 > # Looks like you failed 2 tests of 3. > > # Failed test 'schedule from yaml file: case with machines/products and job > dependencies' > # at t/api/02-iso-yaml.t line 98. > > # Failed test '200 OK' > # at > /build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/api/../lib/OpenQA/Test/Utils.pm > line 603. > # got: '400' > # expected: '200' > > # Failed test 'two jobs were scheduled without products/machines' > # at t/api/02-iso-yaml.t line 105. > # got: '0' > # expected: '2' > # 0 > > # Failed test 'two job IDs returned' > # at t/api/02-iso-yaml.t line 107. > # got: '0' > # expected: '2' > # 0 > # Looks like you failed 3 tests of 4. > > # Failed test 'schedule from yaml file: most simple case of two explicitly > specified jobs' > # at t/api/02-iso-yaml.t line 123. > > # Failed test '200 OK' > # at > /build/reproducible-path/openqa-4.6.1732034221.ae34b08ff/t/api/../lib/OpenQA/Test/Utils.pm > line 603. > # got: '400' > # expected: '200' > > # Failed test 'one job was scheduled' > # at t/api/02-iso-yaml.t line 130. > # got: '0' > # expected: '1' > # 0 > > # Failed test 'one job ID returned' > # at t/api/02-iso-yaml.t line 132. > # got: '0' > # expected: '1' > # 0 > # Looks like you failed 3 tests of 4. > > # Failed test 'schedule from yaml file: wildcard version' > # at t/api/02-iso-yaml.t line 145. > # Looks like you failed 4 tests of 5. > t/api/02-iso-yaml.t ................ > Dubious, test returned 4 (wstat 1024, 0x400) > Failed 4/5 subtests > t/api/02-iso.t ..................... ok > t/api/03-auth.t .................... ok > t/api/04-jobs.t .................... ok > t/api/05-machines.t ................ ok > t/api/06-products.t ................ ok > t/api/07-testsuites.t .............. ok > > # Failed test 'Empty YAML is an error' > # at t/api/08-jobtemplates.t line 463. > # got: '1' > # expected: '2' > # 0 > > # Failed test 'No products defined' > # at t/api/08-jobtemplates.t line 466. > # Structures begin differing at: > # $got->[0] = 'GET http://json-schema.org/draft-04/schema: Can't > connect: Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # $expected->[0] = '/products: Missing property.' > # 0 > > # Failed test 'No distri specified' > # at t/api/08-jobtemplates.t line 470. > # got: 'GET http://json-schema.org/draft-04/schema: Can't connect: > Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # expected: '/products/open-*.SUSE1/distri: Missing property.' > # 0 > > # Failed test 'No flavor specified' > # at t/api/08-jobtemplates.t line 477. > # got: 'GET http://json-schema.org/draft-04/schema: Can't connect: > Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # expected: '/products/open-*.SUSE1/flavor: Missing property.' > # 0 > > # Failed test 'No version specified' > # at t/api/08-jobtemplates.t line 483. > # Structures begin differing at: > # $got->[0] = 'GET http://json-schema.org/draft-04/schema: Can't > connect: Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # $expected->[0] = '/products/open-*.SUSE1/version: Missing property.' > # 0 > > # Failed test 'Invalid product property specified' > # at t/api/08-jobtemplates.t line 490. > # got: 'GET http://json-schema.org/draft-04/schema: Can't connect: > Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # expected: '/products/open-*.SUSE1: Properties not allowed: > distribution.' > # 0 > > # Failed test 'YAML valid as expected' > # at t/api/08-jobtemplates.t line 509. > # Structures begin differing at: > # $got->[0] = 'GET http://json-schema.org/draft-04/schema: Can't > connect: Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # $expected->[0] = Does not exist > # 0 > > # Failed test 'YAML of single group is valid' > # at t/api/08-jobtemplates.t line 525. > # Structures begin differing at: > # $got->[0] = 'GET http://json-schema.org/draft-04/schema: Can't > connect: Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # $expected->[0] = Does not exist > > # Failed test 'YAML added to the database' > # at t/api/08-jobtemplates.t line 596. > # got: '400' > # expected: '200' > # 0 > # Looks like you failed 1 test of 3. > > # Failed test 'Migration' > # at t/api/08-jobtemplates.t line 614. > > # Failed test 'YAML posted successfully' > # at t/api/08-jobtemplates.t line 617. > # got: '400' > # expected: '200' > # Looks like you failed 1 test of 4. > > # Failed test 'Deprecated routes still work' > # at t/api/08-jobtemplates.t line 625. > > # Failed test 'posting with wrong reference fails' > # at t/api/08-jobtemplates.t line 628. > # Structures begin differing at: > # $got->{job_group_id} = Does not exist > # $expected->{job_group_id} = '1001' > > # Failed test 'posting with correct reference succeeds' > # at t/api/08-jobtemplates.t line 651. > # got: '400' > # expected: '200' > # 0 > # Looks like you failed 2 tests of 6. > > # Failed test 'Conflicts' > # at t/api/08-jobtemplates.t line 670. > > # Failed test 'validation error messages returned' > # at t/api/08-jobtemplates.t line 720. > # Structures begin differing at: > # $got->[0] = 'GET http://json-schema.org/draft-04/schema: Can't > connect: Temporary failure in name resolution at > /usr/share/perl5/JSON/Validator/Store.pm line 190.' > # $expected->[0] = HASH(0x5611b95e4970) > # 0 > > # Failed test 'posting invalid YAML template - error path' > # at t/api/08-jobtemplates.t line 733. > # got: undef > # expected: '/scenarios/i586/opensuse-13.1-DVD-i586/0' > > # Failed test 'posting invalid YAML template - error content' > # at t/api/08-jobtemplates.t line 733. > # undef > # doesn't match '(?^:/anyOf/1 Too many properties: 2/1.|/anyOf/0 Expected > string - got object.)' > > # Failed test 'Invalid testsuite' > # at t/api/08-jobtemplates.t line 757. > # Structures begin differing at: > # $got->{id} = Does not exist > # $expected->{id} = '1003' > # 0 > # Looks like you failed 1 test of 4. > > # Failed test 'Create and modify groups with YAML' > # at t/api/08-jobtemplates.t line 1082. > > # Failed test 'New group with references was added to the database' > # at t/api/08-jobtemplates.t line 1093. > # got: '400' > # expected: '200' > # 0 > # Looks like you failed 1 test of 3. > > # Failed test 'References' > # at t/api/08-jobtemplates.t line 1130. > > # Failed test 'New group with hidden keys was added to the database' > # at t/api/08-jobtemplates.t line 1142. > # got: '400' > # expected: '200' > # 0 > # Looks like you failed 1 test of 3. > > # Failed test 'Hidden keys' > # at t/api/08-jobtemplates.t line 1155. > > # Failed test 'New group with references and variables was added to the > database' > # at t/api/08-jobtemplates.t line 1186. > # got: '400' > # expected: '200' > # 0 > # Looks like you failed 1 test of 3. > > # Failed test 'Staging' > # at t/api/08-jobtemplates.t line 1214. > > # Failed test 'Attempt to rename product used in group was blocked' > # at t/api/08-jobtemplates.t line 1219. > # Structures begin differing at: > # $got->{error} = Does not exist > # $expected->{error} = 'Groups foo, opensuse, test must be updated > through the YAML template' > > # Failed test 'Attempt to delete product used in group was blocked' > # at t/api/08-jobtemplates.t line 1234. > # Structures begin differing at: > # $got->{error} = Does not exist > # $expected->{error} = 'Groups foo, opensuse, test must be updated > through the YAML template' > > # Failed test 'Attempt to rename machine used in group was blocked' > # at t/api/08-jobtemplates.t line 1239. > # Structures begin differing at: > # $got->{error_status} = Does not exist > # $expected->{error_status} = '400' > > # Failed test 'Attempt to delete machine used in group was blocked' > # at t/api/08-jobtemplates.t line 1249. > # Structures begin differing at: > # $got->{error_status} = Does not exist > # $expected->{error_status} = '400' > > # Failed test 'Attempt to rename test suite used in group was blocked' > # at t/api/08-jobtemplates.t line 1254. > # Structures begin differing at: > # $got->{error_status} = Does not exist > # $expected->{error_status} = '400' > > # Failed test 'Attempt to delete test suite used in group was blocked' > # at t/api/08-jobtemplates.t line 1267. > # Structures begin differing at: > # $got->{error} = Does not exist > # $expected->{error} = 'Group opensuse must be updated through the > YAML template' > # Looks like you failed 6 tests of 20. > > # Failed test 'Modifying tables used in YAML not allowed' > # at t/api/08-jobtemplates.t line 1272. > > # Failed test 'Group opensuse is managed in YAML' > # at t/api/08-jobtemplates.t line 1275. > > # Failed test 'Attempt to modify priority was blocked' > # at t/api/08-jobtemplates.t line 1277. > # got: '200' > # expected: '400' > > # Failed test 'Attempt to delete was blocked' > # at t/api/08-jobtemplates.t line 1286. > # got: '404' > # expected: '400' > > # Failed test '200 OK' > # at t/api/08-jobtemplates.t line 1289. > # got: '404' > # expected: '200' > > # Failed test '200 OK' > # at t/api/08-jobtemplates.t line 1292. > # got: '404' > # expected: '200' > > # Failed test 'Delete was logged correctly' > # at t/api/08-jobtemplates.t line 1294. > # Structures begin differing at: > # $got = undef > # $expected = HASH(0x5611b971d290) > # Looks like you failed 25 tests of 73. > t/api/08-jobtemplates.t ............ > Dubious, test returned 25 (wstat 6400, 0x1900) > Failed 25/73 subtests > # 0 > t/api/09-comments.t ................ ok > t/api/10-jobgroups.t ............... ok > t/api/11-bugs.t .................... ok > t/api/12-admin-workers.t ........... ok > t/api/13-influxdb.t ................ ok > ssh-keygen is not available. Aborting. > t/api/14-plugin_obs_rsync.t ........ > Dubious, test returned 9 (wstat 2304, 0x900) > No subtests run > ssh-keygen is not available. Aborting. > Can't call method "signal" on an undefined value at > t/api/14-plugin_obs_rsync_async.t line 185. > END failed--call queue aborted. > t/api/14-plugin_obs_rsync_async.t .. > Dubious, test returned 22 (wstat 5632, 0x1600) > No subtests run > t/api/15-search.t .................. ok > t/api/15-users.t ................... ok > > # Failed test 'expected URL used to download > SCENARIO_DEFINITIONS_YAML_FILE' > # at t/api/16-webhooks.t line 169. > # got: 'http://json-schema.org/draft-04/schema' > # expected: > 'https://raw.githubusercontent.com/Martchus/openQA/04a3f669ea13a4aa7cbd4569f578a66f7403c43d/scenario-definitions.yaml' > # Looks like you failed 1 test of 25. > > # Failed test 'triggering the scheduled product will report status back to > GitHub' > # at t/api/16-webhooks.t line 213. > # Looks like you failed 1 test of 8. > t/api/16-webhooks.t ................ > Dubious, test returned 1 (wstat 256, 0x100) > Failed 1/8 subtests > > Test Summary Report > ------------------- > t/api/02-iso-yaml.t (Wstat: 1024 (exited 4) Tests: 5 Failed: 4) > Failed tests: 1-4 > Non-zero exit status: 4 > t/api/08-jobtemplates.t (Wstat: 6400 (exited 25) Tests: 73 Failed: > 25) > Failed tests: 16-22, 28, 31-33, 38, 46-47, 49-54, 56 > 58, 60, 64, 67 > Non-zero exit status: 25 > t/api/14-plugin_obs_rsync.t (Wstat: 2304 (exited 9) Tests: 0 Failed: 0) > Non-zero exit status: 9 > Parse errors: No plan found in TAP output > t/api/14-plugin_obs_rsync_async.t (Wstat: 5632 (exited 22) Tests: 0 Failed: 0) > Non-zero exit status: 22 > Parse errors: No plan found in TAP output > t/api/16-webhooks.t (Wstat: 256 (exited 1) Tests: 8 Failed: 1) > Failed test: 6 > Non-zero exit status: 1 > Files=21, Tests=752, 160 wallclock secs ( 0.94 usr 0.11 sys + 136.96 cusr > 9.58 csys = 147.59 CPU) > Result: FAIL > make[4]: *** [Makefile:264: test-unit-and-integration] Error 1 shuffle=reverse The full build log is available from: http://qa-logs.debian.net/2025/05/05/shuffle/reverse/openqa_4.6.1732034221.ae34b08ff-2_unstable_reverse.log If you reassign this bug to another package, please mark it as 'affects'-ing this package. See https://www.debian.org/Bugs/server-control#affects
