Source: python-pytest-benchmark
Version: 4.0.0-3
Severity: normal
User: debian-pyt...@lists.debian.org
Usertags: python3.13

This package failed build from source when test-built against a version of
python3-defaults that includes 3.13 as a supported version.

To reproduce this issue, build against python3-defaults (python3-all-dev etc.)
from Debian experimental.

What's new in Python 3.13:
https://docs.python.org/3.13/whatsnew/3.13.html
The layout of argparse help changed, it'll need a whitespace patch.

Log snippet:

   dh_auto_test -O--buildsystem=pybuild
I: pybuild base:311: cd 
/<<PKGBUILDDIR>>/.pybuild/cpython3_3.13_pytest-benchmark/build; python3.13 -m 
pytest tests
============================= test session starts ==============================
platform linux -- Python 3.13.0rc2, pytest-8.3.3, pluggy-1.5.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False 
min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 
warmup=False warmup_iterations=100000)
rootdir: /<<PKGBUILDDIR>>/.pybuild/cpython3_3.13_pytest-benchmark/build
configfile: pytest.ini
plugins: benchmark-4.0.0, typeguard-4.3.0, xdist-3.6.1
collected 228 items / 4 skipped

tests/test_benchmark.py ................................................ [ 21%]
.....                                                                    [ 23%]
tests/test_calibration.py ..................................             [ 38%]
tests/test_cli.py F..........                                            [ 42%]
tests/test_doctest.rst .                                                 [ 43%]
tests/test_elasticsearch_storage.py .......                              [ 46%]
tests/test_normal.py ..........                                          [ 50%]
tests/test_pedantic.py ...................                               [ 59%]
tests/test_sample.py ....                                                [ 60%]
tests/test_skip.py s                                                     [ 61%]
tests/test_stats.py ..............                                       [ 67%]
tests/test_storage.py ........................................           [ 85%]
tests/test_utils.py ..................................                   [100%]

=================================== FAILURES ===================================
__________________________________ test_help ___________________________________
/<<PKGBUILDDIR>>/.pybuild/cpython3_3.13_pytest-benchmark/build/tests/test_cli.py:23:
 in test_help
    result.stdout.fnmatch_lines([
E   Failed: fnmatch: 'usage: py.test-benchmark *'
E      with: 'usage: py.test-benchmark [-h [COMMAND]] [--storage URI] [--netrc 
[NETRC]]'
E   nomatch: '                         {help,list,compare} ...'
E       and: '                         [--verbose] [--quiet]'
E       and: '                         [--import-mode 
{prepend,append,importlib}]'
E   exact match: '                         {help,list,compare} ...'
E   exact match: ''
E   exact match: "pytest_benchmark's management commands."
E   exact match: ''
E   fnmatch: 'option*:'
E      with: 'options:'
E   nomatch: '  -h [COMMAND], --help [COMMAND]'
E       and: '  -h, --help [COMMAND]  Display help and exit.'
E       and: '  --storage, -s URI     Specify a path to store the runs as uri 
in form'
E       and: '                        file://path or 
elasticsearch+http[s]://host1,host2/[in'
E       and: '                        dex/doctype?project_name=Project] (when 
--benchmark-'
E       and: '                        save or --benchmark-autosave are used). 
For backwards'
E       and: '                        compatibility unexpected values are 
converted to'
E       and: "                        file://<value>. Default: 
'file://./.benchmarks'."
E       and: '  --netrc [NETRC]       Load elasticsearch credentials from a 
netrc file.'
E       and: "                        Default: ''."
E       and: '  --verbose, -v         Dump diagnostic and progress information.'
E       and: '  --quiet, -q           Disable reporting. Verbose mode takes 
precedence.'
E       and: '  --import-mode {prepend,append,importlib}'
E       and: '                        How to attempt loading hooks from 
conftest. Akin to'
E       and: "                        pytest's --import-mode. Default: 
'prepend'."
E       and: ''
E       and: 'commands:'
E       and: '  {help,list,compare}'
E       and: '    help                Display help and exit.'
E       and: '    list                List saved runs.'
E       and: '    compare             Compare saved runs.'
E   remains unmatched: '  -h [COMMAND], --help [COMMAND]'
----------------------------- Captured stdout call -----------------------------
running: py.test-benchmark --help
     in: /tmp/pytest-of-debusine-worker/pytest-0/test_help1
usage: py.test-benchmark [-h [COMMAND]] [--storage URI] [--netrc [NETRC]]
                         [--verbose] [--quiet]
                         [--import-mode {prepend,append,importlib}]
                         {help,list,compare} ...

pytest_benchmark's management commands.

options:
  -h, --help [COMMAND]  Display help and exit.
  --storage, -s URI     Specify a path to store the runs as uri in form
                        file://path or elasticsearch+http[s]://host1,host2/[in
                        dex/doctype?project_name=Project] (when --benchmark-
                        save or --benchmark-autosave are used). For backwards
                        compatibility unexpected values are converted to
                        file://<value>. Default: 'file://./.benchmarks'.
  --netrc [NETRC]       Load elasticsearch credentials from a netrc file.
                        Default: ''.
  --verbose, -v         Dump diagnostic and progress information.
  --quiet, -q           Disable reporting. Verbose mode takes precedence.
  --import-mode {prepend,append,importlib}
                        How to attempt loading hooks from conftest. Akin to
                        pytest's --import-mode. Default: 'prepend'.

commands:
  {help,list,compare}
    help                Display help and exit.
    list                List saved runs.
    compare             Compare saved runs.

------------------------------------------------------------------------------------------------------------------------------------
 benchmark: 57 tests 
-------------------------------------------------------------------------------------------------------------------------------------
Name (time in ns)                                                     Min       
                      Max                            Mean                  
StdDev                          Median                    IQR             
Outliers               OPS             Rounds  Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_calibrate_stuck[False--1-1e-10]                               5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)            
0.0000 (1.0)                    5.0500 (1.0)           0.0000 (1.0)            
0;0  198,019,801.9807 (1.0)            1           2
test_calibrate_stuck[False-0-1e-10]                                5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)            
0.0000 (1.0)                    5.0500 (1.0)           0.0000 (1.0)            
0;0  198,019,801.9807 (1.0)            1           2
test_calibrate_stuck[False-1-1e-10]                                5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)            
0.0000 (1.0)                    5.0500 (1.0)           0.0000 (1.0)            
0;0  198,019,801.9807 (1.0)            1           2
test_calibrate_stuck[True--1-1e-10]                               10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
 0.0000 (1.0)                   10.0000 (1.98)          0.0000 (1.0)            
0;0  100,000,000.0006 (0.51)           1           1
test_calibrate_stuck[True-0-1e-10]                                10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
 0.0000 (1.0)                   10.0000 (1.98)          0.0000 (1.0)            
0;0  100,000,000.0006 (0.51)           1           1
test_calibrate_stuck[True-1-1e-10]                                10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
 0.0000 (1.0)                   10.0000 (1.98)          0.0000 (1.0)            
0;0  100,000,000.0006 (0.51)           1           1
test_xfast                                                        47.6837 
(9.44)                 100.1358 (19.83)                 50.0901 (9.92)          
 3.1235 (inf)                   50.0679 (9.91)          2.3842 (inf)          
15;15   19,964,015.8033 (0.10)        1824         100
test_calibrate_stuck[False--1-1e-09]                              50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
 0.0000 (1.0)                   50.5000 (10.00)         0.0000 (1.0)            
0;0   19,801,980.1981 (0.10)           1           2
test_calibrate_stuck[False-0-1e-09]                               50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
 0.0000 (1.0)                   50.5000 (10.00)         0.0000 (1.0)            
0;0   19,801,980.1981 (0.10)           1           2
test_calibrate_stuck[False-1-1e-09]                               50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
 0.0000 (1.0)                   50.5000 (10.00)         0.0000 (1.0)            
0;0   19,801,980.1981 (0.10)           1           2
test_calibrate_xfast                                              67.2000 
(13.31)              9,948.8000 (>1000.0)               69.2430 (13.71)         
 8.5206 (inf)                   69.1999 (13.70)         0.4000 (inf)     
5318;78996   14,441,902.1681 (0.07)     1445090         100
test_rounds_iterations                                            84.0009 
(16.63)                148.0003 (29.31)                114.1337 (22.60)         
21.2663 (inf)                  103.9996 (20.59)        34.9995 (inf)            
5;0    8,761,655.7432 (0.04)          15          10
test_calibrate_stuck[True--1-1e-09]                              100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
 0.0000 (1.0)                  100.0000 (19.80)         0.0000 (1.0)            
0;0   10,000,000.0001 (0.05)           1           1
test_calibrate_stuck[True-0-1e-09]                               100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
 0.0000 (1.0)                  100.0000 (19.80)         0.0000 (1.0)            
0;0   10,000,000.0001 (0.05)           1           1
test_calibrate_stuck[True-1-1e-09]                               100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
 0.0000 (1.0)                  100.0000 (19.80)         0.0000 (1.0)            
0;0   10,000,000.0001 (0.05)           1           1
test_proto[SimpleProxy]                                          144.2421 
(28.56)              8,374.5456 (>1000.0)              149.4167 (29.59)         
33.8011 (inf)                  147.8788 (29.28)         2.4240 (inf)      
833;27670    6,692,692.0767 (0.03)      196851          33
test_proto[LocalsSimpleProxy]                                    147.8788 
(29.28)              2,236.3635 (442.84)               151.6120 (30.02)         
12.3460 (inf)                  150.3032 (29.76)         1.2127 (inf)      
793;23190    6,595,782.9939 (0.03)      192308          33
test_iterations                                                  147.9988 
(29.31)                147.9988 (29.31)                147.9988 (29.31)         
 0.0000 (1.0)                  147.9988 (29.31)         0.0000 (1.0)            
0;0    6,756,811.6039 (0.03)           1          10
test_rounds                                                      159.9983 
(31.68)                359.9998 (71.29)                192.0019 (38.02)         
56.9701 (inf)                  160.0129 (31.69)        69.9947 (inf)            
1;1    5,208,283.1484 (0.03)          15           1
test_warmup_rounds                                               159.9983 
(31.68)                200.0015 (39.60)                167.9990 (33.27)         
17.8900 (inf)                  159.9983 (31.68)        10.0008 (inf)            
1;1    5,952,418.1221 (0.03)           5           1
test_proto[CachedPropertyProxy]                                  239.9902 
(47.52)             98,119.9992 (>1000.0)              281.6453 (55.77)        
256.5364 (inf)                  279.9934 (55.44)         0.0146 (inf)      
193;19868    3,550,565.4046 (0.02)      168919           1
test_proto[LocalsCachedPropertyProxy]                            239.9902 
(47.52)             46,720.0007 (>1000.0)              290.6901 (57.56)        
177.2387 (inf)                  280.0080 (55.45)         0.0146 (inf)      
408;32675    3,440,089.3894 (0.02)      178572           1
test_setup_many_rounds                                           279.9934 
(55.44)              5,599.9990 (>1000.0)            1,007.9995 (199.60)     
1,641.2248 (inf)                  359.9998 (71.29)       519.9981 (inf)         
   1;1      992,063.9582 (0.01)          10           1
test_calibrate_fast                                              289.4111 
(57.31)              1,600.0002 (316.83)               296.6838 (58.75)         
11.3895 (inf)                  296.4704 (58.71)         2.3523 (inf)    
18148;74550    3,370,592.3872 (0.02)     1984128          17
test_single                                                      439.9917 
(87.13)                439.9917 (87.13)                439.9917 (87.13)         
 0.0000 (1.0)                  439.9917 (87.13)         0.0000 (1.0)            
0;0    2,272,770.0997 (0.01)           1           1
test_setup_cprofile                                            1,000.0076 
(198.02)             1,000.0076 (198.02)             1,000.0076 (198.02)        
 0.0000 (1.0)                1,000.0076 (198.02)        0.0000 (1.0)            
0;0      999,992.3856 (0.01)           1           1
test_can_use_both_args_and_setup_without_return                1,039.9963 
(205.94)             1,039.9963 (205.94)             1,039.9963 (205.94)        
 0.0000 (1.0)                1,039.9963 (205.94)        0.0000 (1.0)            
0;0      961,541.9032 (0.00)           1           1
test_args_kwargs                                               1,079.9995 
(213.86)             1,079.9995 (213.86)             1,079.9995 (213.86)        
 0.0000 (1.0)                1,079.9995 (213.86)        0.0000 (1.0)            
0;0      925,926.3610 (0.00)           1           1
test_setup                                                     1,160.0059 
(229.70)             1,160.0059 (229.70)             1,160.0059 (229.70)        
 0.0000 (1.0)                1,160.0059 (229.70)        0.0000 (1.0)            
0;0      862,064.5642 (0.00)           1           1
test_fast                                                     10,119.9985 
(>1000.0)          293,320.0012 (>1000.0)           56,166.6821 (>1000.0)    
9,642.9010 (inf)               54,320.0003 (>1000.0)   2,640.0085 (inf)         
 69;98       17,804.1494 (0.00)       10374           1
test_calibrate_slow                                           15,839.9926 
(>1000.0)        9,040,839.9992 (>1000.0)           64,057.4274 (>1000.0)   
17,012.3920 (inf)               63,040.0027 (>1000.0)     159.9983 (inf)     
4343;68136       15,610.9922 (0.00)      486382           1
test_calibrate                                                29,479.9975 
(>1000.0)          214,480.0092 (>1000.0)           29,997.4913 (>1000.0)      
648.7935 (inf)               29,959.9924 (>1000.0)     279.9934 (inf)    
10812;11824       33,336.1210 (0.00)      336474           1
test_parametrized[1]                                          32,519.9944 
(>1000.0)          381,360.0051 (>1000.0)           64,518.4544 (>1000.0)    
8,808.4181 (inf)               63,079.9914 (>1000.0)   1,280.0010 (inf)       
115;2048       15,499.4413 (0.00)       13405           1
test_parametrized[4]                                          38,079.9902 
(>1000.0)          319,600.0034 (>1000.0)           64,394.0631 (>1000.0)    
8,145.2263 (inf)               63,080.0059 (>1000.0)   1,239.9978 (inf)        
59;2015       15,529.3819 (0.00)       13165           1
test_parametrized[0]                                          58,920.0063 
(>1000.0)          102,320.0020 (>1000.0)           63,106.6476 (>1000.0)      
645.4613 (inf)               63,079.9914 (>1000.0)      40.0032 (inf)        
67;1601       15,846.1911 (0.00)       11917           1
test_parametrized[2]                                          62,879.9899 
(>1000.0)           72,359.9951 (>1000.0)           63,081.8273 (>1000.0)      
232.6417 (inf)               63,040.0027 (>1000.0)      80.0064 (inf)       
745;1141       15,852.4260 (0.00)       12981           1
test_parametrized[3]                                          62,959.9963 
(>1000.0)          133,440.0004 (>1000.0)           63,102.6496 (>1000.0)      
703.4388 (inf)               63,040.0027 (>1000.0)      40.0178 (inf)       
104;2582       15,847.1951 (0.00)       13270           1
test_slow                                                  1,059,520.0001 
(>1000.0)        5,424,439.9944 (>1000.0)        1,105,041.4242 (>1000.0)  
267,613.8922 (inf)            1,081,720.0091 (>1000.0)  10,759.9917 (inf)       
    6;47          904.9435 (0.00)         927           1
test_slower                                               10,078,480.0015 
(>1000.0)       10,099,239.9966 (>1000.0)       10,086,234.7454 (>1000.0)    
3,285.3588 (inf)           10,085,519.9998 (>1000.0)   3,729.9978 (inf)         
  17;5           99.1450 (0.00)          99           1
test_calibrate_stuck[False--1-0.01]                      505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
 0.0000 (1.0)          505,000,000.0010 (>1000.0)       0.0000 (1.0)            
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[False-0-0.01]                       505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
 0.0000 (1.0)          505,000,000.0010 (>1000.0)       0.0000 (1.0)            
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[False-1-0.01]                       505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
 0.0000 (1.0)          505,000,000.0010 (>1000.0)       0.0000 (1.0)            
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[True--1-0.01]                     1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)        1,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[True-0-0.01]                      1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)        1,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[True-1-0.01]                      1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)        1,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[False--1-1.000000000000001]      50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False--1-1]                      50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-0-1.000000000000001]       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-0-1]                       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-1-1.000000000000001]       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-1-1]                       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
 0.0000 (1.0)       50,500,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[True--1-1.000000000000001]      100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True--1-1]                      100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-0-1.000000000000001]       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-0-1]                       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-1-1.000000000000001]       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-1-1]                       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
 0.0000 (1.0)      100,000,000,000.0000 (>1000.0)       0.0000 (1.0)            
0;0            0.0100 (0.00)           1           1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 
1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
----------------------------- cProfile (time in s) -----------------------------
tests/test_pedantic.py::test_setup_cprofile
ncalls  tottime percall cumtime percall filename:lineno(function)
1       0.0000  0.0000  0.0000  0.0000  ~:0(<method 'disable' of 
'_lsprof.Profiler' objects>)
1       0.0000  0.0000  0.0000  0.0000  build/tests/test_pedantic.py:29(stuff)
1       0.0000  0.0000  0.0000  0.0000  ~:0(<method 'append' of 'list' objects>)

=========================== short test summary info ============================
SKIPPED [2] tests/test_with_testcase.py:6: could not import 'aspectlib': No 
module named 'aspectlib'
SKIPPED [2] tests/test_with_weaver.py:5: could not import 'aspectlib': No 
module named 'aspectlib'
SKIPPED [1] tests/test_skip.py:5: bla
FAILED tests/test_cli.py::test_help - Failed: fnmatch: 'usage: py.test-benchm...
============= 1 failed, 226 passed, 5 skipped in 407.48s (0:06:47) =============
E: pybuild pybuild:389: test: plugin pyproject failed with: exit code=1: cd 
/<<PKGBUILDDIR>>/.pybuild/cpython3_3.13_pytest-benchmark/build; python3.13 -m 
pytest tests
I: pybuild base:311: cd 
/<<PKGBUILDDIR>>/.pybuild/cpython3_3.12_pytest-benchmark/build; python3.12 -m 
pytest tests
============================= test session starts ==============================
platform linux -- Python 3.12.6, pytest-8.3.3, pluggy-1.5.0
benchmark: 4.0.0 (defaults: timer=time.perf_counter disable_gc=False 
min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 
warmup=False warmup_iterations=100000)
rootdir: /<<PKGBUILDDIR>>/.pybuild/cpython3_3.12_pytest-benchmark/build
configfile: pytest.ini
plugins: benchmark-4.0.0, typeguard-4.3.0, xdist-3.6.1
collected 228 items / 4 skipped

tests/test_benchmark.py ................................................ [ 21%]
.....                                                                    [ 23%]
tests/test_calibration.py ..................................             [ 38%]
tests/test_cli.py ...........                                            [ 42%]
tests/test_doctest.rst .                                                 [ 43%]
tests/test_elasticsearch_storage.py .......                              [ 46%]
tests/test_normal.py ..........                                          [ 50%]
tests/test_pedantic.py ...................                               [ 59%]
tests/test_sample.py ....                                                [ 60%]
tests/test_skip.py s                                                     [ 61%]
tests/test_stats.py ..............                                       [ 67%]
tests/test_storage.py ........................................           [ 85%]
tests/test_utils.py ..................................                   [100%]


-----------------------------------------------------------------------------------------------------------------------------------
 benchmark: 57 tests 
-----------------------------------------------------------------------------------------------------------------------------------
Name (time in ns)                                                     Min       
                      Max                            Mean                 
StdDev                          Median                   IQR            
Outliers               OPS             Rounds  Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_calibrate_stuck[False--1-1e-10]                               5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)           
0.0000 (1.0)                    5.0500 (1.0)          0.0000 (1.0)           
0;0  198,019,801.9796 (1.0)            1           2
test_calibrate_stuck[False-0-1e-10]                                5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)           
0.0000 (1.0)                    5.0500 (1.0)          0.0000 (1.0)           
0;0  198,019,801.9796 (1.0)            1           2
test_calibrate_stuck[False-1-1e-10]                                5.0500 (1.0) 
                   5.0500 (1.0)                    5.0500 (1.0)           
0.0000 (1.0)                    5.0500 (1.0)          0.0000 (1.0)           
0;0  198,019,801.9796 (1.0)            1           2
test_calibrate_stuck[True--1-1e-10]                               10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
0.0000 (1.0)                   10.0000 (1.98)         0.0000 (1.0)           
0;0   99,999,999.9995 (0.50)           1           1
test_calibrate_stuck[True-0-1e-10]                                10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
0.0000 (1.0)                   10.0000 (1.98)         0.0000 (1.0)           
0;0   99,999,999.9995 (0.50)           1           1
test_calibrate_stuck[True-1-1e-10]                                10.0000 
(1.98)                  10.0000 (1.98)                  10.0000 (1.98)          
0.0000 (1.0)                   10.0000 (1.98)         0.0000 (1.0)           
0;0   99,999,999.9995 (0.50)           1           1
test_calibrate_stuck[False--1-1e-09]                              50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
0.0000 (1.0)                   50.5000 (10.00)        0.0000 (1.0)           
0;0   19,801,980.1981 (0.10)           1           2
test_calibrate_stuck[False-0-1e-09]                               50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
0.0000 (1.0)                   50.5000 (10.00)        0.0000 (1.0)           
0;0   19,801,980.1981 (0.10)           1           2
test_calibrate_stuck[False-1-1e-09]                               50.5000 
(10.00)                 50.5000 (10.00)                 50.5000 (10.00)         
0.0000 (1.0)                   50.5000 (10.00)        0.0000 (1.0)           
0;0   19,801,980.1981 (0.10)           1           2
test_xfast                                                        67.9493 
(13.46)                 96.5595 (19.12)                 69.7757 (13.82)         
1.6949 (inf)                   69.1414 (13.69)        1.1921 (inf)          
13;3   14,331,634.3574 (0.07)         545         200
test_calibrate_xfast                                              72.8000 
(14.42)                543.6000 (107.64)                74.9936 (14.85)         
2.3398 (inf)                   74.8000 (14.81)        0.4000 (inf)    
6700;42627   13,334,469.5569 (0.07)     1388890         100
test_rounds_iterations                                            92.0001 
(18.22)                152.0006 (30.10)                114.9334 (22.76)        
20.8104 (inf)                  107.9999 (21.39)       30.0006 (inf)           
5;0    8,700,694.4321 (0.04)          15          10
test_calibrate_stuck[True--1-1e-09]                              100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
0.0000 (1.0)                  100.0000 (19.80)        0.0000 (1.0)           
0;0   10,000,000.0001 (0.05)           1           1
test_calibrate_stuck[True-0-1e-09]                               100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
0.0000 (1.0)                  100.0000 (19.80)        0.0000 (1.0)           
0;0   10,000,000.0001 (0.05)           1           1
test_calibrate_stuck[True-1-1e-09]                               100.0000 
(19.80)                100.0000 (19.80)                100.0000 (19.80)         
0.0000 (1.0)                  100.0000 (19.80)        0.0000 (1.0)           
0;0   10,000,000.0001 (0.05)           1           1
test_rounds                                                      119.9951 
(23.76)                440.0063 (87.13)                191.9999 (38.02)        
78.8498 (inf)                  159.9983 (31.68)       40.0032 (inf)           
2;2    5,208,335.7808 (0.03)          15           1
test_warmup_rounds                                               120.0096 
(23.76)                240.0047 (47.53)                168.0019 (33.27)        
43.8173 (inf)                  159.9983 (31.68)       29.9988 (inf)           
2;1    5,952,315.0053 (0.03)           5           1
test_iterations                                                  147.9988 
(29.31)                147.9988 (29.31)                147.9988 (29.31)         
0.0000 (1.0)                  147.9988 (29.31)        0.0000 (1.0)           
0;0    6,756,811.6039 (0.03)           1          10
test_proto[SimpleProxy]                                          176.9233 
(35.03)              3,143.0771 (622.39)               186.1431 (36.86)        
14.3968 (inf)                  181.5385 (35.95)       10.7690 (inf)       
893;781    5,372,210.2065 (0.03)      192308          26
test_proto[LocalsSimpleProxy]                                    182.3995 
(36.12)              3,108.8002 (615.60)               190.9102 (37.80)        
15.1569 (inf)                  191.9997 (38.02)        6.3999 (inf)      
940;1011    5,238,063.8875 (0.03)      196851          25
test_setup_many_rounds                                           279.9934 
(55.44)              1,200.0091 (237.63)               484.0011 (95.84)       
279.3368 (inf)                  380.0014 (75.25)      280.0080 (inf)           
1;1    2,066,111.1516 (0.01)          10           1
test_calibrate_fast                                              298.8227 
(59.17)              2,809.4124 (556.32)               303.3415 (60.07)        
12.1761 (inf)                  303.5290 (60.10)        2.3531 (inf)    
13695;104427    3,296,614.4123 (0.02)     1984128          17
test_proto[CachedPropertyProxy]                                  319.9966 
(63.37)             22,360.0073 (>1000.0)              338.6695 (67.06)       
107.5532 (inf)                  320.0112 (63.37)       40.0032 (inf)       
112;172    2,952,731.5153 (0.01)      142046           1
test_proto[LocalsCachedPropertyProxy]                            319.9966 
(63.37)             15,559.9992 (>1000.0)              332.3729 (65.82)        
82.2302 (inf)                  319.9966 (63.37)       40.0032 (inf)       
166;166    3,008,668.6042 (0.02)      144509           1
test_single                                                      359.9998 
(71.29)                359.9998 (71.29)                359.9998 (71.29)         
0.0000 (1.0)                  359.9998 (71.29)        0.0000 (1.0)           
0;0    2,777,779.0831 (0.01)           1           1
test_setup_cprofile                                            1,079.9995 
(213.86)             1,079.9995 (213.86)             1,079.9995 (213.86)        
0.0000 (1.0)                1,079.9995 (213.86)       0.0000 (1.0)           
0;0      925,926.3610 (0.00)           1           1
test_args_kwargs                                               1,160.0059 
(229.70)             1,160.0059 (229.70)             1,160.0059 (229.70)        
0.0000 (1.0)                1,160.0059 (229.70)       0.0000 (1.0)           
0;0      862,064.5642 (0.00)           1           1
test_setup                                                     1,280.0010 
(253.47)             1,280.0010 (253.47)             1,280.0010 (253.47)        
0.0000 (1.0)                1,280.0010 (253.47)       0.0000 (1.0)           
0;0      781,249.3802 (0.00)           1           1
test_can_use_both_args_and_setup_without_return                1,319.9897 
(261.38)             1,319.9897 (261.38)             1,319.9897 (261.38)        
0.0000 (1.0)                1,319.9897 (261.38)       0.0000 (1.0)           
0;0      757,581.6814 (0.00)           1           1
test_fast                                                      8,880.0007 
(>1000.0)          310,959.9929 (>1000.0)           55,945.2843 (>1000.0)   
9,534.2866 (inf)               54,280.0117 (>1000.0)  2,639.9939 (inf)         
59;77       17,874.6075 (0.00)       10041           1
test_calibrate_slow                                           18,199.9931 
(>1000.0)        1,102,759.9976 (>1000.0)           63,329.5018 (>1000.0)   
4,134.7893 (inf)               62,999.9995 (>1000.0)    119.9951 (inf)    
8472;47121       15,790.4290 (0.00)      367108           1
test_calibrate                                                27,959.9917 
(>1000.0)          234,319.9885 (>1000.0)           28,683.6941 (>1000.0)     
753.8825 (inf)               28,560.0108 (>1000.0)    240.0047 (inf)     
8796;9456       34,863.0130 (0.00)      351124           1
test_parametrized[3]                                          32,400.0139 
(>1000.0)          268,159.9872 (>1000.0)           63,120.7726 (>1000.0)   
2,785.6377 (inf)               63,040.0027 (>1000.0)     80.0064 (inf)       
26;1392       15,842.6451 (0.00)       13151           1
test_parametrized[0]                                          33,959.9937 
(>1000.0)           79,720.0046 (>1000.0)           63,041.5351 (>1000.0)     
419.7327 (inf)               62,999.9995 (>1000.0)     40.0032 (inf)      
248;2831       15,862.5579 (0.00)       11569           1
test_parametrized[2]                                          43,919.9939 
(>1000.0)          393,360.0092 (>1000.0)           64,569.7469 (>1000.0)   
8,661.8743 (inf)               63,080.0059 (>1000.0)  1,400.0107 (inf)       
79;1894       15,487.1290 (0.00)       13313           1
test_parametrized[1]                                          62,599.9965 
(>1000.0)          325,879.9989 (>1000.0)           64,158.5788 (>1000.0)   
7,256.0723 (inf)               63,040.0027 (>1000.0)    920.0012 (inf)       
47;2083       15,586.3802 (0.00)       13369           1
test_parametrized[4]                                          62,879.9899 
(>1000.0)          281,640.0083 (>1000.0)           64,453.5542 (>1000.0)   
8,113.1076 (inf)               63,040.0027 (>1000.0)  1,239.9978 (inf)       
49;2143       15,515.0482 (0.00)       13221           1
test_slow                                                  1,058,039.9976 
(>1000.0)        1,300,599.9936 (>1000.0)        1,082,836.9459 (>1000.0)  
28,457.7432 (inf)            1,080,660.0039 (>1000.0)  8,999.9958 (inf)         
30;38          923.5001 (0.00)         930           1
test_slower                                               10,079,920.0009 
(>1000.0)       10,096,519.9963 (>1000.0)       10,084,843.6359 (>1000.0)   
3,037.0560 (inf)           10,084,080.0005 (>1000.0)  3,349.9964 (inf)          
15;5           99.1587 (0.00)          99           1
test_calibrate_stuck[False--1-0.01]                      505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
0.0000 (1.0)          505,000,000.0010 (>1000.0)      0.0000 (1.0)           
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[False-0-0.01]                       505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
0.0000 (1.0)          505,000,000.0010 (>1000.0)      0.0000 (1.0)           
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[False-1-0.01]                       505,000,000.0010 
(>1000.0)      505,000,000.0010 (>1000.0)      505,000,000.0010 (>1000.0)       
0.0000 (1.0)          505,000,000.0010 (>1000.0)      0.0000 (1.0)           
0;0            1.9802 (0.00)           1           2
test_calibrate_stuck[True--1-0.01]                     1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
0.0000 (1.0)        1,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[True-0-0.01]                      1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
0.0000 (1.0)        1,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[True-1-0.01]                      1,000,000,000.0000 
(>1000.0)    1,000,000,000.0000 (>1000.0)    1,000,000,000.0000 (>1000.0)       
0.0000 (1.0)        1,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            1.0000 (0.00)           1           1
test_calibrate_stuck[False--1-1.000000000000001]      50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False--1-1]                      50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-0-1.000000000000001]       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-0-1]                       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-1-1.000000000000001]       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[False-1-1]                       50,500,000,000.0000 
(>1000.0)   50,500,000,000.0000 (>1000.0)   50,500,000,000.0000 (>1000.0)       
0.0000 (1.0)       50,500,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0198 (0.00)           1           2
test_calibrate_stuck[True--1-1.000000000000001]      100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True--1-1]                      100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-0-1.000000000000001]       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-0-1]                       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-1-1.000000000000001]       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
test_calibrate_stuck[True-1-1]                       100,000,000,000.0000 
(>1000.0)  100,000,000,000.0000 (>1000.0)  100,000,000,000.0000 (>1000.0)       
0.0000 (1.0)      100,000,000,000.0000 (>1000.0)      0.0000 (1.0)           
0;0            0.0100 (0.00)           1           1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 
1st Quartile and 3rd Quartile.
  OPS: Operations Per Second, computed as 1 / Mean
----------------------------- cProfile (time in s) -----------------------------
tests/test_pedantic.py::test_setup_cprofile
ncalls  tottime percall cumtime percall filename:lineno(function)
1       0.0000  0.0000  0.0000  0.0000  ~:0(<method 'disable' of 
'_lsprof.Profiler' objects>)
1       0.0000  0.0000  0.0000  0.0000  build/tests/test_pedantic.py:29(stuff)
1       0.0000  0.0000  0.0000  0.0000  ~:0(<method 'append' of 'list' objects>)

=========================== short test summary info ============================
SKIPPED [2] tests/test_with_testcase.py:6: could not import 'aspectlib': No 
module named 'aspectlib'
SKIPPED [2] tests/test_with_weaver.py:5: could not import 'aspectlib': No 
module named 'aspectlib'
SKIPPED [1] tests/test_skip.py:5: bla
================== 227 passed, 5 skipped in 394.19s (0:06:34) ==================
dh_auto_test: error: pybuild --test --test-pytest -i python{version} -p "3.13 
3.12" returned exit code 13
make: *** [debian/rules:9: build] Error 25
dpkg-buildpackage: error: debian/rules build subprocess returned exit status 2
--------------------------------------------------------------------------------
Build finished at 2024-09-19T07:04:22Z


If required, the full build log is available here (for the next 30 days):
https://debusine.debian.net/artifact/788229/

This bug has been filed at "normal" severity, as we haven't started the
transition to add 3.13 as a supported version, yet. This will be raised to RC
as soon as that happens, hopefully well before trixie.

Thanks,

Stefano

Reply via email to