[issue26275] perf.py: bm_regex_v8 doesn't seem reliable even with --rigorous

2016-02-03 Thread STINNER Victor
New submission from STINNER Victor: Hi, I'm working on some optimizations projects like FAT Python (PEP 509: issue #26058, PEP 510: issue #26098, and PEP 511: issue #26145) and faster memory allocators (issue #26249). I have the *feeling* that perf.py output is not reliable even if it takes

[issue26275] perf.py: bm_regex_v8 doesn't seem reliable even with --rigorous

2016-02-03 Thread STINNER Victor
STINNER Victor added the comment: Well, it was simpler than I expected to implement calibration. Here is a PoC for regex_v8 and json_dump_v2. json_dump_v2 takes 3 seconds per run, but it already uses internally 100 loop iterations. I divided the number of iterations by 100 in my patch.