nzw921rx commented on PR #12173: URL: https://github.com/apache/seatunnel/pull/12173#issuecomment-6288832460
## SeaTunnel benchmark comparison - Baseline: `dev` at `1ce2d781566564d5bd603710e7442bd88c531414` (2 runs) - Candidate: `PR #12173` at `b137173f7b7d1bb0a6889732401bb01a233585bb` (2 runs) - Suite: `IMapJobStorageBenchmark` - Java: `11.0.32.1` - Runner image: `ubuntu24-20261012.334.1` - CPU: `AMD EPYC 9V74 80-Core Processor` > Baseline and candidate ran alternately on the same worker. ### JMH comparison > `B` = Baseline, `C` = Candidate. Score is the median benchmark result; CV measures variability and Error represents the relative JMH confidence interval, both aggregated as medians across runs. > Score Change is direction-adjusted so positive is favorable; CV and Error changes are relative changes. | Benchmark | Parameters | Score B | Score C | Score Change | CV B | CV C | CV Change | Error B | Error C | Error Change | Unit | | --- | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | --- | | `IMapJobStorage.completedJobHistoryGrowth` | `initialStoredJobCount=0` | 1,925.34 | 1,805.72 | +6.21% | 11.45% | 10.49% | -8.37% | 44.08% | 40.39% | -8.37% | us/op | | `IMapJobStorage.completedJobHistoryGrowth` | `initialStoredJobCount=1000` | 1,752.69 | 1,704.14 | +2.77% | 5.29% | 3.42% | -35.33% | 20.36% | 13.17% | -35.33% | us/op | | `IMapJobStorage.runningJobGrowth` | `initialStoredJobCount=0` | 314.850 | 342.036 | -8.63% | 13.34% | 4.52% | -66.13% | 51.35% | 17.39% | -66.13% | us/op | | `IMapJobStorage.runningJobGrowth` | `initialStoredJobCount=1000` | 270.871 | 381.309 | -40.77% | 5.39% | 32.89% | +510.63% | 20.74% | 126.64% | +510.63% | us/op | | `IMapJobStorage.runningJobRecovery` | `runningJobCount=1000` | 2,132,623.98 | 2,048,926.63 | +3.92% | 5.22% | 0.21% | -95.92% | 20.10% | 0.82% | -95.92% | us/op | | `IMapJobStorage.runningJobRecovery` | `runningJobCount=100` | 2,028,042.01 | 2,032,678.09 | -0.23% | 0.26% | 0.16% | -37.44% | 1.00% | 0.63% | -37.44% | us/op | | `IMapJobStorage.runningMetricsReport` | `taskCount=1000` | 80,680.75 | 77,785.30 | +3.59% | 12.52% | 11.10% | -11.34% | 48.23% | 42.76% | -11.34% | us/op | | `IMapJobStorage.runningMetricsReport` | `taskCount=100` | 7,354.86 | 7,346.32 | +0.12% | 1.14% | 1.24% | +8.27% | 4.39% | 4.76% | +8.27% | us/op | | `IMapJobStorage.runningMetricsReport` | `taskCount=10` | 772.941 | 775.549 | -0.34% | 0.37% | 0.50% | +36.77% | 1.41% | 1.93% | +36.77% | us/op | | `IMapJobStorage.taskGroupStateTransition` | `storedTaskGroupCount=0` | 352.812 | 364.493 | -3.31% | 11.35% | 13.16% | +15.94% | 43.71% | 50.67% | +15.94% | us/op | | `IMapJobStorage.taskGroupStateTransition` | `storedTaskGroupCount=1000` | 328.001 | 367.525 | -12.05% | 13.35% | 20.06% | +50.25% | 51.40% | 77.23% | +50.25% | us/op | exec result. please look runningJobGrowth runningJobCount=1000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
