[
https://issues.apache.org/jira/browse/BEAM-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16352800#comment-16352800
]
Jean-Baptiste Onofré commented on BEAM-3617:
--------------------------------------------
I just ran nexmark ({{mvn exec:java
-Dexec.mainClass=org.apache.beam.sdk.nexmark.Main -Dexec.args="--suite=SMOKE
--streaming=true --manageResources=false --monitorJobs=true"}}):
* On Beam 2.2.0
{code}
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 8.1 12335.0 100000
0001 4.0 25106.7 92000
0002 2.2 46082.9 351
0003 4.6 21767.5 444
0004 1.4 7092.2 40
0005 5.9 16869.1 12
0006 1.0 10111.2 401
0007 153.2 653.0 1
0008 3.3 30413.6 6000
0009 0.9 11111.1 298
0010 5.2 19241.9 1
0011 4.3 23153.5 1919
0012 3.3 30712.5 1919
==========================================================================================
{code}
* On Beam 2.3.0 (release branch):
{code}
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 10.5 9554.7 100000
0001 7.2 13848.5 92000
0002 3.9 25654.2 351
0003 5.9 17059.0 444
0004 1.7 6013.2 40
0005 8.4 11899.1 12
0006 1.4 7077.1 401
0007 1019.0 98.1 1
0008 5.0 19888.6 6000
0009 1.3 7905.1 298
0010 6.2 16186.5 1
0011 9.0 11088.9 1919
0012 6.4 15535.2 1919
==========================================================================================
{code}
> Performance degradation on the direct runner
> --------------------------------------------
>
> Key: BEAM-3617
> URL: https://issues.apache.org/jira/browse/BEAM-3617
> Project: Beam
> Issue Type: Bug
> Components: runner-direct
> Affects Versions: 2.3.0
> Reporter: Jean-Baptiste Onofré
> Assignee: Thomas Groh
> Priority: Blocker
> Fix For: 2.3.0
>
>
> Running Nexmark queries with the direct runner between Beam 2.2.0 and 2.3.0
> shows a performance degradation:
> {code}
> ========================================
> Beam 2.2.0 Beam 2.3.0
> Query Runtime(sec) Runtime(sec)
> ========================================
> 0000 6.4 10.6
> 0001 5.1 10.2
> 0002 3.0 5.8
> 0003 3.8 6.2
> 0004 0.9 1.4
> 0005 5.8 11.4
> 0006 0.8 1.4
> 0007 193.8 1249.1
> 0008 3.9 6.9
> 0009 0.9 1.3
> 0010 6.4 8.2
> 0011 5.0 9.4
> 0012 4.7 9.1
> {code}
> We can see especially Query 7 that is 10 times longer.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
