[
https://issues.apache.org/jira/browse/BEAM-10293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anonymous updated BEAM-10293:
-----------------------------
Status: Triage Needed (was: Resolved)
> Duplicated spark DAG graph by beam
> ----------------------------------
>
> Key: BEAM-10293
> URL: https://issues.apache.org/jira/browse/BEAM-10293
> Project: Beam
> Issue Type: Bug
> Components: beam-community, beam-model
> Affects Versions: 2.8.0
> Reporter: tim
> Assignee: Aizhamal Nurmamat kyzy
> Priority: P3
> Fix For: Not applicable
>
>
> Hi,
> We are using the beam to read the stream from Kafka and using spark as the
> runner, and I found our spark graph looks very strange.
>
> For each batch stream, it will generate 3 stages, one of them of our actual
> work, that I can understand.
>
> Another two is kind of duplicated, you can take a look at the attached graphs:
> !https://mail.google.com/mail/u/0?ui=2&ik=84b7460266&attid=0.1&permmsgid=msg-a:r8422276987250607211&th=172dba93c096ba6c&view=fimg&sz=s0-l75-ft&attbid=ANGjdJ8nnoMne257_LiDMxe7jgX-hhmI_AAQuGUCRtxXGN5re_LPDAEeYhV4YSocTbajibS8pI9JJjgzlJB_hHNBVV4kw9kjyyU1VR_xaERYwUbTwbaSEyxP0kNHits&disp=emb&realattid=ii_kbqdqecj2|width=542,height=263!
>
>
> !https://mail.google.com/mail/u/0?ui=2&ik=84b7460266&attid=0.2&permmsgid=msg-a:r8422276987250607211&th=172dba93c096ba6c&view=fimg&sz=s0-l75-ft&attbid=ANGjdJ-ORq2jejCZFpwQjR079Axp3o2X8WGlC7gZ8_9am3TBN6lUu13Q1Gq5tpzici8UWhoMbydsR20mX50gp0ZqeSrdNYR8jeW5WMHjHmA7zVs-1oWwNJK-I_9NSsQ&disp=emb&realattid=ii_kbqdqzq43|width=542,height=357!
> I don't see any reason we display two graphs but one of them include another
> one.
>
> Br,
> Tim
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
