[ 
https://issues.apache.org/jira/browse/SAMZA-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xinyu Liu updated SAMZA-1204:
-----------------------------
    Attachment: dag2.png
                dag1.png

> Visualize StreamGraph and ExecutionPlan
> ---------------------------------------
>
>                 Key: SAMZA-1204
>                 URL: https://issues.apache.org/jira/browse/SAMZA-1204
>             Project: Samza
>          Issue Type: Bug
>    Affects Versions: 0.13.0
>            Reporter: Xinyu Liu
>            Assignee: Xinyu Liu
>             Fix For: 0.13.0
>
>         Attachments: dag1.png, dag2.png
>
>
> Based on SAMZA-1178, we are able to generate the JSON representation of 
> StreamGraph and ExecutionPlan. We need to provide a visualizer to render the 
> json as DAG and let users to view it.
> First look: https://xinyuiscool.github.io/visualizer/plan.html. This is based 
> on the example graph JSON generated in TestJobGraphJsonGenerator.
> For the api-test job:
> ![image](https://cloud.githubusercontent.com/assets/24738423/25154090/00f6cd76-2444-11e7-84aa-efa7d5fb735f.png)
> For the join-test job:
> ![image](https://cloud.githubusercontent.com/assets/24738423/25154115/19de1182-2444-11e7-9283-3b68a122201d.png)
> How to visualize the plan (locally):
> Once a Samza application (using fluent API) is deployed, an execution plan 
> will be generated by the ExecutionPlanner. The plan JSON will be written to a 
> file (plan.json) under the bin directory, which also contains the plan.html 
> and javscripts (js folder). So the bin dir has the following for 
> visualization:
> ./bin
>   - plan.json
>   - plan.html
>   - /js
>     - d3.js
>     - dagre.js
>     - planToDagre.js
> Then deployed locally, the user can directly view the plan by enter the 
> following in a browser:
>   **file:///my/samza/app/dir/bin/plan.html**
> To visualize the plan remotely, the user can either scp the files into local 
> box and view the plan there, or bring up a simple http server to serve the 
> page.
> In the future when we have the Samza dashboard, we can add the plan 
> visualization there to avoid the above manual steps.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to