[
https://issues.apache.org/jira/browse/FALCON-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Venkatesh Seetharam updated FALCON-285:
---------------------------------------
Description:
We would want to capture enough information from entities and the associated
executions to drive lineage tracing and visualization.
The plan is to capture lineage specific information - which is all the inputs,
process and associated workflows, outputs for each execution in Falcon post
processing step. Post message consumption, this information is acted upon and
persisted in falcon server for each output generated. This should work for
replication as well. I need to think about eviction which was not invoking post
processing but will soon.
was:We would want to capture enough information from entities and the
associated executions to drive lineage tracing and visualization.
> Support Lineage information capture
> -----------------------------------
>
> Key: FALCON-285
> URL: https://issues.apache.org/jira/browse/FALCON-285
> Project: Falcon
> Issue Type: Improvement
> Affects Versions: 0.5
> Reporter: Venkatesh Seetharam
> Labels: lineage
>
> We would want to capture enough information from entities and the associated
> executions to drive lineage tracing and visualization.
> The plan is to capture lineage specific information - which is all the
> inputs, process and associated workflows, outputs for each execution in
> Falcon post processing step. Post message consumption, this information is
> acted upon and persisted in falcon server for each output generated. This
> should work for replication as well. I need to think about eviction which was
> not invoking post processing but will soon.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
