goutamadwant opened a new pull request, #12619:
URL: https://github.com/apache/seatunnel/pull/12619
### Purpose of this pull request
Part of STIP-39: #12268 (feature request #11484).
Phase 1 of the bounded job lineage REST API: a pure projector that turns a
`JobDAGInfo` snapshot into the lineage document defined in the STIP. No REST
route, engine lifecycle or existing class is changed; the endpoint and snapshot
lookup follow in later phases.
- `JobLineageProjector` writes only whitelisted fields (job ID, nodes,
edges, warnings). Environment options and addresses in `JobDAGInfo` are never
read.
- Output is deterministic: nodes, edges, warnings and table paths are
sorted, and identical edges in a pipeline are written once.
- Invalid snapshots (missing vertices, dangling or null endpoints,
self-loops, cycles) are rejected as `LINEAGE_UNAVAILABLE`.
- `JobLineageLimits` bounds nodes, edges, table paths, per-string bytes and
response bytes; an oversized graph is rejected whole as
`LINEAGE_GRAPH_TOO_LARGE`.
### Does this PR introduce _any_ user-facing change?
No. The classes are internal and not wired to any endpoint yet.
### How was this patch tested?
`JobLineageProjectorTest` (21 cases), including a snapshot generated by
`DAGUtils` from `fake_to_console.conf`, ordering, deduplication, missing
metadata, invalid topology, each limit at the boundary and one over,
UTF-8/escaping and a whitelist check with sentinel values. Run with the
existing REST tests on Java 8 and Java 11.
### Check list
* [ ] If any new Jar binary package adding in your PR, please add License
Notice according
[New License
Guide](https://github.com/apache/seatunnel/blob/dev/docs/en/developer/new-license.md)
* [ ] If necessary, please update the documentation to describe the new
feature. https://github.com/apache/seatunnel/tree/dev/docs
* [ ] If necessary, please update `incompatible-changes.md` to describe the
incompatibility caused by this PR.
* [ ] If you are contributing the connector code, please check that the
following files are updated:
1. Update
[plugin-mapping.properties](https://github.com/apache/seatunnel/blob/dev/plugin-mapping.properties)
and add new connector information in it
2. Update the pom file of
[seatunnel-dist](https://github.com/apache/seatunnel/blob/dev/seatunnel-dist/pom.xml)
3. Add ci label in
[label-scope-conf](https://github.com/apache/seatunnel/blob/dev/.github/workflows/labeler/label-scope-conf.yml)
4. Add e2e testcase in
[seatunnel-e2e](https://github.com/apache/seatunnel/tree/dev/seatunnel-e2e/seatunnel-connector-v2-e2e/)
5. Update connector
[plugin_config](https://github.com/apache/seatunnel/blob/dev/config/plugin_config)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
