mattcasters opened a new pull request, #8649:
URL: https://github.com/apache/hop/pull/8649
### What changes were proposed in this pull request?
This pull request implements the **Replay Workflow Engine**, **Replay
Gates** on workflow actions and pipeline transforms, and full integration with
the Hop GUI **Execution Perspective**, addressing #8648.
#### Key Features:
1. **Replay Gates (Transforms and Workflow Actions)**:
- Configurable checkpoints on transforms and workflow actions
(`@GuiContextAction`: *Configure Replay Gate*).
- Visual badge overlays (`#` shield badge) on canvas icons with detailed
tooltips.
- Spools execution results (workflow actions) and intermediate binary row
streams with compression (pipeline transforms) to VFS paths
(`${PROJECT_HOME}/.hop/spool/...`).
- Cryptographic manifest generation (`manifest.json`) verifying SHA-256
hashes of metadata attributes, hops, input variables/parameters, and data
schemas/counts.
2. **Hop Replay Workflow Engine (`ReplayWorkflowEngine`)**:
- Specialized `@WorkflowEnginePlugin(id = "Replay")` that skips completed
upstream actions whose gates are sealed and verified against SHA-256 checksums.
- Restores exact prior action results (exit status, files, rows,
variables, metrics) into the active workflow context.
- Resumes live execution starting at the first failed/unsealed action (or
user-designated start action).
- Standard engines (`local`, `remote`) continue to execute all actions
normally without skipping.
3. **Execution Perspective One-Click Replay**:
- Added a **Replay** toolbar action (`ui/images/replay.svg`) in
`WorkflowExecutionViewer`.
- Automatically pre-selects the first available Replay workflow run
configuration in `WorkflowExecutionConfigurationDialog`.
- Transitions to the Explorer perspective, prepares live logs, and
launches execution.
4. **Serialization and Execution Info Fixes**:
- Fixed POJO and null handling in `XmlMetadataUtil` and
`SerializableMetadataProvider` so execution information locations with
polymorphic metadata (e.g. AI providers) reload cleanly in the Execution
Perspective.
5. **Comprehensive User Documentation**:
- Added user guide for Replay Gates and Workflow Replay
(`replay-gate.adoc`) including data engineer responsibilities (idempotency,
side effects, gate placement strategy, storage management), capabilities, and
boundaries.
- Added engine reference page (`replay-workflow-engine.adoc`).
- Included UI screenshots of the transform gate configuration and
execution viewer toolbar.
- Unit tests covering configuration resolution and gate listeners.
### Issue Priority
Priority: 2
### Issue Component
Component: Workflows
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
