aglinxinyuan opened a new issue, #4911: URL: https://github.com/apache/texera/issues/4911
`ProgressiveUtils` (common/workflow-operator/src/main/scala/org/apache/texera/amber/operator/sink/ProgressiveUtils.scala) defines the insertion / retraction flag machinery used by progressive sinks (an internal BOOLEAN flag column prepended to tuples) but has no test coverage today. Add a `ProgressiveUtilsSpec` that pins: - `insertRetractFlagAttr`: name (`__internal_is_insertion`) and type (BOOLEAN). - `addInsertionFlag` / `addRetractionFlag`: prepend the flag column with the right value, preserve the rest of the tuple, and fail an assertion if the input already carries the flag column. - `isInsertion`: returns true for unflagged tuples (default), and reads the flag column when present. - `getTupleFlagAndValue`: splits a flagged tuple into (Boolean, base tuple) without the flag column, and passes unflagged tuples through with the original schema. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
