GitHub user ossDataEngineer created a discussion: How to use 'write to log' transform to count the records processed by earlier transform?
I am writing a CDC pipeline, which finally inserts/updates/deletes data from target database table. I want to maintain custom log using 'Write to Log' transform that additionally embeds the information of records processed by earlier transform - i.e to know how many records were inserted, updated, deleted in that run. Current Solution: After individual transform I have code as below. I filter the last row and log the sequence as count of records processed by the earlier transform. <img width="1131" height="243" alt="image" src="https://github.com/user-attachments/assets/332bedd6-e8da-43db-ad8e-7231ff852d38"; /> Ask: Is there better way of achieving this? GitHub link: https://github.com/apache/hop/discussions/5620 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
