GitHub user dave-csc added a comment to the discussion: Workflow Log (metadata) limitations
> e.g. try and not have a loop that has 100's of iterations because you will > then hit Java's logging limit and well then no one can really save you. Hi @dmainou, problem is indeed here: I use the pipeline above to log a workflow that does a check if an update is needed, and if it is, it starts the update procedure that requires some tens/hundreds of loops to complete (*). I get the full log only when the update is not needed 😅 (*) The procedure: split various text files with some 100.000's of rows, sort and merge the chunks, compare and merge the data with those in a database GitHub link: https://github.com/apache/hop/discussions/4896#discussioncomment-12335618 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
