GitHub user dave-csc added a comment to the discussion: Why are transaction-based workflows sooooo slow?
Hello @hansva, I experienced this even with probably the simplest pipeline, that just inputs (Table input) from an Oracle Database and outputs (Table output) on a PostgreSQL one on AWS, and nothing else. Without transactions, last execution of this pipeline took about 54 seconds to truncate the output table and copy 186660 records. When testing with transactions, the same pipeline had taken over 40 minutes (and I had to undeploy it...). Replying to dma***@***.com (via mailing list): unfortunately I don't always have a "primary key" available. But even when there is and use it in transforms like Database lookup or Insert / Update, execution times dilate when using transactions... GitHub link: https://github.com/apache/hop/discussions/4678#discussioncomment-11505218 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
