GitHub user EricTonissen created a discussion: Performance HOP on Linux
I have a HOP workflow running on windows with a some performance. Running the same workflow on Linux, it takes much more time to finish. In the logging you see on several places that there is no logline for 1 sec. Somebody any idea what I can do to have better performance on Linux? **Compare Pentaho vs HOP** PENTAHO Windows : Spoon - Processing ended after 5 seconds PENTAHO Linux : Kitchen - Processing ended after 5 seconds HOP Windows : Workflow duration : 6.628 seconds [ 6.628" ] HOP Linux : Workflow duration : **12.382** seconds [ 12.382" ] **HOP Linux logfile** 2025/12/03 20:28:56 - HopRun - Enabling project 'eridani' 2025/12/03 20:28:56 - HopRun - Starting workflow: /opt/hop/eridani-base/pdi-repo/jobscheduler/scheduler/util/jb_scheduler_report.hwf 2025/12/03 20:28:57 - jb_scheduler_report - Start of workflow execution 2025/12/03 20:28:57 - jb_scheduler_report - Starting action [START] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [START] (result=[true]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Common environment] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Common environment] (result=[true]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Property file?] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Property file?] (result=[false]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Env Property file?] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Env Property file?] (result=[false]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Report queue] 2025/12/03 20:28:58 - Report queue - Using run configuration [local] 2025/12/03 20:28:58 - tr_scheduler_report - Executing this pipeline using the Local Pipeline Engine with run configuration 'local' **2025/12/03 20:28:58 - tr_scheduler_report - Execution started for pipeline [tr_scheduler_report] 2025/12/03 20:29:02 - Seq Html per ehs.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqProcess** 2025/12/03 20:29:02 - Seq Not success.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqNotSucces 2025/12/03 20:29:02 - Seq Waiting/running.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqWaitingRunning 2025/12/03 20:29:02 - Examples.0 - Finished processing (I=0, O=0, R=0, W=12, U=0, E=0) 2025/12/03 20:29:02 - Add 18.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:02 - Get TS.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) **2025/12/03 20:29:02 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:04 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)** 2025/12/03 20:29:04 - Calc days.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:04 - Html html.0 - Finished processing (I=0, O=0, R=1, W=30, U=0, E=0) 2025/12/03 20:29:04 - Select Html html.0 - Finished processing (I=0, O=0, R=30, W=30, U=0, E=0) 2025/12/03 20:29:04 - Calc startTS.0 - Finished processing (I=0, O=0, R=1, W=5, U=0, E=0) 2025/12/03 20:29:04 - Get Queue.0 - Finished processing (I=32, O=0, R=1, W=32, U=0, E=0) 2025/12/03 20:29:04 - Get QueueLogArchive.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0) 2025/12/03 20:29:04 - Minimal fields from Queue.0 - Finished processing (I=0, O=0, R=32, W=32, U=0, E=0) 2025/12/03 20:29:05 - Get process.0 - Finished processing (I=32, O=0, R=32, W=32, U=0, E=0) 2025/12/03 20:29:05 - Join examples.0 - Finished processing (I=0, O=0, R=13, W=12, U=0, E=0) 2025/12/03 20:29:05 - Catch examples.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:05 - Get QueueLog.0 - Finished processing (I=118, O=0, R=1, W=118, U=0, E=0) 2025/12/03 20:29:05 - Sort on processID.0 - Finished processing (I=0, O=0, R=118, W=118, U=0, E=0) 2025/12/03 20:29:05 - Not last based on processID.0 - Finished processing (I=0, O=0, R=52, W=52, U=0, E=0) 2025/12/03 20:29:05 - Unique on processID.0 - Finished processing (I=0, O=0, R=118, W=66, U=0, E=52) 2025/12/03 20:29:05 - Minimal fields from QueueLog.0 - Finished processing (I=0, O=0, R=66, W=66, U=0, E=0) 2025/12/03 20:29:05 - Rename config_name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) **2025/12/03 20:29:05 - Get config_name.0 - Finished processing (I=93, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Status to color.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0)** 2025/12/03 20:29:07 - Filter on config_name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Filter on name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Seq Not success.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:07 - Sort on sequence.0 - Finished processing (I=0, O=0, R=191, W=191, U=0, E=0) 2025/12/03 20:29:07 - Select not success.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:07 - Switch / case.0 - Finished processing (I=0, O=0, R=43, W=43, U=0, E=0) 2025/12/03 20:29:07 - Select waiting/running.0 - Finished processing (I=0, O=0, R=39, W=39, U=0, E=0) **HOP Windows logfile** 2025/12/03 20:56:53 - Hop - Starting workflow 2025/12/03 20:56:53 - jb_scheduler_report - Start of workflow execution 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [START] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [START] (result=[true]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Common environment] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Common environment] (result=[true]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Property file?] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Property file?] (result=[false]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Env Property file?] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Env Property file?] (result=[false]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Report queue] 2025/12/03 20:56:53 - Report queue - Using run configuration [local] 2025/12/03 20:56:53 - tr_scheduler_report - Executing this pipeline using the Local Pipeline Engine with run configuration 'local' 2025/12/03 20:56:53 - tr_scheduler_report - Execution started for pipeline [tr_scheduler_report] 2025/12/03 20:56:54 - Seq Html per ehs.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqProcess 2025/12/03 20:56:54 - Seq Not success.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqNotSucces 2025/12/03 20:56:54 - Seq Waiting/running.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqWaitingRunning 2025/12/03 20:56:55 - Examples.0 - Finished processing (I=0, O=0, R=0, W=12, U=0, E=0) 2025/12/03 20:56:55 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Get TS.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Add 18.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Calc days.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Calc startTS.0 - Finished processing (I=0, O=0, R=1, W=5, U=0, E=0) 2025/12/03 20:56:55 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Html html.0 - Finished processing (I=0, O=0, R=1, W=30, U=0, E=0) 2025/12/03 20:56:55 - Select Html html.0 - Finished processing (I=0, O=0, R=30, W=30, U=0, E=0) 2025/12/03 20:56:55 - Get QueueLogArchive.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0) 2025/12/03 20:56:56 - Get Queue.0 - Finished processing (I=6, O=0, R=1, W=6, U=0, E=0) 2025/12/03 20:56:56 - Join examples.0 - Finished processing (I=0, O=0, R=13, W=12, U=0, E=0) 2025/12/03 20:56:56 - Catch examples.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:56:56 - Get process.0 - Finished processing (I=6, O=0, R=6, W=6, U=0, E=0) 2025/12/03 20:56:56 - Minimal fields from Queue.0 - Finished processing (I=0, O=0, R=6, W=6, U=0, E=0) 2025/12/03 20:56:56 - Get QueueLog.0 - Finished processing (I=148, O=0, R=1, W=148, U=0, E=0) 2025/12/03 20:56:56 - Sort on processID.0 - Finished processing (I=0, O=0, R=148, W=148, U=0, E=0) 2025/12/03 20:56:56 - Unique on processID.0 - Finished processing (I=0, O=0, R=148, W=66, U=0, E=82) 2025/12/03 20:56:56 - Not last based on processID.0 - Finished processing (I=0, O=0, R=82, W=82, U=0, E=0) 2025/12/03 20:56:56 - Minimal fields from QueueLog.0 - Finished processing (I=0, O=0, R=66, W=66, U=0, E=0) 2025/12/03 20:56:56 - Get config_name.0 - Finished processing (I=68, O=0, R=72, W=72, U=0, E=0) **2025/12/03 20:56:56 - Rename config_name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Not nulls.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0)** 2025/12/03 20:56:58 - Filter on config_name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Filter on name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Status to color.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Sort config_name.0 - Finished processing (I=0, O=0, R=72, W=144, U=0, E=0) 2025/12/03 20:56:58 - Html per ehs.0 - Finished processing (I=0, O=0, R=72, W=84, U=0, E=0) 2025/12/03 20:56:58 - Filter rows.0 - Finished processing (I=0, O=0, R=72, W=16, U=0, E=0) 2025/12/03 20:56:58 - Seq Html per ehs.0 - Finished processing (I=0, O=0, R=84, W=84, U=0, E=0) 2025/12/03 20:56:58 - Switch / case.0 - Finished processing (I=0, O=0, R=16, W=16, U=0, E=0) 2025/12/03 20:56:58 - Waiting/running.0 - Finished processing (I=0, O=0, R=9, W=13, U=0, E=0) 2025/12/03 20:56:58 - Not success.0 - Finished processing (I=0, O=0, R=7, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select Html per ehs.0 - Finished processing (I=0, O=0, R=84, W=84, U=0, E=0) 2025/12/03 20:56:58 - Seq Waiting/running.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0) 2025/12/03 20:56:58 - Seq Not success.0 - Finished processing (I=0, O=0, R=11, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select not success.0 - Finished processing (I=0, O=0, R=11, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select waiting/running.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0) GitHub link: https://github.com/apache/hop/discussions/6116 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
