GitHub user EricTonissen edited a discussion: Performance HOP on Linux
I have a HOP workflow running on windows with some performance. Running the same workflow on Linux, it takes much more time to finish. In the logging you see on several places that there is no logline for 1 sec. Somebody any idea what I can do to have better performance on Linux? **Compare Pentaho vs HOP** PENTAHO Windows : Spoon - Processing ended after 5 seconds PENTAHO Linux : Kitchen - Processing ended after 5 seconds HOP Windows : Workflow duration : 6.628 seconds [ 6.628" ] HOP Linux : Workflow duration : **12.382** seconds [ 12.382" ] **HOP Linux logfile** 2025/12/03 20:28:56 - HopRun - Enabling project 'eridani' 2025/12/03 20:28:56 - HopRun - Starting workflow: /opt/hop/eridani-base/pdi-repo/jobscheduler/scheduler/util/jb_scheduler_report.hwf 2025/12/03 20:28:57 - jb_scheduler_report - Start of workflow execution 2025/12/03 20:28:57 - jb_scheduler_report - Starting action [START] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [START] (result=[true]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Common environment] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Common environment] (result=[true]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Property file?] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Property file?] (result=[false]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Env Property file?] 2025/12/03 20:28:58 - jb_scheduler_report - Finished action [Env Property file?] (result=[false]) 2025/12/03 20:28:58 - jb_scheduler_report - Starting action [Report queue] 2025/12/03 20:28:58 - Report queue - Using run configuration [local] 2025/12/03 20:28:58 - tr_scheduler_report - Executing this pipeline using the Local Pipeline Engine with run configuration 'local' **2025/12/03 20:28:58 - tr_scheduler_report - Execution started for pipeline [tr_scheduler_report] 2025/12/03 20:29:02 - Seq Html per ehs.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqProcess** 2025/12/03 20:29:02 - Seq Not success.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqNotSucces 2025/12/03 20:29:02 - Seq Waiting/running.0 - init counter name: @@sequence:91e4786a-6d98-4426-9a09-7a89a14aa98c:seqWaitingRunning 2025/12/03 20:29:02 - Examples.0 - Finished processing (I=0, O=0, R=0, W=12, U=0, E=0) 2025/12/03 20:29:02 - Add 18.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:02 - Get TS.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) **2025/12/03 20:29:02 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:04 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0)** 2025/12/03 20:29:04 - Calc days.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:29:04 - Html html.0 - Finished processing (I=0, O=0, R=1, W=30, U=0, E=0) 2025/12/03 20:29:04 - Select Html html.0 - Finished processing (I=0, O=0, R=30, W=30, U=0, E=0) 2025/12/03 20:29:04 - Calc startTS.0 - Finished processing (I=0, O=0, R=1, W=5, U=0, E=0) 2025/12/03 20:29:04 - Get Queue.0 - Finished processing (I=32, O=0, R=1, W=32, U=0, E=0) 2025/12/03 20:29:04 - Get QueueLogArchive.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0) 2025/12/03 20:29:04 - Minimal fields from Queue.0 - Finished processing (I=0, O=0, R=32, W=32, U=0, E=0) 2025/12/03 20:29:05 - Get process.0 - Finished processing (I=32, O=0, R=32, W=32, U=0, E=0) 2025/12/03 20:29:05 - Join examples.0 - Finished processing (I=0, O=0, R=13, W=12, U=0, E=0) 2025/12/03 20:29:05 - Catch examples.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:05 - Get QueueLog.0 - Finished processing (I=118, O=0, R=1, W=118, U=0, E=0) 2025/12/03 20:29:05 - Sort on processID.0 - Finished processing (I=0, O=0, R=118, W=118, U=0, E=0) 2025/12/03 20:29:05 - Not last based on processID.0 - Finished processing (I=0, O=0, R=52, W=52, U=0, E=0) 2025/12/03 20:29:05 - Unique on processID.0 - Finished processing (I=0, O=0, R=118, W=66, U=0, E=52) 2025/12/03 20:29:05 - Minimal fields from QueueLog.0 - Finished processing (I=0, O=0, R=66, W=66, U=0, E=0) 2025/12/03 20:29:05 - Rename config_name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) **2025/12/03 20:29:05 - Get config_name.0 - Finished processing (I=93, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Status to color.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0)** 2025/12/03 20:29:07 - Filter on config_name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Filter on name.0 - Finished processing (I=0, O=0, R=98, W=98, U=0, E=0) 2025/12/03 20:29:07 - Seq Not success.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:07 - Sort on sequence.0 - Finished processing (I=0, O=0, R=191, W=191, U=0, E=0) 2025/12/03 20:29:07 - Select not success.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:29:07 - Switch / case.0 - Finished processing (I=0, O=0, R=43, W=43, U=0, E=0) 2025/12/03 20:29:07 - Select waiting/running.0 - Finished processing (I=0, O=0, R=39, W=39, U=0, E=0) **HOP Windows logfile** 2025/12/03 20:56:53 - Hop - Starting workflow 2025/12/03 20:56:53 - jb_scheduler_report - Start of workflow execution 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [START] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [START] (result=[true]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Common environment] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Common environment] (result=[true]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Property file?] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Property file?] (result=[false]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Env Property file?] 2025/12/03 20:56:53 - jb_scheduler_report - Finished action [Env Property file?] (result=[false]) 2025/12/03 20:56:53 - jb_scheduler_report - Starting action [Report queue] 2025/12/03 20:56:53 - Report queue - Using run configuration [local] 2025/12/03 20:56:53 - tr_scheduler_report - Executing this pipeline using the Local Pipeline Engine with run configuration 'local' 2025/12/03 20:56:53 - tr_scheduler_report - Execution started for pipeline [tr_scheduler_report] 2025/12/03 20:56:54 - Seq Html per ehs.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqProcess 2025/12/03 20:56:54 - Seq Not success.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqNotSucces 2025/12/03 20:56:54 - Seq Waiting/running.0 - init counter name: @@sequence:1f70e235-5be9-4bd0-93c9-cb25ec06c8b2:seqWaitingRunning 2025/12/03 20:56:55 - Examples.0 - Finished processing (I=0, O=0, R=0, W=12, U=0, E=0) 2025/12/03 20:56:55 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Get TS.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Add 18.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Calc days.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Calc startTS.0 - Finished processing (I=0, O=0, R=1, W=5, U=0, E=0) 2025/12/03 20:56:55 - Dummy (do nothing).0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2025/12/03 20:56:55 - Html html.0 - Finished processing (I=0, O=0, R=1, W=30, U=0, E=0) 2025/12/03 20:56:55 - Select Html html.0 - Finished processing (I=0, O=0, R=30, W=30, U=0, E=0) 2025/12/03 20:56:55 - Get QueueLogArchive.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0) 2025/12/03 20:56:56 - Get Queue.0 - Finished processing (I=6, O=0, R=1, W=6, U=0, E=0) 2025/12/03 20:56:56 - Join examples.0 - Finished processing (I=0, O=0, R=13, W=12, U=0, E=0) 2025/12/03 20:56:56 - Catch examples.0 - Finished processing (I=0, O=0, R=12, W=12, U=0, E=0) 2025/12/03 20:56:56 - Get process.0 - Finished processing (I=6, O=0, R=6, W=6, U=0, E=0) 2025/12/03 20:56:56 - Minimal fields from Queue.0 - Finished processing (I=0, O=0, R=6, W=6, U=0, E=0) 2025/12/03 20:56:56 - Get QueueLog.0 - Finished processing (I=148, O=0, R=1, W=148, U=0, E=0) 2025/12/03 20:56:56 - Sort on processID.0 - Finished processing (I=0, O=0, R=148, W=148, U=0, E=0) 2025/12/03 20:56:56 - Unique on processID.0 - Finished processing (I=0, O=0, R=148, W=66, U=0, E=82) 2025/12/03 20:56:56 - Not last based on processID.0 - Finished processing (I=0, O=0, R=82, W=82, U=0, E=0) 2025/12/03 20:56:56 - Minimal fields from QueueLog.0 - Finished processing (I=0, O=0, R=66, W=66, U=0, E=0) 2025/12/03 20:56:56 - Get config_name.0 - Finished processing (I=68, O=0, R=72, W=72, U=0, E=0) **2025/12/03 20:56:56 - Rename config_name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Not nulls.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0)** 2025/12/03 20:56:58 - Filter on config_name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Filter on name.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Status to color.0 - Finished processing (I=0, O=0, R=72, W=72, U=0, E=0) 2025/12/03 20:56:58 - Sort config_name.0 - Finished processing (I=0, O=0, R=72, W=144, U=0, E=0) 2025/12/03 20:56:58 - Html per ehs.0 - Finished processing (I=0, O=0, R=72, W=84, U=0, E=0) 2025/12/03 20:56:58 - Filter rows.0 - Finished processing (I=0, O=0, R=72, W=16, U=0, E=0) 2025/12/03 20:56:58 - Seq Html per ehs.0 - Finished processing (I=0, O=0, R=84, W=84, U=0, E=0) 2025/12/03 20:56:58 - Switch / case.0 - Finished processing (I=0, O=0, R=16, W=16, U=0, E=0) 2025/12/03 20:56:58 - Waiting/running.0 - Finished processing (I=0, O=0, R=9, W=13, U=0, E=0) 2025/12/03 20:56:58 - Not success.0 - Finished processing (I=0, O=0, R=7, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select Html per ehs.0 - Finished processing (I=0, O=0, R=84, W=84, U=0, E=0) 2025/12/03 20:56:58 - Seq Waiting/running.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0) 2025/12/03 20:56:58 - Seq Not success.0 - Finished processing (I=0, O=0, R=11, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select not success.0 - Finished processing (I=0, O=0, R=11, W=11, U=0, E=0) 2025/12/03 20:56:58 - Select waiting/running.0 - Finished processing (I=0, O=0, R=13, W=13, U=0, E=0) GitHub link: https://github.com/apache/hop/discussions/6116 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
