GitHub user swaroopchenchu added a comment to the discussion: What is best approach instead of DB lookup?
hop version: 2.7.0, 16GB RAM for hop pod and 8gb for heap space. # HOP_OPTIONS: -Xmx8g -XX: source and destination resources looking okay I used database join, pipeline is executing fine but it took 20 minutes for 1 million records processing. As I previously mentioned, since i have 133 million to process, is there any other better way, we can fasttrack this? <img width="800" height="230" alt="image" src="https://github.com/user-attachments/assets/81dc98eb-0fba-43b0-99cc-9ac18a093e48"; /> GitHub link: https://github.com/apache/hop/discussions/6136#discussioncomment-15193828 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
