GitHub user swaroopchenchu added a comment to the discussion: I/O Error - Database LookUp transform failing
> Hey, You seem to be wanting to do way too much in one pipeline. Too many > steps to understand what's happening. Potentially too many steps to have > enough cores and memory to allocate. Potentially too many database connection > competing for resources. Start small, keep it small, fail fast and move on. > Your screenshot, could benefit from some artistic layout that enables > understanding what's happening. Looking at it makes me think that perhaps it > would be better executed as a Workflow that has many small pipelines. Each > performing a small piece of the logic with either a DB or a serialised file > input. With the exception of the last pipeline, each of them outputting to a > serialised file. Break it down into workable bits. Even with simpler pipeline, I have same issue. Actually its working for one environment, but failing for another I tried with Limit of one record, even then its failing on my environment, tried placing similar data in my environment too, then also failing. I think DB configuration for both env would be similar, unless any specific parameter I need to check for lookup. Failing Env Screenshot: <img width="920" height="389" alt="image" src="https://github.com/user-attachments/assets/448adb8d-e869-46e3-9119-3ad70923edee"; /> working Env Screenshot: <img width="1846" height="806" alt="image" src="https://github.com/user-attachments/assets/c51091de-a93e-4b2b-b3bf-b8019d45e447"; /> Any insights would be great help, and many thanks GitHub link: https://github.com/apache/hop/discussions/5939#discussioncomment-14865334 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
