GitHub user liosc added a comment to the discussion: What is best approach instead of DB lookup?
IMHO the approach should be chosen considering a variety of factors (number of records of each table, record length, growth rate, available resources, ...). For example, if you have 2.8 millions rows but the record length and the growth are very limited you could bring in all rows. BTW the database lookup should be a good option, if it is taking humongous time probably there is no index suitable for the search. Sometimes there is an index that seems good but for some reasons the query optimizer is not using it. In many cases, It is useful to check the query plan. If database lookup is very slow, also other strategies could result in poor performances. GitHub link: https://github.com/apache/hop/discussions/6136#discussioncomment-15179165 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
