You could meta inject the validation into the data validation. I.e. have a file worth your schema, parse it accordingly and, insert it into the data valuator step in execution.
On Wed, 1 Jan 2025, 1:21 am Alain Benard, <[email protected]> wrote: > Hello, I am looking for an alternative to Talend tools and I am > interested in Apache Hop. I am used to declaring schemas in the > metadata, and one of the systematic processes I used to perform with the > Talend Schema Compliance component was to generate a flow of lines from > my input file that do not comply with the expected schema. The reason > could be an incorrect data type or an excessively long string length... > My file data always ends up in a database, and this verification is > really the basic step in my flows. For now, I have looked at Schema > Mapping, which does not seem to be designed for this, and Data > Validator, which requires defining the controls for each column manually > and does not rely on the schema defined in the metadata. Do you have any > suggestions for performing this schema compliance check? Thank you in > advance. > > Alain > >
