Hi Jeff, Seems like you’re looking for a data filter. Originally, Griffin calculates the data quality like accuracy, profiling, and the output of Griffin would be the data quality metrics. In your case, what kind of data quality do you want to check? How to define the success or failure of you data?
Thanks Lionel, Liu From: Jeff Zemerick Sent: 2019年2月6日 21:41 To: dev@griffin.apache.org Subject: publish data to new Kafka topic Hi Griffin devs, Continuing my email thread from users@ and to better clarify it, I have a Kafka topic with JSON data on it. I would like to perform quality checks on this data, and I would like for data that meets the quality checks to be published to a separate Kafka topic, while data that fails one or more quality checks is left on the original Kafka topic. Is something like this possible with Griffin? Please let me know if my use-case is not clear. Thanks, Jeff
