chitralverma commented on PR #654: URL: https://github.com/apache/griffin/pull/654#issuecomment-2185719857
@guoyuepeng adding data integration to griffin with a ui seems to be a good idea. are we planning UI changes as well? my suggestion is to, - Use logstash/ Apache Spark/ DBT/ Polars / Apache Datafusion backends for data integration - Griffin data quality rules for DQ - Scheduling by Apache Airflow - and cataloguing/ lineage collection by [Datahub](https://github.com/datahub-project/datahub) all of this via one UI. If this makes sense, then I can create an architecture doc for this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@griffin.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
