Hi All, We have seen multiple use cases where users want to get data from relational databases and ingest it downstream. Typical use cases fall into the following categories:
1. Use CDC systems to write to messaging queue and DT apps read from the message queue. 2. JDBC polling. Typically these use cases have multiple tables with multiple columns. Creating schemas for each of these tables to be usable by operators is a manual process today which can get pretty time consuming and error prone as the number of columns increases. To solve it, we can create a feature to convert DDL to schema as DDL is easily accessible from databases. The DDL can be made available by two ways. 1. Query for DDL from the database itself if accessible. 2. DDL can be configured on the application. What do you guys think? -- Regards, Ashwin.
