harrygav commented on PR #665: URL: https://github.com/apache/wayang/pull/665#issuecomment-3947323225
Hi all, picking up on this one again. I just pushed a commit with the update: - Support for more types, using reflection. Currently we support POJOs but also Wayang Records. - Support for different backend DBMSes, added the Calcite dependency to wayang-basic for that - Introduced more tests for the JavaTableSink and SparkTableSink - Added the H2 in-memory DBMS for the tests locally, removing the dependency on an external PostgreSQL DBMS running I think it would be wise to add a couple of DBMSes for the tests, which would also be useful for the source operators or supporting JDBC platforms themselves. This could be done either through their embedded versions or through maven testcontainers. Then, we could add support for sinks on other platforms, e.g., the JDBC platform, to also support DBMS->DBMS workloads. Let me know what you think about the PR, and if we want to do some of the next steps (e.g., testing) here or in another PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
