Extending spark connectors versus providing utility libraries

2023-03-13 Thread Jarus Local
Hi team, Had a design question around wether it’s a good idea to write wrappers over all existing spark connectors for adding some functionality/improving usability in terms of options passed to the connector. In contrast to providing utility libraries that takes parameters and calls the

Extending Spark Connector versus Providing utility library

2023-03-13 Thread Jarus Local
Hi team, Had a design question around wether it’s a good idea to write wrappers over all existing spark connectors for adding some functionality/improving usability in terms of options passed to the connector. In contrast to providing utility libraries that takes parameters and calls the