Thanks @Samrat for bringing this discussion. It makes sense to me to introduce AWS Redshift connector for Apache Flink, and I’m glad to help review the design as well as the code review.
About the implementation phases, How about prioritizing support for the Datastream Sink API and TableSink API in the first phase? It seems that the primary use cases for the Redshift connector are acting as a sink for processed data by Flink. Best, Leonard > On May 29, 2023, at 12:51 PM, Samrat Deb <decordea...@gmail.com> wrote: > > Hello all , > > Context: > Amazon Redshift [1] is a fully managed, petabyte-scale data warehouse > service in the cloud. It allows analyzing data without all of the > configurations of a provisioned data warehouse. Resources are automatically > provisioned and data warehouse capacity is intelligently scaled to deliver > fast performance for even the most demanding and unpredictable workloads. > Redshift is one of the widely used warehouse solutions in the current > market. > > Building flink connector redshift will allow flink users to have source and > sink directly to redshift. It will help flink to expand the scope to > redshift as a new connector in the ecosystem. > > I would like to start a discussion on the FLIP-307: Flink connector > redshift [2]. > Looking forward to comments, feedbacks and suggestions from the community > on the proposal. > > [1] https://docs.aws.amazon.com/redshift/latest/mgmt/welcome.html > [2] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-307%3A++Flink+Connector+Redshift > > > > Bests, > Samrat
