Hi Neelabh You can use FileSystem Connector . for DataStream [1] for TableAPI [2] . And you need to put necessary dependency to your flink environment. [3]
For Flink SQL setup, you can reference `sql getting started module`[4] [1]. https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/filesystem/#file-source [2]. https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/filesystem/ [3]. https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/overview/ [4]. https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/gettingstarted/#prerequisites Best, Feng On Fri, Nov 24, 2023 at 1:52 PM Neelabh Shukla <neelabhshukl...@gmail.com> wrote: > Hey Team, > I want to stream data from AWS S3 source as they are being generated by an > event to Apache Flink Stream for a data transformation job. > > I found out about FileSystem SQL Connector > < > https://stackoverflow.com/questions/62618381/apache-flink-with-s3-as-source-and-s3-as-sink > > > but > need some reference on how to set this up. > > Feel free to share any learnings you have with this problem or any resource > I can refer to. > > Based on slack recommendation I am reaching out to this email list but let > me know if this is not the correct place to reach out to the community. > > Thanks, > Neelabh >
