cuelly3 opened a new issue, #5258: URL: https://github.com/apache/streampipes/issues/5258
### Apache StreamPipes version dev (current development state) ### Affected StreamPipes components Connect ### What happened? Design, implement, and validate a new S3 Adapter for Apache StreamPipes based on Apache Camel. The adapter shall enable users to ingest data from S3-compatible object storage systems and make the data available as StreamPipes event streams. Apache Camel shall be used as the integration framework to provide a standardized, reusable, and extensible connectivity layer. ### How to reproduce? _No response_ ### Expected behavior Evaluate the Apache Camel AWS2-S3 component for integration with StreamPipes. Design a reusable adapter architecture based on Apache Camel routes. Support connectivity to: - AWS S3 - SeaweedFS Provide configurable connection settings: - Endpoint URL - Bucket Name - Region - Access Key / Secret Key - Object Selection Pattern - Polling Interval - Support ingestion of common file formats: - JSON - CSV Automatically map incoming file contents to StreamPipes event schemas. Implement error handling, retry mechanisms, and connection validation. <img width="3213" height="3099" alt="Image" src="https://github.com/user-attachments/assets/acbbcb0f-8816-4d4e-ad8e-9c5d7db120c4" /> ### Additional technical information _No response_ ### Are you willing to submit a PR? Yes, I am willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
