Hi Zike, great to hear that you want to contribute!
A good start can be to setup your development environment and to improve some connectors or sinks. Improving the pulsar components would be great as these are some rather basic implementations we did at ApacheCon. For development, the best setup is to use the CLI tool [1] which can be configured to for different development targets. E.g., "dev" mode can be used to develop core services, UI and extensions so that only other mandatory services are started in Docker, while "pipeline-element" mode starts also the core and UI in Docker which is useful in case you are only developing pipeline elements. There are a few environment variables which might be needed to set and I'm happy to help with that. If you are interested in improving the Pulsar components, a good start could be to take the Pulsar sink [2] and refactor the old three-class implementation used there to the one-class-implementation described in the documentation [3]. Other cool things would be to upgrade the Pulsar version to the latest version and it would be also great to support more advanced options, e.g., authentication or topic discovery so that users see a list of available topics, or whatever you think would be a good configuration option for Pulsar users. Similar things would also be great for the connector. I'm happy to guide you through the first steps, feel free to ask here or join the ASF StreamPipes Slack channel for quick questions! Cheers Dominik [1] https://github.com/apache/incubator-streampipes/tree/dev/installer/cli [2] https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions/streampipes-sinks-brokers-jvm/src/main/java/org/apache/streampipes/sinks/brokers/jvm/pulsar [3] https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.html -----Original Message----- From: Zike Yang <[email protected]> Sent: Tuesday, August 23, 2022 5:50 PM To: [email protected] Subject: New comer to the Apache Streampipes Hi, Apache Streampipes community I am a software engineer and a committer from the Apache Pulsar community. I recently learned about this project. I read some documentation and tried to use it myself and found that it's an excellent project. I'm interested in it. I wish I could contribute to this project. Currently, I'm familiar with the Apache Pulsar. I see that this project also uses Apache Pulsar as a data source connector and sink. I think I can get started by contributing to those modules. Are there other learning resources that can help me deepen my understanding of this project? Is there anything else I can start working on? Very appreciate it if you could provide me with more information. Thanks, Zike Yang
