Hi, I just realized that the documentation completely lacks a section about implementing custom source connectors :-(
The JavaDocs of the relevant interface classes [1] [2] [3] [4] are quite extensive though. I'd also recommend to have a look at the implementations of other source connectors like Kafka or Kinesis [5]. Best, Fabian [1] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/SourceFunction.java [2] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/RichSourceFunction.java [3] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/ParallelSourceFunction.java [4] https://github.com/apache/flink/blob/master/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/RichParallelSourceFunction.java [5] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/connectors/ 2018-04-20 20:26 GMT+02:00 Nortman, Bill <william.nort...@pimco.com>: > Is there any good documentation on building a flink source connector. I > need to build on for AMPS. > > > > > > This message contains confidential information and is intended only for > the individual named. If you are not the named addressee, you should not > disseminate, distribute, alter or copy this e-mail. Please notify the > sender immediately by e-mail if you have received this e-mail by mistake > and delete this e-mail from your system. E-mail transmissions cannot be > guaranteed to be secure or without error as information could be > intercepted, corrupted, lost, destroyed, arrive late or incomplete, or > contain viruses. The sender, therefore, does not accept liability for any > errors or omissions in the contents of this message which arise during or > as a result of e-mail transmission. If verification is required, please > request a hard-copy version. This message is provided for information > purposes and should not be construed as a solicitation or offer to buy or > sell any securities or related financial instruments in any jurisdiction. > Securities are offered in the U.S. through PIMCO Investments LLC, > distributor and a company of PIMCO LLC. > > The individual providing the information herein is an employee of Pacific > Investment Management Company LLC ("PIMCO"), an SEC-registered investment > adviser. To the extent such individual advises you regarding a PIMCO > investment strategy, he or she does so as an associated person of PIMCO. > To the extent that any information is provided to you related to a > PIMCO-sponsored investment fund ("PIMCO Fund"), it is being provided to you > in the individual's capacity as a registered representative of PIMCO > Investments LLC ("PI"), an SEC-registered broker-dealer. PI is not > registered, and does not intend to register, as a municipal advisor and > therefore does not provide advice with respect to the investment of the > proceeds of municipal securities or municipal escrow investments. In > addition, unless otherwise agreed by PIMCO, this communication and any > related attachments are being provided on the express basis that they will > not cause PIMCO LLC, or its affiliates, to become an investment advice > fiduciary under ERISA or the Internal Revenue Code. >
