John is right. Could you provide more detailed code? So that we can help to investigate.
Best, Jark On Wed, 4 Mar 2020 at 06:20, John Smith <java.dev....@gmail.com> wrote: > The sink if for Streaming API, it looks like you are using SQL and tables. > So you can use the connector to output the table result to Elastic. Unless > you want to convert from table to stream first. > > On Tue, 3 Mar 2020 at 16:25, Castro, Fernando C. < > fernando.cas...@leidos.com> wrote: > >> Hello folks! I’m new to Flink and data streaming in general, just initial >> FYI ;) >> >> >> >> I’m currently doing this successfully: >> >> 1 - streaming data from Kafka in Flink >> >> 2 - aggregating the data with Flink’s sqlQuery API >> >> 3 - outputting the result of #2 into STDOUT via toRetreatStream() >> >> >> >> My objective is to change #3 so I’m upserting into an Elasticsearch index >> (see >> https://stackoverflow.com/questions/60512064/flink-is-not-adding-any-data-to-elasticsearch-but-no-errors >> for my complete code) >> >> >> >> I’ve been using the template for the Elasticsearch connector >> https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/table/connect.html#elasticsearch-connector >> >> tableEnvironment >> >> .connect(...) >> >> .withFormat(...) >> >> .withSchema(...) >> >> .inAppendMode() >> >> .createTemporaryTable("MyTable") >> >> >> >> By I’m confused from seeing some old examples online. Should I be using >> the Elasticsearch Sink ( >> https://ci.apache.org/projects/flink/flink-docs-release-1.10/dev/connectors/elasticsearch.html#elasticsearch-sink) >> instead? Or both? >> >> >> >> I’m having trouble with the current implementation where no data is >> outputting to Elasticsearch, but no error is being displayed in Flink (job >> status is RUNNING). >> >> >> >> Hoping somebody could clarify what I’m missing? Thank you in advance! >> >> >> >> Note: Running on Scala 2.11, Elasticsearch 7, Flink 1.10 >> >
