Hi Sunitha,
dependency looks good. I'd probably bump the version to 1.1.0 though
(version is off-cycle to Flink as of now to accelerate releases of this
young feature).
Best,
Arvid
On Tue, Sep 15, 2020 at 5:10 PM s_penakalap...@yahoo.com <
s_penakalap...@yahoo.com> wrote:
> Hi Arvid,
>
> Thank
Hi Arvid,
Thank you!!!
Will check change data capture approach. Please confirm including dependency
and adding sourceFunction should help us to achieve CDC.
com.alibaba.ververica
flink-connector-postgre-cdc
1.0.0 wrote:
Hi Sunitha,
to listen to changes in your database a change-data-ca
Hi Sunitha,
to listen to changes in your database a change-data-capture approach should
be taken [1], which is supported in Flink since 1.11.
Basically, a tool like debezium [2] will monitor the changelog of the
database and publish the result as a change stream, which can be ingested
in Flink as
Flink's built-in JDBC connector will read the data only once. JDBC does
not provide means to continously monitor a database table.
It depends on the size of your database, if you parameter table is small
it might be sufficient to write a simple Flink connector that
periodically reads the table
Hi Timo,
Thank you for the suggestions.
I see now both Process function and CEP approach will not fit in. Now if I
follow the third approach to stream the values from database() . Is it possible
to stream data continuously?
If I follow the bellow approach, both I see one time load only not cont
Hi Sunitha,
what you are describing is a typical streaming enrichment. We need to
enrich the stream with some data from a database. There are different
strategies to handle this:
1) You are querying the database for every record. This is usually not
what you want because it would slow down y
Hi All,
I am new to Flink, request your help!!!
My scenario : 1> we receive Json messages at a very high frequency like 10,000
messages / second2> we need to raise an Alert for a particular user if there is
any breach in threshold value against each attribute in Json.3> These threshold
values ar
