Re: Table API / SQL UIDs not the only one
i delete ‘row‘ flag
it seems good looking
--
a job have two sql
source is kafka
sink is redis or other sink
Asql
select
reqIp as factorContenta,
count(*) as eCount,
60 * 60 as expire
from
kafka_source
where
uri is not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
reqIp
Bsql
select
uid as factorContentb,
count(*) as eCount,
60 * 60 as expire
from
kafka_source
where
uri is not null
group by
hop(
rowtime,
interval '2' second,
interval '60' minute
),
uid
now only start Asql stop Bsqlsink have key 656.19.173.34
then stop Asql and savepoint hdfs now del key 656.19.173.34( if sink is
kafka Don't delete)
start Bsql from savepoint
you will find sink have key 656.19.173.34 and 6630519 all exist
Bsql fetch Asql savepoint result
i think sql uids not the only one
Who can help me see this problem?
my test data is
{
"reqIp" : "656.19.173.34",
"rowtime" : 1537950912546,
"uid" : 6630519,
"uri" : "/web"
}
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Table API / SQL UIDs not the only one
hi i deleteflag it seems good looking -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Table API / SQL UIDs not the only one
hi i deleteflag it seems good looking -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Table API / SQL UIDs not the only one
Hi, Could you rephrase your question? I think some parts of the question are missing. It would be also easier to help you if you could state the final problem a bit more clearly. Best, Dawid On 23/10/2018 04:06, WeiWen Fan wrote: > a job have two sql > source is kafka > sink is redis or other sink > > Asql > > > Bsql > > > now only start Asql stop Bsqlsink have key 656.19.173.34 > > then stop Asql and savepoint hdfs now del key 656.19.173.34( if sink is > kafka Don't delete) > > start Bsql from savepoint > you will find sink have key 656.19.173.34 and 6630519 all exist > > Bsql fetch Asql savepoint result > > i think sql uids not the only one > > Who can help me see this problem? > > > > > -- > Sent from: > http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ signature.asc Description: OpenPGP digital signature
Table API / SQL UIDs not the only one
a job have two sql source is kafka sink is redis or other sink Asql Bsql now only start Asql stop Bsqlsink have key 656.19.173.34 then stop Asql and savepoint hdfs now del key 656.19.173.34( if sink is kafka Don't delete) start Bsql from savepoint you will find sink have key 656.19.173.34 and 6630519 all exist Bsql fetch Asql savepoint result i think sql uids not the only one Who can help me see this problem? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
