无窗口的Join 问题

[邓成刚【qq】]

HI,请教一个问题：
两个流无窗口的Join后生成的新流是一个更新流，怎么把它变成追加流然后-sink出去？

?????? flink savepoints ?? checkpoints??????

[shengjk1]

flink??flink??kafka??kafka??flink??kafkaconsumer
 ??kafkaproducer??flink??kafka 
offset??group.id??group.idkafka??api


flink??applicationgroup??
 ??flinkkafka consumer??APi assign()  
kafka subscribe() ??group.id kafka consumer 
??


Best,
Shengjk1




??2019??03??27?? 14:24??<1048095...@qq.com<1048095...@qq.com>> ??
checkpoint??flink??kafka 
offsetflink??
PSkafkfa 
sourcegroup.id??flink??applicationgroup





--  --
??: ""<1048095...@qq.com>;
: 2019??3??27??(??) 1:42
??: "user-zh";
: ?? flink savepoints ?? checkpoints??


~




--  --
??: "shengjk1";
: 2019??3??27??(??) 12:10
??: "user-zh@flink.apache.org";
: "user-zh";
: ??  flink savepoints ?? checkpoints??



 ??flink-connector-kafkakafka 
0.8zkkafka??(??kafka??API)


Flinkoffsetcheckpoint??
??checkpointkafka??APIoffset??
??checkpoint??flinkcheckpointoffsetstate 
backends??kafka consumer??Api??kafka

https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/connectors/kafka.html


Best,
Shengjk1




??2019??03??27?? 11:52??<1048095...@qq.com> ??
??checkpoint??savepoint

1??flink  
kafka??kafka??offsetflink??zookeeper
PS??zookeeper??offset
2flink??offsetzookeeper??




--  --
??: "baiyg25...@hundsun.com";
: 2019??3??27??(??) 11:38
??: "user-zh";

: : ?? flink savepoints ?? checkpoints??






 savepoint 
??savepoints





baiyg25...@hundsun.com



 
?? 2019-03-27 11:03
 user-zh
?? ?? flink savepoints ?? checkpoints??


??savepointsavepoints




--  --
??: "baiyg25...@hundsun.com";
: 2019??3??27??(??) 11:01
??: "user-zh";

: : flink savepoints ?? checkpoints??



checkpoints:
checkpoint??

savepoints??
savepointssavepointssavepointssavepoints





baiyg25...@hundsun.com

 
?? 2019-03-27 10:48
 user-zh
?? flink savepoints ?? checkpoints??
??flink savepoints ?? 
checkpointscheckpoints??savepointssavepoints??savepoints??
PS??checkpoints, 
3s??cancel??-s??savepointssavepointscheckpoints

Re: RocksDB中指定nameNode 的高可用

[Biao Liu]

Hi,
  HDFS 本身可以解决该问题，可以搜一下 “HDFS HA nameservice”，可以避免写死 name node 地址

Yun Tang  于2019年3月26日周二 下午5:29写道：

> Hi
>
> Flink高可用相关配置的存储目录，当存储路径配置成HDFS时，相关namenode高可用性由HDFS支持，对上层完全透明。
>
> 祝好
> 唐云
> 
> From: 戴嘉诚 
> Sent: Tuesday, March 26, 2019 16:57
> To: user-zh@flink.apache.org
> Subject: RocksDB中指定nameNode 的高可用
>
> 嘿，我想询问一下，flink中的RocksDB位置
> 我指定了hdfs路径，但是，这里是强指定nameNode的地址，但是我的hdfs是有个两个nameNode地址的，这里能否有个功能，当active
> nameNode挂掉了，类似hdfs的HA那样，能无缝切换nameNode地址吗？不然，当nameNode挂掉了， 我指定的flink也会一并挂掉
>
>

blink开源版本维表关联时开启缓存方式

[苏 欣]

我在ppt里面看到这些内容，但是在开源的blink里面没有找到相关的配置，请问各位老师应该如何开启缓存策略？
[cid:image001.png@01D4E4BC.02091040]

发送自 Windows 10 版邮件应用

?????? flink savepoints ?? checkpoints??????

[????]

checkpoint??flink??kafka 
offsetflink??
PSkafkfa 
sourcegroup.id??flink??applicationgroup





--  --
??: ""<1048095...@qq.com>;
: 2019??3??27??(??) 1:42
??: "user-zh";

: ??  flink savepoints ?? checkpoints??



~




--  --
??: "shengjk1";
: 2019??3??27??(??) 12:10
??: "user-zh@flink.apache.org";
: "user-zh"; 
: ??  flink savepoints ?? checkpoints??



 ??flink-connector-kafkakafka 
0.8zkkafka??(??kafka??API)


Flinkoffsetcheckpoint??
??checkpointkafka??APIoffset??
??checkpoint??flinkcheckpointoffsetstate 
backends??kafka consumer??Api??kafka

https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/connectors/kafka.html


Best,
Shengjk1




??2019??03??27?? 11:52??<1048095...@qq.com> ??
??checkpoint??savepoint

1??flink  
kafka??kafka??offsetflink??zookeeper
PS??zookeeper??offset
2flink??offsetzookeeper??




--  --
??: "baiyg25...@hundsun.com";
: 2019??3??27??(??) 11:38
??: "user-zh";

: : ?? flink savepoints ?? checkpoints??






 savepoint 
??savepoints





baiyg25...@hundsun.com



 
?? 2019-03-27 11:03
 user-zh
?? ?? flink savepoints ?? checkpoints??


??savepointsavepoints




--  --
??: "baiyg25...@hundsun.com";
: 2019??3??27??(??) 11:01
??: "user-zh";

: : flink savepoints ?? checkpoints??



checkpoints:
checkpoint??

savepoints??
savepointssavepointssavepointssavepoints





baiyg25...@hundsun.com

 
?? 2019-03-27 10:48
 user-zh
?? flink savepoints ?? checkpoints??
??flink savepoints ?? 
checkpointscheckpoints??savepointssavepoints??savepoints??
PS??checkpoints, 
3s??cancel??-s??savepointssavepointscheckpoints