RocksDB and local file system

2019-11-06 Thread Jaqie Chan
Hello I am using Flink rocksDb state backend, the documentation seems to imply i can use a regular file system such as: file:///data/flink/checkpoints, but the code javadoc only mentions hdfs or s3 option here. I am wondering if it's possible to use local file system with flink rocksdb backend.

Flink SQL dynamic configuration

2019-11-06 Thread Jaqie Chan
Hello, I use Flink SQL API to process a data stream from Kafka. To process these data, I use some configurations loaded from an HTTP endpoint once at initialization. The configuration is loaded only once at job initialization. So it works well with a static configuration, but do not handle dynami

Re: flink on yarn-cluster kerberos authentication for hbase

2019-11-08 Thread Jaqie Chan
Hello, Does this have helps to you? https://stackoverflow.com/questions/34596165/how-to-do-kerberos-authentication-on-a-flink-standalone-installation Regards 嘉琪 On Fri, Nov 8, 2019 at 4:00 PM venn wrote: > HI Guys: > > Who can share some example for flink on yarn-cluster kerberos

Re: Flink SQL dynamic configuration

2019-11-08 Thread Jaqie Chan
uld > apply the configuration changes. > > Cheers, > Till > > On Thu, Nov 7, 2019 at 4:16 AM Jaqie Chan wrote: > >> Hello, >> >> I use Flink SQL API to process a data stream from Kafka. To process these >> data, I use some configurations loaded from an HTTP

static table in flink

2019-11-08 Thread Jaqie Chan
Hello, I have questions about static table in flink. Join the stream table with static table. I'm looking at temporal table, while the time based table would grow exponentially over period. Any suggestions? Stream tables checks the contains in static table(updates once everyday with new set of d