Re: Hive integration in table API and SQL

2017-11-21 Thread Timo Walther
Hi, no, combining batch and streaming environments is not possible at the moment. However, most operations in batch can be done in streaming fashion as well. I would recommend to use the DataStream API as it provides the most flexibility in your use case. Regards, Timo Am 11/21/17 um 4:41

Re: Hive integration in table API and SQL

2017-11-20 Thread wangsan
Hi Timo, Thanks for your reply. I do notice that the document says "A Table is always bound to a specific TableEnvironment. It is not possible to combine tables of different TableEnvironments in the same query, e.g., to join or union them.” Does that mean there is no way I can make operations,

Re: Hive integration in table API and SQL

2017-11-20 Thread Timo Walther
Hi Wangsan, yes, the Hive integration is limited so far. However, we provide an external catalog feature [0] that allows you to implement custom logic to retrieve Hive tables. I think it is not possible to do all you operations in Flink's SQL API right now. For now, I think you need to

Hive integration in table API and SQL

2017-11-20 Thread wangsan
Hi all, I am currently learning table API and SQL in Flink. I noticed that Flink does not support Hive tables as table source, and even JDBC table source are not provided. There are cases we do need to join a stream table with static Hive or other database tables to get more specific