Re: Proper way to get DataStream

2021-04-09 Thread Maminspapin
Arvid Heise-4, Ok, this is clear for me now. Good answer. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Proper way to get DataStream

2021-04-09 Thread Arvid Heise
Hi Maminspapin, I just answered another question similarly, so let me just c it here: The beauty of Avro lies in having reader and writer schema and schema compatibility, such that if your schema evolves over time (which will happen in streaming naturally but is also very common in batch), you

Re: Proper way to get DataStream

2021-04-04 Thread Maminspapin
Hi, @Arvid Heise-4, @Matthias I'm very appreciate for your attention, guys. And sorry for my late reply. Yes, Arvid, you are right, the second way in fact works. I coppied schema from Schema Registry using it's API and created the .avsc format file. And thanks again for explaining me why the

Re: Proper way to get DataStream

2021-04-01 Thread Arvid Heise
Hi, it seems as if the data is written with a confluent registry in mind, so you cannot use option 1: the kafka record is invalid avro as it contains a 5 byte prefix that identifies the schema. So the second way, is the way to go and it actually works well: it tells you that you have read with a

Re: Proper way to get DataStream

2021-03-31 Thread Matthias Pohl
Hi Maminspapin again, have you checked whether your topic actually contains data that matches your schema specified through cep.model.User? Best, Matthias On Tue, Mar 30, 2021 at 3:39 PM Maminspapin wrote: > Hi, > > I'm trying to solve a task with getting data from topic. This topic keeps >

Proper way to get DataStream

2021-03-30 Thread Maminspapin
Hi, I'm trying to solve a task with getting data from topic. This topic keeps avro format data. I wrote next code: public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); Schema schema