Re: Best practice to process DB stored log (is Flink the right choice?)

2019-06-17 Thread Piotr Nowojski
Hi, Those are good questions. > A datastream to connect to a table is available? I What table, what database system do you mean? You can check the list of existing connectors provided by Flink in the documentation. About reading from relational DB (example by using JDBC) you can read a little

Best practice to process DB stored log (is Flink the right choice?)

2019-06-15 Thread Stefano Lissa
Hi, surely really new-bye question but Flink sounds like to be the best choice. I have a log continuously added to a database table where a machine status is stored with a timestamp (the status is 0, 1, 2). What I need is to process this status and produce another stream where a sequence of