Re: Testing Metrics

2018-04-25 Thread Chesnay Schepler
+1 to using reporters. You will have to explicitly pass a configuration with the reporter settings to the environment via StreamExecutionEnvironment#createLocalEnvironment(int, Configuration). The reporter can verify registrations/values and pass this information back to the main test thread

Re: Testing Metrics

2018-04-25 Thread Tzu-Li (Gordon) Tai
Hi, Do you mean tests to verify that some metric is actually registered? AFAIK, this is not really easy to do as a unit test. One possible way is to have an integration test that uses a metrics reporter, from which you verify against. For example, the Kafka consumer integration tests that uses

Testing Metrics

2018-04-24 Thread Julio Biason
Hey guys and gals, Just wondering: Does anyone have an idea how to test if metrics are being generated? I have an integration test and I just added a processor to count elements in late arrivals (the general idea is to capture those, count and get an average, so we can adjust the allowedLateness)