Re: Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-06 Thread Chesnay Schepler
This could be related to FLINK-12579 , some kafka metrics use Infinity as a value which Influx doesn't support. For 1.10 we updated our influxdb-java dependency which automatically filters out these values, but we haven't released this yet. We

Re: Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-06 Thread Morgan Geldenhuys
The only difference that i can tell is the Kubernetes cluster was upgraded from 1.14 to 1.17, however I rolled this back to test and the same result on the older version. Ive created a stripped down Job which produces the errors: // create a testing sink private static class CollectSinkimple

Re: Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-06 Thread Chesnay Schepler
Setup-wise, are there any differences to what you had a few months ago? On 06/02/2020 10:40, Morgan Geldenhuys wrote: Further info, the flink cluster (1.9) is running on Kubernetes (1.17) with InfluxDB. I have tried the following images for InfluxDB: docker.io/influxdb:1.6.4 and influxdb:la

Re: Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-06 Thread Morgan Geldenhuys
Further info, the flink cluster (1.9) is running on Kubernetes (1.17) with InfluxDB. I have tried the following images for InfluxDB: docker.io/influxdb:1.6.4 and influxdb:latest When going into the database and showing the series, there are really weird results: > show series key --- job

Re: Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-06 Thread Chesnay Schepler
What InfluxDB version are you using? On 05/02/2020 19:41, Morgan Geldenhuys wrote: I am trying to setup metrics reporting for Flink using InflixDB, however I am receiving tons of exceptions (listed right at the bottom). Reporting is setup as recommended by the documentation: metrics.reporter

Flink TaskManager Logs polluted with InfluxDB metrics reporter errors

2020-02-05 Thread Morgan Geldenhuys
I am trying to setup metrics reporting for Flink using InflixDB, however I am receiving tons of exceptions (listed right at the bottom). Reporting is setup as recommended by the documentation: metrics.reporter.influxdb.class: org.apache.flink.metrics.influxdb.InfluxdbReporter metrics.reporte