Re: Custom metrics reporter classloading problem

2018-07-11 Thread Gyula Fóra
Thanks for the explanation, that makes sense. For some reason I thought that in Yarn all stuff goes into the classpath. Gy Chesnay Schepler ezt írta (időpont: 2018. júl. 11., Sze, 15:16): > Reporters do not have access to libraries provided with user-jars. > They are instantiated when JM/TM

Re: Custom metrics reporter classloading problem

2018-07-11 Thread Chesnay Schepler
Reporters do not have access to libraries provided with user-jars. They are instantiated when JM/TM starts, i.e. before any user-code is even accessible. My recommendation would be to either put the kafka dependencies in the /lib folder or try to relocate the kafka code in the reporter. On

Custom metrics reporter classloading problem

2018-07-11 Thread Gyula Fóra
Hi all, I have ran into the following problem and I want to double check wether this is intended behaviour. I have a custom metrics reporter that pushes things to Kafka (so it creates a KafkaProducer in the open method etc.etc.) for my streaming job. Naturally as my Flink job consumes from