Aaah this could be potentially major issue as it may prevent metrics from restarted streaming context be not published. Can you make it a JIRA.
TD On Tue, Jun 23, 2015 at 7:59 AM, Juan Rodríguez Hortalá < juan.rodriguez.hort...@gmail.com> wrote: > Hi, > > I'm running a program in Spark 1.4 where several Spark Streaming contexts > are created from the same Spark context. As pointed in > https://spark.apache.org/docs/latest/streaming-programming-guide.html > each Spark Streaming context is stopped before creating the next Spark > Streaming context. The program works ok, but I get exceptions like the > following when a new Spark Streaming context is created > > 15/06/23 16:34:51 INFO MetricsSystem: Metrics already registered > java.lang.IllegalArgumentException: A metric named > local-1435070090627.driver.SampleStreamingTest.StreamingMetrics.streaming.lastReceivedBatch_processingEndTime > already exists > at > com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:91) > at > com.codahale.metrics.MetricRegistry.registerAll(MetricRegistry.java:385) > at > com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:85) > > > Is this something to be concerned, or just a minor nuisance? > > Thanks a lot in advance. > > Greetings, > > Juan Rodriguez Hortala >
