Hi, Shaodong, Could you clarify what's your specific question? I can see that you configured your job to use snapshot metrics reporter and you are getting the JSON format snapshot report as expected. What's wrong here?
On Tue, May 10, 2016 at 1:25 AM, SSHOU <[email protected]> wrote: > Sorry, forget Task config file > > # Job > job.factory.class=org.apache.samza.job.yarn.YarnJobFactory > job.name=AnalyzeTask > > # YARN file://$ > {basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz > yarn.package.path= > file:///home/shou/codes/hello-samza/target/pandora-samza-$ > {pom.version}-dist.tar.gz > > # Task > task.class=com.chinaway.samza.obtain.kafka.task.impl.AnalyzeDataTask > task.inputs=kafka.interface-result > systems.remote.analyze.out.stream=analyze-result > > # Serializers > > serializers.registry.json.class=org.apache.samza.serializers.JsonSerdeFactory > > serializers.registry.string.class=org.apache.samza.serializers.StringSerdeFactory > > # Remote System > > systems.remote.spring.path=META-INF/spring/dubbo-demo-consumer.xml,META-INF/spring/dubbo-demo-action.xml > systems.remote.spring.bean.name=localCodeService > > # Kafka System > > systems.kafka.samza.factory=org.apache.samza.system.kafka.KafkaSystemFactory > systems.kafka.samza.msg.serde=json > systems.kafka.consumer.zookeeper.connect=127.0.0.1:2181/ > systems.kafka.consumer.group.id=interface-result-consumer > systems.kafka.producer.bootstrap.servers=127.0.0.1:9092 > > # Job Coordinator > job.coordinator.system=kafka > job.coordinator.replication.factor=1 > > task.opts=-agentlib:jdwp=transport=dt_socket,address=127.0.0.1:9101 > ,server=y,suspend=y > > task.window.ms=10000 > > task.checkpoint.factory=org.apache.samza.checkpoint.kafka.KafkaCheckpointManagerFactory > task.checkpoint.system=kafka > task.commit.ms=600000 > > task.checkpoint.replication.factor=1 > > metrics.reporters=snapshot > > metrics.reporter.snapshot.class=org.apache.samza.metrics.reporter.MetricsSnapshotReporterFactory > > metrics.reporter.snapshot.stream=kafka.metrics > > > serializers.registry.metrics.class=org.apache.samza.serializers.MetricsSnapshotSerdeFactory > systems.kafka.streams.metrics.samza.msg.serde=metrics > > > 在 2016年05月10日 15:54, SSHOU 写道: > > hello everyone: > I according to metrics configuration use samza but result data not > show metrics page format!!! > I'm getting metrics data format see accessory photo or copy down JSON > data. > > Thanks everyone help me! > -------------------DOWN JSON--------------- > {"header":{"job-id":"1","samza-version":"0.10.0","job-name":"AnalyzeTask","host":"172.21.9.150","reset-time":1462864635447,"container-name":"ApplicationMaster","source":"ApplicationMaster","time":1462865846296,"version":"0.0.1"},"metrics":{"org.apache.samza.system.kafka.KafkaSystemProducerMetrics":{"kafka-producer-send-failed":0,"kafka-flush-ns":0.0,"kafka-producer-send-success":1,"kafka-flush-failed":0,"kafka-producer-sends":1,"kafka-producer-retries":0,"kafka-flushes":0},"org.apache.samza.system.kafka.KafkaSystemConsumerMetrics":{"no-more-messages-SystemStreamPartition > [kafka, __samza_coordinator_AnalyzeTask_1, > 0]":true,"kafka-__samza_coordinator_analyzetask_1-0-high-watermark":61,"kafka-jakewoo-9092-messages-read":12292,"kafka-__samza_coordinator_analyzetask_1-0-messages-behind-high-watermark":0,"blocking-poll-count-SystemStreamPartition > [kafka, __samza_coordinator_AnalyzeTask_1, > 0]":4,"kafka-jakewoo-9092-bytes-read":11225,"kafka-jakewoo-9092-topic-partitions":1,"kafka-__samza_coordinator_analyzetask_1-0-bytes-read":11225,"buffered-message-count-SystemStreamPartition > [kafka, __samza_coordinator_AnalyzeTask_1, > 0]":0,"kafka-jakewoo-9092-skipped-fetch-requests":0,"kafka-__samza_coordinator_analyzetask_1-0-offset-change":61,"kafka-jakewoo-9092-reconnects":0,"kafka-__samza_coordinator_analyzetask_1-0-messages-read":61,"blocking-poll-timeout-count-SystemStreamPartition > [kafka, __samza_coordinator_AnalyzeTask_1, > 0]":0,"poll-count":11},"org.apache.samza.metrics.JvmMetrics":{"mem-heap-committed-mb":372.5,"threads-waiting":5,"mem-non-heap-max-mb":-9.536743E-7,"threads-timed-waiting":25,"mem-heap-used-mb":178.19217,"threads-runnable":16,"ps > scavenge-gc-count":7,"ps > scavenge-gc-time-millis":101,"mem-heap-max-mb":683.0,"gc-count":9,"mem-non-heap-used-mb":51.82807,"threads-new":0,"ps > marksweep-gc-count":2,"threads-blocked":3,"gc-time-millis":176,"mem-non-heap-committed-mb":52.6875,"ps > marksweep-gc-time-millis":75,"threads-terminated":0},"org.apache.samza.job.yarn.SamzaAppMasterMetrics":{"job-healthy":1,"http-port":49137,"locality-matched":0,"completed-containers":0,"needed-containers":0,"running-containers":1,"failed-containers":0,"rpc-port":51252,"released-containers":0,"app-attempt-id":"appattempt_1462864278075_0010_000001","container-count":1,"http-host":"JakeWoo"}}} > > > > > {"header":{"job-id":"1","samza-version":"0.10.0","job-name":"AnalyzeTask","host":"172.21.9.150","reset-time":1462864635447,"container-name":"ApplicationMaster","source":"MetricsSnapshotReporterFactory","time":1462865846297,"version":"0.0.1"},"metrics":{"org.apache.samza.system.kafka.KafkaSystemProducerMetrics":{"kafka-producer-send-failed":0,"kafka-flush-ns":1072401.5555555555,"kafka-producer-send-success":39,"kafka-flush-failed":0,"kafka-producer-sends":39,"kafka-producer-retries":0,"kafka-flushes":39}}} > > > > > > >
