[ https://issues.apache.org/jira/browse/AMBARI-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14231907#comment-14231907 ]
Hudson commented on AMBARI-5707: -------------------------------- SUCCESS: Integrated in Ambari-trunk-Commit-docker #360 (See [https://builds.apache.org/job/Ambari-trunk-Commit-docker/360/]) AMBARI-5707. Replace Ganglia with high performant and pluggable Metrics System. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=a52f8a5572f689351a22d41f62bd083c27a3bfa8) * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryServer.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/params.py * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSReportPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryManagerImpl.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_template/globaltoc.html * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-RS.j2 * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestTimelineWebServices.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSHostPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixTransactSQL.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_pswindows.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/package-info.java * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaHostComponentPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractMiniHBaseClusterTest.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_windows.c * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/MemoryApplicationHistoryStore.java * ambari-metrics/ambari-metrics-host-monitoring/pom.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/MetricClusterAggregate.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaHostPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/RestMetricsPropertyProvider.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/hbase_regionserver_jaas.conf.j2 * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsReportPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSComponentPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/TestStdOutMetricsSender.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_static/copybutton.js * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/phoenix-components-minimal.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/index.rst * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ApplicationAttemptFinishDataPBImpl.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/osx/process_info.h * ambari-server/src/main/java/org/apache/ambari/server/state/Service.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_posix.c * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/Metric.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/HBASE/configuration/hbase-env.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/main.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/GenericObjectMapper.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/timeline/AMSHostComponentPropertyProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/security.c * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/ntextapi.h * ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/AbstractTimelineMetricsSink.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSController.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/conf.py * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaPropertyProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/test/python/unitTests.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_pssunos.py * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/hbase_service.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/make.bat * ambari-metrics/ambari-metrics-timelineservice/conf/unix/log4j.properties * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebServices.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/HOST.dat * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaReportPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TestClusterSuite.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/process_handles.c * ambari-metrics/ambari-metrics-host-monitoring/src/test/python/core/TestHostInfo.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/LICENSE * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/AppID.java * ambari-metrics/ambari-metrics-host-monitoring/conf/unix/ambari-metrics-monitor * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_osx.c * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/MetricsSenderWorker.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsHostProvider.java * .gitignore * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/Makefile * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ContainerFinishDataPBImpl.java * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/scripts/params.py * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-hbase-site.xml * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/TestMetric.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_template/indexsidebar.html * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/SLAVE_HBASE.dat * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/DATANODE.dat * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/metric_monitor.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricClusterAggregatorHourly.java * ambari-server/src/main/java/org/apache/ambari/server/controller/jmx/JMXPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/resources/lib/org/apache/phoenix/phoenix-core-tests/maven-metadata-local.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/stop_slaves.sh * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManagerImpl.java * ambari-server/src/test/java/org/apache/ambari/server/controller/ganglia/TestStreamProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_windows.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TimeStampProvider.java * ambari-server/src/test/resources/ams/multiple_host_metrics.json * ambari-metrics/ambari-metrics-hadoop-sink/pom.xml * ambari-metrics/ambari-metrics-timelineservice/conf/unix/ams-env.sh * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TimelineStoreTestUtils.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_bsd.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/PhoenixHBaseAccessor.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TestLeveldbTimelineStore.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_sunos.c * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/hadoop-metrics2-hbase.properties.j2 * ambari-server/src/main/java/org/apache/ambari/server/controller/internal/StackDefinedPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/utilities/PropertyHelper.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/status_slaves.sh * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_posix.h * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/README * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/MetricHostAggregate.java * ambari-metrics/ambari-metrics-timelineservice/src/test/conf/ams-site.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebServices.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TimelineReader.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/build.py * ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractProviderModule.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricHostProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/make.bat * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/MetricsInitializationException.java * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaReportPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ThreadPoolEnabledPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/ats.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ContainerFinishData.java * ambari-server/src/main/java/org/apache/ambari/server/Role.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/MemoryTimelineStore.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaComponentPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TestTimeStampProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/StdOutMetricsSender.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/bsd/process_info.c * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/service_check.py * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryServer.java * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/phoenix-server.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationAttemptFinishData.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-hbase-env.xml * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/timeline/AMSPropertyProviderTest.java * ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetric.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationHistoryData.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ContainerHistoryData.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TestPhoenixTransactSQL.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/__init__.py * ambari-metrics/ambari-metrics-timelineservice/src/test/conf/hadoop-policy.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_osx.h * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/status_params.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_themes/pydoctheme/static/pydoctheme.css * ambari-server/src/main/resources/ganglia_properties.json * pom.xml * ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetricsCache.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/NODEMANAGER.dat * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/MASTER_HBASE.dat * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-hbase-log4j.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryClientService.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/TestRandomMetricsProvider.java * ambari-server/src/test/java/org/apache/ambari/server/controller/ganglia/GangliaHelperTest.java * ambari-server/src/test/java/org/apache/ambari/server/controller/ganglia/GangliaPropertyProviderTest.java * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaMetricTest.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-log4j.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/conf/simulator-log4j.xml * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-env.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/DefaultPhoenixDataSource.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TestGenericObjectMapper.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/regionservers.j2 * ambari-metrics/ambari-metrics-host-monitoring/src/test/python/core/TestEmitter.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/Aggregator.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/__init__.py * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/process_info.h * ambari-server/src/test/java/org/apache/ambari/server/controller/internal/StackDefinedPropertyProviderTest.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/RESOURCEMANAGER.dat * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/ams.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/metric_collector.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_linux.c * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/hbase_master.py * ambari-server/src/test/resources/ams/multiple_component_metrics.json * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppAttemptPage.java * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaHostPropertyProvider.java * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaHostProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/HBaseTimelineMetricStore.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/hbase_master_jaas.conf.j2 * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-hbase-policy.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/ConnectionProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_compat.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_pslinux.py * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TestTimelineMetricStore.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineClusterMetric.java * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/simulator.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationAttemptHistoryData.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryManager.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaMetric.java * ambari-metrics/ambari-metrics-timelineservice/src/main/conf/hbase-site-metrics-service.xml * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/TestRestMetricsSender.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/security.h * ambari-metrics/ambari-metrics-hadoop-sink/src/main/assemblies/empty.xml * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/TestAppMetrics.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricStore.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/Makefile * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/phoenix-components-major-client.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/metrics_def/NAMENODE.dat * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ApplicationFinishDataPBImpl.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/MetricAggregate.java * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaPropertyProvider.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ApplicationStartDataPBImpl.java * ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetricsSink.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/MetricsSender.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/NameValuePair.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/metric_collector.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TimelineStore.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSView.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TimelineWebServices.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/EntityIdentifier.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/controller.py * ambari-server/src/main/resources/stacks/HDP/2.0.6/services/HBASE/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-MASTER.j2 * ambari-metrics/ambari-metrics-hadoop-sink/src/main/assemblies/sink.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationStartData.java * ambari-metrics/ambari-metrics-timelineservice/src/test/resources/lib/org/apache/phoenix/phoenix-core-tests/4.2.0/phoenix-core-tests-4.2.0.jar * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/host_info.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_common.h * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/iotop.py * ambari-server/src/test/java/org/apache/ambari/server/controller/utilities/PropertyHelperTest.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/start_slaves.sh * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/hbase_regionserver.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/glpi.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationFinishData.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/JAXBContextResolver.java * ambari-metrics/ambari-metrics-timelineservice/conf/unix/ambari-metrics-collector * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/Json.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricAggregator.java * ambari-server/src/test/java/org/apache/ambari/server/controller/ganglia/GangliaReportPropertyProviderTest.java * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaHostComponentPropertyProvider.java * ambari-server/src/test/resources/ams/single_host_metric.json * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/ApplicationInstance.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/application_metric_map.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/__init__.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/event_definition.py * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaReportPropertyProviderTest.java * ambari-metrics/ambari-metrics-host-monitoring/src/test/python/core/TestMetricCollector.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/AppMetrics.java * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/empty.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/stop.sh * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaMetric.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/config_reader.py * ambari-metrics/ambari-metrics-hadoop-sink/src/main/conf/hadoop-metrics2.properties.j2 * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractTimelineAggregator.java * ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetrics.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryReader.java * ambari-metrics/ambari-metrics-timelineservice/src/test/resources/hbase-default.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/osx/process_info.c * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/nettop.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/NullApplicationHistoryStore.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/metainfo.xml * ambari-server/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetrics.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/HostMetricsGenerator.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/configuration/ams-site.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_static/sidebar.js * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/UrlService.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ContainerStartDataPBImpl.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/hbase_grant_permissions.j2 * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/ITMetricAggregator.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/ams_service.py * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestMemoryApplicationHistoryStore.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/net/RestMetricsSender.java * ambari-metrics/ambari-metrics-host-monitoring/src/test/python/core/TestApplicationMetricMap.py * ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/top.py * ambari-metrics/ambari-metrics-timelineservice/src/test/resources/lib/org/apache/phoenix/phoenix-core-tests/4.2.0/phoenix-core-tests-4.2.0.pom * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/JMXPropertyProviderTest.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/files/hbaseSmokeVerify.sh * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_sunos.h * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryStoreTestUtils.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/__init__.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/LeveldbTimelineStore.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_bsd.c * ambari-server/src/main/java/org/apache/ambari/server/controller/ganglia/GangliaComponentPropertyProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/package/rpm/preremove.sh * ambari-metrics/ambari-metrics-timelineservice/pom.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/MetricsLoadSimulator.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/free.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AppPage.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ApplicationAttemptStartData.java * ambari-metrics/ambari-metrics-hadoop-sink/src/main/conf/hadoop-metrics2-hbase.properties.j2 * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/meminfo.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSLogsPage.java * ambari-server/src/test/java/org/apache/ambari/server/controller/internal/AbstractPropertyProviderTest.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/MANIFEST.in * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestFileSystemApplicationHistoryStore.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/hbase_client_jaas.conf.j2 * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/GangliaPropertyProviderTest.java * ambari-server/src/test/resources/ams/single_component_metrics.json * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/ITClusterAggregator.java * ambari-metrics/ambari-metrics-timelineservice/src/main/assemblies/phoenix-client.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/util/RandomMetricsProvider.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_template/page.html * ambari-metrics/ambari-metrics-timelineservice/src/test/conf/hbase-site.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/ams_query.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_linux.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricConfiguration.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/pmap.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psbsd.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/disk_usage.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/process_detail.py * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/metric_monitor.ini.j2 * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/ContainerPage.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/process_info.c * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/NavBlock.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/TestAHSWebApp.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psosx.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TimelineWriter.java * ambari-metrics/ambari-metrics-timelineservice/conf/unix/ams-site.xml * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/impl/pb/ApplicationAttemptStartDataPBImpl.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricAggregatorFactory.java * ambari-server/src/main/java/org/apache/hadoop/metrics2/sink/timeline/TimelineMetric.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_common.py * ambari-server/src/test/java/org/apache/ambari/server/controller/ganglia/GangliaMetricTest.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/hbase.py * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TestMetricHostAggregate.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psutil_common.c * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_themes/pydoctheme/theme.conf * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/netstat.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/killall.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/core/emitter.py * ambari-server/src/main/java/org/apache/ambari/server/controller/metrics/MetricsPropertyProvider.java * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/ganglia/TestStreamProvider.java * ambari-metrics/pom.xml * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/bsd/process_info.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/LoadRunner.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/TestApplicationHistoryClientService.java * ambari-server/src/test/java/org/apache/ambari/server/controller/metrics/RestMetricsPropertyProviderTest.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/loadsimulator/data/MetricsGeneratorConfigurer.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/webapp/AHSWebApp.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/templates/metric_groups.conf.j2 * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/AbstractPhoenixConnectionlessTest.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/examples/who.py * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/setup.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryWriter.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/README * ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/templates/hadoop-metrics2.properties.j2 * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/metrics/timeline/TimelineMetricClusterAggregator.java * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/docs/_template/indexcontent.html * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/_psposix.py * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/FileSystemApplicationHistoryStore.java * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/records/ContainerStartData.java * ambari-metrics/ambari-metrics-timelineservice/src/main/resources/scripts/start.sh * ambari-metrics/ambari-metrics-host-monitoring/src/main/python/psutil/psutil/arch/windows/process_handles.h * ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/hadoop/yarn/server/applicationhistoryservice/ApplicationHistoryStore.java * ambari-metrics/ambari-metrics-timelineservice/src/test/java/org/apache/hadoop/yarn/server/applicationhistoryservice/timeline/TestMemoryTimelineStore.java * ambari-server/src/main/resources/stacks/HDP/2.2/services/AMS/package/scripts/functions.py AMBARI-5707. Replace Ganglia with high performant and pluggable Metrics System. Rat check fix. (swagle) (swagle: http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=93b8348fabb4a50e2ed95ed1b98fea7fff4b2ab1) * ambari-server/src/main/java/org/apache/ambari/server/controller/internal/AbstractProviderModule.java * pom.xml > Replace Ganglia with high performant and pluggable Metrics System > ----------------------------------------------------------------- > > Key: AMBARI-5707 > URL: https://issues.apache.org/jira/browse/AMBARI-5707 > Project: Ambari > Issue Type: Epic > Components: ambari-agent, ambari-server > Affects Versions: 1.6.0 > Reporter: Siddharth Wagle > Assignee: Siddharth Wagle > Priority: Critical > Attachments: MetricsArchLatest.png, Revised archtecture diagram.png > > > *Ambari Metrics System* > - Ability to collect metrics from Hadoop and other Stack services > - Ability to retain metrics at a high precision for a configurable time > period (say 5 days) > - Ability to automatically purge metrics after retention period > - At collection time, provide clear integration point for external system > (such as TSDB) > - At purge time, provide clear integration point for metrics retention by > external system > - Should provide default options for external metrics retention (say “HDFS”) > - Provide tools / utilities for analyzing metrics in retention system (say > “Hive schema, Pig scripts, etc” that can be used with the default retention > store “HDFS”) > *System Requirements* > - Must be portable and platform independent > - Must not conflict with any existing metrics system (such as Ganglia) > - Must not conflict with existing SNMP infra > - Must not run as root > - Must have HA story (no SPOF) > *Usage* > - Ability to obtain metrics from Ambari REST API (point in time and temporal) > - Ability to view metric graphs in Ambari Web (currently, fixed) > - Ability to configure custom metric graphs in Ambari Web (currently, we have > metric graphs “fixed” into the UI) > - Need to improve metric graph “navigation” in Ambari Web (currently, metric > graphs do not allow navigation at arbitrary timeframes, but only at ganglia > aggregation intervals) > - Ability to “view cluster” at point in time (i.e. see all metrics at that > point) > - Ability to define metrics (and how + where to obtain) in Stack Definitions > !https://issues.apache.org/jira/secure/attachment/12669212/Revised%20archtecture%20diagram.png|width=800px! -- This message was sent by Atlassian JIRA (v6.3.4#6332)