[ 
https://issues.apache.org/jira/browse/AMBARI-12339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619785#comment-14619785
 ] 

Hadoop QA commented on AMBARI-12339:
------------------------------------

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12744370/AMBARI-12339.patch
  against trunk revision .

    {color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

    {color:green}+1 tests included{color}.  The patch appears to include 3 new 
or modified test files.

    {color:red}-1 javac{color:red}.  The patch appears to cause the build to 
fail.

Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/3368//console

This message is automatically generated.

> Simulate Ambari Agents to test 3k Node Cluster
> ----------------------------------------------
>
>                 Key: AMBARI-12339
>                 URL: https://issues.apache.org/jira/browse/AMBARI-12339
>             Project: Ambari
>          Issue Type: Story
>          Components: ambari-agent
>    Affects Versions: 2.2.0
>            Reporter: Alejandro Fernandez
>            Assignee: Pengcheng Xu
>             Fix For: 2.2.0
>
>         Attachments: AMBARI-12339.patch, Screen Shot 2015-07-08 at 1.18.55 
> PM.png, Screen Shot 2015-07-08 at 1.19.14 PM.png
>
>
> Ambari's design is based on a single server with multiple agents. The agents 
> heartbeat every x seconds to the server, and the server may reply with a list 
> of commands to run. Once the agent completes a set of commands, it returns a 
> response in its next heartbeat, so that the server can update the result. The 
> response contains the command id, output code, stdout, and stderr.
> In practice, a production cluster will have 100-1000 agents, each of which is 
> running on a VM. However, for developers working on Ambmari, it is 
> unrealistic to test the scalability of their code by spinning up 100 VMs and 
> having the agents execute actual commands. Creating so many VMs is costly in 
> terms of infrastructure, difficult for developers to manage and keep 
> operational.
> Each agent is tracked by its hostname and IP. In this case, the hostname will 
> need to be different, and most likely all use the same IP.
> Ambari needs a way to simulate large-scale clusters, in which the agents send 
> dummy heartbeats and responses.
> Some of the responses are acknowledgements to running commands, while others 
> are just STATUS commands (e.g., I'm alive, NameNode is up, DataNode is up, 
> etc.)
> We need a way to simulate the agents that allows us to test,
> Server accepting heartbeats from hundreds of dummy agents
> Server sending requests to run commands, and accepting dummy data
>  
> *Goal:*
> The developers need an easy way to simulate the agents and specify how many, 
> and where the agents will reside (e.g., same host as the server, or different 
> machine).
> The ultimate goal is to be able to do scale testing on functionality like,
> Ambari Metrics
> Ambari Alerts
> Rolling Upgrade 
> So that the customers can benefit from features that have been tested at 
> scale.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to