[ 
https://issues.apache.org/jira/browse/HADOOP-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12759386#action_12759386
 ] 

Alex Loddengaard commented on HADOOP-6248:
------------------------------------------

Thanks for the feedback, Chris.  I think we're having a Buddhism vs. 
Christianity argument.  Read: I think the two of us have different expectations 
for a tool like this, and perhaps we'll never agree.  You want a strict 
framework and find an "execution engine" to be uninteresting for the Hadoop 
distribution.  I think this tool doubles as a system testing tool that we as a 
community can contribute tests to (you even said that distcp tests at scale are 
manual; they don't have to be), in addition to an execution engine that Hadoop 
users can take advantage of for reasons I've already stated.  I'm also unsure 
how a "scaled back" system would be any more interesting or useful.  Perhaps 
you could provide some suggestions on how I might scale this back, and how such 
a scaled back version would be handy?

I can tell you that Circus will be useful within Cloudera, and it will be 
useful for several of our support customers.  I think I've done all I can to 
prove its merit, so perhaps others can weigh in on whether or not such a 
framework, execution engine, or what have you would be useful for them.  
Lastly, I would hope that contrib projects (such as Circus) would be more 
easily accepted into the distribution, as they don't negatively impact the 
project at all.  Their "optional" nature allows users who are interested to use 
contrib projects at will, while not dirtying or making any other real 
sacrifices to the rest of the code base.

In summary, Chris, can you provide specific guidance on how I might scale back 
Circus to be something more useful?  Others, could you please comment on 
whether or not Circus would be useful to you, and at least provide some 
guidance for how I can make it better?

Thanks again for your feedback, Chris.

> Circus: Proposal and Preliminary Code for a Hadoop System Testing Framework
> ---------------------------------------------------------------------------
>
>                 Key: HADOOP-6248
>                 URL: https://issues.apache.org/jira/browse/HADOOP-6248
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: test
>         Environment: Python, bash
>            Reporter: Alex Loddengaard
>         Attachments: HADOOP-6248.diff, HADOOP-6248_v2.diff, 
> HADOOP-6248_v3.diff
>
>
> This issue contains a proposal and preliminary source code for Circus, a 
> Hadoop system testing framework.  At a high level, Circus will help Hadoop 
> users and QA engineers to run system tests on a configurable Hadoop cluster, 
> or distribution of Hadoop.  See the comment below for the proposal itself.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to