Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Ian Jackson writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > With my xenbits admin hat on I therefore intend to: > > * Create xtf.git in the xenbits toplevel >and give it the appropriate permissions I created a group `xtf-committers' and put Andrew in it. > * Create xtf.git/description containing > > Xen Test Framework and Suite for creating microkernel-based tests > > * Edit osstest.git/description to contain > > Xen Test Framework and Suite, used for Open Source Xen CI push gate I have done the above. xtf.git is currently just what you get from `git init --bare'. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 18/07/2016 16:58, "Ian Jackson" wrote: >Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was >Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> In that case, forget my objection and go ahead and create the >>directories. >> I clearly don't understand how the docs toolchain works and was assuming >> that the docs directory structure gets exposed in the web server index, >> without being able to specify an extra indirection. Given that is not >>the >> case, the directory structure does not matter. > >There are four information structures. > >Note that `directory structure' and `link structure between html >pages' can be different for the same collection of documents. This is >because there is no necessary correspondence between the directory >structure of html file storage (normally visibile in urls) and the >logical structure of the document forest (represented in >table-of-contents pages, cross-page hyperlinks, and so on). Thanks for clarifying > >The proposal is to add > > - /docs/osstest/ > - /docs/xtf/ Go ahead and create them. We can figure out how to present the docs to the user later. I just noticed that docs/INDEX controls what is shown on the generated html pages. Sorry for opening this can of worms unnecessarily. Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > In that case, forget my objection and go ahead and create the directories. > I clearly don't understand how the docs toolchain works and was assuming > that the docs directory structure gets exposed in the web server index, > without being able to specify an extra indirection. Given that is not the > case, the directory structure does not matter. There are four information structures. Note that `directory structure' and `link structure between html pages' can be different for the same collection of documents. This is because there is no necessary correspondence between the directory structure of html file storage (normally visibile in urls) and the logical structure of the document forest (represented in table-of-contents pages, cross-page hyperlinks, and so on). From least to most visible: 1. The xen.git source tree docs/ subdirectory has a directory structure in the source code which is used when organising and editing the docs. 2a. When xen.git is built, it generates docs/html/ which contains a directory structure. The directory structure is controlled by the individual Makefiles in the rest of docs/. 2b. When xen.git is built, the directory structure in docs/html/ is converted into an index.html which is put at the top of docs/html/, by a script `gen-html-index' which simply peers at the titles of the files. The same script is used to generate an index.html for each subdirectory. So in practice this is very similar to 2a. 3. The webtree http://xenbits.xen.org/docs/ is primarily a set of files and directories which are simply served up by apache, and there is no index.html at the top level, so the top level is a webserver directory listing. There are various subdirectories, which are directly exposed, including - /docs/unstable/ xen.git#master's version of 2a/2b - /docs/unstable-stagingxen.git#stagin's version of 2a/2b [etc. for the stable branches, autogenerated] - /docs/osstest-sample-output/ rename proposed The proposal is to add - /docs/osstest/ - /docs/xtf/ to 3. 1 and 2a and 2b will remain unchanged. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 18/07/2016 16:30, "Ian Jackson" wrote: >Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was >Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> I don't object to a new xtf directory in the docs root per se. I mainly >> object to how the documents are presented in >> http://xenbits.xen.org/docs/unstable > >The documents under there are generated from xen.git#master. > >> As far as I understand, the docs directory structure maps onto headline >> categories in http://xenbits.xen.org/docs/unstable. Is this correct? > >What ? No. > >docs/ is just the HTTP namespace section for documents hosted on >xenbits. Its subdirectories currently include: > > - one directory for each existing stable and unstable Xen branch, >generated from the in-tree documentation source. > > - some example osstest output, referred to from the osstest.git >in-tree README > > - a subdirectory `xcp' which is presumably now obsolete and retained >for historical reasons. > >It appears that it doesn't have an index.html, so we get a webserver >directory listing. > >> I would only object to creating a new docs/xtf directory, >> - iff directory structure is exposed in the web index in >> http://xenbits.xen.org/docs/unstable are linked, and > >I don't understand what you are asking. > >> - iff there is only one document in this directory now, and >> - iff this will likely be the case in future. > >I'm proposing that the initial contents of the xtf/ directory would be >the initial contents of the /people/andrewcoop/xen-test-framework/ >directory, only with the titles changed as discussed. > >So there would be one `document', which is really an HTML page, called >index.html, so it would replace the webserver directory listing. > >> And I would have the same concern for osstest. If there are several >> documents already in each, then go ahead and create them. > >Is your concern that it is a bad idea to create a directory rather >than a file ? > >I think this is wrongheaded. > >It is better to create a directory now, with an index.html. Otherwise >it will become difficult to turn it into a directory later. In that case, forget my objection and go ahead and create the directories. I clearly don't understand how the docs toolchain works and was assuming that the docs directory structure gets exposed in the web server index, without being able to specify an extra indirection. Given that is not the case, the directory structure does not matter. Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > If there is a link between directory structure and web index, my preferred > alternative to creating the two separate directories would be to group all > the test related documents into a docs/testing directory. Also, I am annoyed that just when I thought we had agreed a compromise, you have opened another, irrelevant, can of worms. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > I don't object to a new xtf directory in the docs root per se. I mainly > object to how the documents are presented in > http://xenbits.xen.org/docs/unstable The documents under there are generated from xen.git#master. > As far as I understand, the docs directory structure maps onto headline > categories in http://xenbits.xen.org/docs/unstable. Is this correct? What ? No. docs/ is just the HTTP namespace section for documents hosted on xenbits. Its subdirectories currently include: - one directory for each existing stable and unstable Xen branch, generated from the in-tree documentation source. - some example osstest output, referred to from the osstest.git in-tree README - a subdirectory `xcp' which is presumably now obsolete and retained for historical reasons. It appears that it doesn't have an index.html, so we get a webserver directory listing. > I would only object to creating a new docs/xtf directory, > - iff directory structure is exposed in the web index in > http://xenbits.xen.org/docs/unstable are linked, and I don't understand what you are asking. > - iff there is only one document in this directory now, and > - iff this will likely be the case in future. I'm proposing that the initial contents of the xtf/ directory would be the initial contents of the /people/andrewcoop/xen-test-framework/ directory, only with the titles changed as discussed. So there would be one `document', which is really an HTML page, called index.html, so it would replace the webserver directory listing. > And I would have the same concern for osstest. If there are several > documents already in each, then go ahead and create them. Is your concern that it is a bad idea to create a directory rather than a file ? I think this is wrongheaded. It is better to create a directory now, with an index.html. Otherwise it will become difficult to turn it into a directory later. > If there is a link between directory structure and web index, my preferred > alternative to creating the two separate directories would be to group all > the test related documents into a docs/testing directory. I think you are confused. > It would be helpful to users and newcomers if all test related documents > could be found under a Testing headline in > http://xenbits.xen.org/docs/unstable/ This is certainly not possible because the url you quote is generated from xen.git. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > On 15/07/2016 11:21, "Ian Jackson" wrote: > >Lars, you haven't specified the pathname for this. I assume that it > >would be `xtf', to correspond to the toplevel fit repo. > > I don't have a strong opinion. It doesn't really fit into any of the other > categories on http://xenbits.xen.org/docs, maybe with the exception of > Misc. > Or we could create a new directory under docs that contains testing, > build, related stuff Can you please clarify whether you meant: 1. "Please go ahead with the git repo changes but I object to your suggested docs directories" 2. "Please go ahead with the git repo changes and the change to the osstest docs but I object to your suggested name for the docs directory for XTF." In either of which cases I'm blocked, and that's surely a -1 and you should specify what you would like done instead, or: 3. "Please go ahead with the git repo changes. I do not object to your proposals for the docs changes and you can go ahead with those unless someone else objects. "Furthermore, here are some observations for the future or for other people to consider." In which case we are unblocked, because no-one else has objected. Thanks, Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 18/07/2016 15:36, "Ian Jackson" wrote: >Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was >Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> On 15/07/2016 11:21, "Ian Jackson" wrote: >> >Lars, you haven't specified the pathname for this. I assume that it >> >would be `xtf', to correspond to the toplevel fit repo. >> >> I don't have a strong opinion. It doesn't really fit into any of the >>other >> categories on http://xenbits.xen.org/docs, maybe with the exception of >> Misc. >> Or we could create a new directory under docs that contains testing, >> build, related stuff > >Can you please clarify whether you meant: > > 1. "Please go ahead with the git repo changes but I object to >your suggested docs directories" > 2. "Please go ahead with the git repo changes and the change to the >osstest docs but I object to your suggested name for the docs >directory for XTF." Definitely go ahead with the git repo. I don't object to a new xtf directory in the docs root per se. I mainly object to how the documents are presented in http://xenbits.xen.org/docs/unstable As far as I understand, the docs directory structure maps onto headline categories in http://xenbits.xen.org/docs/unstable. Is this correct? If not, feel free to go ahead and create the directories, as presumably we can easily change headline categories that appear in http://xenbits.xen.org/docs/unstable later, without having to move files around. I would only object to creating a new docs/xtf directory, - iff directory structure is exposed in the web index in http://xenbits.xen.org/docs/unstable are linked, and - iff there is only one document in this directory now, and - iff this will likely be the case in future. And I would have the same concern for osstest. If there are several documents already in each, then go ahead and create them. If there is a link between directory structure and web index, my preferred alternative to creating the two separate directories would be to group all the test related documents into a docs/testing directory. It would be helpful to users and newcomers if all test related documents could be found under a Testing headline in http://xenbits.xen.org/docs/unstable/ Regards Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 15/07/2016 11:21, "Ian Jackson" wrote: >Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was >Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> Alright, [stuff] > >With my xenbits admin hat on I therefore intend to: > > * Create xtf.git in the xenbits toplevel > and give it the appropriate permissions > > * Create xtf.git/description containing > > Xen Test Framework and Suite for creating microkernel-based tests > > * Edit osstest.git/description to contain > > Xen Test Framework and Suite, used for Open Source Xen CI push gate > > * Create a directory /docs/osstest (in /var/xenbits-www/html/) > writeable by me. > > * Move /docs/osstest-output-example to /docs/osstest/output-example > and leave a symlink behind to keep old hyperlinks working. > >With my osstest maintainer hat on I will: > > * Populate the latter with an HTML page whose and are > > osstest: Xen Test Framework and Test Suite for Open Source Xen >Continuous Integration > > and which contains a brief description and links to related > pages/resources. > >> Improvements to web searchability for "xen test framework" to ensure >>that >> searches for both frameworks lead somewhere sensible >> B.1) http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ should >> be move under docs and re-named to "XTF: Xen Test Framework and Suite >>for >> creating microkernel-based tests" > >Lars, you haven't specified the pathname for this. I assume that it >would be `xtf', to correspond to the toplevel fit repo. I don't have a strong opinion. It doesn't really fit into any of the other categories on http://xenbits.xen.org/docs, maybe with the exception of Misc. Or we could create a new directory under docs that contains testing, build, related stuff Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Lars Kurth writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > Alright, [stuff] With my xenbits admin hat on I therefore intend to: * Create xtf.git in the xenbits toplevel and give it the appropriate permissions * Create xtf.git/description containing Xen Test Framework and Suite for creating microkernel-based tests * Edit osstest.git/description to contain Xen Test Framework and Suite, used for Open Source Xen CI push gate * Create a directory /docs/osstest (in /var/xenbits-www/html/) writeable by me. * Move /docs/osstest-output-example to /docs/osstest/output-example and leave a symlink behind to keep old hyperlinks working. With my osstest maintainer hat on I will: * Populate the latter with an HTML page whose and are osstest: Xen Test Framework and Test Suite for Open Source Xen Continuous Integration and which contains a brief description and links to related pages/resources. > Improvements to web searchability for "xen test framework" to ensure that > searches for both frameworks lead somewhere sensible > B.1) http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ should > be move under docs and re-named to "XTF: Xen Test Framework and Suite for > creating microkernel-based tests" Lars, you haven't specified the pathname for this. I assume that it would be `xtf', to correspond to the toplevel fit repo. Andrew, do you want to edit the title in /people/andrewcoop/xen-test-framework/ yourself and then have me use my admin powers to move the directory into /docs/xtf/ ? I could leave behind a symlink to keep old hyperlinks working. Thanks, Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Fri, Jul 8, 2016 at 2:06 PM, Andrew Cooper wrote: > However, OSSTest has always been known as OSSTest (including all > references in the automated emails), and not as a xen test framework. > Taking any steps to make OSSTest retroactively searchable as a xen test > framework is a dumb move, which will only confuse users. > > I fully admit that had OSSTest been named differently then I might not > have chosen XTF as a name, but that didn't happen. Trying to rewrite > history isn't the answer. I'm glad we have a solution, but it seems that we still don't all understand one another; in which case I'm afraid something like this may come up again. The objection has nothing to do with OSSTest. It has to do with the fact that 1) contains the word "Xen", and 2) seems to describe something much more general than what it actually is. If you'd called it "Andy's Test Framework", or even "Cooper's Universal Testing Solution", I don't think anyone would have had any strong objections, because although the names very general, they're made much more specific by adding your name to the front. By adding "Xen" to it, you associate it with the community, and thus the community has a right to say whether they accept the name or not. The fact that you used the name for 2 years *privately* doesn't give you any right to suddenly come out and use the name publicly. You can use whatever name you want privately, of course, but once you start to use it publicly, the community has a right to say whether they accept that or not. -George ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 08/07/16 14:42, Lars Kurth wrote: > > On 08/07/2016 14:06, "Andrew Cooper" wrote: > >> On 07/07/16 18:17, Lars Kurth wrote: >>> Alright, >>> >>> it appears we are at an impasse here. Not hosting the code on xenbits as >>> suggested by David, seems to be the worst solution and will benefit >>> no-one. >>> >>> ... >>> That should address everyones concern, as far as I can tell from the the >>> e-mail thread. If anyone disagrees, please shout within the next few >>> days. >>> >>> Best Regards >>> Lars >>> P.S.: I moved fixing some of our governance issues towards the top of my >>> TODO list >> I have no problem with Ian's earlier suggestion: > Alright. Ian confirmed on IRC that he has no problem either. Which means > the main issue is unblocked and the repo can be created. > >>> "CI (continuous integration)" is the keyword that many people will >>> have for osstest. >>> >>> I would suggest >>> >>> (This is not the Xen Project's CI / Continuous Integration / >>>automated push gate system. For that, see >>>osstest.) >>> >>> or something. >> Adding something like that to the XTF documentation is perfectly fine. >> I also have no problem with the other xtf changes in descriptions/etc >> suggested. > That makes perfect sense (but also see below). > >> However, OSSTest has always been known as OSSTest (including all >> references in the automated emails), and not as a xen test framework. >> Taking any steps to make OSSTest retroactively searchable as a xen test >> framework is a dumb move, which will only confuse users. >> >> I fully admit that had OSSTest been named differently then I might not >> have chosen XTF as a name, but that didn't happen. Trying to rewrite >> history isn't the answer. > I am not trying to re-write history. Ultimately I don't mind what the > exact description of OSSTEST says, as long as it is accurate, which is why > I said "something along the lines of ...". Right now there is no wiki or > other xenbits documentation about OSSTEST which is outside the git tree > (except for a few blog posts). Which is mainly why I raised this. > > Of course you are right that OSSTest is established and people who have > been around for a while know that. The key question is what newcomers who > don't know would search for: and to be honest I don't know. But it seems > reasonable to me that the "OSSTEST" page should come up when googling for > a combination/sub-set of the following keywords: "test", "xen", > "Continuous Integration", "CI", "suite", "push-gate" and maybe > "framework". I think the suggested changes to XTF documentation/description should be able to cover these cases. I don't expect anyone to be blindly trying to find things like this; I would expect that searches would be based on information from the xen-devel list to start with. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 08/07/2016 14:06, "Andrew Cooper" wrote: >On 07/07/16 18:17, Lars Kurth wrote: >> Alright, >> >> it appears we are at an impasse here. Not hosting the code on xenbits as >> suggested by David, seems to be the worst solution and will benefit >> no-one. >> >>... >> That should address everyones concern, as far as I can tell from the the >> e-mail thread. If anyone disagrees, please shout within the next few >>days. >> >> Best Regards >> Lars >> P.S.: I moved fixing some of our governance issues towards the top of my >> TODO list > >I have no problem with Ian's earlier suggestion: Alright. Ian confirmed on IRC that he has no problem either. Which means the main issue is unblocked and the repo can be created. > >> "CI (continuous integration)" is the keyword that many people will >> have for osstest. >> >> I would suggest >> >> (This is not the Xen Project's CI / Continuous Integration / >>automated push gate system. For that, see >>osstest.) >> >> or something. > >Adding something like that to the XTF documentation is perfectly fine. >I also have no problem with the other xtf changes in descriptions/etc >suggested. That makes perfect sense (but also see below). >However, OSSTest has always been known as OSSTest (including all >references in the automated emails), and not as a xen test framework. >Taking any steps to make OSSTest retroactively searchable as a xen test >framework is a dumb move, which will only confuse users. > >I fully admit that had OSSTest been named differently then I might not >have chosen XTF as a name, but that didn't happen. Trying to rewrite >history isn't the answer. I am not trying to re-write history. Ultimately I don't mind what the exact description of OSSTEST says, as long as it is accurate, which is why I said "something along the lines of ...". Right now there is no wiki or other xenbits documentation about OSSTEST which is outside the git tree (except for a few blog posts). Which is mainly why I raised this. Of course you are right that OSSTest is established and people who have been around for a while know that. The key question is what newcomers who don't know would search for: and to be honest I don't know. But it seems reasonable to me that the "OSSTEST" page should come up when googling for a combination/sub-set of the following keywords: "test", "xen", "Continuous Integration", "CI", "suite", "push-gate" and maybe "framework". Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 07/07/16 18:17, Lars Kurth wrote: > Alright, > > it appears we are at an impasse here. Not hosting the code on xenbits as > suggested by David, seems to be the worst solution and will benefit > no-one. > >> If we can't get consensus on something like this, the sensible thing >> to do would be to vote. Our governance docs don't really cope with >> this kind of multi-answer question; they only do yes/no. > I am not convinced that we need a formal process in this case. Our > governance has the mechanism to referee, when there is disagreement. For > code changes the referee would be the maintainer/committer which owns a > piece of code and the mechanism would work by withholding an ACK. For > unowned changes the referee would be the project lead: but we have none > and in fact we want none. > > The next level up is the Advisory Board: but I really don't want to go to > the AB with a bike-shed issue like this. > > > In particular as WE DO ACTUALLY HAVE CONSENSUS for a compromise by the two > main people disagreeing. > >> On 20/06/16 18:03, Ian Jackson wrote: >> I could live with "xtf", although I think it's rather too short. > > >> On 07/07/2016 12:26, "Andrew Cooper" wrote: >>> On 07/07/16 12:10, Lars Kurth wrote: >>> @Andrew: would something like test/xtf.git work >> It would, although given a straight choice I would prefer >> xen-test-framework.git over its abbreviation. > > So let's just go with "./xtf.git" and make use of the "Description" field > in http://xenbits.xen.org/gitweb/ to add a bit more verbosity. Adding > something such as "Xen Test Framework and Suite for creating > microkernel-based tests". This is accurate and searchable. > > It is no worse than "raisin.git", "osstest.git", and other top-level repos. > > Maybe we can make improve the description for "./osstest.git": something > along the lines of "Xen Test Framework and Suite, used for Open Source Xen > Continuous Integration that also acts as push gate" or something like it. > That would be more accurate than what we have now. > > Compromise > A.1) Create "xtf.git" and use "Xen Test Framework and Suite for creating > microkernel-based tests" in Description field > > A.2) Update description for osstest.git to "Xen Test Framework and Suite, > used for Open Source Xen Continuous Integration that also acts as push > gate" > >> Out of curiosity, I searched for it on google, and found my written >> documentation as the top hit. >> >> >> https://www.google.co.uk/search?q=xen+test+framework&ie=utf-8&oe=utf-8&gws >> _rd=cr&ei=InxeV52HDYHc-QG0-qN4 > That has nothing to do with the repo name. The reason why google finds > this page is because > http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ exists, but > no equivalent page exists for OSSTEST. > > > Improvements to web searchability for "xen test framework" to ensure that > searches for both frameworks lead somewhere sensible > B.1) http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ should > be move under docs and re-named to "XTF: Xen Test Framework and Suite for > creating microkernel-based tests" > > B.2) Add a similar page under docs for OSSTEST with a similarly verbose > title, e.g. "OSSTEST: Xen Test Framework and Suite for Open Source Xen > Continuous Integration" > > That should address everyones concern, as far as I can tell from the the > e-mail thread. If anyone disagrees, please shout within the next few days. > > Best Regards > Lars > P.S.: I moved fixing some of our governance issues towards the top of my > TODO list I have no problem with Ian's earlier suggestion: > "CI (continuous integration)" is the keyword that many people will > have for osstest. > > I would suggest > > (This is not the Xen Project's CI / Continuous Integration / >automated push gate system. For that, see >osstest.) > > or something. Adding something like that to the XTF documentation is perfectly fine. I also have no problem with the other xtf changes in descriptions/etc suggested. However, OSSTest has always been known as OSSTest (including all references in the automated emails), and not as a xen test framework. Taking any steps to make OSSTest retroactively searchable as a xen test framework is a dumb move, which will only confuse users. I fully admit that had OSSTest been named differently then I might not have chosen XTF as a name, but that didn't happen. Trying to rewrite history isn't the answer. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Alright, it appears we are at an impasse here. Not hosting the code on xenbits as suggested by David, seems to be the worst solution and will benefit no-one. > If we can't get consensus on something like this, the sensible thing > to do would be to vote. Our governance docs don't really cope with > this kind of multi-answer question; they only do yes/no. I am not convinced that we need a formal process in this case. Our governance has the mechanism to referee, when there is disagreement. For code changes the referee would be the maintainer/committer which owns a piece of code and the mechanism would work by withholding an ACK. For unowned changes the referee would be the project lead: but we have none and in fact we want none. The next level up is the Advisory Board: but I really don't want to go to the AB with a bike-shed issue like this. In particular as WE DO ACTUALLY HAVE CONSENSUS for a compromise by the two main people disagreeing. > On 20/06/16 18:03, Ian Jackson wrote: > I could live with "xtf", although I think it's rather too short. > On 07/07/2016 12:26, "Andrew Cooper" wrote: >> On 07/07/16 12:10, Lars Kurth wrote: >> @Andrew: would something like test/xtf.git work > It would, although given a straight choice I would prefer > xen-test-framework.git over its abbreviation. So let's just go with "./xtf.git" and make use of the "Description" field in http://xenbits.xen.org/gitweb/ to add a bit more verbosity. Adding something such as "Xen Test Framework and Suite for creating microkernel-based tests". This is accurate and searchable. It is no worse than "raisin.git", "osstest.git", and other top-level repos. Maybe we can make improve the description for "./osstest.git": something along the lines of "Xen Test Framework and Suite, used for Open Source Xen Continuous Integration that also acts as push gate" or something like it. That would be more accurate than what we have now. Compromise A.1) Create "xtf.git" and use "Xen Test Framework and Suite for creating microkernel-based tests" in Description field A.2) Update description for osstest.git to "Xen Test Framework and Suite, used for Open Source Xen Continuous Integration that also acts as push gate" > Out of curiosity, I searched for it on google, and found my written > documentation as the top hit. > > >https://www.google.co.uk/search?q=xen+test+framework&ie=utf-8&oe=utf-8&gws >_rd=cr&ei=InxeV52HDYHc-QG0-qN4 That has nothing to do with the repo name. The reason why google finds this page is because http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ exists, but no equivalent page exists for OSSTEST. Improvements to web searchability for "xen test framework" to ensure that searches for both frameworks lead somewhere sensible B.1) http://xenbits.xen.org/people/andrewcoop/xen-test-framework/ should be move under docs and re-named to "XTF: Xen Test Framework and Suite for creating microkernel-based tests" B.2) Add a similar page under docs for OSSTEST with a similarly verbose title, e.g. "OSSTEST: Xen Test Framework and Suite for Open Source Xen Continuous Integration" That should address everyones concern, as far as I can tell from the the e-mail thread. If anyone disagrees, please shout within the next few days. Best Regards Lars P.S.: I moved fixing some of our governance issues towards the top of my TODO list On 07/07/2016 15:11, "Andrew Cooper" wrote: >On 07/07/16 14:59, Ian Jackson wrote: >> Andrew Cooper writes ("Re: [Xen-devel] xenbits "official" repo for XTF >>(was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >>> On 07/07/16 12:10, Lars Kurth wrote: >>>> @Andrew: would something like test/xtf.git work >> I would live with that. >> >>> It would, although given a straight choice I would prefer >>> xen-test-framework.git over its abbreviation. >> This conversation is in danger of going round in circles. > >Right - let me draw a line in the sand. > >The current name is xen-test-framework, and that has been around and >used for several years now. XTF is also used frequently as an >abbreviation. > >A concern has been raised about the correctness of this name, but no >alternatives have been suggested which come close to being a plausible >replacement. (All suggestions are less accurate or descriptive than the >current name). > >As the author, I chose the current name, and chose it as the most >appropriate name I could think of. If others feel strongly that it >isn't, then the onus is on them to choose a specific alternative and >argue as to why it is more appropriate. Nothing along this line has >occurred. > >~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Thu, Jul 07, 2016 at 12:26:09PM +0100, Andrew Cooper wrote: > On 07/07/16 12:10, Lars Kurth wrote: > >> On 6 Jul 2016, at 15:22, Konrad Rzeszutek Wilk > >> wrote: > >> > >>> Looking at the above, it occurs to me that, this whole area seems to be a > >>> little inconsistent anyway and could do with a little house-keeping. We > >>> have > >>> - osstest.git > >>> - there also is osstest/*.git which seems to be odd and seems to have been > >>> inactive for a while (not very clear to me what these do) > >>> - and we have old and inactive xentesttools/*.git > >> They are not inactive. I have some patches for it and we are using > >> it (Boris and me). > > That is good to know. > > > >>> - and we are adding a new repo for XTF > >>> > >>> > >>> Maybe, moving everything test related under testing/* or test/* would be > >>> sensible, but that would cause some disruption (not sure how bad that > >>> would be). It would address A, B and D. It wouldn't make C much worse than > >>> now. > >> I don't mind the xentesttools going under a 'test' directory. > > @Ian, @George: Any other views regarding say osstest and the other > > osstest/* directories? > > > > @Andrew: would something like test/xtf.git work > > It would, although given a straight choice I would prefer > xen-test-framework.git over its abbreviation. +1 > > ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Ian Jackson writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > David Vrabel writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was > Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > > Really? Is it that difficult to accept that the original project author > > gets to choose the name? > > Yes. > > https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614907#113 Sorry, I should have given the authoritative link: https://lists.debian.org/debian-devel-announce/2012/07/msg2.html > As I say, I think osstest has a far better claim to the name `Xen Test > Framework'. But I haven't called it that because I have an > understanding that namespace landgrabs are antisocial. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
David Vrabel writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > Really? Is it that difficult to accept that the original project author > gets to choose the name? Yes. https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=614907#113 As I say, I think osstest has a far better claim to the name `Xen Test Framework'. But I haven't called it that because I have an understanding that namespace landgrabs are antisocial. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 07/07/16 14:59, Ian Jackson wrote: > Andrew Cooper writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was > Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> On 07/07/16 12:10, Lars Kurth wrote: >>> @Andrew: would something like test/xtf.git work > I would live with that. > >> It would, although given a straight choice I would prefer >> xen-test-framework.git over its abbreviation. > This conversation is in danger of going round in circles. Right - let me draw a line in the sand. The current name is xen-test-framework, and that has been around and used for several years now. XTF is also used frequently as an abbreviation. A concern has been raised about the correctness of this name, but no alternatives have been suggested which come close to being a plausible replacement. (All suggestions are less accurate or descriptive than the current name). As the author, I chose the current name, and chose it as the most appropriate name I could think of. If others feel strongly that it isn't, then the onus is on them to choose a specific alternative and argue as to why it is more appropriate. Nothing along this line has occurred. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 07/07/16 14:59, Ian Jackson wrote: > Andrew Cooper writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was > Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> On 07/07/16 12:10, Lars Kurth wrote: >>> @Andrew: would something like test/xtf.git work > > I would live with that. > >> It would, although given a straight choice I would prefer >> xen-test-framework.git over its abbreviation. > > This conversation is in danger of going round in circles. > > If we can't get consensus on something like this, the sensible thing > to do would be to vote. Our governance docs don't really cope with > this kind of multi-answer question; they only do yes/no. > > If we need to vote I suggest we use Condorcet. That is: > * Each committers gets to nominate up to 3 possible names for this >proposed new repo. > * Each committer ranks all the nominated possibilities in order. > * We use Condorcet to establish whether there is one dominating >nominee. (If there is no single Condorcet winner, we remain >deadlocked but at least we will have a small set of plausible >possibilities to choose from.) > > Condorcet is good because it necessarily demonstrates the underlying > legitimacy, according to the electorate, of the chosen option. It > also copes well with large numbers of options. (Tactical nomination > and tactical voting are ineffective.) Really? Is it that difficult to accept that the original project author gets to choose the name? My recommendation to Andrew would be to host the project somewhere else -- somewhere without this absurd amount of bureaucracy. github is popular these days. David ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Andrew Cooper writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > On 07/07/16 12:10, Lars Kurth wrote: > > @Andrew: would something like test/xtf.git work I would live with that. > It would, although given a straight choice I would prefer > xen-test-framework.git over its abbreviation. This conversation is in danger of going round in circles. If we can't get consensus on something like this, the sensible thing to do would be to vote. Our governance docs don't really cope with this kind of multi-answer question; they only do yes/no. If we need to vote I suggest we use Condorcet. That is: * Each committers gets to nominate up to 3 possible names for this proposed new repo. * Each committer ranks all the nominated possibilities in order. * We use Condorcet to establish whether there is one dominating nominee. (If there is no single Condorcet winner, we remain deadlocked but at least we will have a small set of plausible possibilities to choose from.) Condorcet is good because it necessarily demonstrates the underlying legitimacy, according to the electorate, of the chosen option. It also copes well with large numbers of options. (Tactical nomination and tactical voting are ineffective.) Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 07/07/16 12:10, Lars Kurth wrote: >> On 6 Jul 2016, at 15:22, Konrad Rzeszutek Wilk >> wrote: >> >>> Looking at the above, it occurs to me that, this whole area seems to be a >>> little inconsistent anyway and could do with a little house-keeping. We >>> have >>> - osstest.git >>> - there also is osstest/*.git which seems to be odd and seems to have been >>> inactive for a while (not very clear to me what these do) >>> - and we have old and inactive xentesttools/*.git >> They are not inactive. I have some patches for it and we are using >> it (Boris and me). > That is good to know. > >>> - and we are adding a new repo for XTF >>> >>> >>> Maybe, moving everything test related under testing/* or test/* would be >>> sensible, but that would cause some disruption (not sure how bad that >>> would be). It would address A, B and D. It wouldn't make C much worse than >>> now. >> I don't mind the xentesttools going under a 'test' directory. > @Ian, @George: Any other views regarding say osstest and the other osstest/* > directories? > > @Andrew: would something like test/xtf.git work It would, although given a straight choice I would prefer xen-test-framework.git over its abbreviation. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
> On 6 Jul 2016, at 15:22, Konrad Rzeszutek Wilk wrote: > >> Looking at the above, it occurs to me that, this whole area seems to be a >> little inconsistent anyway and could do with a little house-keeping. We >> have >> - osstest.git >> - there also is osstest/*.git which seems to be odd and seems to have been >> inactive for a while (not very clear to me what these do) >> - and we have old and inactive xentesttools/*.git > > They are not inactive. I have some patches for it and we are using > it (Boris and me). That is good to know. >> - and we are adding a new repo for XTF >> >> >> Maybe, moving everything test related under testing/* or test/* would be >> sensible, but that would cause some disruption (not sure how bad that >> would be). It would address A, B and D. It wouldn't make C much worse than >> now. > > I don't mind the xentesttools going under a 'test' directory. @Ian, @George: Any other views regarding say osstest and the other osstest/* directories? @Andrew: would something like test/xtf.git work Regards Lars P.S.: Parking the question about old inactive repos for now ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
> Looking at the above, it occurs to me that, this whole area seems to be a > little inconsistent anyway and could do with a little house-keeping. We > have > - osstest.git > - there also is osstest/*.git which seems to be odd and seems to have been > inactive for a while (not very clear to me what these do) > - and we have old and inactive xentesttools/*.git They are not inactive. I have some patches for it and we are using it (Boris and me). > - and we are adding a new repo for XTF > > > Maybe, moving everything test related under testing/* or test/* would be > sensible, but that would cause some disruption (not sure how bad that > would be). It would address A, B and D. It wouldn't make C much worse than > now. I don't mind the xentesttools going under a 'test' directory. > > We already follow a similar pattern for out-of-tree via pvdrivers/* > > It does in fact occur to me that some of the older inactive repos should > be archived somehow: candidates seem to be kemari/*, xentesttools/*, > xenclient/*, xcp/*, ... pollute the namespace. If we are concerned about > the namespace, we should address this at some point. There are also some > inactive top level git repos such as linux-2.5-xen.git and quite a few > inactive people repos. The Linux ones, the linux-pvops.git could go. > > >Lars, can you please advise what process we need to use to come to > >closure on this decision ? > ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 01/07/2016 20:04, "Ian Jackson" wrote: >David Vrabel writes ("Re: [Xen-devel] xenbits "official" repo for XTF >(was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> On 20/06/16 18:03, Ian Jackson wrote: >> > Hopefully we can find one that Andrew likes and that's acceptable to >> > the committers. >> > >> > I suggest >> > xen-microvm-test-framework >> > xen-microvm-test-suite >> > xtf-microvm-suite >> >> "xtf" > >iwj@xenbits:~$ ls ~xen/git >kemari qemu-xen-4.1-testing.git >libvirt.gitqemu-xen-4.2-testing.git >linux-2.6-xen.git qemu-xen-4.3-testing.git >linux-pvops.gitqemu-xen-4.4-testing.git >livepatch-build-tools.git qemu-xen-4.5-testing.git >mini-os.gitqemu-xen-4.6-testing.git >osstestqemu-xen.git >osstest.gitqemu-xen-traditional.git >ovmf.git qemu-xen-unstable.git >people raisin.git >pvdrivers rumpuser-xen.git >qemu-upstream-4.2-testing.git seabios.git >qemu-upstream-4.3-testing.git staging >qemu-upstream-4.4-testing.git xcp >qemu-upstream-4.5-testing.git xenalyze.git >qemu-upstream-4.6-testing.git xenclient >qemu-upstream-unstable.git xen.git >qemu-xen-3.3-testing.git xen.git-aside >qemu-xen-3.4-testing.git xenrt-citrix >qemu-xen-4.0-testing.git xentesttools >iwj@xenbits:~$ > >> It seems unfair to give Andrew's project a clunky (repo) name because >> osstest is not sufficiently discoverable. > >Is that a complaint that it's too long ? > >I could live with "xtf", although I think it's rather too short. Let me just summarise my understanding of the discussion: A) The label xtf has been around for a while, thus changing it may be confusing B) Generally there is concern about not being able to discover test related technology easily in the git tree C) More verbose repository names seem to be a little long D) None of the other proposals on the table seem to be much clearer / more accurate I couldn't tell from the thread who really is in favour. As far as I can tell 1 committer is in favour of using xtf.git 2 committer have voiced concrete concerns A number of other committers and Linux maintainers have provided some input, but have not been very clear about their position. Looking at the above, it occurs to me that, this whole area seems to be a little inconsistent anyway and could do with a little house-keeping. We have - osstest.git - there also is osstest/*.git which seems to be odd and seems to have been inactive for a while (not very clear to me what these do) - and we have old and inactive xentesttools/*.git - and we are adding a new repo for XTF Maybe, moving everything test related under testing/* or test/* would be sensible, but that would cause some disruption (not sure how bad that would be). It would address A, B and D. It wouldn't make C much worse than now. We already follow a similar pattern for out-of-tree via pvdrivers/* It does in fact occur to me that some of the older inactive repos should be archived somehow: candidates seem to be kemari/*, xentesttools/*, xenclient/*, xcp/*, ... pollute the namespace. If we are concerned about the namespace, we should address this at some point. There are also some inactive top level git repos such as linux-2.5-xen.git and quite a few inactive people repos. >Lars, can you please advise what process we need to use to come to >closure on this decision ? Really we need to come to some sort of proposal. My gut feel is that maybe this would most quickly resolved in a short IRC meeting, where we discuss this issue and reduce it down to a concrete proposal (IRC log could then be posted) and then put it to a vote, if need be. Otherwise this discussion will drag on for a while as e-mail. Lars ___ Xen-devel mailing list Xen-devel@lists.xen.org https://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
David Vrabel writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > On 20/06/16 18:03, Ian Jackson wrote: > > Hopefully we can find one that Andrew likes and that's acceptable to > > the committers. > > > > I suggest > > xen-microvm-test-framework > > xen-microvm-test-suite > > xtf-microvm-suite > > "xtf" iwj@xenbits:~$ ls ~xen/git kemari qemu-xen-4.1-testing.git libvirt.gitqemu-xen-4.2-testing.git linux-2.6-xen.git qemu-xen-4.3-testing.git linux-pvops.gitqemu-xen-4.4-testing.git livepatch-build-tools.git qemu-xen-4.5-testing.git mini-os.gitqemu-xen-4.6-testing.git osstestqemu-xen.git osstest.gitqemu-xen-traditional.git ovmf.git qemu-xen-unstable.git people raisin.git pvdrivers rumpuser-xen.git qemu-upstream-4.2-testing.git seabios.git qemu-upstream-4.3-testing.git staging qemu-upstream-4.4-testing.git xcp qemu-upstream-4.5-testing.git xenalyze.git qemu-upstream-4.6-testing.git xenclient qemu-upstream-unstable.git xen.git qemu-xen-3.3-testing.git xen.git-aside qemu-xen-3.4-testing.git xenrt-citrix qemu-xen-4.0-testing.git xentesttools iwj@xenbits:~$ > It seems unfair to give Andrew's project a clunky (repo) name because > osstest is not sufficiently discoverable. Is that a complaint that it's too long ? I could live with "xtf", although I think it's rather too short. Lars, can you please advise what process we need to use to come to closure on this decision ? Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
David Vrabel writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > It seems unfair to give Andrew's project a clunky (repo) name because > osstest is not sufficiently discoverable. > > Perhaps you should consider renaming osstest to xen-ci-system instead? Sure, how about "xen-test-framework" ? :-P Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 20/06/16 18:03, Ian Jackson wrote: > We are in danger of getting stuck on this naming question. I would > like everyone to put forward some suggestions for the name of thisr > toplevel epo on xenbits. > > Hopefully we can find one that Andrew likes and that's acceptable to > the committers. > > I suggest > xen-microvm-test-framework > xen-microvm-test-suite > xtf-microvm-suite "xtf" It seems unfair to give Andrew's project a clunky (repo) name because osstest is not sufficiently discoverable. Perhaps you should consider renaming osstest to xen-ci-system instead? David ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Mon, Jun 20, 2016 at 06:03:42PM +0100, Ian Jackson wrote: > We are in danger of getting stuck on this naming question. I would > like everyone to put forward some suggestions for the name of thisr > toplevel epo on xenbits. > > Hopefully we can find one that Andrew likes and that's acceptable to > the committers. > > I suggest > xen-microvm-test-framework Either this or the original name looks ok to me. > xen-microvm-test-suite > xtf-microvm-suite > > Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
> xtf-microvm-suite +1 ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
We are in danger of getting stuck on this naming question. I would like everyone to put forward some suggestions for the name of thisr toplevel epo on xenbits. Hopefully we can find one that Andrew likes and that's acceptable to the committers. I suggest xen-microvm-test-framework xen-microvm-test-suite xtf-microvm-suite Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Tue, Jun 14, 2016 at 6:27 PM, Andrew Cooper wrote: > On 13/06/16 15:11, Ian Jackson wrote: >> George Dunlap writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was >> Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >>> On Mon, Jun 13, 2016 at 11:10 AM, Andrew Cooper >>>> I am not completely averse to changing it, but I don't see an >>>> alternative which is any better or clearer. >>> Do you have any opinions on "Xen verification framework"? >> The problem IMO is the word "framework" which implies some kind of >> daemonic machinery. > > I disagree. Framework implies building blocks. > > I can't see any implication or suggestion of daemonic machinery here. I agree with Andrew here -- "framework" is used in many circumstances to indicate a pre-existing structure or set of components which can be used to build something; "web development framework" clearly has nothing to do with daemons. So "framework" is (from what I gather, not having actually looked at the code) the exact word to describe the code. -George ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 13/06/16 15:11, Ian Jackson wrote: > George Dunlap writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was > Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): >> On Mon, Jun 13, 2016 at 11:10 AM, Andrew Cooper >>> I am not completely averse to changing it, but I don't see an >>> alternative which is any better or clearer. >> Do you have any opinions on "Xen verification framework"? > The problem IMO is the word "framework" which implies some kind of > daemonic machinery. I disagree. Framework implies building blocks. I can't see any implication or suggestion of daemonic machinery here. > The frameworky bit of XTF is quite small; mostly, > it is a suite of test cases. "Xen Micro-VM Test Suite" maybe ? At the moment, the framework is larger than the suite, although I don't necessarily expect this to remain the case. Having said that, I would argue that the "framework" is the more important part; It is the bit with the complicated logic to build the same code into multiple different VM types, and APIs to make test reporting easy and consistent. > > (I think "verification" is inaccurate because to me it implies formal > methods, static analysis, or the like.) I concur. "verification" is definitely a less accurate description. > >> If we weren't going to change it, then you should probably put a note >> somewhere near the top of the introduction saying something like, "If >> you're looking for the Xen automated push-gate software, you want >> osstest[link]", so that people who want osstest but search for "xen >> test framework" find what they're looking for. > "CI (continuous integration)" is the keyword that many people will > have for osstest. > > I would suggest > > (This is not the Xen Project's CI / Continuous Integration / >automated push gate system. For that, see >osstest.) > > or something. I am happy to add text to that effect. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Thu, Jun 09, 2016 at 04:04:59PM +0100, Ian Jackson wrote: > Roger Pau Monne writes ("[Xen-devel] [PATCH 0/2] xtf: add launcher (+1 > bugfix)"): > > This series contains a bugfix for the build infrastructure and a basic > > launcher for XTF. Patches can also be found in the following git repo: > > > > git://xenbits.xen.org/people/royger/xen-test-framework.git launcher_v1 > > IMO we should give this thing a proper repo in the root of the xenbits > git namespace. > > I'm slightly concerned that `xen-test-framework' is a bit vague. It > sounds like a CI system (of which we already have at least three ...), > rather than a collection of tests based on tiny VMs, each designed to > make specific demands of the host environment. xtf-os.git ? ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
George Dunlap writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > On Mon, Jun 13, 2016 at 11:10 AM, Andrew Cooper > > I am not completely averse to changing it, but I don't see an > > alternative which is any better or clearer. > > Do you have any opinions on "Xen verification framework"? The problem IMO is the word "framework" which implies some kind of daemonic machinery. The frameworky bit of XTF is quite small; mostly, it is a suite of test cases. "Xen Micro-VM Test Suite" maybe ? (I think "verification" is inaccurate because to me it implies formal methods, static analysis, or the like.) > If we weren't going to change it, then you should probably put a note > somewhere near the top of the introduction saying something like, "If > you're looking for the Xen automated push-gate software, you want > osstest[link]", so that people who want osstest but search for "xen > test framework" find what they're looking for. "CI (continuous integration)" is the keyword that many people will have for osstest. I would suggest (This is not the Xen Project's CI / Continuous Integration / automated push gate system. For that, see osstest.) or something. Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Mon, Jun 13, 2016 at 11:10 AM, Andrew Cooper wrote: > On 09/06/16 16:04, Ian Jackson wrote: >> Roger Pau Monne writes ("[Xen-devel] [PATCH 0/2] xtf: add launcher (+1 >> bugfix)"): >>> This series contains a bugfix for the build infrastructure and a basic >>> launcher for XTF. Patches can also be found in the following git repo: >>> >>> git://xenbits.xen.org/people/royger/xen-test-framework.git launcher_v1 >> IMO we should give this thing a proper repo in the root of the xenbits >> git namespace. >> >> I'm slightly concerned that `xen-test-framework' is a bit vague. It >> sounds like a CI system (of which we already have at least three ...), >> rather than a collection of tests based on tiny VMs, each designed to >> make specific demands of the host environment. >> >> Andrew, do you have other naming ideas ? I don't object to "xtf" but >> that's just an acronym, and the expansion is confusing. I think >> qualifying the somehow might be useful. >> >> Others: do you have opinions ? Is my concern ill-founded ? > > The XTF name has been around for 2 years now. > > Out of curiosity, I searched for it on google, and found my written > documentation as the top hit. > > https://www.google.co.uk/search?q=xen+test+framework&ie=utf-8&oe=utf-8&gws_rd=cr&ei=InxeV52HDYHc-QG0-qN4 > > The snippet summary includes the first line of the introduction, "This > is both a framework for creating microkernel-based tests, and a suite of > tests built using the framework", which should be sufficient > clarification for anyone with questions. > > I am not completely averse to changing it, but I don't see an > alternative which is any better or clearer. Do you have any opinions on "Xen verification framework"? If we weren't going to change it, then you should probably put a note somewhere near the top of the introduction saying something like, "If you're looking for the Xen automated push-gate software, you want osstest[link]", so that people who want osstest but search for "xen test framework" find what they're looking for. -George ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On 09/06/16 16:04, Ian Jackson wrote: > Roger Pau Monne writes ("[Xen-devel] [PATCH 0/2] xtf: add launcher (+1 > bugfix)"): >> This series contains a bugfix for the build infrastructure and a basic >> launcher for XTF. Patches can also be found in the following git repo: >> >> git://xenbits.xen.org/people/royger/xen-test-framework.git launcher_v1 > IMO we should give this thing a proper repo in the root of the xenbits > git namespace. > > I'm slightly concerned that `xen-test-framework' is a bit vague. It > sounds like a CI system (of which we already have at least three ...), > rather than a collection of tests based on tiny VMs, each designed to > make specific demands of the host environment. > > Andrew, do you have other naming ideas ? I don't object to "xtf" but > that's just an acronym, and the expansion is confusing. I think > qualifying the somehow might be useful. > > Others: do you have opinions ? Is my concern ill-founded ? The XTF name has been around for 2 years now. Out of curiosity, I searched for it on google, and found my written documentation as the top hit. https://www.google.co.uk/search?q=xen+test+framework&ie=utf-8&oe=utf-8&gws_rd=cr&ei=InxeV52HDYHc-QG0-qN4 The snippet summary includes the first line of the introduction, "This is both a framework for creating microkernel-based tests, and a suite of tests built using the framework", which should be sufficient clarification for anyone with questions. I am not completely averse to changing it, but I don't see an alternative which is any better or clearer. ~Andrew ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
On Thu, Jun 9, 2016 at 4:04 PM, Ian Jackson wrote: > Roger Pau Monne writes ("[Xen-devel] [PATCH 0/2] xtf: add launcher (+1 > bugfix)"): >> This series contains a bugfix for the build infrastructure and a basic >> launcher for XTF. Patches can also be found in the following git repo: >> >> git://xenbits.xen.org/people/royger/xen-test-framework.git launcher_v1 > > IMO we should give this thing a proper repo in the root of the xenbits > git namespace. > > I'm slightly concerned that `xen-test-framework' is a bit vague. It > sounds like a CI system (of which we already have at least three ...), > rather than a collection of tests based on tiny VMs, each designed to > make specific demands of the host environment. > > Andrew, do you have other naming ideas ? I don't object to "xtf" but > that's just an acronym, and the expansion is confusing. I think > qualifying the somehow might be useful. > > Others: do you have opinions ? Is my concern ill-founded ? I agree -- if someone had heard about osstest, but had forgotten the name, they might well search for "xen test framework" and end up rather frustrated. Since the purpose of these tests is to verify very specific bits of functionality (not unlike processor verification actually), maybe something with some form of "verify" in the name? Xen verification framework / xvf? -George ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel
[Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Roger Pau Monne writes ("[Xen-devel] [PATCH 0/2] xtf: add launcher (+1 bugfix)"): > This series contains a bugfix for the build infrastructure and a basic > launcher for XTF. Patches can also be found in the following git repo: > > git://xenbits.xen.org/people/royger/xen-test-framework.git launcher_v1 IMO we should give this thing a proper repo in the root of the xenbits git namespace. I'm slightly concerned that `xen-test-framework' is a bit vague. It sounds like a CI system (of which we already have at least three ...), rather than a collection of tests based on tiny VMs, each designed to make specific demands of the host environment. Andrew, do you have other naming ideas ? I don't object to "xtf" but that's just an acronym, and the expansion is confusing. I think qualifying the somehow might be useful. Others: do you have opinions ? Is my concern ill-founded ? Thanks, Ian. ___ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel