Re: Fedora 11 Test Day survey

2009-06-04 Thread Adam Williamson
On Thu, 2009-06-04 at 14:16 +0200, Till Maas wrote:

> > 3. Did you encounter any obstacles preventing participation in Fedora
> > test Days?  How might they have been avoided?  Did you discover any
> > workaround?
> 
> The live iso images failed to be converted to live usb media on F10 with a 
> strange looking boot menu. It could have beend avoided with testing this 
> before starting the test day.

This sounds like the somewhat-infamous problem with f10's USB creator
not working for F11 images. Later in the F11 cycle, we did have that
issue neatly identified and pinned down, and we started adding a box out
to test days explaining it. See the nouveau page, for e.g.:

https://fedoraproject.org/wiki/Test_Day:2009-03-26_Nouveau#Live_Image

note the blue box. The explanation could have been a bit more
descriptive and emphatic, though, I suppose.

> > 4. Were you able to locate and download installation media for testing?
> > Did it function as expected?
> 
> Yes. No, see 3. Also I would have expected testing instructions on the live 
> media to perform the tests without the need to setup an internet connection 
> on 
> the testing machine. 

That's a good point - in some situations it's hard to get an internet
connection on a live image. So we should try as hard as we can to
include all necessary material on the image itself.

> Also some bug report info gathering scripts would have 
> been nice, that e.g. collect all the data required by the packages 
> maintainers 
> for a bug report in some file on the usb medium. E.g. the Xorg people wanted 
> a 
> lot of information that I did not have anymore after I rebooted to my stable 
> F10 system and reported the bug. Also when the test crashes the Xserver, it 
> is 
> very annoying to get to the log files, because they are deleted after a 
> reboot.

This one's a bit tricky - on the one hand it'd be nice, on the other
it'd be a substantial development effort for each test day and they
already take quite a lot of effort to organize. Perhaps, however, we
could come up with a general-purpose script which could be used for X
test days, as the procedures tend to be very similar for different
drivers and different releases. We'll certainly look into that for the X
test days for F12.

Thanks for your feedback!
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-04 Thread Adam Williamson
On Thu, 2009-06-04 at 10:08 +0200, Michal Hlavinka wrote:

> > 2. Was sufficient documentation available to help you participate in a
> > Fedora Test Day?  If not, what did you find missing or in need of
> > improvement?
> 
> mostly, see examples:
> good:
> Test Day:2009-03-26 Nouveau
> "
> /sbin/lspci -d 10de: | grep -iq VGA && echo "Join Nouveau Fedora Test Day" || 
> echo "No nVidia graphics hardware found."
> "
> 
> bad:
> Test Day:2009-04-09 UEFI
> "
> FIXME|How to identify if your system supports UEFI?
> "
> This text was there for some time and than it just disappeared without any 
> answer.

The UEFI one was kind of a special case. The only people who actually
have appropriate hardware either work for BIOS companies, hardware
manufacturers, or in the testing department of companies like RH, and
everyone who has UEFI hardware certainly knows they do. :) We
intentionally under-promoted that test day because it was really only of
interest to a small and very definitely defined circle of people.

We should, however, have made that rather a lot clearer on the Wiki page
itself, for people who'd got into the habit of just looking at each
week's Test Day as it came. You're right there.

> > 7. Do you have any more general comments or any suggestions for
> > improving future test days?
> 
> start them earlier in rawhide development phase. If tens of bugs are found 
> three weeks before freeze, we can hardly expect they are fixed in time.

Scheduling is a tricky point, yep: too late in the cycle and you can't
get fixes in, too early and the feature isn't done being written yet.
We're trying to think of ways to optimize scheduling as far as we can.

Thanks for your feedback!
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-04 Thread Till Maas
On Wed June 3 2009, James Laska wrote:

> 1. How did you find out about Fedora Test Days?

devel mailing list

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

Yes.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

The live iso images failed to be converted to live usb media on F10 with a 
strange looking boot menu. It could have beend avoided with testing this 
before starting the test day.

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Yes. No, see 3. Also I would have expected testing instructions on the live 
media to perform the tests without the need to setup an internet connection on 
the testing machine. Also some bug report info gathering scripts would have 
been nice, that e.g. collect all the data required by the packages maintainers 
for a bug report in some file on the usb medium. E.g. the Xorg people wanted a 
lot of information that I did not have anymore after I rebooted to my stable 
F10 system and reported the bug. Also when the test crashes the Xserver, it is 
very annoying to get to the log files, because they are deleted after a 
reboot.

Also the media was not signed in a way that one can easily verify that it was 
not tampered with. E.g. the official Fedora releases are normally signed with 
a gpg key that can be obtained via the SSH secured CVS repository.

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

The reported bugs should be fixed soon. 

> 6. Would you participate again in future Fedora Test Days?

Yes.

> 7. Do you have any more general comments or any suggestions for
> improving future test days?

It would be nice to automate the tests that need to be run, e.g. just boot the 
media and then the tests are automatically started and the user is asked for 
input in case something cannot be detected automatically. This is especially 
useful for testing hardware support, because the required testing actions are 
mostly simple, e.g. boot with this option, play this video, ...

Regards
Till


signature.asc
Description: This is a digitally signed message part.
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Fedora 11 Test Day survey

2009-06-04 Thread Michal Hlavinka
> 1. How did you find out about Fedora Test Days?
fedora-devel-list

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

mostly, see examples:
good:
Test Day:2009-03-26 Nouveau
"
/sbin/lspci -d 10de: | grep -iq VGA && echo "Join Nouveau Fedora Test Day" || 
echo "No nVidia graphics hardware found."
"

bad:
Test Day:2009-04-09 UEFI
"
FIXME|How to identify if your system supports UEFI?
"
This text was there for some time and than it just disappeared without any 
answer.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

 let's have live cd for all test days (where it makes sense)

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

yes

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

imo it's ok now

> 6. Would you participate again in future Fedora Test Days?

yes

> 7. Do you have any more general comments or any suggestions for
> improving future test days?

start them earlier in rawhide development phase. If tens of bugs are found 
three weeks before freeze, we can hardly expect they are fixed in time.

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Adam Williamson
On Wed, 2009-06-03 at 09:21 -0500, King InuYasha wrote:
> 6. If they were planned better, then maybe I would be able to set
> aside time to do them. I would like to participate in future Test
> Days. 

You're right that we generally only get the meat of the test cases and
so forth up about 48 hours in advance. However, the actual *schedule* of
events is fixed a lot earlier than that. The F11 schedule was here:

https://fedoraproject.org/wiki/QA/Test_Days/F11

and most of the days were listed there weeks before they actually
happened. The F12 one is up now:

https://fedoraproject.org/wiki/QA/Test_Days/F12

and will be getting populated starting pretty soon. So you do at least
have the opportunity to see what days are coming up in future, though
the test cases and live media may not be available yet.

> 7. Set up a reporting center just for Test Day feedback. Using the
> wiki is definitely not good enough. Additionally, Do not limit the
> test days to people subscribed to the mailing list. Take a page from
> Mozilla's books and announce those test days to the world.
> Unfortunately, to do that, test days need to be planned better.

We do announce them on Planet Fedora also. For a couple of test days in
the F11 cycle, we did wider announcements to general-interest sites, and
this was pretty successful; it's something we'll be doing for F12 too.
However, it's not appropriate for all test days (some are things that
are really specific to a Fedora audience, or even more selective than
that) - we have to pick ones that are both of interest to a general
audience, and that a general audience will be able to participate in
(i.e. can be tested from a live CD with general-purpose hardware).

Thanks for the thoughts!
-- 
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Christopher Brown
> 1. How did you find out about Fedora Test Days?

Planet.fp.o

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

Documentation was excellent.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

None - only took part on the nouveau day though.

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Yes.

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

Bugs fixed. Possibly a summary of how the previous test day helped
before talking about the next one?

> 6. Would you participate again in future Fedora Test Days?

Yes, dependent on barrier to entry.

> 7. Do you have any more general comments or any suggestions for
> improving future test days?

Just that I'm very glad they're happening. Well done.


-- 
Christopher Brown

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Björn Persson
James Laska wrote:
> 1. How did you find out about Fedora Test Days?

fedora-devel-announce

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

The instructions were sufficient.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

I found out about the Intel graphics test day too late to be able to 
participate on the right day. I first had to create a FAS account as I hadn't 
yet taken all the steps to become a packager. I got side-tracked by an 
incorrect error message in FAS and had some problems before I could report 
that. Then I had to create a Smolt profile. SmoltGUI crashed but I could work 
around the crash by changing the locale. Smolt using two kinds of UUIDs 
caused some confusion. I could eventually go through the test cases for Intel 
graphics a week after the actual test day.

See also the next question:

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Live CD images were linked from the wiki pages. I had no problems downloading 
them. I eventually managed to make a working live USB stick from the one for 
the Intel test day, after I transferred it to my work computer where I had 
Fedora 10 and could install the latest Syslinux from Rawhide. It wasn't 
possible to do this on Fedora 9.

The live USB stick I made from the CD image for the Nvidia test day was more 
dead than live. It wouldn't boot, so I couldn't participate in that test day.

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

I expected that someone would attempt to fix the bugs I reported. No such 
attempts have been mentioned in Bugzilla so far. I suppose I'll se whether 
they've been fixed when I upgrade to Fedora 11.

Perhaps there would have been more interest in my reports if I had submitted 
them during the actual test day.

> 6. Would you participate again in future Fedora Test Days?

If they cover some functionality that's particularly important to me or some 
less than common hardware that I have.

Björn Persson


signature.asc
Description: This is a digitally signed message part.
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Fedora 11 Test Day survey

2009-06-03 Thread Frank Murphy

James Laska wrote:


===

1. How did you find out about Fedora Test Days?  
  

Test-List

2. Was sufficient documentation available to help you participate in a
Fedora Test Day?  If not, what did you find missing or in need of
improvement?

  

Yes

3. Did you encounter any obstacles preventing participation in Fedora
test Days?  How might they have been avoided?  Did you discover any
workaround?

4. Were you able to locate and download installation media for testing?
  

Could be easier to find

Did it function as expected?
  

Yes


5. What follow-up actions do you expect after the Test Day?  Are your
expectations currently being met?

  

Yes

6. Would you participate again in future Fedora Test Days?
  

Yes, even more so


7. Do you have any more general comments or any suggestions for
improving future test days?
  

Coffee coffee coffee :)

Frank

--
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Bruno Wolff III
On Wed, Jun 03, 2009 at 10:10:26 -0400,
  James Laska  wrote:
> 
> 1. How did you find out about Fedora Test Days?  

Mostly I saw them in the mailing lists first, but saw reminders in FWN.

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

For the ones I participated in (storage and radeon) things seemed fine.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

Some related to being pretty busy on Thursdays. For one off tests I don't
see Fedora doing anything about that, but if you do repeats on the same
test later it is probably worth thinking about if it would be better to
keep the followup on the same day of the week to make it more likely that
people who participated in the earlier session can participate in the
followup or if making it a different day of the week to make it more likely
that some people who couldn't participate in the earlier session because
of a conflict would be able to participate in the followup.

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

I have a local rawhide mirror allowed me to have up to date images for
testing.

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

The storage test day ended up with some bugs getting filed and fixed.
The radeon day, not so much.

> 6. Would you participate again in future Fedora Test Days?

Yes. Encryption over raid get's messed up fairly often and actively
participating seems to help in getting the issues fixed.
Even though the radeon stuff didn't work out that great this time, I'd
participate again. I think the stuff I am having issues with is low
priority right now, but might get more attention in the future.

> 7. Do you have any more general comments or any suggestions for
> improving future test days?

Start them earlier in the process. In particular I think this would have
been advantageous for the anaconda storage rewrite.

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Rahul Sundaram
On 06/03/2009 09:25 PM, James Laska wrote:
> Thanks for the feedback!
> 
> On Wed, 2009-06-03 at 20:16 +0530, Rahul Sundaram wrote:
>>
>>> 5. What follow-up actions do you expect after the Test Day?  Are
>> your
>>> expectations currently being met?
>>
>> Yes. Although I was hoping there would be a test day for Ext4.
> 
> I was too, but there were some schedule conflicts which kept it from
> happening on the QA side.  In the end the only test day topic with focus
> on ext4 was around changing the anaconda default filesystem to ext4
> (https://fedoraproject.org/wiki/QA/Test_Days/2009-02-05).

With concerns over Ext4, I did my own testing and didn't find any issues
and now run with Ext4 on this laptop except for /boot. However that is a
key piece and it would have raised the confidence level to have a
dedicated test day. Having test days built into the release schedule
would help everyone provide more feedback and I (and likely others)
would have raised this earlier than I did in that case.

IMO, the most important thing the recent QA efforts including test days
having brought in is a change in general mentality. Earlier when users
would hit some regressions or new bugs, they would come up to the forum
and get told by others to expect breakage since Fedora is meant to be
that way. I found that a very dangerous stand point since it effectively
means that over time, we will get lower quality with not enough people
raising a concern since they have been told to live with it. Now with
the QA efforts, even if users do hit bugs which I am sure they will,
many would atleast be aware that a community is involved in helping to
avoid them and fix them otherwise. We are more visibly concerned about
quality now than ever before.

Last week in distrowatch, there was a question raised on the Fedora
release delays as to whether such delays are a strength or a weakness

http://distrowatch.com/weekly.php?issue=20090601&mode=67#comments

You can find a very consistent feedback from everyone that they
appreciate the stand point of willing to delay a release if needed.
While I think delays *are* a sign of a weakness at some level, it is
good to prioritize critical fixes over a rigid schedule. Even without
all the other benefits, the visibility in approach itself is worth all
the effort you and others have put into this. Thanks.

Rahul

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread James Laska
Thanks for the feedback!

On Wed, 2009-06-03 at 20:16 +0530, Rahul Sundaram wrote:
> 
> > 5. What follow-up actions do you expect after the Test Day?  Are
> your
> > expectations currently being met?
> 
> Yes. Although I was hoping there would be a test day for Ext4.

I was too, but there were some schedule conflicts which kept it from
happening on the QA side.  In the end the only test day topic with focus
on ext4 was around changing the anaconda default filesystem to ext4
(https://fedoraproject.org/wiki/QA/Test_Days/2009-02-05).

Thanks,
James



signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Re: Fedora 11 Test Day survey

2009-06-03 Thread Andreas Thienemann
On Wed, 3 Jun 2009, James Laska wrote:

> ===
> 
> 1. How did you find out about Fedora Test Days?  

Planet.fp.o

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

Sure. But I'm running rawhide anyway on several machines and am probably 
not really representing the average user.

 
> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

Feature rewrites such as the storage rewrite has made installation tests
basically infeasable as the installer always broke during partitioning on
my systems. Feedback from the developers was great and instant and we
identified and fixed several of these problems on the same day. This can
be considered a success of the test day but in my case, we never came
around to testing later stages of anaconda.

The live CD might help in some cases e.g. a nouveau test but would be
mostly useless for installer-related tests. I guess more care should be
taken into identifying "known-good" snapshots and testing with these where
we made certain that there are no other, unrelated bugs interfering with
the aim of the test day.


> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Never tried livecds but yeah, my PXE server is doing great for installs. 
Thank you for asking. *g*

 
> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

I'd like to see bugs fixed as the follow-up action.

Some have been verified and put up as F11Blocker or F11Target with not
much more happening. In some cases the Needinfo requests for rechecking or
further info came up only a few days earlier and I haven't gotten around
to them yet as the test systems are not always available to me. Faster
turnaround times would be great there as I have easier access to the
machines in question.

Some of my bugs have not been fixed yet, but I have to admit that these 
are unusually difficult to track down or fix. :)


> 6. Would you participate again in future Fedora Test Days?

Sure, time permitting.

 
> 7. Do you have any more general comments or any suggestions for
> improving future test days?

I strongly support the newfound focus on QA. I think I mentioned that to 
Adam on IRC repeatedly and wrote something about it in my FESCO 
nomination questionare as well but I'll repeat that:

It has long been common opinion that Fedora is spending too much time on
developing exciting new features while not spending any on ironing out the
bugs. Certain show-stoppers have been persisting through 4 releases and
more or some bugs "are now reaching the age where they should seriosly
start thinking about attending kindergarden". While this is a great quote, 
due to its humourous value, it shows a real problem we're having.

This has hurt our marketing tremendously.
Seeing news about Test Days, revitalized QA etc. helps us fighting this 
impression.

So thank you for your work.


regards,
 andreas

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Rahul Sundaram
On 06/03/2009 07:40 PM, James Laska wrote:

> 1. How did you find out about Fedora Test Days?  
> 

Mailing list, forum and blog posts

> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

Generally, yes. It was sufficient.

> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

It went smoothly

> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Yes and yes

> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

Yes. Although I was hoping there would be a test day for Ext4.

> 6. Would you participate again in future Fedora Test Days?

Intend to

> 7. Do you have any more general comments or any suggestions for
> improving future test days?

It would be useful to incorporate test days directly in the release
schedule listed in the wiki so people can know well ahead of time what
is the plan and participate accordingly. The last minute rush in some of
the test days seems avoidable.

Rahul

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread Michael Cronenworth
James Laska wrote:
> 
> 1. How did you find out about Fedora Test Days?  

Mailing list posting.

> 
> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?

Yes, I found everything I needed on the corresponding wiki page.

> 
> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?

Time. Test days are sometimes not announced early enough for me, or I do
not have them marked on my calendar so I forget about them.

> 
> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?

Yes. Yes.

> 
> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?

I expected an analysis of the data received either by a mailing list
post or an update on the wiki page. I saw neither and thought my data
was just thrown into the wind. My expectations were not met.

> 
> 6. Would you participate again in future Fedora Test Days?

Yes.

> 
> 7. Do you have any more general comments or any suggestions for
> improving future test days?
> 

Please get the Fedora calendar server going. I'd love to subscribe
Thunderbird/Lightning to the QA calendar. People would be able to know
about and participate in test days (or any QA event) without a mailing
list subscription or a 24/7 IRC connection as it seems some things are
discussed solely on IRC.

-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list


Re: Fedora 11 Test Day survey

2009-06-03 Thread King InuYasha
On Wed, Jun 3, 2009 at 9:10 AM, James Laska  wrote:

> Greetings,
>
> The Fedora QA team would like your feedback on Fedora 11 Test Days.  You
> may have seen Adam Williamson's planet post [1] kicking off Fedora 12
> Test Day planning.  We're interested in identifying areas for
> improvement to increase participation and improve effectiveness.
>
> Please take 10-15 minutes to answer any/all of the questions below.  You
> may reply to the mailing list, or send feedback directly to me.  Your
> responses to this survey are instrumental in making Fedora 12 Test Days
> successful.
>
> Many thanks to Chris Ward for his help in getting things moving with the
> survey questions!
>
> ===
>
> 1. How did you find out about Fedora Test Days?
>
> 2. Was sufficient documentation available to help you participate in a
> Fedora Test Day?  If not, what did you find missing or in need of
> improvement?
>
> 3. Did you encounter any obstacles preventing participation in Fedora
> test Days?  How might they have been avoided?  Did you discover any
> workaround?
>
> 4. Were you able to locate and download installation media for testing?
> Did it function as expected?
>
> 5. What follow-up actions do you expect after the Test Day?  Are your
> expectations currently being met?
>
> 6. Would you participate again in future Fedora Test Days?
>
> 7. Do you have any more general comments or any suggestions for
> improving future test days?
>
> ===
>
> Thanks,
> James
>
> [1] http://www.happyassassin.net/2009/06/02/whats-goin-on-f12-test-days/
>
> --
> fedora-devel-list mailing list
> fedora-devel-list@redhat.com
> https://www.redhat.com/mailman/listinfo/fedora-devel-list
>


I'll answer these in order.

1. I got lucky when I looked in the mailing list.

2. Yes there was good enough docs for the test days to help me participate.

3. My biggest obstacle with test days was that they were not planned early
enough. Most of the test days seemed to be planned less than 48 hours ahead
of time. If test days were planned better, I could actually participate
more.

4. Yes, I was able to download them. No, the media didn't work. It generally
hung the computer, but that's not the fault of the test days.

5. I would expect a recap of the testing efforts so that Fedora people could
analyze what the issues were, track them, and fix them. I suppose they are.
The mailing list enabled them to do this, but there was no formal method of
doing it.

6. If they were planned better, then maybe I would be able to set aside time
to do them. I would like to participate in future Test Days.

7. Set up a reporting center just for Test Day feedback. Using the wiki is
definitely not good enough. Additionally, Do not limit the test days to
people subscribed to the mailing list. Take a page from Mozilla's books and
announce those test days to the world. Unfortunately, to do that, test days
need to be planned better.

Hopefully this feedback helps :)
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list

Fedora 11 Test Day survey

2009-06-03 Thread James Laska
Greetings,

The Fedora QA team would like your feedback on Fedora 11 Test Days.  You
may have seen Adam Williamson's planet post [1] kicking off Fedora 12
Test Day planning.  We're interested in identifying areas for
improvement to increase participation and improve effectiveness.

Please take 10-15 minutes to answer any/all of the questions below.  You
may reply to the mailing list, or send feedback directly to me.  Your
responses to this survey are instrumental in making Fedora 12 Test Days
successful.

Many thanks to Chris Ward for his help in getting things moving with the
survey questions!

===

1. How did you find out about Fedora Test Days?  

2. Was sufficient documentation available to help you participate in a
Fedora Test Day?  If not, what did you find missing or in need of
improvement?

3. Did you encounter any obstacles preventing participation in Fedora
test Days?  How might they have been avoided?  Did you discover any
workaround?

4. Were you able to locate and download installation media for testing?
Did it function as expected?

5. What follow-up actions do you expect after the Test Day?  Are your
expectations currently being met?

6. Would you participate again in future Fedora Test Days?

7. Do you have any more general comments or any suggestions for
improving future test days?

===

Thanks,
James

[1] http://www.happyassassin.net/2009/06/02/whats-goin-on-f12-test-days/


signature.asc
Description: This is a digitally signed message part
-- 
fedora-devel-list mailing list
fedora-devel-list@redhat.com
https://www.redhat.com/mailman/listinfo/fedora-devel-list