Re: [WiX-users] wixunit?

2008-05-16 Thread Bob Arnson
Richard wrote:
   - start/reset the VMware guest machine image
   - launch the built install in the VMWare image
   - monitor the VMware image for failures
   - report back via email to the developers any failures
   

Me too, in a previous life. The challenge is to test your product (or 
just its setup) rather than testing MSI itself. We had an ongoing issue 
where the test was a simple does the product run? which meant that the 
setup devs were tier-1 support for every failure. Guess what? Most of 
the failures were in the product code, not the setup.

Yet another reason why centralized setup is risky.

-- 
sig://boB
http://joyofsetup.com/



-
This SF.net email is sponsored by: Microsoft 
Defy all challenges. Microsoft(R) Visual Studio 2008. 
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
WiX-users mailing list
WiX-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-users


[WiX-users] wixunit?

2008-05-15 Thread Ross Holder (Cactus Commerce Inc)
Another question that's come up today concerns testing practices around WiX and 
I noticed in the toolset interaction diagram (still shipping in the v3.0 help 
file) a reference to a tool called wixunit.  There's anecdotal mention of 
this thing in a couple of Google searches, but nothing concrete.  Does it 
exist?  Is it under development?  No specific mention on SourceForge (other 
than the .chm contained with the install); nothing on wixwiki.com

Insight appreciated on this or other pertinent tools for test purposes 
generally.
RH

-
This SF.net email is sponsored by: Microsoft 
Defy all challenges. Microsoft(R) Visual Studio 2008. 
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
WiX-users mailing list
WiX-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-users


Re: [WiX-users] wixunit?

2008-05-15 Thread Rob Mensching
It's a unit test framework for the WiX toolset itself.  It isn't very 
interesting unless you are changing core WiX toolset code and want to make sure 
you haven't regressed.  I also haven't pushed out all of the test data that I 
have internally because I haven't done the necessary scrub to make sure there 
isn't any proprietary Microsoft code in the test data.  I know there is some 
because some early teams at Microsoft contributed their setup code to the test 
harness to bootstrap our testing efforts.

However, I should note that Jordan has been building a fantastic new test 
system for verifying the WiX toolset itself so WiXUnit will be retired in the 
not too distant future.  Jordan says he'll have information in the WiX.chm 
about how to add more tests in the next couple weeks.  I'm just now starting to 
write tests using it (used it last week to run down a bug about the SymbolPath 
element) after Jordan gave me a sneak peek.  It's quite cool...

To answer your actual question, we don't really have any tools to do testing on 
MSIs today in the WiX toolset.  There is the static analysis stuff (ICEs, via 
light.exe or smoke.exe) but nothing that verifies installs work.  Bob had some 
interesting opinions on it that I thought he wrote on his blog 
(http://www.joyofsetup.com)... I'm not seeing it now.

From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Ross Holder 
(Cactus Commerce Inc)
Sent: Thursday, May 15, 2008 13:59
To: 'wix-users@lists.sourceforge.net'
Subject: [WiX-users] wixunit?

Another question that's come up today concerns testing practices around WiX and 
I noticed in the toolset interaction diagram (still shipping in the v3.0 help 
file) a reference to a tool called wixunit.  There's anecdotal mention of 
this thing in a couple of Google searches, but nothing concrete.  Does it 
exist?  Is it under development?  No specific mention on SourceForge (other 
than the .chm contained with the install); nothing on wixwiki.com

Insight appreciated on this or other pertinent tools for test purposes 
generally.
RH

-
This SF.net email is sponsored by: Microsoft 
Defy all challenges. Microsoft(R) Visual Studio 2008. 
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___
WiX-users mailing list
WiX-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-users


Re: [WiX-users] wixunit?

2008-05-15 Thread Richard

In article [EMAIL PROTECTED],
Rob Mensching [EMAIL PROTECTED]  writes:

 To answer your actual question, we don't really have any tools to do testin=
 g on MSIs today in the WiX toolset.  There is the static analysis stuff (=
 ICEs, via light.exe or smoke.exe) but nothing that verifies installs work. =
  Bob had some interesting opinions on it that I thought he wrote on his blo=
 g (http://www.joyofsetup.com)... I'm not seeing it now.

ICEs are a good place to start unit testing your built MSI.  Most
people never even seem to get that far.  I wrote a bunch (~70+) of
ICEs when I worked on a complex install.

For testing whether or not the install itself worked, we hacked
together a VMware machine, vbscript running on the VMware host and
vbscript running on the virtual machine to tie everything together.
We actually had a continuous integration feedback loop that went like
this:

- monitor CVS for changes to install source files
- after a period of quiescence on CVS, build the install
- start/reset the VMware guest machine image
- launch the built install in the VMWare image
- monitor the VMware image for failures
- report back via email to the developers any failures

We wanted to evolve this to doing automated upgrade testing as well,
but didn't get that far.
-- 
The Direct3D Graphics Pipeline -- DirectX 9 draft available for download
  http://www.xmission.com/~legalize/book/download/index.html

Legalize Adulthood! http://blogs.xmission.com/legalize/

-
This SF.net email is sponsored by: Microsoft 
Defy all challenges. Microsoft(R) Visual Studio 2008. 
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
WiX-users mailing list
WiX-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/wix-users