Testing Harness, or a/b testing scenario, and sending logs back to developer

2010-09-13 Thread Anna Billstrom
Hi, Since last posting, I've done some more research. Has anyone used MixPanel for testing? The goal I'm looking for is getting touchevents, and feature usage, sent back to the apple developer so that we can do true a/b testing on user interface elemetns. Similar to web analytics, we can test

A/B testing

2010-09-09 Thread Anna Billstrom
I have a relatively simple game, and I wanted to test some UI elements, to see which is more popular and useful for customers. Does anyone have a practice of setting up a testing harness in their app, so they can readily show different versions to different users, and report back on those

Re: A/B testing

2010-09-09 Thread Mark Ritchie
Hey! On 9/Sep/2010, at 2:01 PM, Anna Billstrom wrote: Other ideas? 1) Please start a new thread instead of replying to another with a different subject... Messes up thread tracking. ;-) 2) I think that you actually want the opposite, but in case that's not the case: the Automated User

Re: A/B testing

2010-09-09 Thread banane
Sorry Mark, didn't know the thread info was still attached, if I changed the subject. Right- I don't want automated testing, but to release a version A of the app, and a Version B, and see which one performs better. This post (http://www.markj.net/ab-testing-iphone-app-names-360idev/) advises

Re: A/B testing

2010-09-09 Thread Scott Anguish
On Sep 9, 2010, at 5:31 PM, banane wrote: Sorry Mark, didn't know the thread info was still attached, if I changed the subject. Right- I don't want automated testing, but to release a version A of the app, and a Version B, and see which one performs better. This post

Re: A/B testing

2010-09-09 Thread Scott Anguish
That would be one option. On Sep 9, 2010, at 11:52 PM, Anna Billstrom wrote: I am using nibs, so you're suggesting switching the nib according to... Whether the device id ends in an odd or even #, or some other logic? Sent from my iPhone On Sep 9, 2010, at 7:33 PM, Scott Anguish