Éric Miclo wrote:

> I do agree that more testing (non automatic testing) should be made
> before releasing a commercial product.
> But I’m not sure RunRev will listen.
>
> When the CEO says:
>  "I really would urge everyone in our community to move to 7 as
> soon as possible. We spent 18 months building it and considering
> the amount of change its getting very good results stability wise.
> There are issues but they are mostly minor."
>
> When minor bugs are so many, I don’t consider it is minor to test
> and fix before releasing a commercial product.
> And by fixing I mean test if the fix really fixes the bug so it
> doesn’t have to be reopened immediately.
> It is not the amount of time spent on a product that is an indicator
> of quality.
>
> My 2 cents.
>
> Best,
>
> ÉrIC
>
> -- My NeXT computer will Be a Mac too! --


Re/Code recently posted the full video of their interview with Apple VP Greg Joswiak, discussing iOS 8.0.1 bugs among other things:
<http://www.macrumors.com/2014/11/12/greg-joswiak-full-interview/>

iOS 8.0.1 was sent out in response to critical bugs in v8.0, and it turned out that the fix itself required fixing, as 8.0.1 wound up bricking some user's phones.

In the video the interviewer raises the larger question of overall QA, and we're all familiar with recent issues there from iMaps forward.

Watching the video, I don't feel Joswiak's obvious pride in Apple is at all misplaced. Sure, there have been many issues, sometimes critical ones, in both iOS and OS X in recent years, and this may seem surprising given the wealth of resources Apple has at their disposal which would seem more than sufficient to prevent such things.

Software is complex stuff.

I don't think it was a mistake for Tim Cook to suggest we upgrade our Apple devices to the latest software version which later bricked some phones, and I don't think it was a mistake for Kevin to suggest that we use the latest version of his company's software.

Obviously, with the benefit of hindsight, both CEOs were mistaken about the fitness of the final deliverable, and both companies have devoted considerable resources to addressing the issues once they became evident.

I'd wager that Apple has now added additional QA review steps to prevent the specific issues that affected iOS 8.0.1, and I'd wager RunRev has done the same with the issues evident in 7.0.

Late-stage regressions are especially troubling for all of us. developers and users alike, because in the late stages it's especially hard to detect such things as might have happened during earlier Beta periods. When unpredictable events occurs late-stage it becomes more likely that a software will be delivered that makes standalones unable to quit, or bricks people's phones.

I wouldn't assume that either Apple or RunRev spends nothing on internal testing. On the contrary, as a percentage of payroll I'd be surprised if RunRev's costs for that weren't a multiple of Apple's.

I volunteered for this role of Community Manager because LiveCode is very important to my own business interests and those of my clients. Part of this role is to advocate for community concerns, and I agree that QA is critical.

We *all* want to see QA improved, ever more so going forward. The folks at RunRev have more at stake in this than most of us.

Those of us who read the bug DB regularly have a good appreciation for the level of engagement the core team has in the QA process.

That v7.0 shipped with show-stoppers is annoying to all of us, and exploring ways to improve the QA process is the focus of my meeting with Ben later today.

Sean's suggestion of including a reporting item in the Help menu is a very good one, and I'll be sure to raise it at the meeting.

Any other specific actionable items like that are very welcome, and can help us all refine the process of making complex software ever more robust.

--
 Richard Gaskin
 LiveCode Community Manager
 rich...@livecode.org


_______________________________________________
use-livecode mailing list
use-livecode@lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

Reply via email to