Michael, If this field ever wants to reach a certain level of maturity, it has to start obeying some grown-up rules, not running around like kinder-garden kids screaming at each other : “my grand’ma is smaller then your grand’ma..”
That how it all looks to me from the outside now (e.g. NoSQL X scales to the level of the … universe… and not a bit less..! :-) And building reliable benchmarks, is one of the grown-up rules of an industry — if nothing else, but to understand, in a very unclear/nascent market, what is the usage pattern for which each product has been created and optimized for. I agree with you, building benchmarks is very difficult, indeed. That’s why you need a REAL third party. That’s why all the vendors AND their customers have to cooperate, etc. That’s why you need some good will and transparency. I hope one day they’ll be mature enough to do that. Have a great weekend, Dana > On Jun 13, 2015, at 2:27 AM, Michael Kay <[email protected]> wrote: > > All benchmarks are biased. They are less likely to be biased by business > relationships than by skills imbalances. You can’t conduct an unbiased > benchmark between two products unless you have the same skill and knowledge > level in both, and that’s pretty difficult to achieve. > > Michael Kay > Saxonica > > >> On 12 Jun 2015, at 22:24, daniela florescu <[email protected] >> <mailto:[email protected]>> wrote: >> >> And this is yet another public and very honest answer when I commented that >> a “third party” doing a benchmark >> should not, in theory, have a business relationship with ANY of the vendors. >> Otherwise, not credible, so waste of time. >> >> >> ============================================== >> >> Daniela - the fact that we are partnered with MarkLogic and Couchbase (so >> that we can better serve our clients who use those platforms) has no bearing >> on our ability to conduct benchmarks with independence. >> >> >> ========== >> >> >> I guess it’s not clear to everyone what a “third party benchmark” usually >> means in Computer Science :-)) >> >> >> Have a great weekend everyone, best >> Dana >> _______________________________________________ >> [email protected] <mailto:[email protected]> >> http://x-query.com/mailman/listinfo/talk >
_______________________________________________ [email protected] http://x-query.com/mailman/listinfo/talk
