On Mon, 17 Jan 2011 10:00:57 -0500, Andrei Alexandrescu
<seewebsiteforem...@erdani.org> wrote:
On 1/17/11 6:44 AM, Steven Schveighoffer wrote:
We need to get some real numbers together. I'll see what I can create
for a type, but someone else needs to supply the input :) I'm on short
supply of unicode data, and any attempts I've made to create some result
in failure. I have one example of one composed character in this thread
that I can cling to, but in order to supply some real numbers, we need a
large amount of data.
Oh, one more thing. You don't need a lot of Unicode text containing
combining characters to write benchmarks. (You do need it for testing
purposes.) Most text won't contain combining characters anyway, so after
you implement graphemes, just benchmark them on regular text.
True, benchmarking doesn't apply with combining characters because we have
nothing to compare it to. The current scheme fails on it anyways, so it
by default would be the best solution.
-Steve
