> W dniu 2014-08-31 07:41, R.J. Baars pisze:
>> I understand that, but it is not what I tried to ask. Wij is the
>> degree-sign not a separate token?
>
> Because it is not one of the tokenizing characters. I think some rules
> in some languages rely on this, so we'd have to be very careful.
Okay, I see. I expected any non-word char to be a token border.
>
> Marcin
>
>>
>> Ruud
>>
>>> On 2014-08-30 13:24, R.J. Baars wrote:
>>>
>>>> <token><exception
>>>> regexp="yes">[0-9]{1,2}|[a-z]</exception></token>
>>>
>>>> Is there an explanation for the rule catching 2 characters in the
>>>> token,
>>>> like -3 and 1ð ?
>>>
>>> [0-9]{1,2} matches 0, 1, 2... 10, 11, 12...
>>> [a-z] matches a, b, c...
>>>
>>> As this is in an exception, the rule will match everything else, e.g.
>>> "1ð".
>>>
>>> Regards
>>> Daniel
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Slashdot TV.
>>> Video for Nerds. Stuff that matters.
>>> http://tv.slashdot.org/
>>> _______________________________________________
>>> Languagetool-devel mailing list
>>> Languagetool-devel@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/languagetool-devel
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Slashdot TV.
>> Video for Nerds. Stuff that matters.
>> http://tv.slashdot.org/
>> _______________________________________________
>> Languagetool-devel mailing list
>> Languagetool-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/languagetool-devel
>>
>>
>
>
> ------------------------------------------------------------------------------
> Slashdot TV.
> Video for Nerds. Stuff that matters.
> http://tv.slashdot.org/
> _______________________________________________
> Languagetool-devel mailing list
> Languagetool-devel@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/languagetool-devel
>
------------------------------------------------------------------------------
Slashdot TV.
Video for Nerds. Stuff that matters.
http://tv.slashdot.org/
_______________________________________________
Languagetool-devel mailing list
Languagetool-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/languagetool-devel
