Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Josh Cooper commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters This would be good to resolve but we don't have any plans on fixing it anytime soon. Please reopen if this is needed. Add Comment This message was sent by Atlassian Jira (v8.13.2#813002-sha1:c495a97) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.27574.1393541755000.52934.1623277320026%40Atlassian.JIRA.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title
Josh Cooper updated an issue
Puppet / PUP-1800
Ruby downcase does not handle all unicode letters
Change By:
Josh Cooper
In the puppet language, {{" A" == "a"}} is true and {{" Ä" == "ä"}} should be true, but it is false . :{noformat}bx puppet apply -e 'notice("A" == "a") notice("Ä" == "ä")'Notice: Scope(Class[main]): trueNotice: Scope(Class[main]): false{noformat} Ruby doesn't properly handle changing from upper to lower case letters for all unicode glyphs in the letters category.Other interesting cases to look at are things like "ß" which has no upper/lower-case distinction.
Add Comment
This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)
--
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.27574.1393541755000.1256
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Josh Cooper updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Josh Cooper Team: Puppet Developer Experience Night's Watch Add Comment This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-bugs/JIRA.27574.1393541755000.80669.1591487940199%40Atlassian.JIRA.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Henrik Lindberg commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters Oh, the implementation is naturally filled with gotchas - see this article: http://blog.honeybadger.io/ruby-s-unicode-support/ Read through the list of tests in that post and cry... We may have to normalize all strings everywhere and that will have a huge performance impact. (Every JSON and YAML read for example). If we do nothing we get the new behavior and we will probably be seeing bug after bug in relation to use of unicode characters and non normalized strings. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Henrik Lindberg commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters Here is an article about the Unicode support in Ruby 2.4 http://www.sw.it.aoyama.ac.jp/2016/pub/IUC40-Ruby2.4/ I found that it follows Unicode 9.0.0 recommendations for handling of special characters in German, Turkish, etc. by making compromises. That is better than having to rely on Locale and having different behavior depending on it. This means that up/down-case operations work - but that the operation in reverse (upcase.downcase or downcase.upcase) is not guaranteed to produce the same result. This is good enough since Puppet is not a typesetting system I have yet to try out sorting and comparisons (<=>, <, >, etc) and operations like casecmp. (Article did not talk much about that) Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Ethan Brown commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters FYI - Ruby 2.4 (which will ship with Puppet 5) is supposed to have fixed this. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Moses Mendoza updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Moses Mendoza Labels: i18n triaged utf-8 Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title John Duarte updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: John Duarte Labels: i18n triaged utf-8 Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Ethan Brown commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters Henrik Lindberg I'm removing the PUP-1031 epic in an effort to close that off. This seems like a ticket that belongs in a separate language (or similar) related epic like the ones that we've created at PUP-6718 / PUP-6719 / PUP-6720. I'd suggest creating that new epic and having it block the LOC-11 epic. Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Henrik Lindberg Team: Puppet Developer Support Add Comment This message was sent by Atlassian JIRA (v6.4.14#64029-sha1:ae256fe) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Henrik Lindberg commented on PUP-1800 Re: Ruby downcase does not handle all unicode letters Note that: normalization is required which is performance demanding in Ruby user locale is needed as rules for up/down case depends on locale locale is also needed for correct comparisons/ordering of strings These together makes this a much thornier problem than just adding a library and comparing a different way. Add Comment This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Ethan Brown updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Ethan Brown Labels: i18n utf-8 Add Comment This message was sent by Atlassian JIRA (v6.4.13#64028-sha1:b7939e9) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at https://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Henrik Lindberg updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Henrik Lindberg Scrum Team: Language Add Comment This message was sent by Atlassian JIRA (v6.3.10#6340-sha1:7ea293a) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at http://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title
Henrik Lindberg commented on an issue
Re: Ruby downcase does not handle all unicode letters
Since this breaks API it needs to be done at a major version boundary. Do we attempt to do this for Puppet 4.0.0 ? If not, it needs to wait until 5.0.0.
Add Comment
Puppet / PUP-1800
Ruby downcase does not handle all unicode letters
{{"Ä" == "ä"}} should be true, but it is false. Ruby doesn't properly handle changing from upper to lower case letters for all unicode glyphs in the letters category. Other interesting cases to look at are things like "ß" which has no upper/lower-case distinction.
This message was sent by Atlassian JIRA (v6.1.4#6159-sha1:44eaede)
--
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-bugs@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-bugs.
For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Kylo Ginsberg updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Kylo Ginsberg Fix Version/s: 3.7.0 Add Comment This message was sent by Atlassian JIRA (v6.1.4#6159-sha1:44eaede) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at http://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/d/optout.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title
Henrik Lindberg commented on an issue
Re: Ruby downcase does not handle all unicode letters
This gem: https://github.com/lang/unicode_utils is an implementation in Ruby that performs all sorts of unicode related things.
Add Comment
Puppet / PUP-1800
Ruby downcase does not handle all unicode letters
{{"Ä" == "ä"}} should be true, but it is false. Ruby doesn't properly handle changing from upper to lower case letters for all unicode glyphs in the letters category. Other interesting cases to look at are things like "ß" which has no upper/lower-case distinction.
This message was sent by Atlassian JIRA (v6.1.4#6159-sha1:44eaede)
--
You received this message because you are subscribed to the Google Groups "Puppet Bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com.
To post to this group, send email to puppet-bugs@googlegroups.com.
Visit this group at http://groups.google.com/group/puppet-bugs.
For more options, visit https://groups.google.com/groups/opt_out.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Andrew Parker updated an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Change By: Andrew Parker Story Points: 3 Add Comment This message was sent by Atlassian JIRA (v6.1.4#6159-sha1:44eaede) -- You received this message because you are subscribed to the Google Groups "Puppet Bugs" group. To unsubscribe from this group and stop receiving emails from it, send an email to puppet-bugs+unsubscr...@googlegroups.com. To post to this group, send email to puppet-bugs@googlegroups.com. Visit this group at http://groups.google.com/group/puppet-bugs. For more options, visit https://groups.google.com/groups/opt_out.
Jira (PUP-1800) Ruby downcase does not handle all unicode letters
Title: Message Title Andrew Parker created an issue Puppet / PUP-1800 Ruby downcase does not handle all unicode letters Issue Type: Bug Assignee: Andrew Parker Components: DSL Created: 27/Feb/14 2:55 PM Fix Versions: 3.6.0 Priority: Normal Reporter: Andrew Parker "Ä" == "ä" should be true, but it is false. Ruby doesn't properly handle changing from upper to lower case letters for all unicode glyphs in the letters category. Other interesting cases to look at are things like "ß" which has no upper/lower-case distinction. Add Comment
