Re: [HACKERS] Unicode mapping scripts cleanup

2016-10-27 Thread Peter Eisentraut
On 9/1/15 12:13 AM, Peter Eisentraut wrote: > ere is a series of patches to clean up the Unicode mapping script > business in src/backend/utils/mb/Unicode/. I never committed the last of these patches, which have the download locations of the files. I have updated this a bit now and propose it he

Re: [HACKERS] Unicode mapping scripts cleanup

2015-10-03 Thread Andres Freund
Hi, On 2015-09-01 00:13:07 -0400, Peter Eisentraut wrote: > Here is a series of patches to clean up the Unicode mapping script > business in src/backend/utils/mb/Unicode/. It overlaps with the > perlcritic work that I recently wrote about, except that these pieces > are not strictly related to Pe

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-16 Thread Tatsuo Ishii
> What if we discovered that one of our mappings was wrong? Suppose > that there is some encoding where the Unicode mapping for "a" is > inadvertently mapped to the letter "b" in some other character set, > and "b" is mapped to "a". I imagine that anyone using that encoding > would want this fixe

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-16 Thread Robert Haas
On Tue, Sep 15, 2015 at 9:00 PM, Tatsuo Ishii wrote: >> Then again, I don't have >> any knowledge about how to handle such changes. But the fact that the >> standards bodies are still making changes indicates that such changes >> are to be expected and should be handled. I think this is similar

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-15 Thread Tatsuo Ishii
>> I think so. We must be very careful updating the maps. Adding new >> mapping data would cause less problem, but replacing existing mappings >> will be definitely a big problem for users. > > Note that I'm not actually proposing to change the mappings, I just want > to get the scripts into worki

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-15 Thread Peter Eisentraut
On 9/1/15 7:27 PM, Tatsuo Ishii wrote: >> On Tue, Sep 1, 2015 at 5:13 AM, Peter Eisentraut wrote: >>> So apparently, the >>> CJK to Unicode mappings are still evolving and should be updated >>> occasionally. Next steps would be to commit some or all of these >>> differences after additional ver

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-01 Thread Tatsuo Ishii
> I discovered that some of the source files that one is supposed to > download don't exist anymore or are labeled obsolete. Also, running the > scripts produces slight differences in the output. So apparently, the > CJK to Unicode mappings are still evolving and should be updated > occasionally.

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-01 Thread Tatsuo Ishii
> On Tue, Sep 1, 2015 at 5:13 AM, Peter Eisentraut wrote: >> So apparently, the >> CJK to Unicode mappings are still evolving and should be updated >> occasionally. Next steps would be to commit some or all of these >> differences after additional verification, and then update the scripts >> to

Re: [HACKERS] Unicode mapping scripts cleanup

2015-09-01 Thread Greg Stark
On Tue, Sep 1, 2015 at 5:13 AM, Peter Eisentraut wrote: > So apparently, the > CJK to Unicode mappings are still evolving and should be updated > occasionally. Next steps would be to commit some or all of these > differences after additional verification, and then update the scripts > to use wh

[HACKERS] Unicode mapping scripts cleanup

2015-08-31 Thread Peter Eisentraut
Here is a series of patches to clean up the Unicode mapping script business in src/backend/utils/mb/Unicode/. It overlaps with the perlcritic work that I recently wrote about, except that these pieces are not strictly related to Perl, but wrong comments, missing makefile pieces, and such. I disco