Ok, but why do you need to do that in web2py? I remember have read something about encoding in the book that was saying don't need to concern about that in web2py.
Richard On Fri, Sep 27, 2013 at 2:46 PM, Vinicius Assef <vinicius...@gmail.com>wrote: > On Fri, Sep 27, 2013 at 3:37 PM, Richard Vézina > <ml.richard.vez...@gmail.com> wrote: > > Ha ok, I was miss leading by the linux shell... Could it be that you need > > u('éà') ?? > > No. the "áéíóú".decode("utf-8") should do that. > And really does, in standard Python shell, outside web2py. > > > > > > > > On Fri, Sep 27, 2013 at 1:47 PM, Vinicius Assef <vinicius...@gmail.com> > > wrote: > >> > >> It wasn't a bash script, Richard. > >> > >> I made exactly as I described: straight from terminal. > >> > >> On Fri, Sep 27, 2013 at 2:23 PM, Richard Vézina > >> <ml.richard.vez...@gmail.com> wrote: > >> > Could it be the encoding of the file that content your bash script? > >> > > >> > Richard > >> > > >> > > >> > On Fri, Sep 27, 2013 at 12:23 PM, Vinicius Assef < > vinicius...@gmail.com> > >> > wrote: > >> >> > >> >> Hey all. > >> >> > >> >> I'm facing a strange problem concerning special characters. > >> >> > >> >> Using web2py shell, through command line (linux shell), I do this: > >> >> > >> >> # ---------------- start > >> >> $ python web2py.py -S welcome > >> >> web2py Web Framework > >> >> Created by Massimo Di Pierro, Copyright 2007-2013 > >> >> Version 2.6.4-stable+timestamp.2013.09.22.01.43.37 > >> >> Database drivers available: SQLite(sqlite3), MySQL(pymysql), > >> >> PostgreSQL(pg8000), IMAP(imaplib) > >> >> WARNING:web2py:import IPython error; use default python shell > >> >> Python 2.7.3 (default, Apr 10 2013, 06:20:15) > >> >> [GCC 4.6.3] on linux2 > >> >> Type "help", "copyright", "credits" or "license" for more > information. > >> >> (InteractiveConsole) > >> >> >>> print "áéíóú" # note the strange chars! > >> >> áéÃóú > >> >> >>> from unicodedata import normalize > >> >> >>> normalize("NFKD", "áéuíóú".decode("utf-8")).encode("ASCII", > >> >> >>> "ignore") > >> >> >>> # again! > >> >> 'AAuAA3Ao' > >> >> # ---------------- end > >> >> > >> >> Note the noisy characters on the last line. > >> >> > >> >> > >> >> Then, at the same machine, I enter into the naked Python shell and: > >> >> # ---------------- start > >> >> $ python > >> >> Python 2.7.3 (default, Apr 10 2013, 06:20:15) > >> >> [GCC 4.6.3] on linux2 > >> >> Type "help", "copyright", "credits" or "license" for more > information. > >> >> >>> print "áéíóú" # looks ok > >> >> áéíóú > >> >> >>> from unicodedata import normalize > >> >> >>> normalize("NFKD", "áéuíóú".decode("utf-8")).encode("ASCII", > >> >> >>> "ignore") > >> >> >>> # ok again. > >> >> 'aeiou' > >> >> # ---------------- end > >> >> > >> >> Everything works fine. > >> >> > >> >> The same code. > >> >> > >> >> I found this problem because I'm working to strip special characters > >> >> off of names, with unicodedata.normalize(). > >> >> > >> >> If it wan't strange enough, the unicodedata.normalize() works fine > >> >> from web environment, throug app admin. There the normalization works > >> >> as expected (the same way as the standard naked Python shell). > >> >> > >> >> What could be the root of this situation? > >> >> > >> >> -- > >> >> Resources: > >> >> - http://web2py.com > >> >> - http://web2py.com/book (Documentation) > >> >> - http://github.com/web2py/web2py (Source code) > >> >> - https://code.google.com/p/web2py/issues/list (Report Issues) > >> >> --- > >> >> You received this message because you are subscribed to the Google > >> >> Groups > >> >> "web2py-users" group. > >> >> To unsubscribe from this group and stop receiving emails from it, > send > >> >> an > >> >> email to web2py+unsubscr...@googlegroups.com. > >> >> For more options, visit https://groups.google.com/groups/opt_out. > >> > > >> > > >> > -- > >> > Resources: > >> > - http://web2py.com > >> > - http://web2py.com/book (Documentation) > >> > - http://github.com/web2py/web2py (Source code) > >> > - https://code.google.com/p/web2py/issues/list (Report Issues) > >> > --- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "web2py-users" group. > >> > To unsubscribe from this group and stop receiving emails from it, send > >> > an > >> > email to web2py+unsubscr...@googlegroups.com. > >> > For more options, visit https://groups.google.com/groups/opt_out. > >> > >> -- > >> Resources: > >> - http://web2py.com > >> - http://web2py.com/book (Documentation) > >> - http://github.com/web2py/web2py (Source code) > >> - https://code.google.com/p/web2py/issues/list (Report Issues) > >> --- > >> You received this message because you are subscribed to the Google > Groups > >> "web2py-users" group. > >> To unsubscribe from this group and stop receiving emails from it, send > an > >> email to web2py+unsubscr...@googlegroups.com. > >> For more options, visit https://groups.google.com/groups/opt_out. > > > > > > -- > > Resources: > > - http://web2py.com > > - http://web2py.com/book (Documentation) > > - http://github.com/web2py/web2py (Source code) > > - https://code.google.com/p/web2py/issues/list (Report Issues) > > --- > > You received this message because you are subscribed to the Google Groups > > "web2py-users" group. > > To unsubscribe from this group and stop receiving emails from it, send an > > email to web2py+unsubscr...@googlegroups.com. > > For more options, visit https://groups.google.com/groups/opt_out. > > -- > Resources: > - http://web2py.com > - http://web2py.com/book (Documentation) > - http://github.com/web2py/web2py (Source code) > - https://code.google.com/p/web2py/issues/list (Report Issues) > --- > You received this message because you are subscribed to the Google Groups > "web2py-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to web2py+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > -- Resources: - http://web2py.com - http://web2py.com/book (Documentation) - http://github.com/web2py/web2py (Source code) - https://code.google.com/p/web2py/issues/list (Report Issues) --- You received this message because you are subscribed to the Google Groups "web2py-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to web2py+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.