Re: [pygtk] utf8 validating string
John Ehresman wrote:
Yann Leboulanger wrote:
I'd like not to have it. But I getthis string by gpg-decodding a message
send by Miranda IM. I think it's a bug in their GnuPG implementation,
but anyway I'd like my client to detect those bad string and a) print
message correctly if I can or b) don't traceback and print a warning
message. But for that I need a function that tells me that
g_utf8_validate will fail ...
You probably should explicitly decide how to handle \0. If it's always
at the end, it's probably just a simple bug and can be chopped off but
it may be something more if valid text follows the \0.
But in general, I think this'll work:
def valid_glib_utf8(s):
try:
unicode(s, 'utf-8')
except Exception:
return False
else:
return '\x0' not in s
In case you need it s.replace('\x0', '') will remove the \0's.
Cheers,
John
That doesn't work:
import gtk
tv = gtk.TextView()
b = tv.get_buffer()
t = test\x00
u = unicode(t, 'utf-8')
b.set_text(t)
__main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion
`g_utf8_validate (text, len, NULL)' failed
it's the same if I try with the unicode:
import gtk
tv = gtk.TextView()
b = tv.get_buffer()
t = test\x00
u = unicode(t, 'utf-8')
b.set_text(u)
__main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion
`g_utf8_validate (text, len, NULL)' failed
--
Yann
___
pygtk mailing list pygtk@daa.com.au
http://www.daa.com.au/mailman/listinfo/pygtk
Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/
Re: [pygtk] utf8 validating string
John Ehresman wrote: I'm confused here; I think your last example passes '\x0' to a gtk function which does not work. Either remove the '\x0' or do something else with \x0 here. Or am I missing something? removeing the \x0 isn't a problem, a replce can do that, but is it the only char that will cause this problem? -- Yann ___ pygtk mailing list pygtk@daa.com.au http://www.daa.com.au/mailman/listinfo/pygtk Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/
[pygtk] utf8 validating string
Hi,
I have a string that a textview can't display. It contains invalid chars:
t = Let's check this out.\x00
import gtk
tv = gtk.TextView()
b = tv.get_buffer()
b.set_text(t)
__main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion
`g_utf8_validate (text, len, NULL)' failed
but when I di that I have no problem:
t.decode('utf-8')
uLet's check this out.\x00
so what could I do to validate the string before sending it to GTK?
___
pygtk mailing list pygtk@daa.com.au
http://www.daa.com.au/mailman/listinfo/pygtk
Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/
Re: [pygtk] utf8 validating string
John Ehresman wrote:
Yann Leboulanger wrote:
Hi,
I have a string that a textview can't display. It contains invalid chars:
t = Let's check this out.\x00
import gtk
tv = gtk.TextView()
b = tv.get_buffer()
b.set_text(t)
__main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion
`g_utf8_validate (text, len, NULL)' failed
but when I di that I have no problem:
t.decode('utf-8')
uLet's check this out.\x00
try:
u = unicode(t, 'utf-8')
except Exception:
print 'not utf8'
else:
b.set_text(t)
John
import gtk
tv = gtk.TextView()
b = tv.get_buffer()
t = Let's check this out.\x00
u = unicode(t, 'utf-8')
b.set_text(t)
__main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion
`g_utf8_validate (text, len, NULL)' failed
but b.set_text(u) works ... is it the way to go?
___
pygtk mailing list pygtk@daa.com.au
http://www.daa.com.au/mailman/listinfo/pygtk
Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/
Re: [pygtk] utf8 validating string
Yann Leboulanger wrote: import gtk tv = gtk.TextView() b = tv.get_buffer() t = Let's check this out.\x00 u = unicode(t, 'utf-8') b.set_text(t) __main__:1: GtkWarning: gtk_text_buffer_emit_insert: assertion `g_utf8_validate (text, len, NULL)' failed but b.set_text(u) works ... is it the way to go? Your mistake might be the final '\x00'. Is there a reason you're including it? Python handles \x00 in strings, but gtk ( most C libs) probably doesn't. Cheers, John ___ pygtk mailing list pygtk@daa.com.au http://www.daa.com.au/mailman/listinfo/pygtk Read the PyGTK FAQ: http://www.async.com.br/faq/pygtk/
