Hi Tim, I consider this an error. The Web server tries to avoid interpreting anything as UTF-8 unless asked by the servlet. Header comparison incorrectly converted to UTF-8 and I just pushed a fix. Can you verify that it works now with your workload?
Jay On Thu, May 5, 2016 at 11:28 AM, Tim Brown <[email protected]> wrote: > Folks, > > I have a web server, which in production is receiving a user agent > in its header which includes the phrase: > > #"FBCR/M\351ditel" > > It seems to be a mobile from Morocco. I’m forcing the > request-headers/raw promise on my request; and I get: > > “bytes->string/utf-8: string is not a well-formed UTF-8 encoding” > > Which it isn’t. I then investigated (searched on StackOverflow[1], more > like) what character set should be used for HTTP headers. In turn I was > pointed to [2]: > > > Historically, HTTP has allowed field content with text in the > > ISO-8859-1 charset [ISO-8859-1], supporting other charsets only > > through use of [RFC2047] encoding. In practice, most HTTP header > > field values use only a subset of the US-ASCII charset [USASCII]. > > Newly defined header fields SHOULD limit their field values to > > US-ASCII octets. A recipient SHOULD treat other octets in field > > content (obs-text) as opaque data. > > Do you agree that the headers’ string conversion for HTTP (at least, > I don’t know about other network protocols) should be done using: > bytes->string/latin-1 -- which should support LATIN-1 as well as its > subset US-ASCII, as we’d hope for in the future? > > > Tim > > [1] > > http://stackoverflow.com/questions/4400678/http-header-should-use-what-character-encoding > [2] https://tools.ietf.org/html/rfc7230#section-3.2.4 > > -- > Tim Brown CEng MBCS <[email protected]> > ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ > City Computing Limited · www.cityc.co.uk > City House · Sutton Park Rd · Sutton · Surrey · SM1 2AE · GB > T:+44 20 8770 2110 · F:+44 20 8770 2130 > ──────────────────────────────────────────────────────────────────────── > City Computing Limited registered in London No:1767817. > Registered Office: City House, Sutton Park Road, Sutton, Surrey, SM1 2AE > VAT No: GB 918 4680 96 > > -- > You received this message because you are subscribed to the Google Groups > "Racket Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > For more options, visit https://groups.google.com/d/optout. > -- Jay McCarthy Associate Professor PLT @ CS @ UMass Lowell http://jeapostrophe.github.io "Wherefore, be not weary in well-doing, for ye are laying the foundation of a great work. And out of small things proceedeth that which is great." - D&C 64:33 -- You received this message because you are subscribed to the Google Groups "Racket Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.

