As a follow-up, it looks like the data I get back from the response often has "\r\n2000\r\n" in the middle of what otherwise looks like good data, so I'm guessing something is going wrong with processing multi-part (chunked? whatever is the right term?) responses, and it sometimes reads too much and then tries to read the next chunk size from the middle of the response data (sometimes getting an "invalid chunk size" error, or if it gets lucky and reads a small number, it just truncates my response (though leaves the "\r\n2000\r\n" in the middle of it).
On Thursday, September 20, 2012 1:48:02 PM UTC-7, Jimb Esser wrote: > > We're trying migrating from node 0.6.21 to 0.8.9, and one of our processes > that does a database backup (a couple million items fetched over HTTP and > HTTPS from Amazon SimpleDB and DynamoDB APIs) has started getting > "HPE_INVALID_CHUNK_SIZE" errors, presumably from node's http_parser.c (and > then after that, it seems we're generally handed back a partial response, > and sometimes also a disconnected socket on the next request, which > black-holes the connection without some other fixes). It generally gets > one or two of these errors in the millions of fetched items (maybe 10s-100s > of thousands of individual HTTP requests over just a handful of HTTP 1.1 > connections with connection keep-alive). Rolling back to 0.6.21 makes > everything fine. Doing a diff of http_parser.c between the two versions > show's it's had some major work done (though nothing right around where > this error is emitted), so perhaps a bug has been introduced, but I know > nothing of that code and don't know where to start debugging it. Any > suggestions? Any recent changes to related code I should try bisecting? > Anyone else getting this error? > > Jimb Esser > Cloud Party, Inc > > -- Job Board: http://jobs.nodejs.org/ Posting guidelines: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines You received this message because you are subscribed to the Google Groups "nodejs" group. To post to this group, send email to nodejs@googlegroups.com To unsubscribe from this group, send email to nodejs+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/nodejs?hl=en?hl=en