Hi,
I've been trying to debug this problem for a week now and it's finally time
to come here and ask if I'm doing something dumb. We're downloading a PDF
file from American Express, with the following code:
var request = require('request'); // Mikeal's request library
var req = _make_req(...); // constructs a request
var r = request(req);
r.on('response', function (res) {
res.on('error', function (err) { console.log(err) });
res.on('end', function () { console.log('end') });
res.on('close', function () { console.log('close') });
// encoding shouldn't matter here as we're writing Buffer objects
anyway...
var ws = fs.createWriteStream(filename, {encoding: 'binary'});
r.pipe(ws);
ws.on('close', function () {
// parse the PDF
});
});
The problem is that sporadically the PDF is corrupted (the end is missing).
I haven't managed to even replicate it outside of our live systems. The
code is used to get PDFs from many places other than Amex and works just
fine, and even works fine on Amex most of the time. We can't really even
packet sniff because it's over https...
Is there anything obvious I'm missing? It's not an fsync issue because even
hours later the file isn't complete.
I can't provide the request headers for privacy reasons, but here's the
response headers:
Response Headers:
date: Mon, 13 May 2013 12:00:23 GMT
server: IBM_HTTP_Server
x-powered-by: Servlet/3.0
content-disposition: attachment; filename="Statement_Apr 2013.pdf";
pragma: max-age=86400
expires: Tue, 14 May 2013 12:00:24 GMT
lastmodified: Mon, 13 May 2013 12:00:24 GMT
transfer-encoding: chunked
content-type: application/pdf
content-language: en-US
connection: close
Oh, and this is with Node v0.8.22. Upgrading to v0.10 isn't really an
option right now - we need to wait for it to fully be stable first.
Matt.
--
--
Job Board: http://jobs.nodejs.org/
Posting guidelines:
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups "nodejs" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en
---
You received this message because you are subscribed to the Google Groups
"nodejs" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.
