Hi! For those interested, you might want to follow what's going on in https://github.com/joyent/libuv/pull/1521 and https://github.com/joyent/libuv/issues/1430. If we can get this in libuv, then we'll be able to work on adding a streaming API for reading directories in Node.js.
Julien On Tuesday, October 7, 2014 6:49:52 PM UTC-7, Aseem Kishore wrote: > > Hi there, > > I have a directory with a very large number of files in them (over 1M). I > need to process them, so I'm using fs.readdir() on the directory. > > The problem is, fs.readdir() returns everything at once, causing my script > to suddenly consume >1 GB of RAM. > > AFAICT, there's no way to stream this list instead of returning it all at > once. Is there anything equivalent that I can do? > > Thanks! > > Aseem > > -- Job board: http://jobs.nodejs.org/ New group rules: https://gist.github.com/othiym23/9886289#file-moderation-policy-md Old group rules: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines --- You received this message because you are subscribed to the Google Groups "nodejs" group. To unsubscribe from this group and stop receiving emails from it, send an email to nodejs+unsubscr...@googlegroups.com. To post to this group, send email to nodejs@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/nodejs/3c5c1a10-b305-442e-aa4e-c85a61e6665c%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
