Depending on how you implemented the transform stream, the pipeline should be balancing itself automatically. How did you implement the stream? Do you use object mode? Did you try to do something with highWaterMark?
On Tuesday, April 26, 2016 at 6:34:05 PM UTC+2, Kayode Odeyemi wrote: > > Hi, > > I'm streaming data using the following data flow: > > Source(Database) -> Transform (An HTTP request) -> Sink(Database) > > Obviously the HTTP request task is a blocking task. At the moment, it > seems the Source is faster than the Transform process. > > How do I make the Transform process delay or better still work in tandem > with the Source or much better make the source delay until the current > transform task finishes? > > Appreciate your help. > > Thanks > > -- Job board: http://jobs.nodejs.org/ New group rules: https://gist.github.com/othiym23/9886289#file-moderation-policy-md Old group rules: https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines --- You received this message because you are subscribed to the Google Groups "nodejs" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/nodejs/791f9e72-c9e6-458f-bad7-04496ffd9505%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
