Hello Bhupesh Sir, But does that mean I am emitting only 'x' lines from the file?. Because from what I understood, emitTuples() emits multiple lines in a single call and emitBatchSize controls number of times emitTuples is called in a window. Am I right?. I inferred this from the following
The platform invokes the emitTuples() callback multiple time in each > streaming window; within a single such call, if a large number of tuples > are emitted, there is some risk that they may overwhelm the downstream > operators especially if they are performing some compute intensive > operation. Thank You. On Fri, Apr 7, 2017 at 1:44 PM, Bhupesh Chawda <[email protected]> wrote: > You can set emitBatchSize to 1 and make sure emitTuples is called just 'x' > times within a window. You can do this manually by keeping a count and > resetting it in beginWindow(). > > ~ Bhupesh > > > _______________________________________________________ > > Bhupesh Chawda > > E: [email protected] | Twitter: @bhupeshsc > > www.datatorrent.com | apex.apache.org > > > > On Fri, Apr 7, 2017 at 1:38 PM, Ambarish Pande < > [email protected]> wrote: > >> Yes i tried. That just gives me control on how many times emitTuples is >> called. I want control on number of tuples emitted. >> >> Thank you. >> >> Sent from my iPhone >> >> On 07-Apr-2017, at 8:08 AM, Yogi Devendra <[email protected]> >> wrote: >> >> Have you tried *emitBatchSize *as mentioned https://apex.apache. >> org/docs/malhar/operators/fsInputOperator/ >> >> ~ Yogi >> >> On 3 April 2017 at 00:05, Ambarish Pande <[email protected]> >> wrote: >> >>> Hi, >>> >>> How can i make the AbstractFileInputOperator emit only 'x' number of >>> lines per window. Is there a hook for that. Or i have to do it manually? >>> >>> Thank You. >>> >> >> >
