Re: KafkaIO Windowing Fn

2016-08-31 Thread Gaurav Gupta
Sumit, I tried running the code you shared. I noticed that if MaxNumRecords is set to number N then KafkaIO doesn't return till it has read N messages. So either try setting a low value of MaxNumRecords or don't set it at all.. Another thing I observed was that while using anonymous DoFns I got f

Re: TextIO.Read.Bound class

2016-08-25 Thread Gaurav Gupta
l. > > On Thu, Aug 25, 2016 at 11:42 AM, Gaurav Gupta > wrote: > > > Hi All, > > > > I am new to Apache beam and I was going through the word count example. I > > found that TextIO.Read.Bound is used to read file. > > > > Should TextIO.Read.Bound not

TextIO.Read.Bound class

2016-08-25 Thread Gaurav Gupta
Hi All, I am new to Apache beam and I was going through the word count example. I found that TextIO.Read.Bound is used to read file. Should TextIO.Read.Bound not extend PTransform> instead of PTransform> similar to KafkaIO.Read and JMSIO.Read that extend PTransform>? Thanks Gaurav

Re: Dev environment set up

2016-08-16 Thread Gaurav Gupta
Chaoran, Tests annotated with @Category(NeedsRunner.class) are ignored when you run tests using maven because sdks/java/core/pom.xml is configured to do so. org.apache.beam.sdk.testing.NeedsRunner But when you run it from IDE these tests are not ignored and these tests fail. HTH. Gaurav On