Re: Report to the Board, June 2017 edition

Thanks everyone; the report is now submitted. On Tue, Jun 13, 2017 at 7:47 AM, Davor Bonaci wrote: > We are expected to submit a project report to the ASF Board of Directors > ahead of its next meeting. The report is due on Wednesday, 6/14. > > If interested, please take a look at the draft [1],

Re: [DISCUSS] Bundle in Flink Runner

Hi, Thanks for summarising everything that was discussed so far and also for coming up with a good implementation plan! The plan looks good, it will unblock proper bundle support on Beam because we cannot wait for Flink to support bundles the way we like it. I also want to quickly highlight t

TextIO - writing to directory, possible problem

Hi everyone, lost some time figuring out why TextIO is not writing data for me. I have this: stringsPCollection.apply(Window.into(FixedWindows.of(Duration.standardSeconds(5 .apply("WritingToOutput", TextIO.write().withWindowedWrites().withFilenamePolicy(new WindowedFilenamePolicy("my

Re: [DISCUSS] Bundle in Flink Runner

Thanks Aljoscha,  I will add these related links to the docs. Best, JingsongLee -- From:Aljoscha Krettek Time:2017 Jun 14 (Wed) 20:56 To:dev ; JingsongLee Subject:Re: [DISCUSS] Bundle in Flink Runner Hi, Thanks for summarising everyt

Re: TextIO - writing to directory, possible problem

This looks wrong, filed https://issues.apache.org/jira/browse/BEAM-2448 On Wed, Jun 14, 2017 at 6:16 AM, Borisa Zivkovic wrote: > Hi everyone, > > lost some time figuring out why TextIO is not writing data for me. > > I have this: > > stringsPCollection.apply(Window.into(FixedWindows.of(Duration

Rewind back tuple timestamp in DoFn

Hi, I saw the DoFn#getAllowedTimestampSkew has been marked as deprecated. What if a user does want to rewind back the timestamp without violating the watermark? Consider the case where there is a GroupByKey followed by a ParDo. The GroupByKey transform groups tuples into one-hour windows. Say, ea