[VOTE] Release 2.1.0, release candidate #3

Hi everyone, Please review and vote on the release candidate #3 for the version 2.1.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1

Re: [INFO] Build fails on master

Hi Ahmet, It's when I try to build on my machine after having updated master (I don't have the issue on the release-2.1.0 branch). Let me try to new time and let you know. Thanks, Regards JB On 08/09/2017 12:29 AM, Ahmet Altay wrote: Hey, are you referring to a specifc Jenkins build? If not

Re: [INFO] Build fails on master

Hey, are you referring to a specifc Jenkins build? If not could you share the actual error? Last python post commit test was successful ( https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Python_Verify/2887/), although the one before that failed. The failure looks like a flaked to m

Re: Proposed API for a Whole File IO

I also agree that it'll be cleaner to write your elements to files using a ParDo instead of trying to use FileBasedSink. FileBasedSink is specifically designed for writing bundles of elements to single files of a given file-type. Same goes for FileBasedSource when reading. You can use the FileSyst

Re: Exactly-once Kafka sink

I think the issue we're hitting is how to write this in Beam. Dataflow historically guaranteed checkpointing at every GBK (which due to the design of Dataflow's streaming shuffle was reasonably efficient). In Beam we never formalized these semantics, leaving these syncs in a gray area. I believe t

Re: is it ok to have a dicussion without subscribe the list

Hi Derek, If you aren't subscribed to the list then people have to manually add you back into the to: line in order for you to receive replies (I always do anyway). Subscribing (and unsubscribing) to the list is fairly straightforward, so that's what I would suggest. Best, Jason On Mon, Aug 7,

Re: Exactly-once Kafka sink

That's awesome! I will look into it more this weekend. On Tue, Aug 8, 2017 at 8:22 AM, Aljoscha Krettek wrote: > Hi, > > In Flink, there is a TwoPhaseCommit SinkFunction that can be used for such > cases: [1]. The PR for a Kafka 0.11 exactly once producer builds on that: > [2] > > Best, > Aljosc

Re: Exactly-once Kafka sink

Hi, In Flink, there is a TwoPhaseCommit SinkFunction that can be used for such cases: [1]. The PR for a Kafka 0.11 exactly once producer builds on that: [2] Best, Aljoscha [1] https://github.com/apache/flink/blob/62e99918a45b7215c099fbcf160d45aa02d4559e/flink-streaming-java/src/main/java/org/a

Re: [VOTE] Release 2.1.0, release candidate #2

+1 to releasing now and working on a fix for a follow-up release. > On 8. Aug 2017, at 06:52, Jean-Baptiste Onofré wrote: > > Hi Kenn, > > As said, I just gave an extra couple of days to Stas and I to try to fix the > issue. However, we didn't fix it yet, and I'm still struggling to find the

is it ok to have a dicussion without subscribe the list

is it ok to have a dicussion without subscribe the list?

Build failed in Jenkins: beam_Release_NightlySnapshot #498

See Changes: [owenzhang1990] [BEAM-79] add Gearpump runner [klk] move integration tests to profile [klk] add package-info.java [klk] Update Gearpump runner version to 0.3.0-incubating [klk] Rename