Re: Jenkins jobs not running for my PR 10438

Hi Beam Committer, I appreciate if someone could trigger jobs for https://github.com/apache/beam/pull/10712. Thanks! *Shoaib Zafar* Software Engineering Lead Mobile: +92 333 274 6242 Skype: live:shoaibzafar_1 On Thu, Jan 30, 2020 at 9:09 AM Boyuan Zhang wrote: > D

[BEAM-8550] @RequiresTimeSortedInput ready for merge to master

Hi, PR [1] (issue [2]) went though code review, and according to [3] seems to me to be ready for merge. Current state of the implementation is that it is supported only for direct runner, legacy flink runner (batch and streaming) and legacy spark (batch). It could be supported by all other (s

2nd Apache Beam Meetup in Warsaw

Hi there, we're organizing the second Apache Beam Meetup in Warsaw! It's going to take place on 20th February in our office. We're looking for speakers, so if anyone is interested in sharing some knowledge - let me know and I'll pass it on to the people in charge of organization :) here's the Meet

Re: A new reworked Elasticsearch 7+ IO module

Hi Ludovic, First of all thanks for your work. Then, please be aware that the current ES IO on master supports ES7 already and will be part of Beam 2.19. I understand that your approach enables many new features which is great ! For the record, the current ES module was designed to have only

Re: 2nd Apache Beam Meetup in Warsaw

Adding user@ :) On Thu, Jan 30, 2020, 5:05 AM Michał Walenia wrote: > Hi there, > we're organizing the second Apache Beam Meetup in Warsaw! It's going to > take place on 20th February in our office. We're looking for speakers, so > if anyone is interested in sharing some knowledge - let me know

Re: A new reworked Elasticsearch 7+ IO module

I’m second for this question. We have a similar (maybe a bit less painful) issue for KafkaIO and it would be useful to have a general strategy for such cases about how to deal with that. > On 24 Jan 2020, at 21:54, Kenneth Knowles wrote: > > Would it make sense to have different version-specia

Re: Jenkins jobs not running for my PR 10438

done On Thu, Jan 30, 2020 at 12:28 AM Shoaib Zafar wrote: > Hi Beam Committer, > > I appreciate if someone could trigger jobs for > https://github.com/apache/beam/pull/10712. > > Thanks! > > *Shoaib Zafar* > > Software Engineering Lead > Mobile: +92 333 274 6242 > Skype: live:shoaibzafar_1 > > <

Re: flaky WordCountIT.testE2EWordCount in Jenkins Java_Examples_Dataflow Job

Logs don't provide any insight. There has been an issue with streaming engine that has been impacting availability over the past few days which might be the cause. This is the entirety of the logs: I 2020-01-28T18:12:05.491Z Loading pipeline options from /var/opt/google/dataflow/pipeline_options.j

Re: flaky WordCountIT.testE2EWordCount in Jenkins Java_Examples_Dataflow Job

Luke, Thank you for checking. Then I'll wait a day or two before retrying. On Thu, Jan 30, 2020 at 1:54 PM Luke Cwik wrote: > > Logs don't provide any insight. There has been an issue with streaming engine > that has been impacting availability over the past few days which might be > the cause.

Extending the Beam IO connectors, how to best share the code

Dear Beam dev team, Our company (www.cognite.com) offers software that is heavily based on data I/O. As such, we find Beam a very useful framework for building data pipelines that read/write to our software. We have built a set of Beam connectors that we (internally per now) use as an extension to

Re: Extending the Beam IO connectors, how to best share the code

Are you looking to contribute your IO connectors to be part of Apache Beam and have the Apache Beam community build/maintain/extend/release them or are you looking to have your own repository and release process? On Thu, Jan 30, 2020 at 11:15 AM Kjetil Halvorsen < kjetil.halvor...@cognite.com> wro

Re: [DISCUSS][PROPOSAL] Improvements to the Apache Beam website

Thank you all for your feedback. If no one has objections, I will continue working according to the plan. I will be sharing the progress updates in the dev list. Thanks, Aizhamal On Tue, Jan 28, 2020 at 7:42 PM Kenneth Knowles wrote: > Technical clarification: Docsy is a set of templates for Hu

Re: Release 2.19.0, release candidate #1

+1 -- Verified web page / blog post changes. Thank you for building this RC and pre-validating a large number of tests. On Wed, Jan 29, 2020 at 9:03 PM Boyuan Zhang wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version > 2.19.0, as follows: > [ ] +1, Approve