Re: Hello Beam Community!

Welcome! On Sat, 14 Mar 2020, 01:27 Tomo Suzuki, wrote: > Welcome. > > On Fri, Mar 13, 2020 at 1:20 PM Udi Meiri wrote: > >> Welcome! >> >> >> On Fri, Mar 13, 2020 at 9:47 AM Yichi Zhang wrote: >> >>> Welcome! >>> >>> On Fri, Mar 13, 2020 at 9:40 AM Ahmet Altay wrote: >>> Welcome

Re: Letting workers fetch AWS keys for Kinesis

Streaming pipelines on Dataflow have a limitation where all initial splitting[1] of the UnboundedSource is done upfront at pipeline creation time. This has been a 5+ year issue. The recent development in this space has been to use Splittable DoFns that wrap UnboundedSources[2] and this would move

Contributor permission for Beam Jira tickets

Hi Everyone, This is Anup from GE. I would like to contribute to this amazing project. Can someone add me as a contributor for Beam's Jira issue tracker? I would like to assign/create tickets to work on. Thanks, Anup

Re: Java SplittableDoFn Watermark API

Using the interfaces defined in pr/10992[1], I started migrating from ProcessContext#updateWatermark to the WatermarkEstimators with pr/11126[2]. The PR is very WIP but it does include the necessary changes to the Watch transform and also the UnboundedSource SDF wrapper to be able to report

Re: Autolink references for Apache Beam

Thanks Kyle for catching that, I pinged INFRA again hopefully it will be working soon. On Fri, Mar 13, 2020 at 8:49 PM Kyle Weaver wrote: > > Sounds like a really cool feature! However, it doesn't seem to work: links > are missing the BEAM- prefix, e.g.

Letting workers fetch AWS keys for Kinesis

Hi, We're running a Beam job in Dataflow that reads inputs from KinesisIO. Right now it works if we pass the AWS keys to the job like so: p.apply(KinesisIO.read() // ... .withAWSClientsProvider("AWS_KEY", "AWS_SECRET", STREAM_REGION) .apply( ... )); Instead of passing the AWS keys

Re: [VOTE + INPUT] Beam Mascot Designs, 1st iteration - Deadline Wed March 18

Nice! 1. Personally, I especially want it to be something easy for people to draw and improvise in new poses / situations. Here is the sheet about the Go Gopher that is about what I am thinking about, and amusing: https://golang.org/doc/gopher/modelsheet.jpg. I think your slides do a really good

Re: Autolink references for Apache Beam

Sounds like a really cool feature! However, it doesn't seem to work: links are missing the BEAM- prefix, e.g. https://issues.apache.org/jira/browse/9475 On Fri, Mar 13, 2020 at 12:42 PM Ismaël Mejía wrote: > Github released some months ago a new feature to configure Autolink > references > for

Autolink references for Apache Beam

Github released some months ago a new feature to configure Autolink references for Apache Beam a new github feature to have automatic links to issues in external systems e.g. JIRA for our case. https://github.blog/2019-10-14-introducing-autolink-references/ For info I filled INFRA-19967 to

Re: [VOTE + INPUT] Beam Mascot Designs, 1st iteration - Deadline Wed March 18

Thank you Julian! Here is the link to the slides https://docs.google.com/presentation/d/1cEydTxQcsTJES_JCRvC_xgK7HMCIfnxmuawd7x2Bk_o/edit?usp=sharing On Fri, Mar 13, 2020 at 12:25 PM Julian Bruno wrote: > Hello Apache Beam Community, > > > Together with Aizhamal and her team, we have been

[VOTE + INPUT] Beam Mascot Designs, 1st iteration - Deadline Wed March 18

Hello Apache Beam Community, Together with Aizhamal and her team, we have been working on the design of the Apache Beam mascot. We now need input from the community to continue moving forward with the design. Please share your input no later than Wednesday, March 18, at noon Pacific Time. Below

Re: Hello Beam Community!

Welcome. On Fri, Mar 13, 2020 at 1:20 PM Udi Meiri wrote: > Welcome! > > > On Fri, Mar 13, 2020 at 9:47 AM Yichi Zhang wrote: > >> Welcome! >> >> On Fri, Mar 13, 2020 at 9:40 AM Ahmet Altay wrote: >> >>> Welcome Brittany! >>> >>> On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann >>> wrote:

Re: Hello Beam Community!

Welcome! On Fri, Mar 13, 2020 at 9:47 AM Yichi Zhang wrote: > Welcome! > > On Fri, Mar 13, 2020 at 9:40 AM Ahmet Altay wrote: > >> Welcome Brittany! >> >> On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann >> wrote: >> >>> Hello Beam Community! >>> >>> My name is Brittany Hermann and I

Re: Hello Beam Community!

Welcome! On Fri, Mar 13, 2020 at 9:40 AM Ahmet Altay wrote: > Welcome Brittany! > > On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann > wrote: > >> Hello Beam Community! >> >> My name is Brittany Hermann and I recently joined the Open Source team in >> Data Analytics at Google. As a Program

Re: Hello Beam Community!

Welcome Brittany! On Thu, Mar 12, 2020 at 6:32 PM Brittany Hermann wrote: > Hello Beam Community! > > My name is Brittany Hermann and I recently joined the Open Source team in > Data Analytics at Google. As a Program Manager, I will be focusing on > community engagement while getting to work on

Re: Request to be added as Jira contributor

Thanks! :) On 2020/03/12 19:14:43, Ahmet Altay wrote: > Done. Welcome! > > On Wed, Mar 11, 2020 at 1:51 PM Piotr Szuberski > wrote: > > > *Hi, my name is Piotr. I am interested in contributing java sdk to the > > Apache Beam SDK. I'd like to be added **as a Jira contributor so that I > > can