Modifying pip install behavior / custom pypi index

Hi all, We are running into problems trying to use our own pypi mirror with Beam. For those who are not well versed in the esotera of python package management, pip provides a few ways to specify urls for the pypi index server: - command line

DRAFT - Beam board report September 2020

Hi all, The Beam board report is technically due today. Sorry for the late notice. I will leave it open for about 24 hours for people in every time zone to hopefully have a chance to contribute. Please add suggestions to the doc:

[Proposal] Website Revamp project

Hi Beam community, In a previous thread [1] I mentioned that I was going to work on product requirements document (PRD) for a project to address some of the requests and ideas collected by Aizhamal, Rose and David in previous efforts. The PRD is ready [2], and I'd like to get your feedback

Re: [PROPOSAL] Preparing for Beam 2.25.0 release

Thanks Robin for working on this! -Rui On Wed, Sep 9, 2020 at 10:11 AM Robin Qiu wrote: > Hello everyone, > > The next Beam release (2.25.0) is scheduled to be cut on September 23 > according to the release calendar [1]. > > I'd like to volunteer myself to handle this release. I plan on

[PROPOSAL] Preparing for Beam 2.25.0 release

Hello everyone, The next Beam release (2.25.0) is scheduled to be cut on September 23 according to the release calendar [1]. I'd like to volunteer myself to handle this release. I plan on cutting the branch on that date and cherry-picking in release-blocking fixes afterwards. So unresolved

Re: PubSub MultiReader

I made the modification to fuse topics and subscriptions, I now think it may be cleaner. Attached a file with both versions. Let me know what you think :D Thanks On Wed, Sep 9, 2020 at 5:35 PM Iñigo San Jose wrote: > > Hi everyone! > > I have seen a very common use case in Beam which is

PubSub MultiReader

Hi everyone! I have seen a very common use case in Beam which is pipelines that read from multiple PubSub topics or multiple subscriptions to end up flattening them. In general, this makes the pipeline harder to understand since not much context can be taken from it. I was thinking of adding a

Re: [ANNOUNCE] New committer: Heejong Lee

Congratulations! > On 9 Sep 2020, at 09:50, Jan Lukavský wrote: > > Congratulations! > On 9/9/20 1:00 AM, Chamikara Jayalath wrote: >> Congrats Heejong! >> >> On Tue, Sep 8, 2020 at 1:55 PM Yichi Zhang > > wrote: >> Congratulations Heejong! >> >> On Tue, Sep 8, 2020

Re: Enabling checkpointing while running Flink Runner

> But, from the configuration, there is no way to pass the checkpoint interval. Set the checkpointingInterval pipeline option. https://beam.apache.org/documentation/runners/flink/ On Wed, Sep 9, 2020 at 4:44 AM Sruthi Sree Kumar wrote: > Hi, > > How do we enable checkpointing for Flink

Enabling checkpointing while running Flink Runner

Hi, How do we enable checkpointing for Flink Runner? To enable checkpointing, we set the checkpoint interval But, from the configuration, there is no way to pass the checkpoint interval. We are trying to enable checkpointing while running NEXMark queries as part of our experiments. -- Regards,

Re: [ANNOUNCE] New committer: Heejong Lee

Congratulations! On 9/9/20 1:00 AM, Chamikara Jayalath wrote: Congrats Heejong! On Tue, Sep 8, 2020 at 1:55 PM Yichi Zhang > wrote: Congratulations Heejong! On Tue, Sep 8, 2020 at 1:42 PM Ankur Goenka mailto:goe...@google.com>> wrote: