Invitation: Beam Community Meetup @ Thu Sep 22, 2022 11:30am - 12:30pm (CDT) (dev@beam.apache.org)

2022-09-12 Thread hello
BEGIN:VCALENDAR PRODID:-//Google Inc//Google Calendar 70.9054//EN VERSION:2.0 CALSCALE:GREGORIAN METHOD:REQUEST BEGIN:VEVENT DTSTART:20220922T163000Z DTEND:20220922T173000Z DTSTAMP:20220912T204000Z ORGANIZER;CN=Clowder Events:mailto:c_m8k910vjcu6b4b7udo0kngo4d4@group.calen dar.google.com UID:1c9cv

Re: Rest connector

2022-09-12 Thread John Casey via dev
We don't have a generic REST API IO at the moment. There has been some discussion, but as far as I know there haven't been any IOs developed. A factor here is that most http based services aren't strictly REST, which makes the development of an easy to use, but sufficiently generic, IO challengin

Re: Rest connector

2022-09-12 Thread Ahmet Altay via dev
/cc @John Casey On Mon, Sep 12, 2022 at 12:03 PM Reddy annapureddy, Vijayas (V.) < vredd...@ford.com> wrote: > Hi Team, > > We are planning to use Apache beam for a new microservice project which is > in the discovery phase. Apache beam pipeline will read data from GCS and > send data to other

Rest connector

2022-09-12 Thread Reddy annapureddy, Vijayas (V.)
Hi Team, We are planning to use Apache beam for a new microservice project which is in the discovery phase. Apache beam pipeline will read data from GCS and send data to other microservice via REST API. Wanted to check if there is any connector already in place for this use case. Thanks, Vija

Re: Pass Custom namespaces to RunInference metrics

2022-09-12 Thread Danny McCormick via dev
Thanks for writing this up Anand! I agree with you (and Andy) that solution 1 is the best path forward. Thanks, Danny On Mon, Sep 12, 2022 at 2:11 PM Andy Ye via dev wrote: > Thanks Anand for the great summary! > > I'm leaning towards (solution 1) to allow users to pass in a custom > namespace

Re: Pass Custom namespaces to RunInference metrics

2022-09-12 Thread Andy Ye via dev
Thanks Anand for the great summary! I'm leaning towards (solution 1) to allow users to pass in a custom namespace for full user control. If there needs to be a certain grouping or ordering of the metrics, the onus should be on the user to add an appropriate grouping prefix such as 'RunInference_'

Pass Custom namespaces to RunInference metrics

2022-09-12 Thread Anand Inguva via dev
Hi all, I created a doc [1] to outline a few solutions on how to pass custom namespace to the RunInference[2] transform for better tracking and usage of metrics. Please go through it and let me know w

Re: Beam Website Feedback

2022-09-12 Thread Kenneth Knowles
+Reza Rokni do you know about the slowly updating side input window documentation? Do you know who might? On Mon, Sep 12, 2022 at 8:19 AM Peter McArthur wrote: > There are a couple issues with the python SDK and side input patterns page > here > https://beam.apache.org/documentation/patterns/si

Beam Website Feedback

2022-09-12 Thread Peter McArthur
There are a couple issues with the python SDK and side input patterns page here https://beam.apache.org/documentation/patterns/side-inputs/ 1. Slowly updating global window side input doesn’t have a python example 2. Slowly updating side input using windows doesn’t have enough code to run the pyt

Beam High Priority Issue Report (67)

2022-09-12 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/23179 [Bug]: Parquet size