Re: Looping timer blog

On Fri, 21 Jun 2019 at 18:02, Jan Lukavský wrote: > Hi Reza, > > great prezentation on the Beam Summit. I have had a few posts here in the > list during last few weeks, some of which might actually be related to both > looping timers and validity windows. But maybe you will be able to see a >

Re: Testing code in extensions against runner

So if I understood correctly; Emulate the SQL precommit / postcommit extension and incorporate running the test against different runners. Would be snazzy indeed! A bit beyond my skill set I fear :-) On Wed, 19 Jun 2019 at 10:34, Kenneth Knowles wrote: > Slight point here: @ValidatesRunner

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Thomas thank you for sharing this Congratulations on this Mikhail!!! On Mon, Jun 24, 2019 at 3:19 PM Kai Jiang wrote: > Congrats! > > On Mon, Jun 24, 2019 at 1:46 PM Chamikara Jayalath > wrote: > >> Congrats!! >> >> On Mon, Jun 24, 2019 at 11:12 AM Mikhail Gryzykhin >> wrote: >> >>>

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Congrats! On Mon, Jun 24, 2019 at 1:46 PM Chamikara Jayalath wrote: > Congrats!! > > On Mon, Jun 24, 2019 at 11:12 AM Mikhail Gryzykhin > wrote: > >> Thank you everyone. >> >> On Mon, Jun 24, 2019 at 2:28 AM Aizhamal Nurmamat kyzy < >> aizha...@google.com> wrote: >> >>> Congrats Misha! >>> >>>

Change of Behavior - JDBC Set Command

Hi all, I am writing to ask if it is OK to slightly change the behaviour of SET command in JDBC connection of Beam SQL. Currently, if we try to use set command for an option that does not exist or setting an option to an illegal value, it does not show any error until we run a query. This means

Re: [POPOSAL] Integrate BigQuery-compatible HyperLogLog algorithm into Beam

Thanks for bringing this Robin, Can you please add this to the design documents webpage. https://beam.apache.org/contribute/design-documents/ Let some comments in the doc, It is great that this is finally open and even better that it becomes part of Beam. I am not sure if this feature should go

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Congrats!! On Mon, Jun 24, 2019 at 11:12 AM Mikhail Gryzykhin wrote: > Thank you everyone. > > On Mon, Jun 24, 2019 at 2:28 AM Aizhamal Nurmamat kyzy < > aizha...@google.com> wrote: > >> Congrats Misha! >> >> On Mon, Jun 24, 2019 at 11:23 Łukasz Gajowy wrote: >> >>> Congratulations Mikhail!

Re: [VOTE] Release vendored artifacts upgrading Guava usage to 26.0-jre, release candidate #1

The upgrade is worth for security reasons and to catch the gRPC improvements so really nice that this is happening. However I am not clear if we are mixing two things here. (1) The release of the vendored versions and (2) the upgrade of it into Beam. I think those should be separate (obviously

Re: [POPOSAL] Integrate BigQuery-compatible HyperLogLog algorithm into Beam

Thanks Robin! It would also be interesting if we could offer HLL_COUNT functions in BeamSQL based on your proposal! -Rui On Mon, Jun 24, 2019 at 10:47 AM Robin Qiu wrote: > Hi all, > > I have written a doc > >

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Thank you everyone. On Mon, Jun 24, 2019 at 2:28 AM Aizhamal Nurmamat kyzy wrote: > Congrats Misha! > > On Mon, Jun 24, 2019 at 11:23 Łukasz Gajowy wrote: > >> Congratulations Mikhail! >> >> pt., 21 cze 2019 o 22:09 Ruoyun Huang napisał(a): >> >>> Congratulations! Mikhail! >>> >>> >>> On Fri,

[POPOSAL] Integrate BigQuery-compatible HyperLogLog algorithm into Beam

Hi all, I have written a doc proposing we integrate the HyperLogLog++ algorithm into Beam as a new combiner. The algorithm

Re: PTransform.expand() guarantees

On 21 Jun 2019, at 19:12, Lukasz Cwik wrote: > This question was triggered by one issue in KinesisIO [1] where we did quite > expensive check that stream exists in Write.expand() (calling backend Kinesis > for that) and, according to issue reporter, it was called several times, > though I

Re: Pull panda

Add onto that I feel the codecov github integration might be valuable for beam as can show code coverage on pull requests. https://github.com/marketplace/codecov https://codecov.io/ On Mon, Jun 24, 2019 at 3:01 AM Łukasz Gajowy wrote: > Hi all, > > I just came across this thing called Pull

Re: pipeline status tracing

I see. This was discussed in this thread [1] - however looks like nobody has picked it up yet. [1] https://lists.apache.org/thread.html/235b1f683ef0eee66934fdf0908b3b85ed4e7d3627cbcfcf12b27de4@%3Cuser.beam.apache.org%3E On Sun, Jun 23, 2019 at 4:06 AM Chaim Turkel wrote: > i am writing to

Beam Dependency Check Report (2019-06-24)

High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue google-cloud-core 0.29.1 1.0.2

Re: [Discuss] Ideas for Apache Beam presence in social media

On Fri, Jun 21, 2019 at 1:02 PM Thomas Weise wrote: > > From what I understand, spreadsheets (not docs) provide the functionality > that we need: https://support.google.com/docs/answer/91588 > > Interested PMC members can subscribe and react to changes in the spreadsheet. > > Lazy consensus

Re: Assigning Reviewers in GitHub?

This is unfortunate, as the reviewers pulldown at least gives some reasonable suggestions for new users (which is why I suggested it). But, yes, R: @ is the convention. On Fri, Jun 21, 2019 at 5:56 PM Lukasz Cwik wrote: > > Only a few people have permission to update the 'Reviewers' section and

Pull panda

Hi all, I just came across this thing called Pull Panda [1], [2]. It's now available in Github marketplace for free. To me, the "Pull reminder" feature looks the most interesting form beam's perspective. Maybe it could mitigate some delays that we sometimes have in pull requests reviews. Pull

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Congrats Misha! On Mon, Jun 24, 2019 at 11:23 Łukasz Gajowy wrote: > Congratulations Mikhail! > > pt., 21 cze 2019 o 22:09 Ruoyun Huang napisał(a): > >> Congratulations! Mikhail! >> >> >> On Fri, Jun 21, 2019 at 1:00 PM Yichi Zhang wrote: >> >>> Congrats! >>> >>> On Fri, Jun 21, 2019 at 11:55

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

Congratulations Mikhail! pt., 21 cze 2019 o 22:09 Ruoyun Huang napisał(a): > Congratulations! Mikhail! > > > On Fri, Jun 21, 2019 at 1:00 PM Yichi Zhang wrote: > >> Congrats! >> >> On Fri, Jun 21, 2019 at 11:55 AM Tanay Tummalapalli >> wrote: >> >>> Congratulations! >>> >>> On Fri, Jun 21,