Re: release process: typescript SDK?

2024-04-29 Thread Austin Bennett
secret contents, and (b) opened > a JIRA to externally track progress - > https://issues.apache.org/jira/browse/INFRA-25009 > > On Wed, Apr 17, 2024 at 11:24 AM Austin Bennett wrote: > >> I don't mind doing, esp. if nobody is eager to handle/prioritize the push >>

Survey/Pulse: Beam on Flink/Spark/Samza/etc

2024-04-29 Thread Austin Bennett
Curious who all is using Beam on runners other than dataflow. Please respond either on-list or to me directly ... Mostly just curious the extent of whether Beam is fulfilling its promise of runner agnosticism. Getting good data on that is hard, so anecdotes would be very welcomed!

Re: release process: typescript SDK?

2024-04-17 Thread Austin Bennett
x27;ll also note that we don't do any typescript validation today, and it >> would be nice to publish RCs as part of this >> >> On Tue, Apr 16, 2024 at 4:11 PM Austin Bennett wrote: >> >>> Hi Beam Devs, >>> >>> Calling out it looks like our

release process: typescript SDK?

2024-04-16 Thread Austin Bennett
Hi Beam Devs, Calling out it looks like our release process for apache-beam for typescript/npm is broken, seemingly the last published release was 2.49.0 about 9 months ago. The other languages look like they are publishing to expected locations. https://www.npmjs.com/package/apache-beam I noti

Re: tox issues in dev container

2024-04-10 Thread Austin Bennett
based on 'devcontainer', I assume running in/via: https://containers.dev/ ? On Fri, Apr 5, 2024 at 3:46 PM XQ Hu via dev wrote: > always pin the versions as well. > > On Fri, Apr 5, 2024 at 5:24 PM Valentyn Tymofieiev via dev < > dev@beam.apache.org> wrote: > >> Could you please provide more in

Re: Adding Dead Letter Queues to Beam IOs

2023-11-12 Thread Austin Bennett
This will eventually be a great addition to aid usability -- thanks for starting to think through and address, John! On Fri, Nov 10, 2023, 10:54 AM Danny McCormick via dev wrote: > Thanks - the general ideas seem solid, I added some questions/comments as > well. > > On Fri, Nov 10, 2023 at 1:3

Re: [VOTE] Release 2.52.0, release candidate #4

2023-11-12 Thread Austin Bennett
Danny: The rc # differs between the subject [ #4 ] and the first sentence of your email [ #3 ]. I think we can assume this is a VOTE to match the subject and is for RC #4 , but wanted to call that out. Cheers, Austin On Sat, Nov 11, 2023, 3:44 PM Danny McCormick via dev wrote: > Hi everyone

Lakehouse Formats with IO/Integration --> Hudi? Iceberg?

2023-11-06 Thread Austin Bennett
Beam Devs, I was looking through GH Issue and online more generally and hadn't seen much... Has anyone written any Beam IO or other integration for writing to [ or reading from ] either Hudi or Iceberg? Any experience that can be shared [ on list, else feel free to message me off list and I'll a

Re: [Discuss] Idea to increase RC voting participation

2023-10-17 Thread Austin Bennett
Great effort. I'm also interested in streamlining releases -- so if there are alot of manual tests that could be automated, would be great to discover and then look to address. On Tue, Oct 17, 2023 at 8:47 AM Robert Bradshaw via dev wrote: > +1 > > I would also strongly suggest that people try

Re: [ANNOUNCE] New Committer: Sam Whittle

2023-10-16 Thread Austin Bennett
Thanks, Sam! On Mon, Oct 16, 2023 at 12:39 PM XQ Hu via dev wrote: > Congratulations! > > On Mon, Oct 16, 2023 at 1:58 PM Ahmet Altay via dev > wrote: > >> Congratulations Sam! >> >> On Mon, Oct 16, 2023 at 10:42 AM Byron Ellis via dev >> wrote: >> >>> Congrats Sam! >>> >>> On Mon, Oct 16, 202

Re: [ANNOUNCE] New Committer: Byron Ellis

2023-10-16 Thread Austin Bennett
thanks, Byron! On Mon, Oct 16, 2023 at 12:38 PM XQ Hu via dev wrote: > Congratulations! > > On Mon, Oct 16, 2023 at 1:58 PM Ahmet Altay via dev > wrote: > >> Congratulations Byron! >> >> On Mon, Oct 16, 2023 at 10:35 AM Tomo Suzuki via dev >> wrote: >> >>> Congratulations! >>> >>> >>> On Mon,

Re: [ANNOUNCE] New PMC Member: Valentyn Tymofieiev

2023-10-03 Thread Austin Bennett
Thanks for everything @Valentyn Tymofieiev ! On Tue, Oct 3, 2023 at 12:53 PM Ahmed Abualsaud wrote: > Congrats Valentyn! > > On 2023/10/03 18:39:49 Kenneth Knowles wrote: > > Hi all, > > > > Please join me and the rest of the Beam PMC in welcoming Valentyn > > Tymofieiev as our newest PMC memb

Re: [ANNOUNCE] New PMC Member: Robert Burke

2023-10-03 Thread Austin Bennett
Thanks for all you do @Robert Burke ! On Tue, Oct 3, 2023 at 12:53 PM Ahmed Abualsaud wrote: > Congrats Rebo! > > On 2023/10/03 18:39:47 Kenneth Knowles wrote: > > Hi all, > > > > Please join me and the rest of the Beam PMC in welcoming Robert Burke < > > lostl...@apache.org> as our newest PMC

Re: [ANNOUNCE] New PMC Member: Alex Van Boxel

2023-10-03 Thread Austin Bennett
Thanks for all you do, @Alex Van Boxel ! On Tue, Oct 3, 2023 at 12:50 PM Ahmed Abualsaud via dev wrote: > Congratulations! > > On Tue, Oct 3, 2023 at 3:48 PM Byron Ellis via dev > wrote: > >> Congrats! >> >> On Tue, Oct 3, 2023 at 12:40 PM Danielle Syse via dev < >> dev@beam.apache.org> wrote:

Re: Contribution of Asgarde: Error Handling for Beam?

2023-09-20 Thread Austin Bennett
but the community and to help the community. >> If the best solution to help the community is including the library >> directly on Beam, we can go in this direction, with of course your reviews >> and recommendations. >> >> Then the library will belong to the co

Re: Contribution of Asgarde: Error Handling for Beam?

2023-09-11 Thread Austin Bennett
;>> (2) run this workflow >>>>>>>> <https://github.com/tosun-si/asgarde/blob/main/.github/workflows/publish-project.yml>, >>>>>>>> and (3) tag/mark the release as released on GitHub. >>>>>>>> >>>>>>>

Contribution of Asgarde: Error Handling for Beam?

2023-09-02 Thread Austin Bennett
bstraction > for error handling. > Kerry > > On Wed, Jun 14, 2023, 6:31 PM Austin Bennett wrote: > >> Hi Beam Devs, >> >> @Mazlum <https://www.linkedin.com/in/mazlum-tosun-900b1812/> was >> suggested to consider donating Asgarde >> <https://gi

Re: Proposal for pyproject.toml Support in Apache Beam Python

2023-08-28 Thread Austin Bennett
I've thought about this a ton, but haven't been in a position to undertake the work. Thanks for bringing this up, @Anand Inguva ! I'd point us to https://python-poetry.org/ ... [ which is where I'd look take us, but I'm also not able to do all the work, so my suggestion/preference doensn't matt

Asgarde: Error Handling for Beam?

2023-06-14 Thread Austin Bennett
Hi Beam Devs, @Mazlum was suggested to consider donating Asgarde to Beam for Java/Kotlin error handling to Beam [ see: https://2022.beamsummit.org/sessions/error-handling-asgarde/ for last year's Beam Summit

Re: [beam-starter-typescript]: Missing place to create issue

2023-06-14 Thread Austin Bennett
A few additional thoughts: * @Anyone --> Should each starter repo allow issues? Or, better to file issues in https://github.com/apache/beam/issues ? * @david-kh...@hotmail.com -- I'd say in general PRs are likely welcome. * Seems like Contributing.md should get updated. The text linking to is

Re: [VOTE] Release 2.47.0, release candidate #3

2023-05-05 Thread Austin Bennett
+1 ( non-binding ) On Fri, May 5, 2023 at 10:49 PM Jean-Baptiste Onofré wrote: > +1 (binding) > > Regards > JB > > On Fri, May 5, 2023 at 4:52 AM Jack McCluskey via dev > wrote: > >> Hi everyone, >> >> Please review and vote on the release candidate #3 for the version >> 2.47.0, as follows: >>

Re: [LAZY CONSENSUS] Drop @Experimental annotations and concept from Beam

2023-05-01 Thread Austin Bennett
great, thanks, @* Kenneth Knowles ! On Mon, May 1, 2023 at 10:12 AM Kenneth Knowles wrote: > We are well past the lazy consensus. I will remove the @Experimental > annotations and concept from Beam. > > Kenn > > On Tue, Apr 25, 2023 at 3:40 PM Kenneth Knowles wrote: > >> Hello! >> >> I propose

Re: [ANNOUNCE] New committer: Anand Inguva

2023-04-25 Thread Austin Bennett
Thanks, and Congratulations, Anand! On Tue, Apr 25, 2023 at 8:12 AM Reza Rokni via dev wrote: > Congratulations! > > On Tue, Apr 25, 2023 at 3:48 AM Alexey Romanenko > wrote: > >> Congratulations, Anand! Well deserved! >> >> On 25 Apr 2023, at 06:02, Byron Ellis via dev >> wrote: >> >> Congrat

Re: [ANNOUNCE] New committer: Damon Douglas

2023-04-24 Thread Austin Bennett
thanks for all you do @Damon Douglas ! On Mon, Apr 24, 2023 at 1:00 PM Robert Burke wrote: > Congratulations Damon!!! > > On Mon, Apr 24, 2023, 12:52 PM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Damon Douglas (damondo

Re: new contributor messaging: behaviorbot/welcome

2023-03-06 Thread Austin Bennett
reate-tickets and copy any individual from PMC specifically. Once that's done, we can merge the code for the bot to be configured - imagining that is a better second step, so we do not have code in the codebase that doesn't do anything. On Tue, Feb 21, 2023 at 8:42 PM Austin Bennett wrote:

Re: new contributor messaging: behaviorbot/welcome

2023-02-21 Thread Austin Bennett
osal of what the content (and triggers) would >> be. >> >> On Tue, Feb 21, 2023 at 1:36 PM Austin Bennett >> wrote: >> > >> > It is fantastic if generally able to address welcoming newcomers >> manually [ @Robert Burke ! ] . Community communication, hu

Re: [ANNOUNCE] New PMC Member: Jan Lukavský

2023-02-21 Thread Austin Bennett
Thanks, Jan, for all the ways you've contributed to the community! On Tue, Feb 21, 2023 at 8:06 PM Ahmet Altay via dev wrote: > Congratulations Jan! > > On Fri, Feb 17, 2023 at 4:52 AM Jan Lukavský wrote: > >> Thanks everyone! >> >> This is great honor, I'm grateful for the support of the Apach

Re: new contributor messaging: behaviorbot/welcome

2023-02-21 Thread Austin Bennett
orkflow using an if/else and > actions/comment-pull-request for the pr merge comment, that is probably > more trouble than it is worth though (>10 lines of code for something that > can just be config). > >>> > >>> > And/or since I imagine you might know

Re: new contributor messaging: behaviorbot/welcome

2023-02-21 Thread Austin Bennett
ns which are all actions based > > The only con I see: > - actions/first-interaction doesn't support PR merge messages ( > https://github.com/behaviorbot/welcome#first-pr-merge) > > If you put up a PR for `first-interaction`, I'm happy to review/merge > (barring

new contributor messaging: behaviorbot/welcome

2023-02-20 Thread Austin Bennett
Hi Devs, I'd like us to consider adding behaviorbot , and specifically behaviorbot/welcome to beam's repo. This will allow us to easily have a bit of messaging to new contributors. Ex: on first issue creation and/or first P

Fwd: [NOTICE] Upcoming global changes to default GitHub Actions behavior for outside collaborators

2023-02-13 Thread Austin Bennett
FYI - I am not sure this is overly concerning, but wanted to ensure people had seen -- Forwarded message - From: Daniel Gruno Date: Mon, Feb 13, 2023, 11:49 AM Subject: [NOTICE] Upcoming global changes to default GitHub Actions behavior for outside collaborators To: To Project

Re: [Go SDK] Direct Runner Replacement: Prism

2023-02-09 Thread Austin Bennett
Thanks for the work on this; a very welcomed feature/contribution! On Thu, Feb 9, 2023 at 7:36 AM Jack McCluskey via dev wrote: > Congratulations on getting the runner to a state you're happy contributing > to the main repo! I'm happy to help review PRs and get sub-packages in. > Anything that h

Re: [fyi] Updating ip address for Playground staging

2023-02-01 Thread Austin Bennett
[ Happy New Year ] Pablo, I imagine there shouldn't be an issue with changing regions, esp. in a testing environment ( verifying this is actually testing, which is distinct from production as served from an account with a 'testing' name :-) ). Though, it seems likely that you'll also want to updat

Re: How to write an IO guide draft

2023-01-10 Thread Austin Bennett
This is great, thanks for putting this together! A related question: are we as a community targeting java to be the canonical/target IO language if an IO does not currently exist? If that is not the case, then I would imagine we are hoping that we might eventually also wind up with good examples

Re: A Declarative API for Apache Beam

2022-12-16 Thread Austin Bennett
Seems a worthwhile addition which can expand the community by making Beam increasingly accessible to additional users and for more use-cases. A bit of a tangent, since commenting on @Byron Ellis 's part, but ... Ensuring some have also seen Dataform [ ex: https://cloud.google.com/dataform/docs/ov

Re: [DISCUSSION][JAVA] Current state of Java 17 support

2022-11-29 Thread Austin Bennett
-1 for ongoing Java8 support [ or, said another way, +1 for dropping support of Java8 ] +1 for having tests that run for ANY JDK that we say we support. Is there any reason the resources to support are too costly [ or outweigh the benefits of additional confidence in ensuring we support what we s

Re: bhulette stepping back (for now)

2022-11-11 Thread Austin Bennett
Thanks for everything you've done, @bhule...@apache.org! On Fri, Nov 11, 2022 at 11:01 AM Pablo Estrada via dev wrote: > I promised I wouldn't cry so I won't. Cya! > > On Fri, Nov 11, 2022 at 10:46 AM Robin Qiu via dev > wrote: > >> Thanks for your contribution Brian! Hope you enjoy your new te

Re: [DISCUSS] Avro dependency update, design doc

2022-11-11 Thread Austin Bennett
ct instead of core. > > > > Though, if we accept that this breaking change at compile time is > allowable, then this process of transition should be much faster and can be > performed within only one Beam release. Our main concern here is runtime > breaking changes that we can miss b

Re: [Python][Bikeshed] typehint vs. type-hint vs. "type hint"

2022-11-09 Thread Austin Bennett
+1 And, well articulated, @Robert Burke ! On Wed, Nov 9, 2022 at 10:43 AM Robert Burke wrote: > +1 to standardizing on "type hint" > > I learned that there's a rule in English that defines when one would have > a space in a compound word or not. If removing one of the components would > change

Re: [ANNOUNCE] New committer: Yi Hu

2022-11-09 Thread Austin Bennett
Congrats, and Thanks, Yi! On Wed, Nov 9, 2022 at 11:24 AM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > I am with the Beam PMC on this, congratulations and very well deserved, Yi! > > On Wed, Nov 9, 2022 at 11:08 AM Byron Ellis via dev > wrote: > >> Congratulations! >> >> On Wed, N

Re: [DISCUSS] Avro dependency update, design doc

2022-11-09 Thread Austin Bennett
Being tied to a specific version of a dependency, and esp. one that is not-[actually-long-term]critical, sounds like a problem. It doesn't seem like Avro needs to be in core. I am in favor of about any path someone wants to address towards removing that from core [ *#2 in the design doc seems rea

Re: [DISCUSS] Jenkins -> GitHub Actions ?

2022-11-07 Thread Austin Bennett
+1 Also would help address a good amount of what concerns me that was [sorta] raised by https://lists.apache.org/thread/7jr99nc5xsb3ft1d75kb0ml32bzw89rv Once we think this is something we want to do, but might be blocked/concerned because of lack of definitively comparable features, I'd be happy

Re: [ANNOUNCE] New committer: Ritesh Ghorse

2022-11-03 Thread Austin Bennett
Congratulations, and Thanks @riteshgho...@apache.org! On Thu, Nov 3, 2022 at 4:17 PM Sachin Agarwal via dev wrote: > Congrats Ritesh! > > On Thu, Nov 3, 2022 at 4:16 PM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Ritesh

[DISCUSS] Separating Cloud Environment(s) - Separate Dev/Test from Production 'Testing' environment(s)

2022-10-06 Thread Austin Bennett
Howdy! I'm increasingly concerned by our Cloud 'Testing' environment ( resources associated with the 'apache-beam-testing' GCP project ). The following might sound a little strange, given repetition of words [ and many meanings of 'testing']: * There is a 'production' need for ongoing testing in

Re: What to do about issues that track flaky tests?

2022-09-14 Thread Austin Bennett
+1 to being realistic -- proper labels are worthwhile. Though, some flaky tests probably should be P1, and just because isn't addressed in a timely manner doesn't mean it isn't a P1 - though, it does mean it wasn't addressed. On Wed, Sep 14, 2022 at 1:19 PM Kenneth Knowles wrote: > I would li

Re: Beam Website Feedback

2022-09-09 Thread Austin Bennett
Any chance you've seen a GH Issue for that? If not, please feel free to file one :-) https://github.com/apache/beam/issues On Fri, Sep 9, 2022 at 12:09 PM Peter McArthur wrote: > I wish there were a python example for "Slowly updating global window side > inputs” on this page > https://beam.ap

Re: [idea] A new IO connector named DataLakeIO, which support to connect Beam and data lake, such as Delta Lake, Apache Hudi, Apache iceberg.

2022-08-30 Thread Austin Bennett
Is there enough commonality across Delta, Hudi, Iceberg for this generic solution? I imagined we'd potentially have individual IOs for each. A generic one seems possible, but certainly would like to learn more. Also, are others in the community working on connectors for ANY of those Delta Lake,

Re: Present an Apache Beam Learning Session

2022-08-01 Thread Austin Bennett
Hi Cacie, The list could probably use some more details about what you are seeking. Ex: Where is CUNA Mutual group physically located? Or are you imagining this occurring online? Do people need to get hands-on ( you mention overview so maybe not )? Or, you are seeking just something about what/wh

Re: [ANNOUNCE] New committer: John Casey

2022-08-01 Thread Austin Bennett
Thanks, John! On Mon, Aug 1, 2022 at 12:01 PM John Casey via dev wrote: > Thanks! I'm looking forward to continuing to improve all of our connectors. > > On Mon, Aug 1, 2022 at 1:52 PM Yichi Zhang via dev > wrote: > >> Congratulations John! >> >> On Sat, Jul 30, 2022 at 4:23 AM Robert Burke wr

Re: [RFC] State & Timers API Design for Go SDK

2022-07-28 Thread Austin Bennett
Looks great! On Thu, Jul 28, 2022 at 10:54 AM Jack McCluskey via dev wrote: > Great write-up on state and timers! The solution you chose feels very > in-line with how the Go SDK works. Make sure the design doc makes it onto > the wiki once you've addressed any feedback! > > On Thu, Jul 28, 2022

Re: [ANNOUNCE] New committer: Steven Niemitz

2022-07-20 Thread Austin Bennett
Great! On Wed, Jul 20, 2022 at 10:11 AM Aizhamal Nurmamat kyzy wrote: > Congrats, Steve! > > On Wed, Jul 20, 2022 at 3:10 AM Jan Lukavský wrote: > >> Congrats Steve! >> On 7/20/22 06:20, Reuven Lax via dev wrote: >> >> Welcome Steve! >> >> On Tue, Jul 19, 2022 at 1:05 PM Connell O'Callaghan via

Re: Join a meeting to help coordinate implementing a Dask Runner for Beam

2022-06-21 Thread Austin Bennett
Looks/Sounds great! On Tue, Jun 21, 2022 at 11:06 AM Alex Merose wrote: > We had a great meeting last week on this topic! Here is a proposal / > meeting notes doc: > > https://docs.google.com/document/d/1Awj_eNmH-WRSte3bKcCcUlQDiZ5mMKmCO_xV-mHWAak/edit#heading=h.y0pwg4polebc > > Tomorrow, anothe

Re: [ANNOUNCE] New committer: Ke Wu

2022-05-27 Thread Austin Bennett
Congrats, and Thanks, Ke! On Fri, May 27, 2022 at 3:49 PM Ahmet Altay wrote: > Hi all, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Ke Wu (kw2542@) > > Ke has been contributing to Beam since 2020. Ke's contributions are mostly > focused on the SamzaRunner, as a

Re: Javascript SDK

2022-05-04 Thread Austin Bennett
+1 -- had started playing with this a couple weeks ago, is really shaping up! Some questions about docs, and making [ developing any language ] more approachable --> I wonder whether we have learned enough from this for a guide of sorts for future language development. Perhaps, since fresh, wou

Re: Beam Website Feedback

2022-03-29 Thread Austin Bennett
Hi Charles, I am not working with any of the mentioned DBs, so can't speak to the state of IOs ( though I think you can use a jdbc connection with each of these, so perhaps see: https://beam.apache.org/releases/pydoc/2.24.0/apache_beam.io.jdbc.html ) . But, I would suggest that contributions to th

Re: Create a Dataset in GCP Testing Project?

2022-01-24 Thread Austin Bennett
Bumping this from last week... Can someone with permissions please verify my permissions in the GCP Testing Project ? It doesn't seem like I still have access. Thanks! On Tue, Jan 18, 2022 at 3:10 PM Austin Bennett wrote: > Following up here, it seems I have lost my access to the (G

Re: Create a Dataset in GCP Testing Project?

2022-01-18 Thread Austin Bennett
d one of my emails already has access - I checked several ]. Thanks! On Tue, Sep 28, 2021 at 2:47 PM Austin Bennett wrote: > Thanks, and Yes, some in wiki would be helpful -- I looked there first ( > still am not certain on our conventions/why, so not sure that I’m the > person to doc

Re: Beam Website Feedback

2021-11-23 Thread Austin Bennett
Prs welcome :-) On Mon, Nov 22, 2021, 4:46 PM Michael Lehenbauer wrote: > The python version of > https://beam.apache.org/documentation/programming-guide/#using-schemas > has a bunch of missing examples... > > [image: image.png] >

Re: Create a Dataset in GCP Testing Project?

2021-09-28 Thread Austin Bennett
ns to >> this rule. For example, I am an owner - so I was able to grant you editor >> access. I think you should be able to create a new dataset now. >> >> Brian >> >> On Fri, Sep 24, 2021 at 12:07 PM Austin Bennett < >> whatwouldausti...@gmail.com> w

Create a Dataset in GCP Testing Project?

2021-09-24 Thread Austin Bennett
Hi Devs, I am working on https://issues.apache.org/jira/browse/BEAM-10652 and specifically sorting out Integration Tests for this. I believe that I need to create a dataset for this to work given errors ( a special purpose dataset seems cleaner than reusing an existing dataset, and in line with t

Re: Avro String decoding changes in Beam 2.30.0

2021-08-05 Thread Austin Bennett
Claire and I discussed this a bit earlier, and I asked her to submit a PR. It is found: https://github.com/apache/beam/pull/15292 On Wed, Aug 4, 2021 at 2:21 PM Kirill Panarin wrote: > +1 to what Claire is proposing. Would be nice to have this merged to avoid > fixing things on our side! > > O

Re: Spark Structured Streaming runner migrated to Spark 3

2021-08-05 Thread Austin Bennett
Hooray! Thanks, Etienne! On Thu, Aug 5, 2021 at 3:11 AM Etienne Chauchot wrote: > Hi all, > > Just to let you know that Spark Structured Streaming runner was migrated > to Spark 3. > > Enjoy ! > > Etienne > >

Re: Allyship workshops for open source contributors

2021-06-03 Thread Austin Bennett
+1, assuming timing can work. On Wed, Jun 2, 2021 at 2:07 PM Aizhamal Nurmamat kyzy wrote: > If we have a good number of people who express interest in this thread, I >> will set up training for the Airflow community. >> > > I meant Beam ^^' I am organizing it for the Airflow community as well.

Re: One Pager - Test Command Line Discoverability in Beam

2021-05-25 Thread Austin Bennett
Cool; will be good to have and make things clearer! On Tue, May 25, 2021 at 2:39 PM Kyle Weaver wrote: > I left some comments. In summary, I think this is mostly a documentation > problem. If running a test isn't as easy as "./gradlew > $MODULE:integrationTest", there should be instructions in t

Re: [ANNOUNCE] New committer: Ning Kang

2021-03-24 Thread Austin Bennett
Thanks, Ning! On Wed, Mar 24, 2021 at 5:51 AM Reza Rokni wrote: > Congratulations! > > On Wed, Mar 24, 2021 at 12:53 PM Kenneth Knowles wrote: > >> Congratulations and thanks for all your contributions, Ning! >> >> Kenn >> >> On Tue, Mar 23, 2021 at 4:10 PM Valentyn Tymofieiev >> wrote: >> >>>

Re: UX Research Findings Readout for Apache Beam Community

2021-01-30 Thread Austin Bennett
Is it possible to writeup/share results for those not able to attend and/or to digest ahead of attending? On Thu, Jan 28, 2021, 10:46 AM Carlos Camacho Frausto < carlos.cama...@wizeline.com> wrote: > Hello, > Some weeks ago, our firm conducted a User Experience Research Study for > Google Apach

Re: Standarizing the "Runner" concept across website content

2021-01-07 Thread Austin Bennett
To those unfamiliar with these concepts, I generally conflate everything to a "Runner" to keep things simple. Though, also mention "execution engine" at times. Glad there appears to be concrete consensus on how we want to talk about this. It will also help guide me in being consistent :-) On

Re: Looking for a PMC member to help with website development

2020-11-04 Thread Austin Bennett
And, @Griselda Cuevas -- not meaning to change focus of thread. It seemed you might have the ability to cast a wider net. But, I also might be off on the differences in roles/rights/responsibilities. On Wed, Nov 4, 2020 at 9:26 AM Austin Bennett wrote: > To understand differences in PMC

Re: Looking for a PMC member to help with website development

2020-11-04 Thread Austin Bennett
To understand differences in PMC vs committer --> would like to understand why a committer doesn't suffice for the listed requests (and @Griselda Cuevas you are a committer, but it seems you'd potentially just want another committer to also review). It seems the website is less about shifting th

BeamSQL and Beam equivalent -- examples?

2020-11-01 Thread Austin Bennett
Hi All, For something I am currently writing -- I am seeking any examples of BeamSQL and Beam that take the same input and produce the same output. I can't recall, off head, any examples/slides/writeups. Do any exist? I would like to show: (a) that BeamSQL is a real thing :-) (b) that Beam can

Re: Beam summit update on blog?

2020-09-22 Thread Austin Bennett
Imagining we should also share specific talks over a longer time-frame? Like not just a one off announcement, but drive activity/attention over next months, until concretely planning. Something like every other week tweet of specific talk. Which would be separate from any new (small) events we as

Re: [ANNOUNCE] New committer: Reza Ardeshir Rokni

2020-09-10 Thread Austin Bennett
Thanks and congrats, Reza! On Thu, Sep 10, 2020 at 5:48 PM Heejong Lee wrote: > Congratulations! > > On Thu, Sep 10, 2020 at 4:42 PM Robert Bradshaw > wrote: > >> Thank you and welcome, Reza! >> >> On Thu, Sep 10, 2020 at 4:00 PM Ahmet Altay wrote: >> >>> Congratulations Reza! And thank you fo

Re: Ability to link to "latest" of python docs

2020-09-08 Thread Austin Bennett
+dev Lynn, Seems totally doable. If others don't speak up with a good way to do this (or in opposition), I'm sure we can sort something out to accomplish this (will dig into intersphinx mapping tomorrow). Cheers, Austin On Tue, Sep 8, 2020, 5:19 PM Lynn Root wrote: > Hey folks - > > I'm

Intro to Beam and Contributing Workshops

2020-07-19 Thread Austin Bennett
Hi All, I'm a huge fan of HOPE . In the virtual edition this year, I am giving 2 talks. * a 2hr introduction to Beam. * a 1hr introduction to contributing to open source (with specific examples from Beam). These to occur on 30/31 July, schedule found: https://scheduler.hop

Re: [VOTE] Extension name of Interactive Beam Side Panel in JupyterLab

2020-07-16 Thread Austin Bennett
if specific to jupyterlab, then [3] makes sense. Am wondering whether that gets confusing, if it will also be used in datalab, and/or other (similar/same underlying tech but going by different names)? On Thu, Jul 16, 2020 at 12:35 PM Pablo Estrada wrote: > +1 for 3. Thanks Ning. > > On Thu, Jul

Re: [ANNOUNCE] New committer: Aizhamal Nurmamat kyzy

2020-06-29 Thread Austin Bennett
Congratulations, @Aizhamal Nurmamat kyzy ! On Mon, Jun 29, 2020 at 2:32 PM Valentyn Tymofieiev wrote: > Congratulations and big thank you for all the hard work on Beam, Aizhamal! > > On Mon, Jun 29, 2020 at 9:56 AM Kenneth Knowles wrote: > >> Please join me and the rest of the Beam PMC in welc

Re: [ANNOUNCE] New PMC Member: Alexey Romanenko

2020-06-16 Thread Austin Bennett
Congrats! On Tue, Jun 16, 2020 at 1:27 PM Valentyn Tymofieiev wrote: > Congratulations! > > On Tue, Jun 16, 2020 at 11:41 AM Ahmet Altay wrote: > >> Congratulations! >> >> On Tue, Jun 16, 2020 at 10:05 AM Pablo Estrada >> wrote: >> >>> Yooohooo! Thanks for all your contributions and hard work

Re: Beam Summit Status Report - 6/10

2020-06-15 Thread Austin Bennett
Great, if worried about publicly archiving things -- it seems that PMC/etc is starting to view this effort even more as a community effort of the project!? That's my hope. As opposed to an external, yet somewhat condoned, effort. That said, have we worked out the parts where such efforts need to

Re: Try Beam Katas Today

2020-06-07 Thread Austin Bennett
range? On Mon, May 25, 2020 at 9:03 PM Austin Bennett wrote: > Cool; thanks Henry! > > On Mon, May 25, 2020 at 7:49 PM Henry Suryawirawan < > hsuryawira...@google.com> wrote: > >> Hi Austin, >> >> The remote-info yaml files would get updated upon updating the

Fwd: [DISCUSSION] Use github actions for python wheels ?

2020-05-30 Thread Austin Bennett
There seems to be support here for this idea. After digging through things, I *think* I understand the moving pieces and can address (reason I was digging through the code, including beam-wheels repo [1]). Though, not 100% that I have not overlooked bits. Would be happy to pickup https://issues.

Re: Try Beam Katas Today

2020-05-25 Thread Austin Bennett
of the number of learners > who have tried the course, any star and review, e.g. for Java Katas ( > https://stepik.org/course/54530/promo). > The private stats include number of learners per day, task pass rate, the > learners, etc. > > > Henry Suryawirawan > > Strateg

Re: Try Beam Katas Today

2020-05-25 Thread Austin Bennett
be able to also run the pipeline > independently and observe the output, just like when they write the > pipeline normally. > > Hope my answers help to clarify. > > > Henry Suryawirawan > > Strategic Cloud Engineer > > hsuryawira...@google.com > > > > >

Re: deploy_travis.sh ?

2020-05-24 Thread Austin Bennett
eels/commit/40c0bd1a36d70736b84e925889cdad417e429fd4 > > On 2020/05/22 02:13:35, Austin Bennett > wrote: > > Hi All, > > > > Was digging into https://github.com/apache/beam-wheels after being > reminded > > of https://issues.apache.org/jira/browse/BEAM-9388 (I recall the > original > > con

Re: Try Beam Katas Today

2020-05-24 Thread Austin Bennett
@Rion, @Henry Suryawirawan , @Damon, I added a Flatten Kata for Go. Please have a look: https://github.com/apache/beam/pull/11806 -- tagged all of you as other authors of Katas. A few questions: 1) Across all the katas, we have files '{task, lesson,section}-remote-info.yaml'. These files do

deploy_travis.sh ?

2020-05-21 Thread Austin Bennett
Hi All, Was digging into https://github.com/apache/beam-wheels after being reminded of https://issues.apache.org/jira/browse/BEAM-9388 (I recall the original conversation --> https://lists.apache.org/thread.html/r4a7d34e64a34e9fe589d06aec74d9b464d252c516fe96c35b2d6c9ae%40%3Cdev.beam.apache.org%3E

Re: Transparency to Beam Digital Summit Planning

2020-05-20 Thread Austin Bennett
Should the link/meeting notes be publicly available? Not just available to individuals plus all of @google? On Wed, May 20, 2020 at 2:06 PM Brittany Hermann wrote: > Hi folks, > > I wanted to provide a few different ways of transparency to you during the > planning of the Beam Digital Summit.

Re: [ANNOUNCE] New committer: Robin Qiu

2020-05-20 Thread Austin Bennett
Congrats! On Tue, May 19, 2020, 8:32 PM Chamikara Jayalath wrote: > Congrats Robin! > > On Tue, May 19, 2020 at 2:39 PM Rui Wang wrote: > >> Nice! Congrats! >> >> >> >> -Rui >> >> On Tue, May 19, 2020 at 11:13 AM Pablo Estrada >> wrote: >> >>> yoohoo : ) >>> >>> On Tue, May 19, 2020 at 11:03 A

Event Calendar?

2020-05-19 Thread Austin Bennett
Hi All, As we have events more often that are more accessible (digital), wondering whether others see a value of adding a calendar to the website? Perhaps related, is it worth updating https://beam.apache.org/community/in-person/ <- to something that isn't 'in-person' since doing things in-person

Re: Try Beam Katas Today

2020-05-14 Thread Austin Bennett
It looks like there are instructions online for writing exercises/Katas: https://www.jetbrains.com/help/education/educator-start-guide.html Do we have a guide for contributing and publication/releases occur (publishing to Stepik)? Although the code lives in the main repo (therefore subject to tho

Re: Companies using Beam?

2020-04-30 Thread Austin Bennett
gt; > Regards > JB > > > Le 28 avr. 2020 à 23:42, Austin Bennett a > écrit : > > > > Hi All, > > > > Have we considered getting onto our website or our our GitHub repo the > ability for individuals to share that their company is using Beam? Seeing >

Companies using Beam?

2020-04-28 Thread Austin Bennett
Hi All, Have we considered getting onto our website or our our GitHub repo the ability for individuals to share that their company is using Beam? Seeing - what I believe to be a reasonable list of - companies productively using Beam would be helpful to point others to. For instance, a common que

Beam Digital Summit 2020 -- JUNE 2020!

2020-04-22 Thread Austin Bennett
Hi All, We are excited to announce the Beam Digital Summit 2020! This will occur for partial days during the week of 15-19 June. CfP is open and found: https://sessionize.com/beam-digital-summit-2020/ CfP closes on 20 May 2020. Do not hesitate to reach out to the organizers with any questions.

Re: New Contributor Intro

2020-04-17 Thread Austin Bennett
Nice, welcome to the project, Cameron -- many of us met back at Beam Summit EU/Berlin! I don't have the permissions to assign you, but imagine someone will take care of that soon. On Fri, Apr 17, 2020 at 11:15 AM Cameron Morgan wrote: > Hello everyone, > > I would like the permission to contrib

Re: Usage metrics for Beam

2020-04-13 Thread Austin Bennett
is ambiguously defined). >> >> On Thu, Apr 9, 2020 at 7:30 PM Kenneth Knowles wrote: >> >>> Yea, interpreting the raw absolute number is tricky. You can probably >>> manage to see certain kinds of trends if you just look at relative numbers. >>> >>

Re: Usage metrics for Beam

2020-04-09 Thread Austin Bennett
@Robert Bradshaw , you sent that pypi link [1] the other day in response to something else, which is what prompted me to ask Gris about Maven (based on that link [2], @* Kenneth Knowles ). I recall talking to someone about Maven download statistics at ApacheCon. Perhaps these are not the only

Re: [VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-04-02 Thread Austin Bennett
+1 (nonbinding) On Thu, Apr 2, 2020 at 12:10 PM Luke Cwik wrote: > +1 (binding) > > On Thu, Apr 2, 2020 at 11:54 AM Pablo Estrada wrote: > >> +1! (binding) >> >> On Thu, Apr 2, 2020 at 11:19 AM Alex Van Boxel wrote: >> >>> Thanks for clearing this up Aizhamal. >>> >>> +1 (non binding) >>> >>>

Re: Next LTS?

2020-03-25 Thread Austin Bennett
was a suggestion to mark the last release with python 2 support > to be an LTS release, was there a conclusion on that? ( +Valentyn > Tymofieiev ) > > >> > > >> Ahmet > > >> > > >> On Tue, Mar 24, 2020 at 2:34 PM Robert Bradshaw >

Re: Next LTS?

2020-03-24 Thread Austin Bennett
ow are we going to gauge this demand? > > +Yifan Zou +Alan Myrvold on > the tooling question as well. Unless we address the tooling problem it > seems difficult to feasibly maintain LTS versions over time. > > On Thu, Sep 19, 2019 at 3:45 PM Austin Bennett < > whatwouldausti

Meetups

2020-03-23 Thread Austin Bennett
Seems we won't be convening in-person in about any city anytime soon. Seems like a chance to come together virtually. WHO CAN SHARE? Seeking: * Use Cases * Developing Beam/Components * Other If anything particular, also, what would you like to hear -- can see if we can track such speakers down.

Re: Issue in testing doing DirectRunner Apache Beam Local Machine

2020-03-20 Thread Austin Bennett
Hi Yogesh, Many of the examples, use the direct runner: https://github.com/apache/beam/tree/master/examples/java/src/main/java/org/apache/beam/examples As does the word count example: https://beam.apache.org/get-started/quickstart-java/#get-the-wordcount-code I'm not well versed enough with our

  1   2   >