Re: Try Beam Katas Today

2020-05-14 Thread Henry Suryawirawan
The guide for sharing the course (publishing to Stepik) can be found here: https://www.jetbrains.com/help/education/educator-start-guide.html#share_course It is well integrated in the IDE with a few clicks. Yeah the

Re: [Proposal] Apache Beam Fn API - GCP IO Debuggability Metrics

2020-05-14 Thread Alex Amato
Thanks to all who have spent their time on this, there were many great suggestions, just another reminder that tomorrow I will be finalizing the documents, unless there are any major objections left. Please take a look at it if you are interested. I will still welcome feedback at any time :).

Re: Try Beam Katas Today

2020-05-14 Thread Rion Williams
+1 on the contributions front. My team and I have been working with Beam primarily with Kotlin and I recently added the appropriate dependencies to Gradle and performed a bit of conversions and have it working as expected against the existing Java course. I don’t know how many others are

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

2020-05-14 Thread Aizhamal Nurmamat kyzy
Thank you Ahmet, Brian, Robert and everyone else who spent time working on this. The pull requests are now merged and the website seems to be working as expected [1]. One minor issue that I have noticed is that the code blocks have a grey background, which makes it less accessible than before. I

Re: New Grafana dashboards

2020-05-14 Thread Pablo Estrada
I noticed that postcommit status dashboard shows 0/1 values - I remember it used to show green/red for passed/failed tests. Maybe something changed for it? Best -P. On Wed, May 13, 2020 at 3:23 PM Pablo Estrada wrote: > Thanks Kamil! These dashboards are super useful. I'm happy to see our perf

Interested in applying to GSoD project

2020-05-14 Thread Deepak Vohra
Aizhamal, I am interested in applying as a technical writer to the Apache Beam project in Google Season of Docs. In the project exploration phase I would like to introduce myself as a potential applicant (when the application opens). I have experience using several data processing frameworks

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

2020-05-14 Thread Pablo Estrada
Here's a zipped-up tree from a staged sample of the website: https://drive.google.com/file/d/1LKL936tBJ79jpjvlL5vC5uYYwTHsWXiJ/view?usp=sharing I'd also suggest tagging the commit, so we can find the fist commit later on for reference. I can push the tag after the PR is merged. On Thu, May 14,

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

2020-05-14 Thread Ahmet Altay
On Thu, May 14, 2020 at 9:16 AM Aizhamal Nurmamat kyzy wrote: > Thank you all for reviewing and validating this pull request. I see that > all tests are passing now, should we merge it? > +1 to merging now. Before the merge, please share a link to an archive copy of the old website. After the

Regarding Google Season of Docs

2020-05-14 Thread Arun Prakash
Hi, Greetings! I am an MSc Computer Science Student at the Chalmers University of Technology, Sweden! I would love to be a participant in Google Season of Docs 2020. I have explored a lot about Apache Beam. I was part of the GSoC Community to Implement a Hazlecast Portable Runner Support to

Google Season of Docs

2020-05-14 Thread Shalini Mukhopadhyay
Respected sir/madam I want to apply with your org for the Google Season of Docs. Here's my CV: Can we talk about your ideas please?thanks [image: Mailtrack] Sender notified by Mailtrack

Re: [DISCUSS] How many Python 3.x minor versions should Beam Python SDK aim to support concurrently?

2020-05-14 Thread Yoshiki Obata
Thank you, Kyle and Valentyn. I'll update test codes to treat Python 3.5 and 3.7 as high-priority versions at this point. 2020年5月12日(火) 2:10 Valentyn Tymofieiev : > > I agree with the point echoed earlier that the lowest and the highest of > supported versions will probably give the most useful

[BEAM-9615][Go SDK] Beam Schemas

2020-05-14 Thread Robert Burke
https://s.apache.org/beam-go-schemas The tracking JIRA is BEAM-9615 I've written up the plan and the overall description of the design of schemas in the Go SDK, for your comment. Due to the approach, there's not alot of code to look at for the

Re: [REVIEW][please pause website changes] Migrated the Beam website to Hugo

2020-05-14 Thread Aizhamal Nurmamat kyzy
Thank you all for reviewing and validating this pull request. I see that all tests are passing now, should we merge it? On Wed, May 13, 2020, 5:41 PM Ahmet Altay wrote: > Thank you! Let's merge it once tests are done. > > On Wed, May 13, 2020 at 5:23 PM Robert Bradshaw > wrote: > >> I took a

Re: Try Beam Katas Today

2020-05-14 Thread Nathan Fisher
Yes write IO On Thu, May 14, 2020 at 05:41, Henry Suryawirawan wrote: > Yeah certainly we can expand it further. > There are more lessons that definitely can be added further. > > >Eg more the write side windowing interactions? > Are you referring to Write IOs? > > > > On Wed, May 13, 2020 at

Re: Try Beam Katas Today

2020-05-14 Thread Austin Bennett
It looks like there are instructions online for writing exercises/Katas: https://www.jetbrains.com/help/education/educator-start-guide.html Do we have a guide for contributing and publication/releases occur (publishing to Stepik)? Although the code lives in the main repo (therefore subject to

Re: Add options to CassandraIO

2020-05-14 Thread Etienne Chauchot
Hi Nathan, Thanks for raising this, and thanks for the PR proposal. I would recommend (as it was done in other IOs such as ElasticsearchIO) the third solution: you could add a method called withConnectTimeout(Integer) to both the Read and Write builders of the IO (there is no common conf

Re: TextIO. Writing late files

2020-05-14 Thread Jose Manuel
Hi again, I have simplify the example to reproduce the data loss. The scenario is the following: - TextIO write files. - getPerDestinationOutputFilenames emits file names - File names are processed by a aggregator (combine, distinct, groupbyKey...) with a window **without allowlateness** - File

Re: Try Beam Katas Today

2020-05-14 Thread Henry Suryawirawan
Yeah certainly we can expand it further. There are more lessons that definitely can be added further. >Eg more the write side windowing interactions? Are you referring to Write IOs? On Wed, May 13, 2020 at 11:56 PM Nathan Fisher wrote: > I went through them earlier this week! Definitely