Re: [VOTE] Community Examples Repository

2018-08-13 Thread Yifan Zou
3 for all reasons above. Keeping the examples in the Beam repository is a straightforward way to let the examples being visible and maintainable. And as Lukasz Cwik mentioned, the Quickstart makes a clear and easy approach for users to generate the archetype and run examples. I did not see enough b

Re: [VOTE] Community Examples Repository

2018-08-13 Thread Andrew Pilloud
+1 for 2, it would be nice to have a example project in it's own GitHub repo. Might not need to be an "official" repo thought. Could we provide links to community supplied examples? On Thu, Aug 9, 2018, 2:30 PM Robert Bradshaw wrote: > (3) > > In particular, I see a lot of value for (quoting the

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Robert Bradshaw
(3) In particular, I see a lot of value for (quoting the proposal) """ Since then, there have been numerous updates, increased Python parity, and new features that do not have accompanying examples employing best practices and demonstrating an end-to-end experience for new users. We would like to

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Ismaël Mejía
3 for all the reasons discussed above. I think there are better ways to improve the status quo without the extra maintenance of having a new repo for this. On Thu, Aug 9, 2018 at 7:00 PM Ahmet Altay wrote: > If we go forward with (3), could we actually update our documentation on > how we will s

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Ahmet Altay
If we go forward with (3), could we actually update our documentation on how we will support casual example contributions? I think we will need to have information on how to add links to the new examples people want to add to the set, what examples would be good additions to the Beam repo and what

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Mikhail Gryzykhin
3 (if contributors are up for voting) - We want to have beam maintained examples in main repo. This will give good man to users and allow us to test those easily with minimal maintenance. We can add links to opensource user repositories to our documentation/wiki. This will be flexible enough to pr

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Rafael Fernandez
Here is the Rose', David's, and Gris' proposal in text form, I hope the copy/paste helps: Apache Beam Examples Repository Authors: Rose Nguyen (rtngu...@google.com), David Cavazos (dcava...@google.com), Gris Cuevas (g...@apache.org) Status: Proposal Created: 2018-07-30 Updated: 2018-07-30 Summ

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Łukasz Gajowy
I'd also vote for 3: I don't see much added value in separating the repos and I see much additional effort to be done in maintaining extra repo(s) (updating examples when new version of beam sdk comes out) and their infrastructure (jenkins, etc). What Lukasz Cwik said about mvn archetypes and how e

Re: [VOTE] Community Examples Repository

2018-08-09 Thread Alexey Romanenko
3 - I agree with JB, Charles and Lukasz arguments above saying why we need to have examples and main code in the same repository (+ website code base will move there soon). I don’t see any huge benefits to have examples aside and, at the same time, it will bring additional complexity and burden

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Jean-Baptiste Onofré
Hi guys, For this kind of discussion, I would prefer to avoid Google Doc and directly put the point/proposal on the mailing list. It's easier for the community to follow. The statement is more for 3 because it's more convenient for users to easily find the examples and include in the distributio

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Ahmet Altay
Charles, I agree with your comments and questions. I want to add one more benefit that was mentioned earlier: A place for people to contribute example that is not tied to the beam release cycle. Such a repository could be a place for casual contributors to add examples over time. On Wed, Aug 8, 2

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Charles Chen
It looks like the main claim is that 1 and 2 have the benefit of increasing visibility for examples on the Beam site. I agree with Robert's comments on the doc which claim that this is orthogonal to whether a separate repository is created (the comments are unresolved: https://docs.google.com/a/go

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Griselda Cuevas
I'd vote for 2. Giving independence to an example repository and creating the right infrastructure to maintain them will give visibility to the efforts our users are creating to solve their uses cases with Beam. I also want to make the process of sharing common work more easily. Re:The examples t

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Jean-Baptiste Onofré
I would go for 1 or 3 to be consistent. Regards JB On 08/08/2018 18:38, David Cavazos wrote: > Hi everyone! > > We discussed several options as well as some of the implications of each > option. Please vote for your favorite option, feel free to back it up > with any reasons that make you feel t

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Lukasz Cwik
I would vote for 3. My reasoning is that Java has a good mechanism to get a starter/example project going by using the the maven archetypes already. Our quickstart guide for Apache Beam for the Java SDK already covers generating the examples archetype. We could point users to the starter project a

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Andrea Foegler
I guess I'm voting for 2. Tests obviously belong in the code repo, both as a sample usage (not "how-to", more like "man") and, well, for testing. These pipelines might not be annotated as completely and include hitting edge cases and other non-standard situations. Any example where the primary pu

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Rui Wang
2 - examples that rely on experimental API can still stay in where they are because such examples could be changed. -Rui On Wed, Aug 8, 2018 at 10:52 AM Charles Chen wrote: > 3 - We benefit from increased test coverage by having examples together > with the rest of the code. As Robert mentions

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Charles Chen
3 - We benefit from increased test coverage by having examples together with the rest of the code. As Robert mentions in the doc, hosting the Beam examples in the main repository is the best way to keep the examples visible, tested and maintained. Given that we recently moved to a single reposito

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Ahmet Altay
2 - Similar to Huygaa, I see value in keeping a core set of examples tested and maintained against head. At the same time I understand the value of a growing set of community grown examples that are targeted against a pre-defined versions of Beam and not necessarily updated at every release. On We

Re: [VOTE] Community Examples Repository

2018-08-08 Thread Huygaa Batsaikhan
2 - I like the idea of having a separate repo where we can have more freedom to check in examples. However, we benefit from having immediate core examples in Beam for testing purposes. On Wed, Aug 8, 2018 at 9:38 AM David Cavazos wrote: > Hi everyone! > > We discussed several options as well as

[VOTE] Community Examples Repository

2018-08-08 Thread David Cavazos
Hi everyone! We discussed several options as well as some of the implications of each option. Please vote for your favorite option, feel free to back it up with any reasons that make you feel that way. 1) Move *all* samples to a *new *examples* repository* 2) Move *some* samples to a *new *exampl