Re: git commit message

2017-04-30 Thread Jean-Baptiste Onofré
Ah, as the subject of the thread is "git commit message", I thought you talked about the commit message. The commit message should look like "[BEAM-xx] message" for the squashed content, and "[BEAM-xx] This closes #" for the merge commit. Regarding the pull request title, I highly recomme

[PROPOSAL] Running Splittable DoFn via Source API

2017-04-30 Thread Eugene Kirpichov
Hey all, TL;DR: Development of SDF ecosystem (transitioning existing connectors to SDF, building libraries, battle-testing the API) is currently blocked on having SDF supported at full parity with Source API in all Beam runners, which will take a long time. But we can unblock all this work and st

Re: [JENKINS] - Removal of top level views

2017-04-30 Thread Jason Kuster
I'm happy to do it, or help out if someone else is interested. On Sun, Apr 30, 2017 at 9:27 PM, Davor Bonaci wrote: > We need to move our top-level view [1] into the A-D view [2]. > > Any volunteers willing to code this view in the Jenkins DSL? > > Davor > > [1] https://builds.apache.org/view/Be

Fwd: [JENKINS] - Removal of top level views

2017-04-30 Thread Davor Bonaci
We need to move our top-level view [1] into the A-D view [2]. Any volunteers willing to code this view in the Jenkins DSL? Davor [1] https://builds.apache.org/view/Beam/ [2] https://builds.apache.org/view/A-D/view/Beam/ -- Forwarded message -- From: Gavin McDonald Date: Sun, Ap

Re: git commit message

2017-04-30 Thread Ted Yu
I was actually talking about title of the PR. >From the link, there is guideline which some of the recent commits didn't follow: The title of the pull request should be strictly in the following format: On Sun, Apr 30, 2017 at 1:22 PM, Chamikara Jayalath wrote: > Do we have a convention on th

Re: git commit message

2017-04-30 Thread Chamikara Jayalath
Do we have a convention on the commit message ? Seems like Contributor's guide only talks about the title of the PR not the commit message. I might be missing something. https://beam.apache.org/contribute/contribution-guide/#create-a-pull-request Thanks, Cham On Sun, Apr 30, 2017 at 12:41 PM Jea

Re: git commit message

2017-04-30 Thread Jean-Baptiste Onofré
Hi, IMHO, it's very rare. That's true we did couple of "fast" commit to fix issues (I remember at the beginning of the project). However, almost all changes go via PR and most of with a Jira. So, if maybe you found couple of, again, it's rare and we follow the Jira/PR/review/commit path. R

Re: Status of our CI tools

2017-04-30 Thread Chamikara Jayalath
+1 So far, I've been able to commit to Python SDK without caring much about Travis. At least for now, it's not too hard to do testing locally in rare cases where Jenkins is not stable. Hopefully Jenkins will become more stable/faster over time. - Cham On Sun, Apr 30, 2017 at 10:19 AM Dan Halperi

Re: How to create an unbounded PCollection?

2017-04-30 Thread Shen Li
Sorry about the duplication. Please ignore the above email. Shen On Sat, Apr 29, 2017 at 3:43 PM, Shen LI wrote: > It seems that Create.of(Iterable) can only create a BoundedSource. Is there > a convenient way to read from an unbounded Iterable object without writing > application code to wrap

How to create an unbounded PCollection?

2017-04-30 Thread Shen LI
It seems that Create.of(Iterable) can only create a BoundedSource. Is there a convenient way to read from an unbounded Iterable object without writing application code to wrap it into an UnboundedSource object? Thanks, Shen

Re: Status of our CI tools

2017-04-30 Thread Dan Halperin
I think the confusion to new users is much worse than any temporary loss of functionality here. +1 * 100! On Fri, Apr 28, 2017 at 11:00 PM, Mingmin Xu wrote: > +1 > Have ignored TravisCI for some time as the failures are not related with > code/test issues. > > I still hope TravisCI could work w

Re: What's the easiest way for an application to convert an Iterable to an UnboundedSource

2017-04-30 Thread Dan Halperin
Hi Shen, Most runners are expected to use `UnboundedReadFromBoundedSource` (in `runners-core-construction`) to convert a BoundedSource to an UnboundedSource if that is the semantics they need. As Eugene says, I suspect you can also get similar behavior with a SplittableDoFn. Dan On Sat, Apr 29,

git commit message

2017-04-30 Thread Ted Yu
Hi, When I went over git commit messages, I found some without either of the following: JIRA number PR number It would be nice for other people to get background / goal / discussion w.r.t. any commit if either (or both) of the above is present. My two cents.

Jenkins build is unstable: beam_Release_NightlySnapshot #400

2017-04-30 Thread Apache Jenkins Server
See