[GitHub] incubator-beam pull request: Add CounterNameAndMetadata to support...

[peihe]

GitHub user peihe opened a pull request:

https://github.com/apache/incubator-beam/pull/102

Add CounterNameAndMetadata to support structured counter name



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/peihe/incubator-beam structured-counter

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/102.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #102


commit a26d595db2e28d687f6f662169029a44b41a7fdc
Author: Pei He 
Date:   2016-03-31T05:38:34Z

Add CounterNameAndMetadata to support structured counter name




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[Daniel Halperin (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219376#comment-15219376
 ] 

Daniel Halperin commented on BEAM-68:
-

Okay, I think I'm partially wrong.

KV -> ParDo(process all elements in a single DoFn with per-K 
startBundle/endBundle/etc) is doable as a solution to BEAM-92.
   -It won't of course work with empty K, so you can't in fact guarantee 
numShards is matched.
   -It won't scale.
   -It overly restricts implementation.
but I think it works, in essence, without a model change.

Would you prefer to dupe 169 against 92? I don't see a need for more bug bloat 
here tho. Have suggested edits to the text of either bug that will fix?

> Support for limiting parallelism of a step
> --
>
> Key: BEAM-68
> URL: https://issues.apache.org/jira/browse/BEAM-68
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Daniel Halperin
>
> Users may want to limit the parallelism of a step. Two classic uses cases are:
> - User wants to produce at most k files, so sets 
> TextIO.Write.withNumShards(k).
> - External API only supports k QPS, so user sets a limit of k/(expected 
> QPS/step) on the ParDo that makes the API call.
> Unfortunately, there is no way to do this effectively within the Beam model. 
> A GroupByKey with exactly k keys will guarantee that only k elements are 
> produced, but runners are free to break fusion in ways that each element may 
> be processed in parallel later.
> To implement this functionaltiy, I believe we need to add this support to the 
> Beam Model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Comment Edited] (BEAM-68) Support for limiting parallelism of a step

[Daniel Halperin (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219353#comment-15219353
 ] 

Daniel Halperin edited comment on BEAM-68 at 3/31/16 5:08 AM:
--

Eugene: I disagree with the premise that even the group by key trick works 
without runner support. Fusion breaks and dynamic work rebalancing violate all 
such assumptions. Model changes are all that will guarantee anything here, 
without completely removing modularity from the system


was (Author: dhalp...@google.com):
Eugene: I disagree with the premise that even the group by key trick works 
without runner support. Fusion breaks and dynamic work rebalancing violate all 
such assumptions. Model changes are all that will guarantee anything here.

> Support for limiting parallelism of a step
> --
>
> Key: BEAM-68
> URL: https://issues.apache.org/jira/browse/BEAM-68
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Daniel Halperin
>
> Users may want to limit the parallelism of a step. Two classic uses cases are:
> - User wants to produce at most k files, so sets 
> TextIO.Write.withNumShards(k).
> - External API only supports k QPS, so user sets a limit of k/(expected 
> QPS/step) on the ParDo that makes the API call.
> Unfortunately, there is no way to do this effectively within the Beam model. 
> A GroupByKey with exactly k keys will guarantee that only k elements are 
> produced, but runners are free to break fusion in ways that each element may 
> be processed in parallel later.
> To implement this functionaltiy, I believe we need to add this support to the 
> Beam Model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[Daniel Halperin (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219353#comment-15219353
 ] 

Daniel Halperin commented on BEAM-68:
-

Eugene: I disagree with the premise that even the group by key trick works 
without runner support. Fusion breaks and dynamic work rebalancing violate all 
such assumptions. Model changes are all that will guarantee anything here.

> Support for limiting parallelism of a step
> --
>
> Key: BEAM-68
> URL: https://issues.apache.org/jira/browse/BEAM-68
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Daniel Halperin
>
> Users may want to limit the parallelism of a step. Two classic uses cases are:
> - User wants to produce at most k files, so sets 
> TextIO.Write.withNumShards(k).
> - External API only supports k QPS, so user sets a limit of k/(expected 
> QPS/step) on the ParDo that makes the API call.
> Unfortunately, there is no way to do this effectively within the Beam model. 
> A GroupByKey with exactly k keys will guarantee that only k elements are 
> produced, but runners are free to break fusion in ways that each element may 
> be processed in parallel later.
> To implement this functionaltiy, I believe we need to add this support to the 
> Beam Model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #8

[Apache Jenkins Server]

See 

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #8

[Apache Jenkins Server]

See 

[jira] [Closed] (BEAM-152) Convert contrib guide to website page

[James Malone (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Malone closed BEAM-152.
-
Resolution: Fixed

> Convert contrib guide to website page
> -
>
> Key: BEAM-152
> URL: https://issues.apache.org/jira/browse/BEAM-152
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: James Malone
>Assignee: James Malone
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-85) DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219303#comment-15219303
 ] 

ASF GitHub Bot commented on BEAM-85:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/93


> DataflowAssert (BeamAssert ;) needs sanity check that it's used correctly
> -
>
> Key: BEAM-85
> URL: https://issues.apache.org/jira/browse/BEAM-85
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-java-core
>Reporter: Daniel Halperin
>
> We should validate two things:
> # DataflowAssert is not added to a pipeline that has already been run.
> # The pipeline is run after the DataflowAssert is added.
> If either of these are not validated, then it is possible that the test 
> doesn't actually verify anything.
> This code should throw an assertion error or fail in some other way.
> {code}
> Pipeline p = TestPipeline.create();
> PCollection value = p.apply(Create.of(Boolean.FALSE));
> p.run();
> DataflowAssert.thatSingleton(value).isEqualTo(true);
> {code}
> but it would pass silently.
> similarly, this code wills pass silently:
> {code}
> Pipeline p = TestPipeline.create();
> PCollection value = p.apply(Create.of(Boolean.FALSE));
> DataflowAssert.thatSingleton(value).isEqualTo(true);
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-85] Manually fix some broken us...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/93


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: This closes #93

[kenn]

This closes #93


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0c47cad4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0c47cad4
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/0c47cad4

Branch: refs/heads/master
Commit: 0c47cad4810c307f14490a8ebdef167b039a2ec8
Parents: 9793fa2 a98858a
Author: Kenneth Knowles 
Authored: Wed Mar 30 21:19:40 2016 -0700
Committer: Kenneth Knowles 
Committed: Wed Mar 30 21:19:40 2016 -0700

--
 .../dataflow/sdk/runners/inprocess/InProcessCreateTest.java| 4 
 .../dataflow/sdk/transforms/ApproximateQuantilesTest.java  | 6 ++
 2 files changed, 6 insertions(+), 4 deletions(-)
--

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[Davor Bonaci (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219143#comment-15219143
 ] 

Davor Bonaci commented on BEAM-68:
--

The uses cases are different for sure.

However, it is unclear whether the solution is the same. Perhaps we'll end up 
with different APIs, but that is far from certain, I think. It is explicitly 
called out as a scenario here, so I don't think we need to have a separate 
tracking issue.

> Support for limiting parallelism of a step
> --
>
> Key: BEAM-68
> URL: https://issues.apache.org/jira/browse/BEAM-68
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Daniel Halperin
>
> Users may want to limit the parallelism of a step. Two classic uses cases are:
> - User wants to produce at most k files, so sets 
> TextIO.Write.withNumShards(k).
> - External API only supports k QPS, so user sets a limit of k/(expected 
> QPS/step) on the ParDo that makes the API call.
> Unfortunately, there is no way to do this effectively within the Beam model. 
> A GroupByKey with exactly k keys will guarantee that only k elements are 
> produced, but runners are free to break fusion in ways that each element may 
> be processed in parallel later.
> To implement this functionaltiy, I believe we need to add this support to the 
> Beam Model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #7

[Apache Jenkins Server]

See 

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #7

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-68) Support for limiting parallelism of a step

[Eugene Kirpichov (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219126#comment-15219126
 ] 

Eugene Kirpichov commented on BEAM-68:
--

I think the two use cases are quite different and need different APIs. The 
first use case is about the expected outputs of the pipeline (i.e. 
runner-agnostic); the second is about the execution (implemented in a 
runner-specific way).

I think for the first case we just need to come up with a convenient way to 
encode the sharding needs of custom sinks (e.g. output filename for a 
file-based sink, or say, shard of a pubsub topic for a sink that outputs to 
some pubsub system), and it can probably be done as a PTransform. I think it 
can actually be done using the "data-dependent sinks" API (route the data to a 
destination shard, one sink per shard), BEAM-92.

The second case requires support in the Beam model.

I'm inclined to reopen BEAM-159, let me know what you think.

> Support for limiting parallelism of a step
> --
>
> Key: BEAM-68
> URL: https://issues.apache.org/jira/browse/BEAM-68
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Daniel Halperin
>
> Users may want to limit the parallelism of a step. Two classic uses cases are:
> - User wants to produce at most k files, so sets 
> TextIO.Write.withNumShards(k).
> - External API only supports k QPS, so user sets a limit of k/(expected 
> QPS/step) on the ParDo that makes the API call.
> Unfortunately, there is no way to do this effectively within the Beam model. 
> A GroupByKey with exactly k keys will guarantee that only k elements are 
> produced, but runners are free to break fusion in ways that each element may 
> be processed in parallel later.
> To implement this functionaltiy, I believe we need to add this support to the 
> Beam Model.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

[Thomas Groh (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Thomas Groh resolved BEAM-94.
-
Resolution: Fixed

https://github.com/apache/incubator-beam/pull/17

> CountingInput should be able to limit the rate at which output is produced
> --
>
> Key: BEAM-94
> URL: https://issues.apache.org/jira/browse/BEAM-94
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Thomas Groh
>Assignee: Thomas Groh
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-94) CountingInput should be able to limit the rate at which output is produced

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-94?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219068#comment-15219068
 ] 

ASF GitHub Bot commented on BEAM-94:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/17


> CountingInput should be able to limit the rate at which output is produced
> --
>
> Key: BEAM-94
> URL: https://issues.apache.org/jira/browse/BEAM-94
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Thomas Groh
>Assignee: Thomas Groh
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-94] Add UnboundedCountingInput#...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/17


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/2] incubator-beam git commit: Closes #17

[dhalperi]

Repository: incubator-beam
Updated Branches:
  refs/heads/master ffb7002b8 -> 9793fa2c8


Closes #17


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9793fa2c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9793fa2c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/9793fa2c

Branch: refs/heads/master
Commit: 9793fa2c860279b8c90254260c87e5665b000254
Parents: ffb7002 b21a0be
Author: Dan Halperin 
Authored: Wed Mar 30 16:37:17 2016 -0700
Committer: Dan Halperin 
Committed: Wed Mar 30 16:37:17 2016 -0700

--
 .../cloud/dataflow/sdk/io/CountingInput.java| 42 -
 .../cloud/dataflow/sdk/io/CountingSource.java   | 99 ++--
 .../dataflow/sdk/io/CountingInputTest.java  | 25 +
 .../dataflow/sdk/io/CountingSourceTest.java | 73 +++
 4 files changed, 226 insertions(+), 13 deletions(-)
--

[18/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java
index 7d59b09..01a42ce 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableIO.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.io.bigtable;
 
 import static com.google.common.base.Preconditions.checkArgument;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableService.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableService.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableService.java
index 85d706c..0c47f65 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableService.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableService.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 package com.google.cloud.dataflow.sdk.io.bigtable;
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableServiceImpl.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableServiceImpl.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableServiceImpl.java
index 5ab8582..9f32022 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableServiceImpl.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/bigtable/BigtableServiceImpl.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) 

[12/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java
index 8b6f495..3348d64 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcpCredentialFactory.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import com.google.api.client.auth.oauth2.Credential;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsIOChannelFactory.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsIOChannelFactory.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsIOChannelFactory.java
index ce933f5..9d21b45 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsIOChannelFactory.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsIOChannelFactory.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import com.google.cloud.dataflow.sdk.options.GcsOptions;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsStager.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsStager.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsStager.java
index 4219bc4..7307e83 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsStager.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/GcsStager.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  

[22/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

Update LICENSE header across all files


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d59c8012
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d59c8012
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/d59c8012

Branch: refs/heads/master
Commit: d59c80121dd0362040e1269f4ad4a58390557500
Parents: c6aac3b
Author: Davor Bonaci 
Authored: Wed Mar 30 14:59:35 2016 -0700
Committer: Dan Halperin 
Committed: Wed Mar 30 16:34:14 2016 -0700

--
 contrib/hadoop/pom.xml  | 31 ++--
 .../contrib/hadoop/HadoopFileSource.java| 23 ---
 .../dataflow/contrib/hadoop/WritableCoder.java  | 23 ---
 .../contrib/hadoop/HadoopFileSourceTest.java| 23 ---
 .../contrib/hadoop/WritableCoderTest.java   | 23 ---
 .../dataflow/contrib/joinlibrary/Join.java  | 23 ---
 .../contrib/joinlibrary/InnerJoinTest.java  | 23 ---
 .../contrib/joinlibrary/OuterLeftJoinTest.java  | 23 ---
 .../contrib/joinlibrary/OuterRightJoinTest.java | 23 ---
 .../dataflow/examples/DebuggingWordCount.java   | 23 ---
 .../dataflow/examples/MinimalWordCount.java | 23 ---
 .../dataflow/examples/WindowedWordCount.java| 23 ---
 .../cloud/dataflow/examples/WordCount.java  | 23 ---
 .../examples/common/DataflowExampleOptions.java | 23 ---
 .../examples/common/DataflowExampleUtils.java   | 23 ---
 .../common/ExampleBigQueryTableOptions.java | 23 ---
 ...xamplePubsubTopicAndSubscriptionOptions.java | 23 ---
 .../common/ExamplePubsubTopicOptions.java   | 23 ---
 .../examples/common/PubsubFileInjector.java | 23 ---
 .../examples/complete/AutoComplete.java | 23 ---
 .../examples/complete/StreamingWordExtract.java | 23 ---
 .../cloud/dataflow/examples/complete/TfIdf.java | 23 ---
 .../examples/complete/TopWikipediaSessions.java | 23 ---
 .../examples/complete/TrafficMaxLaneFlow.java   | 23 ---
 .../examples/complete/TrafficRoutes.java| 23 ---
 .../examples/cookbook/BigQueryTornadoes.java| 23 ---
 .../cookbook/CombinePerKeyExamples.java | 23 ---
 .../examples/cookbook/DatastoreWordCount.java   | 23 ---
 .../examples/cookbook/DeDupExample.java | 23 ---
 .../examples/cookbook/FilterExamples.java   | 23 ---
 .../examples/cookbook/JoinExamples.java | 23 ---
 .../examples/cookbook/MaxPerKeyExamples.java| 23 ---
 .../examples/cookbook/TriggerExample.java   | 23 ---
 .../examples/DebuggingWordCountTest.java| 23 ---
 .../cloud/dataflow/examples/WordCountTest.java  | 23 ---
 .../examples/complete/AutoCompleteTest.java | 23 ---
 .../dataflow/examples/complete/TfIdfTest.java   | 23 ---
 .../complete/TopWikipediaSessionsTest.java  | 23 ---
 .../cookbook/BigQueryTornadoesTest.java | 23 ---
 .../cookbook/CombinePerKeyExamplesTest.java | 23 ---
 .../examples/cookbook/DeDupExampleTest.java | 23 ---
 .../examples/cookbook/FilterExamplesTest.java   | 23 ---
 .../examples/cookbook/JoinExamplesTest.java | 23 ---
 .../cookbook/MaxPerKeyExamplesTest.java | 23 ---
 .../examples/cookbook/TriggerExampleTest.java   | 23 ---
 .../examples/MinimalWordCountJava8.java | 23 ---
 .../examples/complete/game/GameStats.java   | 23 ---
 .../examples/complete/game/HourlyTeamScore.java | 23 ---
 .../examples/complete/game/LeaderBoard.java | 23 ---
 .../examples/complete/game/UserScore.java   | 23 ---
 .../complete/game/injector/Injector.java| 23 ---
 .../complete/game/injector/InjectorUtils.java   | 23 ---
 .../injector/RetryHttpInitializerWrapper.java   | 23 ---
 .../complete/game/utils/WriteToBigQuery.java| 23 ---
 .../game/utils/WriteWindowedToBigQuery.java | 23 ---
 .../examples/MinimalWordCountJava8Test.java | 23 ---
 .../examples/complete/game/GameStatsTest.java   | 23 ---
 .../complete/game/HourlyTeamScoreTest.java  | 23 ---
 .../examples/complete/game/UserScoreTest.java   | 23 ---
 .../beam/runners/flink/examples/TFIDF.java  | 23 ---
 .../flink/examples/streaming/AutoComplete.java  | 23 ---
 .../flink/examples/streaming/JoinExamples.java  | 23 

[GitHub] incubator-beam pull request: Update LICENSE header across all file...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/100


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[04/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java
index b82e625..24750fe 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryTableRowIteratorTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import static org.hamcrest.Matchers.containsString;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryUtilTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryUtilTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryUtilTest.java
index fab4aec..7cb2c46 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryUtilTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BigQueryUtilTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import static org.junit.Assert.assertEquals;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BufferedElementCountingOutputStreamTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BufferedElementCountingOutputStreamTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BufferedElementCountingOutputStreamTest.java
index af2f442..5720070 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BufferedElementCountingOutputStreamTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/BufferedElementCountingOutputStreamTest.java
@@ 

[14/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java
index e2c4487..6f40889 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/View.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.transforms;
 
 import com.google.cloud.dataflow.sdk.runners.DirectPipelineRunner;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithKeys.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithKeys.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithKeys.java
index c06795c..91ef254 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithKeys.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithKeys.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.transforms;
 
 import com.google.cloud.dataflow.sdk.coders.CannotProvideCoderException;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithTimestamps.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithTimestamps.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithTimestamps.java
index 85a93bf..bc8e047 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithTimestamps.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/WithTimestamps.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor 

[21/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
--
diff --git 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
index 23562d0..1b2a57c 100644
--- 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
+++ 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
@@ -1,17 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not 
use this file except
- * in compliance with the License. You may obtain a copy of the License at
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software 
distributed under the License
- * is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY 
KIND, either express
- * or implied. See the License for the specific language governing permissions 
and limitations under
- * the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.examples.common;
 
 import com.google.api.client.googleapis.json.GoogleJsonResponseException;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExampleBigQueryTableOptions.java
--
diff --git 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExampleBigQueryTableOptions.java
 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExampleBigQueryTableOptions.java
index 7c213b5..a026f3e 100644
--- 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExampleBigQueryTableOptions.java
+++ 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExampleBigQueryTableOptions.java
@@ -1,17 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not 
use this file except
- * in compliance with the License. You may obtain a copy of the License at
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software 
distributed under the License
- * is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY 
KIND, either express
- * or implied. See the License for the specific language governing permissions 
and limitations under
- * the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.examples.common;
 
 import com.google.api.services.bigquery.model.TableSchema;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExamplePubsubTopicAndSubscriptionOptions.java
--
diff --git 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/ExamplePubsubTopicAndSubscriptionOptions.java
 

[20/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java
--
diff --git 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java
 
b/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java
index fcae41c..b34b70d 100644
--- 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java
+++ 
b/examples/java8/src/test/java/com/google/cloud/dataflow/examples/MinimalWordCountJava8Test.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.examples;
 
 import com.google.cloud.dataflow.sdk.Pipeline;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/GameStatsTest.java
--
diff --git 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/GameStatsTest.java
 
b/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/GameStatsTest.java
index f77d146..e1a5edb 100644
--- 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/GameStatsTest.java
+++ 
b/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/GameStatsTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.examples.complete.game;
 
 import 
com.google.cloud.dataflow.examples.complete.game.GameStats.CalculateSpammyUsers;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/HourlyTeamScoreTest.java
--
diff --git 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/HourlyTeamScoreTest.java
 
b/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/HourlyTeamScoreTest.java
index f77a5d4..df9768a 100644
--- 
a/examples/java8/src/test/java/com/google/cloud/dataflow/examples/complete/game/HourlyTeamScoreTest.java
+++ 

[11/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java
index 248f005..98a9d94 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/ReshuffleTrigger.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 package com.google.cloud.dataflow.sdk.util;
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/RetryHttpRequestInitializer.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/RetryHttpRequestInitializer.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/RetryHttpRequestInitializer.java
index 756dce0..f324e0d 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/RetryHttpRequestInitializer.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/RetryHttpRequestInitializer.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import com.google.api.client.http.HttpBackOffIOExceptionHandler;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/SerializableUtils.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/SerializableUtils.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/SerializableUtils.java
index 501b430..c660f70 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/SerializableUtils.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/SerializableUtils.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license 

[15/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java
index 1afb691..2f920a6 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineOptions.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.testing;
 
 import com.google.cloud.dataflow.sdk.options.BlockingDataflowPipelineOptions;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
index 9fff070..065d808 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestDataflowPipelineRunner.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.testing;
 
 import com.google.api.services.dataflow.model.JobMessage;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestPipeline.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestPipeline.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestPipeline.java
index a05a778..a942868 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestPipeline.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/testing/TestPipeline.java
@@ 

[06/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java
index c5b5fca..ffb71c0 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/DataflowJUnitTestRunner.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.testing;
 
 import com.google.cloud.dataflow.sdk.options.Description;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogs.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogs.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogs.java
index 48449b3..6c4ecf0 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogs.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogs.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.testing;
 
 import static org.junit.Assert.fail;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogsTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogsTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogsTest.java
index 2dce880..cff2df7 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogsTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/testing/ExpectedLogsTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) 

[07/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java
index d6a3c18..ca23737 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/PipelineOptionsValidatorTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.options;
 
 import org.junit.Rule;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/ProxyInvocationHandlerTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/ProxyInvocationHandlerTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/ProxyInvocationHandlerTest.java
index 7eb5822..f960d26 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/ProxyInvocationHandlerTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/options/ProxyInvocationHandlerTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.options;
 
 import static org.junit.Assert.assertEquals;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/AggregatorPipelineExtractorTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/AggregatorPipelineExtractorTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/AggregatorPipelineExtractorTest.java
index 04c7ede..480d7a3 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/runners/AggregatorPipelineExtractorTest.java
+++ 

[16/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java
index b736e35..9c46a41 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ForwardingPTransform.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2016 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 package com.google.cloud.dataflow.sdk.runners.inprocess;
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/GroupByKeyEvaluatorFactory.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/GroupByKeyEvaluatorFactory.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/GroupByKeyEvaluatorFactory.java
index 3ec4af1..3276a1b 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/GroupByKeyEvaluatorFactory.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/GroupByKeyEvaluatorFactory.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 package com.google.cloud.dataflow.sdk.runners.inprocess;
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ImmutabilityEnforcementFactory.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ImmutabilityEnforcementFactory.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ImmutabilityEnforcementFactory.java
index dfc56a9..2e4c07b 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/runners/inprocess/ImmutabilityEnforcementFactory.java
+++ 

[05/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java
index a6fe7e8..6508738 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/RemoveDuplicatesTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.transforms;
 
 import static org.junit.Assert.assertEquals;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SampleTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SampleTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SampleTest.java
index d860513..2342766 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SampleTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SampleTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.transforms;
 
 import static com.google.cloud.dataflow.sdk.TestUtils.LINES;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SimpleStatsFnsTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SimpleStatsFnsTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SimpleStatsFnsTest.java
index 914f95d..81690ad 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SimpleStatsFnsTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/SimpleStatsFnsTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * 

[08/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java
index 46b3997..999193c 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringDelegateCoderTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.coders;
 
 import com.google.cloud.dataflow.sdk.coders.Coder.NonDeterministicException;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringUtf8CoderTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringUtf8CoderTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringUtf8CoderTest.java
index 7f40fc0..a6b7f96 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringUtf8CoderTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StringUtf8CoderTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.coders;
 
 import com.google.cloud.dataflow.sdk.testing.CoderProperties;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StructuralByteArrayTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StructuralByteArrayTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StructuralByteArrayTest.java
index 8f8cd8c..f28dfa2 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StructuralByteArrayTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/coders/StructuralByteArrayTest.java
@@ -1,17 +1,19 @@

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #6

[Apache Jenkins Server]

See 

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #6

[Apache Jenkins Server]

See 

[13/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java
index cc817ba..dcc042c 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/TriggerBuilder.java
@@ -1,17 +1,19 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
 package com.google.cloud.dataflow.sdk.transforms.windowing;
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/Window.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/Window.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/Window.java
index 6793e76..1e7282d 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/Window.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/Window.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.transforms.windowing;
 
 import com.google.cloud.dataflow.sdk.annotations.Experimental;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/WindowFn.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/WindowFn.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/WindowFn.java
index d51fc7e..f455426 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/WindowFn.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/transforms/windowing/WindowFn.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 

[10/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java
index 6c764d9..56d671e 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ElementByteSizeObserver.java
@@ -1,19 +1,20 @@
-/***
- * Copyright (C) 2015 Google Inc.
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
- 
**/
-
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
 package com.google.cloud.dataflow.sdk.util.common;
 
 import java.util.Observable;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/PeekingReiterator.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/PeekingReiterator.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/PeekingReiterator.java
index 0948747..1a092e6 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/PeekingReiterator.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/PeekingReiterator.java
@@ -1,19 +1,20 @@
-/***
- * Copyright (C) 2015 Google Inc.
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
- 
**/
-
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
 package com.google.cloud.dataflow.sdk.util.common;
 
 import static com.google.common.base.Preconditions.checkNotNull;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ReflectHelpers.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/util/common/ReflectHelpers.java
 

[02/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java
--
diff --git 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java
 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java
index 525de69..30b9e1a 100644
--- 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java
+++ 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/ExamplePubsubTopicOptions.java
@@ -1,17 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not 
use this file except
- * in compliance with the License. You may obtain a copy of the License at
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software 
distributed under the License
- * is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY 
KIND, either express
- * or implied. See the License for the specific language governing permissions 
and limitations under
- * the License.
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package ${package}.common;
 
 import com.google.cloud.dataflow.sdk.options.DataflowPipelineOptions;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/PubsubFileInjector.java
--
diff --git 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/PubsubFileInjector.java
 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/PubsubFileInjector.java
index f6f80ae..096d9d2 100644
--- 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/PubsubFileInjector.java
+++ 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/main/java/common/PubsubFileInjector.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package ${package}.common;
 
 import com.google.api.services.pubsub.Pubsub;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/src/test/java/DebuggingWordCountTest.java
--
diff --git 

[09/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java
index eb95a23..f7c7b70 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValue.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.values;
 
 import com.google.cloud.dataflow.sdk.transforms.AppliedPTransform;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValueBase.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValueBase.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValueBase.java
index 7e57204..ee2a845 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValueBase.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/PValueBase.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.values;
 
 import com.google.cloud.dataflow.sdk.Pipeline;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/TimestampedValue.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/TimestampedValue.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/TimestampedValue.java
index 1085d44..26e6b1a 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/TimestampedValue.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/values/TimestampedValue.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with 

[03/23] incubator-beam git commit: Update LICENSE header across all files

[dhalperi]

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java
index f291438..fdfe1e6 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/TriggerTester.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import static com.google.common.base.Preconditions.checkArgument;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedInputStreamTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedInputStreamTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedInputStreamTest.java
index 30da6ae..ef956cb 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedInputStreamTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedInputStreamTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
  *
- * Licensed under the Apache License, Version 2.0 (the "License"); you may not
- * use this file except in compliance with the License. You may obtain a copy 
of
- * the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
+ * http://www.apache.org/licenses/LICENSE-2.0
  *
  * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
- * WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
- * License for the specific language governing permissions and limitations 
under
- * the License.
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
  */
-
 package com.google.cloud.dataflow.sdk.util;
 
 import static org.junit.Assert.assertEquals;

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d59c8012/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedOutputStreamTest.java
--
diff --git 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedOutputStreamTest.java
 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedOutputStreamTest.java
index eea70fe..459220a 100644
--- 
a/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedOutputStreamTest.java
+++ 
b/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/util/UnownedOutputStreamTest.java
@@ -1,19 +1,20 @@
 /*
- * Copyright (C) 2015 Google Inc.
+ * Licensed to the Apache Software Foundation (ASF) 

[01/23] incubator-beam git commit: Update checkstyle.xml to require Apache copyright header in each file

[dhalperi]

Repository: incubator-beam
Updated Branches:
  refs/heads/master c6aac3b26 -> ffb7002b8


Update checkstyle.xml to require Apache copyright header in each file


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/43f25f1c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/43f25f1c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/43f25f1c

Branch: refs/heads/master
Commit: 43f25f1cd4fbbd17bc72162457351df0d8c5097d
Parents: d59c801
Author: Davor Bonaci 
Authored: Wed Mar 30 15:16:39 2016 -0700
Committer: Dan Halperin 
Committed: Wed Mar 30 16:34:14 2016 -0700

--
 sdks/java/checkstyle.xml | 11 +--
 1 file changed, 5 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/43f25f1c/sdks/java/checkstyle.xml
--
diff --git a/sdks/java/checkstyle.xml b/sdks/java/checkstyle.xml
index 6852e6c..504bdc1 100644
--- a/sdks/java/checkstyle.xml
+++ b/sdks/java/checkstyle.xml
@@ -26,21 +26,20 @@ page at http://checkstyle.sourceforge.net/config.html -->
 
 
   
-
 
+value="^ \* Licensed to the Apache Software Foundation \(ASF\) under 
one$" />
 
 
-
+
 
   
 

[GitHub] incubator-beam pull request: Add basic integration/e2e tests.

[jasonkuster]

GitHub user jasonkuster opened a pull request:

https://github.com/apache/incubator-beam/pull/101

Add basic integration/e2e tests.

This contribution adds the failsafe plugin in the examples directory and 
adds a WordCount test which for now runs using the DataflowPipelineRunner.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/stevewheeler/incubator-beam int_tests

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/101.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #101


commit ab876f8848a23ce2fb7c36f327bd37f34e0b0453
Author: Jason Kuster 
Date:   2016-03-30T23:24:52Z

Add failsafe plugin for integration tests.

Signed-off-by: Jason Kuster 

commit 99da844b4af7226e758f6ec549a53643875d6692
Author: Steve Wheeler 
Date:   2016-03-25T18:14:15Z

Add WordCount batch e2e integration tests

Signed-off-by: Steve Wheeler 

commit 56eeef51fee6a2fb76260fb59be911b84bb495a9
Author: Jason Kuster 
Date:   2016-03-30T01:30:33Z

Use correct jar

Signed-off-by: Jason Kuster 

commit 0961384859d30fedfe5f908cb8b8bf2337c2240d
Author: Steve Wheeler 
Date:   2016-03-30T15:41:31Z

Fix WordCount integration tests to use correct staging and output locations

Signed-off-by: Steve Wheeler 

commit 84fa2042003a1655feb5a888e7b42c5ebc7f05e4
Author: Jason Kuster 
Date:   2016-03-30T23:25:32Z

Add profiles to enable or disable integration tests.

Signed-off-by: Jason Kuster 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request: Re-interrupt current thread when igno...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/45


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: This closes #45

[lcwik]

This closes #45


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6aac3b2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c6aac3b2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/c6aac3b2

Branch: refs/heads/master
Commit: c6aac3b263df2da3bd8c335fdf131e462ef9268d
Parents: 78abd96 a8eeaf5
Author: Luke Cwik 
Authored: Wed Mar 30 16:28:31 2016 -0700
Committer: Luke Cwik 
Committed: Wed Mar 30 16:28:31 2016 -0700

--
 .../dataflow/examples/common/DataflowExampleUtils.java  |  8 +++-
 .../com/google/cloud/dataflow/sdk/io/BigQueryIO.java|  3 +++
 .../dataflow/sdk/io/BoundedReadFromUnboundedSource.java |  6 +++---
 .../sdk/runners/BlockingDataflowPipelineRunner.java |  3 +++
 .../cloud/dataflow/sdk/runners/DataflowPipelineJob.java |  3 +++
 .../sdk/transforms/IntraBundleParallelization.java  |  1 +
 .../cloud/dataflow/sdk/util/BigQueryTableInserter.java  |  2 ++
 .../dataflow/sdk/util/BigQueryTableRowIterator.java | 12 +++-
 .../com/google/cloud/dataflow/sdk/util/GcsUtil.java |  4 
 9 files changed, 29 insertions(+), 13 deletions(-)
--

[1/2] incubator-beam git commit: Re-interrupt current thread when ignoring InterruptedException

[lcwik]

Repository: incubator-beam
Updated Branches:
  refs/heads/master 78abd964a -> c6aac3b26


Re-interrupt current thread when ignoring InterruptedException


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a8eeaf5e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a8eeaf5e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/a8eeaf5e

Branch: refs/heads/master
Commit: a8eeaf5e1f0c74beb96ad78e73af4751cd650262
Parents: 78abd96
Author: Pei He 
Authored: Mon Mar 14 17:34:57 2016 -0700
Committer: Luke Cwik 
Committed: Wed Mar 30 16:27:23 2016 -0700

--
 .../dataflow/examples/common/DataflowExampleUtils.java  |  8 +++-
 .../com/google/cloud/dataflow/sdk/io/BigQueryIO.java|  3 +++
 .../dataflow/sdk/io/BoundedReadFromUnboundedSource.java |  6 +++---
 .../sdk/runners/BlockingDataflowPipelineRunner.java |  3 +++
 .../cloud/dataflow/sdk/runners/DataflowPipelineJob.java |  3 +++
 .../sdk/transforms/IntraBundleParallelization.java  |  1 +
 .../cloud/dataflow/sdk/util/BigQueryTableInserter.java  |  2 ++
 .../dataflow/sdk/util/BigQueryTableRowIterator.java | 12 +++-
 .../com/google/cloud/dataflow/sdk/util/GcsUtil.java |  4 
 9 files changed, 29 insertions(+), 13 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a8eeaf5e/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
--
diff --git 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
index 4dfdd85..23562d0 100644
--- 
a/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
+++ 
b/examples/java/src/main/java/com/google/cloud/dataflow/examples/common/DataflowExampleUtils.java
@@ -50,6 +50,7 @@ import com.google.common.base.Strings;
 import com.google.common.base.Throwables;
 import com.google.common.collect.Lists;
 import com.google.common.collect.Sets;
+import com.google.common.util.concurrent.Uninterruptibles;
 
 import java.io.IOException;
 import java.util.Collection;
@@ -108,6 +109,7 @@ public class DataflowExampleUtils {
 }
   } while (BackOffUtils.next(sleeper, backOff));
 } catch (InterruptedException e) {
+  Thread.currentThread().interrupt();
   // Ignore InterruptedException
 }
 Throwables.propagate(lastException);
@@ -442,11 +444,7 @@ public class DataflowExampleUtils {
   System.out.println(
   "The example pipeline is still running. Verifying the 
cancellation.");
 }
-try {
-  Thread.sleep(1);
-} catch (InterruptedException e) {
-  // Ignore
-}
+Uninterruptibles.sleepUninterruptibly(10, TimeUnit.SECONDS);
   }
   if (!cancellationVerified) {
 System.out.println("Failed to verify the cancellation for job: " + 
job.getJobId());

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a8eeaf5e/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BigQueryIO.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BigQueryIO.java 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BigQueryIO.java
index ab7df6f..8b08225 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BigQueryIO.java
+++ 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BigQueryIO.java
@@ -1438,6 +1438,9 @@ public class BigQueryIO {
   LOG.info("Number of records read from BigQuery: {}", elems.size());
   context.setPCollection(context.getOutput(transform), elems);
 } catch (IOException | InterruptedException e) {
+  if (e instanceof InterruptedException) {
+Thread.currentThread().interrupt();
+  }
   throw new RuntimeException(e);
 }
   }

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a8eeaf5e/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BoundedReadFromUnboundedSource.java
--
diff --git 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BoundedReadFromUnboundedSource.java
 
b/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BoundedReadFromUnboundedSource.java
index 52c730c..3fa9c69 100644
--- 
a/sdks/java/core/src/main/java/com/google/cloud/dataflow/sdk/io/BoundedReadFromUnboundedSource.java
+++ 

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #5

[Apache Jenkins Server]

See 

[GitHub] incubator-beam pull request: Update LICENSE header across all file...

[davorbonaci]

GitHub user davorbonaci opened a pull request:

https://github.com/apache/incubator-beam/pull/100

Update LICENSE header across all files

R: @jbonofre

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam header

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/100.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #100


commit a326f77509239ab998c1292c09a5a6dfdbf836eb
Author: Davor Bonaci 
Date:   2016-03-30T21:59:35Z

Update LICENSE header across all files

commit 4762dff3f05d5aaf837d3d237c236c0e42f52093
Author: Davor Bonaci 
Date:   2016-03-30T22:16:39Z

Update checkstyle.xml to require Apache copyright header in each file




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218969#comment-15218969
 ] 

ASF GitHub Bot commented on BEAM-77:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/98


> Reorganize Directory structure
> --
>
> Key: BEAM-77
> URL: https://issues.apache.org/jira/browse/BEAM-77
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Frances Perry
>Assignee: Jean-Baptiste Onofré
>
> Now that we've done the initial Dataflow code drop, we will restructure 
> directories to provide space for additional SDKs and Runners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-77] Move Java-specific checksty...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/98


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/2] incubator-beam git commit: [BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory

[dhalperi]

Repository: incubator-beam
Updated Branches:
  refs/heads/master 636ad413a -> 78abd964a


[BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cd828f1a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cd828f1a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/cd828f1a

Branch: refs/heads/master
Commit: cd828f1ab007db78fc4dc637bbbf3324897b6d8b
Parents: 636ad41
Author: Davor Bonaci 
Authored: Wed Mar 30 13:18:30 2016 -0700
Committer: Davor Bonaci 
Committed: Wed Mar 30 13:21:14 2016 -0700

--
 checkstyle.xml   | 413 --
 contrib/hadoop/pom.xml   |   2 +-
 contrib/join-library/pom.xml |   2 +-
 examples/java/pom.xml|   2 +-
 examples/java8/pom.xml   |   2 +-
 sdks/java/checkstyle.xml | 413 ++
 sdks/java/core/pom.xml   |   2 +-
 sdks/java/java8tests/pom.xml |   2 +-
 8 files changed, 419 insertions(+), 419 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/cd828f1a/checkstyle.xml
--
diff --git a/checkstyle.xml b/checkstyle.xml
deleted file mode 100644
index f38dd74..000
--- a/checkstyle.xml
+++ /dev/null
@@ -1,413 +0,0 @@
-
-
-http://www.puppycrawl.com/dtds/configuration_1_3.dtd;>
-
-
-
-
-
-  
-
-
-
-
-
-
-  
-
-  
-
-  
-
-  
-
-  
-
-
-
-
-  
-
-  
-
-
-
-  
-
-  
-
-
-
-
-  
-
-  
-
-
-
-
-  
-
-  
-  
-
-
-
-  
-
-  
-  
-
-
-  
-  
-  
-
-
-
-
-
-  
-  
-  
-
-
-
-  
-
-  
-  
-  
-  
-  
-  
-
-
-
-  
-
-
-
-  
-  
-  
-
-
-
-
-
-
-
-  
-  
-  
-  
-  
-  
-  
-  
-
-
-
-  
-  
-  
-
-
-
-  
-  
-
-
-
-
-
-
-
-  
-  
-  
-  
-
-
-
-  
-  
-  
-
-
-
-  
-  
-  
-  
-  
-  
-  
-  
-  
-
-
-
-  
-  
-  
-  
-  
-  
-  
-  
-
-
-
-  
-  
-  
-  
-  
-  
-  
-  
-
-
-
-  
-  
-  
-  
-
-
-
-  
-  
-
-
-
-  
-  
-
-
-
-  
-  
-
-
-
-
-  
-  
-
-
-
-  
-  
-
-
-
-  
-  
-
-
-
-
-
-  
-  
-  
-
-  
-
-  
-
-
-
-  
-  
-
-
-
-  
-  
-  
-  
-
-
-
-
-  
-  
-
-
-
-  
-  
-
-
-
-  
-  
-  
-
-
-
-
-
-
-  
-  
-
-
-
-
-
-
-  
-  
-  
-
-
-
-  
-  
-
-
-
-  
-  
-  
-  
-
-
-
-  
-  
-  
-  
-
-
-
-  
-  
-
-
-
-
-
-  
-
-

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/cd828f1a/contrib/hadoop/pom.xml
--
diff --git a/contrib/hadoop/pom.xml b/contrib/hadoop/pom.xml
index 8e5a207..05212e4 100644
--- a/contrib/hadoop/pom.xml
+++ b/contrib/hadoop/pom.xml
@@ -63,7 +63,7 @@
   
 
 
-  ../../checkstyle.xml
+  ../../sdks/java/checkstyle.xml
   true
   true
   true

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/cd828f1a/contrib/join-library/pom.xml
--
diff --git a/contrib/join-library/pom.xml b/contrib/join-library/pom.xml
index df39545..10f663d 100644
--- a/contrib/join-library/pom.xml
+++ b/contrib/join-library/pom.xml
@@ -70,7 +70,7 @@
 maven-checkstyle-plugin
 2.17
 
-  ../../checkstyle.xml
+  ../../sdks/java/checkstyle.xml
   true
   true
   true

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/cd828f1a/examples/java/pom.xml
--
diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index b762c84..2e158cb 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -70,7 +70,7 @@
   
 
 
-  ../../checkstyle.xml
+  ../../sdks/java/checkstyle.xml
   true
   true
   true

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/cd828f1a/examples/java8/pom.xml

[2/2] incubator-beam git commit: Closes #98

[dhalperi]

Closes #98


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/78abd964
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/78abd964
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/78abd964

Branch: refs/heads/master
Commit: 78abd964aa3dc17577f6b8e583859c43ccc48024
Parents: 636ad41 cd828f1
Author: Dan Halperin 
Authored: Wed Mar 30 15:08:06 2016 -0700
Committer: Dan Halperin 
Committed: Wed Mar 30 15:08:06 2016 -0700

--
 checkstyle.xml   | 413 --
 contrib/hadoop/pom.xml   |   2 +-
 contrib/join-library/pom.xml |   2 +-
 examples/java/pom.xml|   2 +-
 examples/java8/pom.xml   |   2 +-
 sdks/java/checkstyle.xml | 413 ++
 sdks/java/core/pom.xml   |   2 +-
 sdks/java/java8tests/pom.xml |   2 +-
 8 files changed, 419 insertions(+), 419 deletions(-)
--

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow #4

[Apache Jenkins Server]

See 

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDKs :: Java :: Core #4

[Apache Jenkins Server]

See 

[GitHub] incubator-beam pull request: [BEAM-160] Import NexMark integration...

[mshields822]

GitHub user mshields822 opened a pull request:

https://github.com/apache/incubator-beam/pull/99

[BEAM-160] Import NexMark integration tests.

BUILDS ON https://github.com/apache/incubator-beam/pull/85

This is an initial import of the 'NexMark' integration tests.
All Google Dataflow specific code has been isolated.
It could do with more cleanup, but wanted to get it out in the sunlight. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mshields822/incubator-beam nexmark

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/99.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #99


commit dbc39a605bf09f2d1f1cae05de4caaf176abe6c1
Author: Mark Shields 
Date:   2016-03-28T20:30:37Z

Initial import

commit 4fa0b3d98c302c8b710106610b5aca0721436f87
Author: Mark Shields 
Date:   2016-03-28T20:37:23Z

Initial import II

commit 4ba8f304821a09af12e4fd8703d64c16b1349256
Author: Mark Shields 
Date:   2016-03-28T21:58:49Z

Formatting busywork

commit e78d9a8b220874b87107312a6d13670e798184f7
Author: Mark Shields 
Date:   2016-03-30T18:52:34Z

pub/sub source/sink and grpc client refactor

Move some pubsub source/sink machinery into
PubSubGrpcClient so that it's api can be grpc
and protoc neutral.

commit a7291da3b27a657b8cd2deeda87f158f97240b76
Author: Mark Shields 
Date:   2016-03-30T19:22:20Z

Unused imports

commit c2e8219050c904ba7a8cbb57199f95b61e88bec7
Author: Mark Shields 
Date:   2016-03-30T19:39:21Z

Import order

commit 444937c53d219c10f2705e41e5c3268abccd6c0e
Author: Mark Shields 
Date:   2016-03-28T23:25:29Z

Copy over. Break deps on RetryHttpInitializer

commit 30585ad3529b0799043d3cef9d2824337b631baa
Author: Mark Shields 
Date:   2016-03-30T20:04:10Z

Unused import

commit c5d663ed79c6a89b05c580f8340024a211482f9e
Author: Mark Shields 
Date:   2016-03-30T20:24:57Z

Limit dataflow dependencies




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request: [BEAM-77] Move Java-specific checksty...

[davorbonaci]

GitHub user davorbonaci opened a pull request:

https://github.com/apache/incubator-beam/pull/98

[BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory

R: @dhalperi 
CC: @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam checkstyle.xml

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/98.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #98


commit cd828f1ab007db78fc4dc637bbbf3324897b6d8b
Author: Davor Bonaci 
Date:   2016-03-30T20:18:30Z

[BEAM-77] Move Java-specific checkstyle.xml into 'sdks/java' directory




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (BEAM-159) Support fixed number of shards in custom sinks

[Daniel Halperin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin resolved BEAM-159.
--
Resolution: Duplicate

> Support fixed number of shards in custom sinks
> --
>
> Key: BEAM-159
> URL: https://issues.apache.org/jira/browse/BEAM-159
> Project: Beam
>  Issue Type: Improvement
>Reporter: Eugene Kirpichov
>
> TextIO supports .withNumShards, however custom sinks, in particular 
> FileBasedSinks, provide no support for controlling sharding. Some users want 
> this, e.g. 
> http://stackoverflow.com/questions/36316304/set-num-of-output-shard-in-write-tosink-in-dataflow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-159) Support fixed number of shards in custom sinks

[Daniel Halperin (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218769#comment-15218769
 ] 

Daniel Halperin commented on BEAM-159:
--

https://issues.apache.org/jira/browse/BEAM-68

> Support fixed number of shards in custom sinks
> --
>
> Key: BEAM-159
> URL: https://issues.apache.org/jira/browse/BEAM-159
> Project: Beam
>  Issue Type: Improvement
>Reporter: Eugene Kirpichov
>
> TextIO supports .withNumShards, however custom sinks, in particular 
> FileBasedSinks, provide no support for controlling sharding. Some users want 
> this, e.g. 
> http://stackoverflow.com/questions/36316304/set-num-of-output-shard-in-write-tosink-in-dataflow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218739#comment-15218739
 ] 

ASF GitHub Bot commented on BEAM-77:


Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/90


> Reorganize Directory structure
> --
>
> Key: BEAM-77
> URL: https://issues.apache.org/jira/browse/BEAM-77
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Frances Perry
>Assignee: Jean-Baptiste Onofré
>
> Now that we've done the initial Dataflow code drop, we will restructure 
> directories to provide space for additional SDKs and Runners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-77] Using wrap modules for sdks...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/90


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/2] incubator-beam git commit: [BEAM-77] Using wrap modules for sdks and examples

[davor]

Repository: incubator-beam
Updated Branches:
  refs/heads/master 17863c851 -> 636ad413a


[BEAM-77] Using wrap modules for sdks and examples


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c6c28365
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c6c28365
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/c6c28365

Branch: refs/heads/master
Commit: c6c283653ffa5c1c696a234a87bfcefc47a23cf7
Parents: 17863c8
Author: Jean-Baptiste Onofré 
Authored: Wed Mar 30 00:23:10 2016 +0200
Committer: Jean-Baptiste Onofré 
Committed: Wed Mar 30 17:10:51 2016 +0200

--
 examples/pom.xml| 53 +++
 pom.xml | 23 +-
 runners/pom.xml |  1 +
 sdks/java/core/pom.xml  |  6 +--
 sdks/java/java8tests/pom.xml|  6 +--
 sdks/java/maven-archetypes/examples/pom.xml |  2 +-
 sdks/java/maven-archetypes/pom.xml  |  6 +--
 sdks/java/maven-archetypes/starter/pom.xml  |  2 +-
 sdks/java/pom.xml   | 54 
 sdks/pom.xml| 41 ++
 10 files changed, 162 insertions(+), 32 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c6c28365/examples/pom.xml
--
diff --git a/examples/pom.xml b/examples/pom.xml
new file mode 100644
index 000..26b6720
--- /dev/null
+++ b/examples/pom.xml
@@ -0,0 +1,53 @@
+
+
+http://maven.apache.org/POM/4.0.0;
+ xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
+ xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
+
+  4.0.0
+
+  
+org.apache.beam
+parent
+0.1.0-incubating-SNAPSHOT
+../pom.xml
+  
+
+  examples-parent
+
+  pom
+
+  Apache Beam :: Examples
+
+  
+java
+  
+
+  
+
+  java8
+  
+[1.8,)
+  
+  
+java8
+  
+  
+  
+
+
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c6c28365/pom.xml
--
diff --git a/pom.xml b/pom.xml
index b79ddf6..3cae1a4 100644
--- a/pom.xml
+++ b/pom.xml
@@ -125,32 +125,13 @@
   pom
 
   
-sdks/java/core
+sdks
 runners
-examples/java
-sdks/java/maven-archetypes
+examples
   
 
   
 
-  java8-tests
-  
-[1.8,)
-  
-  
-sdks/java/java8tests
-  
-
-
-  java8-examples
-  
-[1.8,)
-  
-  
-examples/java8
-  
-
-
   doclint-java8-disable
   
 [1.8,)

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c6c28365/runners/pom.xml
--
diff --git a/runners/pom.xml b/runners/pom.xml
index fc379ce..cba25a3 100644
--- a/runners/pom.xml
+++ b/runners/pom.xml
@@ -25,6 +25,7 @@
 org.apache.beam
 parent
 0.1.0-incubating-SNAPSHOT
+../pom.xml
   
 
   runners-parent

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c6c28365/sdks/java/core/pom.xml
--
diff --git a/sdks/java/core/pom.xml b/sdks/java/core/pom.xml
index 2b9e4a9..f788c0d 100644
--- a/sdks/java/core/pom.xml
+++ b/sdks/java/core/pom.xml
@@ -23,13 +23,13 @@
 
   
 org.apache.beam
-parent
+java-sdk-parent
 0.1.0-incubating-SNAPSHOT
-../../../pom.xml
+../pom.xml
   
 
   java-sdk-all
-  Apache Beam :: SDK :: Java All
+  Apache Beam :: SDKs :: Java :: Core
   Beam SDK Java All provides a simple, Java-based
   interface for processing virtually any size data. This
   artifact includes entire Apache Beam Java SDK.

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/c6c28365/sdks/java/java8tests/pom.xml
--
diff --git a/sdks/java/java8tests/pom.xml b/sdks/java/java8tests/pom.xml
index 0338702..61e4785 100644
--- a/sdks/java/java8tests/pom.xml
+++ b/sdks/java/java8tests/pom.xml
@@ -23,13 +23,13 @@
 
   
 org.apache.beam
-parent
+java-sdk-parent
 0.1.0-incubating-SNAPSHOT
-../../../pom.xml
+../pom.xml
   
 
   java8tests-all
-  Apache Beam :: Tests :: Java 8 All
+  Apache Beam :: SDKs :: Java :: Tests
   Apache Beam Java SDK provides a simple, Java-based
 interface for processing virtually any size data.
 This artifact includes tests of the SDK from a Java 8

[jira] [Created] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

[Mark Shields (JIRA)]

Mark Shields created BEAM-160:
-

 Summary: Port 'NexMark Queries' to Beam for use as integration test
 Key: BEAM-160
 URL: https://issues.apache.org/jira/browse/BEAM-160
 Project: Beam
  Issue Type: Test
  Components: testing
Reporter: Mark Shields
Assignee: Davor Bonaci


A while back we implemented the 'queries' from
  http://datalab.cs.pdx.edu/niagara/NEXMark/
as Gooogle Dataflow pipelines. We found them useful
for uncovering performance problems with the sdk, our runners,
and our service. Many of those problems only manifested under
high load, multi-day runs, or with high 'backlog' on the incoming
pub/sub subscriptions.

We thus think they would be useful for other runners.

Disclaimer: Though the original 'queries' were proposed as a way to
benchmark 'continuous SQL' implementations, we have so far only
used them for internal A/B and regression testing and have not validated
them as representative of customer workloads. We would thus discourage their 
use for competitive benchmarks without more work.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to stable : beam_MavenVerify #51

[Apache Jenkins Server]

See 

[jira] [Created] (BEAM-159) Support fixed number of shards in custom sinks

[Eugene Kirpichov (JIRA)]

Eugene Kirpichov created BEAM-159:
-

 Summary: Support fixed number of shards in custom sinks
 Key: BEAM-159
 URL: https://issues.apache.org/jira/browse/BEAM-159
 Project: Beam
  Issue Type: Improvement
Reporter: Eugene Kirpichov


TextIO supports .withNumShards, however custom sinks, in particular 
FileBasedSinks, provide no support for controlling sharding. Some users want 
this, e.g. 
http://stackoverflow.com/questions/36316304/set-num-of-output-shard-in-write-tosink-in-dataflow



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218464#comment-15218464
 ] 

ASF GitHub Bot commented on BEAM-77:


GitHub user jbonofre opened a pull request:

https://github.com/apache/incubator-beam/pull/97

[BEAM-77] Create IO module and move bigtable there

[BEAM-77] Create io module and move bigtable there

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable 
   Travis-CI for on your fork and ensure the whole test matrix passes).
 - [X] Replace "" in the title with the actual Jira issue 
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
   



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jbonofre/incubator-beam BIGTABLE_IO

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/97.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #97


commit 1e80395cd280546775bd56a1f743276bf71ea284
Author: Jean-Baptiste Onofré 
Date:   2016-03-30T16:18:51Z

[BEAM-77] Create IO module and move bigtable there




> Reorganize Directory structure
> --
>
> Key: BEAM-77
> URL: https://issues.apache.org/jira/browse/BEAM-77
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Frances Perry
>Assignee: Jean-Baptiste Onofré
>
> Now that we've done the initial Dataflow code drop, we will restructure 
> directories to provide space for additional SDKs and Runners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-77] Create IO module and move b...

[jbonofre]

GitHub user jbonofre opened a pull request:

https://github.com/apache/incubator-beam/pull/97

[BEAM-77] Create IO module and move bigtable there

[BEAM-77] Create io module and move bigtable there

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable 
   Travis-CI for on your fork and ensure the whole test matrix passes).
 - [X] Replace "" in the title with the actual Jira issue 
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
   



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jbonofre/incubator-beam BIGTABLE_IO

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/97.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #97


commit 1e80395cd280546775bd56a1f743276bf71ea284
Author: Jean-Baptiste Onofré 
Date:   2016-03-30T16:18:51Z

[BEAM-77] Create IO module and move bigtable there




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-77) Reorganize Directory structure

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-77?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218462#comment-15218462
 ] 

ASF GitHub Bot commented on BEAM-77:


Github user jbonofre closed the pull request at:

https://github.com/apache/incubator-beam/pull/95


> Reorganize Directory structure
> --
>
> Key: BEAM-77
> URL: https://issues.apache.org/jira/browse/BEAM-77
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Frances Perry
>Assignee: Jean-Baptiste Onofré
>
> Now that we've done the initial Dataflow code drop, we will restructure 
> directories to provide space for additional SDKs and Runners.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [BEAM-77] IOs module creation, and re...

[jbonofre]

Github user jbonofre closed the pull request at:

https://github.com/apache/incubator-beam/pull/95


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request: [BEAM-77] Move hadoop contrib as hdfs...

[jbonofre]

GitHub user jbonofre opened a pull request:

https://github.com/apache/incubator-beam/pull/96

[BEAM-77] Move hadoop contrib as hdfs IO

[BEAM-77] Move hadoop into io module as hdfs

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable 
   Travis-CI for on your fork and ensure the whole test matrix passes).
 - [X] Replace "" in the title with the actual Jira issue 
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).
   



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jbonofre/incubator-beam HDFS_IO

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/96.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #96


commit cd3aff12cadadd5a342d17ee08ea065e472c979f
Author: Jean-Baptiste Onofré 
Date:   2016-03-30T16:18:51Z

[BEAM-77] Move hadoop contrib as hdfs IO




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (BEAM-154) Provide Maven BOM

[Davor Bonaci (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Davor Bonaci updated BEAM-154:
--
Component/s: sdk-java-core

> Provide Maven BOM
> -
>
> Key: BEAM-154
> URL: https://issues.apache.org/jira/browse/BEAM-154
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Jean-Baptiste Onofré
>Assignee: Jean-Baptiste Onofré
>
> When using the Java SDK (for instance to develop IO), the developer has to 
> add dependencies in his pom.xml (like junit, hamcrest, slf4j, ...).
> To simplify the way to define the dependencies, each Beam SDK could provide a 
> Maven BoM (Bill of Material) describing these dependencies. Then the 
> developer could simply define this BoM as pom.xml dependency.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-134) Investigate use of AutoValue

[Davor Bonaci (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218445#comment-15218445
 ] 

Davor Bonaci commented on BEAM-134:
---

A quick doc showing how the code changes for one of the high-value cases?

> Investigate use of AutoValue
> 
>
> Key: BEAM-134
> URL: https://issues.apache.org/jira/browse/BEAM-134
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Scott Wegner
>Assignee: Scott Wegner
>Priority: Minor
> Attachments: 
> 0001-Mark-classes-which-might-benefit-from-AutoValue.patch
>
>
> The initial PR for [BEAM-118] added a dependency on AutoValue to 
> auto-implement equality semantics for a new POJO. We decided to remove the 
> dependency because the cost of adding the dependency for this feature may not 
> be worth it for the value.
> However, we could use AutoValue for all of our POJO's, it might be worth it. 
> The proposal here is to follow-up with an investigation on whether we would 
> gain significant value to porting our code to use AutoValue instead of 
> hand-written POJO's.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_RunnableOnService_GoogleCloudDataflow » Apache Beam :: SDK :: Java All #3

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-127) Support for Unbounded sinks in Streaming

[Kostas Kloudas (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217812#comment-15217812
 ] 

Kostas Kloudas commented on BEAM-127:
-

Hi [~mxm], I suppose you mean sinks right?

> Support for Unbounded sinks in Streaming
> 
>
> Key: BEAM-127
> URL: https://issues.apache.org/jira/browse/BEAM-127
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-flink
>Reporter: Kostas Kloudas
>Assignee: Kostas Kloudas
>
> Currently the Flink runner for streaming does not support any sinks apart 
> from writing on the local filesystems of the task managers. This has to 
> change. A possible way is to add support for UnboundedFlinkSinks that wrap 
> around the currently supported sinks in Flink.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-136) PipelineOptionsFactory should detect all runners

[Maximilian Michels (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217763#comment-15217763
 ] 

Maximilian Michels commented on BEAM-136:
-

Thanks. Seems like we're already set up then. The user must have excluded the 
META-INF file in his fat jar.

+1 for a lightweight integration test

> PipelineOptionsFactory should detect all runners
> 
>
> Key: BEAM-136
> URL: https://issues.apache.org/jira/browse/BEAM-136
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Daniel Halperin
>Assignee: Thomas Groh
>Priority: Minor
>
> Even with flink-runner jar on classpath, we didn't find it.
> See linked thread here: 
> http://mail-archives.apache.org/mod_mbox/incubator-beam-user/201603.mbox/%3CCAA8k_FLekCURJKYO8qab%3DR%3DG-sRrTmYc7_NQXcrY1kHyATAtBw%40mail.gmail.com%3E



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (BEAM-158) Add support for bounded sources in streaming mode

[Maximilian Michels (JIRA)]

Maximilian Michels created BEAM-158:
---

 Summary: Add support for bounded sources in streaming mode
 Key: BEAM-158
 URL: https://issues.apache.org/jira/browse/BEAM-158
 Project: Beam
  Issue Type: Improvement
  Components: runner-flink
Reporter: Maximilian Michels
Assignee: Maximilian Michels






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request: [flink] improve lifecycle handling of...

[mxm]

GitHub user mxm opened a pull request:

https://github.com/apache/incubator-beam/pull/94

[flink] improve lifecycle handling of GroupAlsoByWindowWrapper 

Could someone have a look if these minor changes are good to merge? 
@davorbonaci @kennknowles 

Note, that there are two commits. One for the lifecycle of the Operator, 
another one for improving code readability.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mxm/incubator-beam lifecycle

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/94.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #94


commit 033b9240765543438068c1adea6d0cff34ddcd53
Author: Maximilian Michels 
Date:   2016-03-28T09:31:38Z

[flink] improve lifecycle handling of GroupAlsoByWindowWrapper

commit 63a7c3d0cb51caf65dc82141671cf28d47c2be39
Author: Maximilian Michels 
Date:   2016-03-30T10:02:01Z

[flink] improve readability of processElement function




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request: [BEAM-80] Manually fix some broken us...

[dhalperi]

GitHub user dhalperi opened a pull request:

https://github.com/apache/incubator-beam/pull/93

[BEAM-80] Manually fix some broken uses of DataflowAssert



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam dataflow-assert

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/93.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #93


commit f9fa9b9afe6905e8b33aa8a2a196e6009704cead
Author: Dan Halperin 
Date:   2016-03-30T06:05:49Z

Manually fix some broken uses of DataflowAssert

Pipeline was not run




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-157) CombineTest.testGlobalCombineWithDefaultsAndTriggers is broken

[Daniel Halperin (JIRA)]

Daniel Halperin created BEAM-157:


 Summary: CombineTest.testGlobalCombineWithDefaultsAndTriggers is 
broken
 Key: BEAM-157
 URL: https://issues.apache.org/jira/browse/BEAM-157
 Project: Beam
  Issue Type: Bug
  Components: sdk-java-core
Reporter: Daniel Halperin
Assignee: Kenneth Knowles
Priority: Critical


The test is not run because `p.run()` is not called. When `p.run()` is added, 
the test fails.

Kenn, I suspect this is because it's using triggers in batch, which obviously 
is not guaranteed to work.

Please investigate!

https://github.com/apache/incubator-beam/blob/master/sdks/java/core/src/test/java/com/google/cloud/dataflow/sdk/transforms/CombineTest.java#L373

Failed tests: 
  CombineTest.testGlobalCombineWithDefaultsAndTriggers:391 
Expected: iterable over ["2: true", "1: false"] in any order
 but: No item matches: "1: false" in ["2: true"]

Tests run: 30, Failures: 1, Errors: 0, Skipped: 0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)