[jira] [Assigned] (BEAM-2042) Implement Committed Metrics support for Flink runner

[Aljoscha Krettek (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aljoscha Krettek reassigned BEAM-2042:
--

Assignee: (was: Aljoscha Krettek)

> Implement Committed Metrics support for Flink runner
> 
>
> Key: BEAM-2042
> URL: https://issues.apache.org/jira/browse/BEAM-2042
> Project: Beam
>  Issue Type: Improvement
>  Components: runner-flink
>Reporter: Aljoscha Krettek
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-2192) support DISTINCT select

[Xu Mingmin (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999693#comment-15999693
 ] 

Xu Mingmin commented on BEAM-2192:
--

{{DISTINCT}} should be covered by BEAM-2006.

> support DISTINCT select
> ---
>
> Key: BEAM-2192
> URL: https://issues.apache.org/jira/browse/BEAM-2192
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: James Xu
>Assignee: Xu Mingmin
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Assigned] (BEAM-2192) support DISTINCT select

[Xu Mingmin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xu Mingmin reassigned BEAM-2192:


Assignee: Xu Mingmin

> support DISTINCT select
> ---
>
> Key: BEAM-2192
> URL: https://issues.apache.org/jira/browse/BEAM-2192
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: James Xu
>Assignee: Xu Mingmin
>




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (BEAM-2151) Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder

[James Xu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Xu resolved BEAM-2151.

   Resolution: Fixed
Fix Version/s: Not applicable

> Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder
> -
>
> Key: BEAM-2151
> URL: https://issues.apache.org/jira/browse/BEAM-2151
> Project: Beam
>  Issue Type: Bug
>  Components: dsl-sql
>Reporter: James Xu
>Assignee: James Xu
>Priority: Blocker
> Fix For: Not applicable
>
>
> In BeamSqlRow, sql FLOAT is mapping to java Float:
> {code:java}
> case FLOAT:
>   if (!(fieldValue instanceof Float)) {
> throw new InvalidFieldException(
> String.format("[%s] doesn't match type [%s]", fieldValue, 
> fieldType));
>   }
>   break;
> {code}
> but in BeamSqlRowCoder, sql FLOAT is treated as java Double:
> {code:java}
>   case DOUBLE:
>   case FLOAT:
> doubleCoder.encode(value.getDouble(idx), outStream, nested);
> break;
> {code}
> Let's mapping sql FLOAT consistently to java Float?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-2166) Remove Coder.Context from the public API

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999669#comment-15999669
 ] 

ASF GitHub Bot commented on BEAM-2166:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2930


> Remove Coder.Context from the public API
> 
>
> Key: BEAM-2166
> URL: https://issues.apache.org/jira/browse/BEAM-2166
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core, sdk-py
>Affects Versions: 2.0.0
>Reporter: Robert Bradshaw
>Assignee: Robert Bradshaw
> Fix For: 2.0.0
>
>
> Justification: 
> * Contexts add confusion and complexity to the public API (e.g. 
> https://issues.apache.org/jira/browse/BEAM-1448)
> * Leaf (user-written) coders are nearly always nested.
> * Coders are being removed from sources, which was the initial need for 
> context.
> * It is unclear how much value, if any, this provides for internal 
> performance.
> * There may be performance (as well as simplification) gains in removing this 
> for the Fn API.
> Fully removing this distinction from the internals can be defered  until the 
> last bullet points are more completely investigated. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[1/3] beam git commit: Remove context from size estimate operations.

[lcwik]

Repository: beam
Updated Branches:
  refs/heads/master 019d3002b -> dabad1ae5


Remove context from size estimate operations.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/78a99be1
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/78a99be1
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/78a99be1

Branch: refs/heads/master
Commit: 78a99be1c46656996081744e52dac3d619cb4fe7
Parents: 019d300
Author: Robert Bradshaw 
Authored: Fri May 5 15:18:52 2017 -0700
Committer: Luke Cwik 
Committed: Sat May 6 19:23:50 2017 -0700

--
 .../java/org/apache/beam/sdk/coders/Coder.java  | 52 
 1 file changed, 10 insertions(+), 42 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/78a99be1/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/Coder.java
--
diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/Coder.java 
b/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/Coder.java
index eeafbd2..d140e89 100644
--- a/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/Coder.java
+++ b/sdks/java/core/src/main/java/org/apache/beam/sdk/coders/Coder.java
@@ -301,40 +301,10 @@ public abstract class Coder implements Serializable {
* unless it is overridden. This is considered expensive.
*/
   public boolean isRegisterByteSizeObserverCheap(T value) {
-return isRegisterByteSizeObserverCheap(value, Context.NESTED);
-  }
-
-  /**
-   * {@inheritDoc}
-   *
-   * Not intended to be called by user code, but instead by
-   * {@link PipelineRunner}
-   * implementations.
-   *
-   * @return {@code false} unless it is overridden. {@link 
StructuredCoder#registerByteSizeObserver}
-   * invokes {@link #getEncodedElementByteSize} which requires 
re-encoding an element
-   * unless it is overridden. This is considered expensive.
-   */
-  @Deprecated
-  public boolean isRegisterByteSizeObserverCheap(T value, Context context) {
 return false;
   }
 
   /**
-   * Returns the size in bytes of the encoded value using this coder.
-   */
-  protected long getEncodedElementByteSize(T value, Context context)
-  throws Exception {
-try (CountingOutputStream os = new 
CountingOutputStream(ByteStreams.nullOutputStream())) {
-  encode(value, os, context);
-  return os.getCount();
-} catch (Exception exn) {
-  throw new IllegalArgumentException(
-  "Unable to encode element '" + value + "' with coder '" + this + 
"'.", exn);
-}
-  }
-
-  /**
* Notifies the {@code ElementByteSizeObserver} about the byte size
* of the encoded value using this {@code Coder}.
*
@@ -347,22 +317,20 @@ public abstract class Coder implements Serializable {
*/
   public void registerByteSizeObserver(T value, ElementByteSizeObserver 
observer)
   throws Exception {
-registerByteSizeObserver(value, observer, Context.NESTED);
+observer.update(getEncodedElementByteSize(value));
   }
 
   /**
-   * Notifies the {@code ElementByteSizeObserver} about the byte size
-   * of the encoded value using this {@code Coder}.
-   *
-   * Not intended to be called by user code, but instead by
-   * {@link PipelineRunner}
-   * implementations.
+   * Returns the size in bytes of the encoded value using this coder.
*/
-  @Deprecated
-  public void registerByteSizeObserver(
-  T value, ElementByteSizeObserver observer, Context context)
-  throws Exception {
-observer.update(getEncodedElementByteSize(value, context));
+  protected long getEncodedElementByteSize(T value) throws Exception {
+try (CountingOutputStream os = new 
CountingOutputStream(ByteStreams.nullOutputStream())) {
+  encode(value, os);
+  return os.getCount();
+} catch (Exception exn) {
+  throw new IllegalArgumentException(
+  "Unable to encode element '" + value + "' with coder '" + this + 
"'.", exn);
+}
   }
 
   /**

[GitHub] beam pull request #2930: [BEAM-2166] Remove context from size estimating ope...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2930


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/3] beam git commit: Remove uses of context in coder size estimation calls.

[lcwik]

Remove uses of context in coder size estimation calls.

find . -type f -name '*.java' | xargs sed -i '' 
's/\([a-zA-Z]*[bB]yteSize[a-zA-Z]*[(].*\), 
[^,]*[Cc]ontext[^,()]*\([(][)]\)*[)]/\1)/'

plus a one-off Python script and some manual fixups.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/96de8d73
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/96de8d73
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/96de8d73

Branch: refs/heads/master
Commit: 96de8d735c40ee5f823ff17966992c433d68f296
Parents: 78a99be
Author: Robert Bradshaw 
Authored: Fri May 5 15:23:03 2017 -0700
Committer: Luke Cwik 
Committed: Sat May 6 20:33:20 2017 -0700

--
 runners/google-cloud-dataflow-java/pom.xml  |  2 +-
 .../runners/dataflow/internal/IsmFormat.java|  8 ++--
 .../runners/dataflow/util/RandomAccessData.java | 11 ++
 .../dataflow/util/RandomAccessDataTest.java |  6 +--
 .../apache/beam/sdk/coders/BigDecimalCoder.java |  8 ++--
 .../beam/sdk/coders/BigEndianIntegerCoder.java  |  4 +-
 .../beam/sdk/coders/BigEndianLongCoder.java |  4 +-
 .../apache/beam/sdk/coders/BigIntegerCoder.java |  6 +--
 .../apache/beam/sdk/coders/ByteArrayCoder.java  | 10 ++---
 .../org/apache/beam/sdk/coders/ByteCoder.java   |  4 +-
 .../org/apache/beam/sdk/coders/DoubleCoder.java |  4 +-
 .../apache/beam/sdk/coders/DurationCoder.java   |  8 ++--
 .../apache/beam/sdk/coders/InstantCoder.java|  8 ++--
 .../beam/sdk/coders/IterableLikeCoder.java  |  9 ++---
 .../org/apache/beam/sdk/coders/KvCoder.java | 12 +++---
 .../beam/sdk/coders/LengthPrefixCoder.java  | 11 +++---
 .../org/apache/beam/sdk/coders/MapCoder.java| 10 ++---
 .../apache/beam/sdk/coders/NullableCoder.java   | 14 +++
 .../beam/sdk/coders/StringDelegateCoder.java|  1 -
 .../apache/beam/sdk/coders/StringUtf8Coder.java | 16 ++--
 .../beam/sdk/coders/TextualIntegerCoder.java|  4 +-
 .../org/apache/beam/sdk/coders/VarIntCoder.java |  4 +-
 .../apache/beam/sdk/coders/VarLongCoder.java|  4 +-
 .../org/apache/beam/sdk/coders/VoidCoder.java   |  4 +-
 .../beam/sdk/testing/CoderProperties.java   |  6 ++-
 .../sdk/transforms/ApproximateQuantiles.java| 22 ---
 .../org/apache/beam/sdk/transforms/Count.java   |  4 +-
 .../org/apache/beam/sdk/transforms/Top.java |  9 ++---
 .../beam/sdk/transforms/join/UnionCoder.java|  8 ++--
 .../org/apache/beam/sdk/util/BitSetCoder.java   |  1 -
 .../org/apache/beam/sdk/util/WindowedValue.java | 15 
 .../beam/sdk/coders/BigDecimalCoderTest.java|  5 ++-
 .../beam/sdk/coders/BigIntegerCoderTest.java|  5 ++-
 .../beam/sdk/coders/CoderRegistryTest.java  |  4 +-
 .../beam/sdk/coders/LengthPrefixCoderTest.java  | 24 ++--
 .../beam/sdk/coders/NullableCoderTest.java  | 18 -
 .../apache/beam/sdk/testing/PAssertTest.java|  4 +-
 .../apache/beam/sdk/transforms/CombineTest.java |  8 ++--
 .../apache/beam/sdk/transforms/ParDoTest.java   |  4 +-
 .../extensions/protobuf/ByteStringCoder.java|  8 +---
 .../protobuf/ByteStringCoderTest.java   | 10 ++---
 .../sdk/io/gcp/bigquery/TableRowJsonCoder.java  |  4 +-
 .../beam/sdk/io/kafka/KafkaRecordCoder.java |  4 +-
 .../org/apache/beam/sdk/io/xml/JAXBCoder.java   | 40 +++-
 44 files changed, 168 insertions(+), 207 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/96de8d73/runners/google-cloud-dataflow-java/pom.xml
--
diff --git a/runners/google-cloud-dataflow-java/pom.xml 
b/runners/google-cloud-dataflow-java/pom.xml
index 09901d5..b579041 100644
--- a/runners/google-cloud-dataflow-java/pom.xml
+++ b/runners/google-cloud-dataflow-java/pom.xml
@@ -33,7 +33,7 @@
   jar
 
   
-
beam-master-20170505-wd-2914
+
beam-master-20170506
 
1
 
6
   

http://git-wip-us.apache.org/repos/asf/beam/blob/96de8d73/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/internal/IsmFormat.java
--
diff --git 
a/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/internal/IsmFormat.java
 
b/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/internal/IsmFormat.java
index aed514a..00e0c54 100644
--- 
a/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/internal/IsmFormat.java
+++ 
b/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/internal/IsmFormat.java
@@ -704,12 +704,12 @@ public class IsmFormat {
 }
 
 @Override
-public boolean isRegisterByteSizeObserverCheap(KeyPrefix value, 
Coder.Context context) {
+public boolean i

[3/3] beam git commit: [BEAM-2166] Remove context from size estimating operations.

[lcwik]

[BEAM-2166] Remove context from size estimating operations.

This closes #2930


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dabad1ae
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/dabad1ae
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/dabad1ae

Branch: refs/heads/master
Commit: dabad1ae595f7081c74f775209037caaae558a0d
Parents: 019d300 96de8d7
Author: Luke Cwik 
Authored: Sat May 6 20:34:00 2017 -0700
Committer: Luke Cwik 
Committed: Sat May 6 20:34:00 2017 -0700

--
 runners/google-cloud-dataflow-java/pom.xml  |  2 +-
 .../runners/dataflow/internal/IsmFormat.java|  8 +--
 .../runners/dataflow/util/RandomAccessData.java | 11 ++---
 .../dataflow/util/RandomAccessDataTest.java |  6 +--
 .../apache/beam/sdk/coders/BigDecimalCoder.java |  8 +--
 .../beam/sdk/coders/BigEndianIntegerCoder.java  |  4 +-
 .../beam/sdk/coders/BigEndianLongCoder.java |  4 +-
 .../apache/beam/sdk/coders/BigIntegerCoder.java |  6 +--
 .../apache/beam/sdk/coders/ByteArrayCoder.java  | 10 ++--
 .../org/apache/beam/sdk/coders/ByteCoder.java   |  4 +-
 .../java/org/apache/beam/sdk/coders/Coder.java  | 52 
 .../org/apache/beam/sdk/coders/DoubleCoder.java |  4 +-
 .../apache/beam/sdk/coders/DurationCoder.java   |  8 +--
 .../apache/beam/sdk/coders/InstantCoder.java|  8 +--
 .../beam/sdk/coders/IterableLikeCoder.java  |  9 ++--
 .../org/apache/beam/sdk/coders/KvCoder.java | 12 ++---
 .../beam/sdk/coders/LengthPrefixCoder.java  | 11 ++---
 .../org/apache/beam/sdk/coders/MapCoder.java| 10 ++--
 .../apache/beam/sdk/coders/NullableCoder.java   | 14 +++---
 .../beam/sdk/coders/StringDelegateCoder.java|  1 -
 .../apache/beam/sdk/coders/StringUtf8Coder.java | 16 ++
 .../beam/sdk/coders/TextualIntegerCoder.java|  4 +-
 .../org/apache/beam/sdk/coders/VarIntCoder.java |  4 +-
 .../apache/beam/sdk/coders/VarLongCoder.java|  4 +-
 .../org/apache/beam/sdk/coders/VoidCoder.java   |  4 +-
 .../beam/sdk/testing/CoderProperties.java   |  6 ++-
 .../sdk/transforms/ApproximateQuantiles.java| 22 +++--
 .../org/apache/beam/sdk/transforms/Count.java   |  4 +-
 .../org/apache/beam/sdk/transforms/Top.java |  9 ++--
 .../beam/sdk/transforms/join/UnionCoder.java|  8 +--
 .../org/apache/beam/sdk/util/BitSetCoder.java   |  1 -
 .../org/apache/beam/sdk/util/WindowedValue.java | 15 +++---
 .../beam/sdk/coders/BigDecimalCoderTest.java|  5 +-
 .../beam/sdk/coders/BigIntegerCoderTest.java|  5 +-
 .../beam/sdk/coders/CoderRegistryTest.java  |  4 +-
 .../beam/sdk/coders/LengthPrefixCoderTest.java  | 24 +
 .../beam/sdk/coders/NullableCoderTest.java  | 18 +++
 .../apache/beam/sdk/testing/PAssertTest.java|  4 +-
 .../apache/beam/sdk/transforms/CombineTest.java |  8 +--
 .../apache/beam/sdk/transforms/ParDoTest.java   |  4 +-
 .../extensions/protobuf/ByteStringCoder.java|  8 +--
 .../protobuf/ByteStringCoderTest.java   | 10 ++--
 .../sdk/io/gcp/bigquery/TableRowJsonCoder.java  |  4 +-
 .../beam/sdk/io/kafka/KafkaRecordCoder.java |  4 +-
 .../org/apache/beam/sdk/io/xml/JAXBCoder.java   | 40 ---
 45 files changed, 178 insertions(+), 249 deletions(-)
--

[GitHub] beam pull request #2886: [BEAM-2151]Fix inconsistent mapping for SQL FLOAT

[xumingming]

Github user xumingming closed the pull request at:

https://github.com/apache/beam/pull/2886


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-2151) Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999668#comment-15999668
 ] 

ASF GitHub Bot commented on BEAM-2151:
--

Github user xumingming closed the pull request at:

https://github.com/apache/beam/pull/2886


> Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder
> -
>
> Key: BEAM-2151
> URL: https://issues.apache.org/jira/browse/BEAM-2151
> Project: Beam
>  Issue Type: Bug
>  Components: dsl-sql
>Reporter: James Xu
>Assignee: James Xu
>Priority: Blocker
>
> In BeamSqlRow, sql FLOAT is mapping to java Float:
> {code:java}
> case FLOAT:
>   if (!(fieldValue instanceof Float)) {
> throw new InvalidFieldException(
> String.format("[%s] doesn't match type [%s]", fieldValue, 
> fieldType));
>   }
>   break;
> {code}
> but in BeamSqlRowCoder, sql FLOAT is treated as java Double:
> {code:java}
>   case DOUBLE:
>   case FLOAT:
> doubleCoder.encode(value.getDouble(idx), outStream, nested);
> break;
> {code}
> Let's mapping sql FLOAT consistently to java Float?



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #2941: PR to run tests for #2930 on Jenkins

[lukecwik]

Github user lukecwik closed the pull request at:

https://github.com/apache/beam/pull/2941


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam-site pull request #231: Website updates for version 2.0.0: downloads, J...

[davorbonaci]

GitHub user davorbonaci opened a pull request:

https://github.com/apache/beam-site/pull/231

Website updates for version 2.0.0: downloads, Javadoc, Pydoc



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam-site javadoc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam-site/pull/231.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #231






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

svn commit: r19499 - /dev/beam/2.0.0-RC1/

[davor]

Author: davor
Date: Sun May  7 03:08:43 2017
New Revision: 19499

Log:
Adding Apache Beam, version 2.0.0, release candidate 1


Added:
dev/beam/2.0.0-RC1/
dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip   (with props)
dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.asc
dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.md5
dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.sha1
dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip   (with props)
dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.asc
dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.md5
dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.sha1

Added: dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip
==
Binary file - no diff available.

Propchange: dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip
--
svn:mime-type = application/octet-stream

Added: dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.asc
==
--- dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.asc (added)
+++ dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.asc Sun May  7 03:08:43 
2017
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+Version: GnuPG v1
+
+iQEcBAABAgAGBQJZDo+FAAoJEMkEN+GPDTNPCgoH/iaj8lnjbg/UPdDTdqqJ39K5
+YeyLCqKaeWGkzKRV1OEKRvz6CbbPIUHj51NGl4QC7pCp1Kg9W2HZVz7zNRkpL3HF
+qTsrp7ZwEj/gL1UGSinZDmd/ZW7sL1wUY8FWODjvy1YEhxqRGjGR/hnwTcu3B1ZL
+Ns9W/Xxq1p7n/eErR3DyW8xCthyr0TAIVwOT1vxrHjTXQVR6DtRWbSV93nwo/WqP
+2woU823XQYiA/dR5uL7IKIurijvq1D2O02e8byVJQJsCgHuY7toYXyX4+6Zrwd32
+6w1lYQzCU7nADJl3Q+vQlf0Z6sm2Q72fLbDr58r7QYur93sLdj4NeYAjbbZv7xE=
+=vN9P
+-END PGP SIGNATURE-

Added: dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.md5
==
--- dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.md5 (added)
+++ dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.md5 Sun May  7 03:08:43 
2017
@@ -0,0 +1 @@
+eaa9cee1b0605e9307ae7a8fb3062f48  apache-beam-0.7.0.dev-python.zip

Added: dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.sha1
==
--- dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.sha1 (added)
+++ dev/beam/2.0.0-RC1/apache-beam-0.7.0.dev-python.zip.sha1 Sun May  7 
03:08:43 2017
@@ -0,0 +1 @@
+5d71c602e2916880499d809e9c2741c615d67111  apache-beam-0.7.0.dev-python.zip

Added: dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip
==
Binary file - no diff available.

Propchange: dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip
--
svn:mime-type = application/octet-stream

Added: dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.asc
==
--- dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.asc (added)
+++ dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.asc Sun May  7 
03:08:43 2017
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+Version: GnuPG v1
+
+iQEcBAABAgAGBQJZDSO8AAoJEMkEN+GPDTNPIRkIALDFotbkb59DY6ZRVCZUSCmd
+GrCh40dD7JcuIS5e5mi4HlQsPnGu9Zhb9Kr2KWS7zNjC83b37RT76u3g3bkp7FUp
+Jw8TwZQh3CJkLNx9pXSxxgYticopE/X33uUm8nU9kYLyK4iA270xcI9Fr6iy7mR/
+QY/hH0JqEuhCAd/xodWkbHLr8K4jdOYfb7RAJK4DIbMsyS1sinhCF7+yiaV/WdfD
+5FZ4bxJ0X5EidshEHRV1a5UvVpHPfuIO3G9WK4r4qTdDyXndrVeZRww3HPS/MI9n
+bkiICnnSRoRbY+IJUja+Hqsg4bF9Fg16ECdGW94Y7idrKgodufGcWnnOl31m1jg=
+=3DSx
+-END PGP SIGNATURE-

Added: dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.md5
==
--- dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.md5 (added)
+++ dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.md5 Sun May  7 
03:08:43 2017
@@ -0,0 +1 @@
+4d9dcb18753451f206e38b7d67f42804  apache-beam-2.0.0-source-release.zip

Added: dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.sha1
==
--- dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.sha1 (added)
+++ dev/beam/2.0.0-RC1/apache-beam-2.0.0-source-release.zip.sha1 Sun May  7 
03:08:43 2017
@@ -0,0 +1 @@
+d597a2c6ae161b0dc8c955cda1df43e3e1dfab8c  apache-beam-2.0.0-source-release.zip

[GitHub] beam pull request #2941: PR to run tests for #2930 on Jenkins

[lukecwik]

GitHub user lukecwik opened a pull request:

https://github.com/apache/beam/pull/2941

PR to run tests for #2930 on Jenkins

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/lukecwik/incubator-beam finish-pr-2930

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2941.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2941


commit 78a99be1c46656996081744e52dac3d619cb4fe7
Author: Robert Bradshaw 
Date:   2017-05-05T22:18:52Z

Remove context from size estimate operations.

commit 1f59e0a99f86c5b2d78adaebda1818f270cba775
Author: Robert Bradshaw 
Date:   2017-05-05T22:23:03Z

Remove uses of context in coder size estimation calls.

find . -type f -name '*.java' | xargs sed -i '' 
's/\([a-zA-Z]*[bB]yteSize[a-zA-Z]*[(].*\), 
[^,]*[Cc]ontext[^,()]*\([(][)]\)*[)]/\1)/'

plus a one-off Python script and some manual fixups.

commit 0593da952214f581dbe0c816d12e39fd9ca73c54
Author: Luke Cwik 
Date:   2017-05-07T02:23:20Z

fixup! Fix test issues with PR 2930 and migrate to new Dataflow worker image




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/2] beam git commit: Fix inconsistent mapping for SQL FLOAT

[davor]

Repository: beam
Updated Branches:
  refs/heads/DSL_SQL cf95571d9 -> f7ee8d33e


Fix inconsistent mapping for SQL FLOAT


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/dd70852f
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/dd70852f
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/dd70852f

Branch: refs/heads/DSL_SQL
Commit: dd70852f6fa811a410938e5baa51cb8e602c931b
Parents: cf95571
Author: James Xu 
Authored: Thu May 4 11:44:14 2017 +0800
Committer: Davor Bonaci 
Committed: Sat May 6 19:23:39 2017 -0700

--
 dsls/sql/pom.xml|  9 +-
 .../beam/dsls/sql/schema/BeamSqlRowCoder.java   | 93 ++--
 .../dsls/sql/schema/BeamSqlRowCoderTest.java| 63 +
 3 files changed, 117 insertions(+), 48 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/dd70852f/dsls/sql/pom.xml
--
diff --git a/dsls/sql/pom.xml b/dsls/sql/pom.xml
index e2f09be..6139ada 100644
--- a/dsls/sql/pom.xml
+++ b/dsls/sql/pom.xml
@@ -24,7 +24,7 @@
 beam-dsls-parent
 0.7.0-SNAPSHOT
   
-  
+
   beam-dsls-sql
   Apache Beam :: DSLs :: SQL
   Beam SQL provides a new interface to generate a Beam pipeline 
from SQL statement
@@ -36,7 +36,7 @@
 -MM-dd 
HH:mm
 1.11.0
   
-  
+
   
 
   
@@ -199,5 +199,10 @@
   calcite-linq4j
   ${calcite-version}
 
+
+  org.hamcrest
+  hamcrest-all
+  test
+
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/dd70852f/dsls/sql/src/main/java/org/apache/beam/dsls/sql/schema/BeamSqlRowCoder.java
--
diff --git 
a/dsls/sql/src/main/java/org/apache/beam/dsls/sql/schema/BeamSqlRowCoder.java 
b/dsls/sql/src/main/java/org/apache/beam/dsls/sql/schema/BeamSqlRowCoder.java
index 22ffaad..9b2474a 100644
--- 
a/dsls/sql/src/main/java/org/apache/beam/dsls/sql/schema/BeamSqlRowCoder.java
+++ 
b/dsls/sql/src/main/java/org/apache/beam/dsls/sql/schema/BeamSqlRowCoder.java
@@ -63,28 +63,29 @@ public class BeamSqlRowCoder extends 
StandardCoder{
   }
 
   switch (value.getDataType().getFieldsType().get(idx)) {
-  case INTEGER:
-intCoder.encode(value.getInteger(idx), outStream, context.nested());
-break;
-  case SMALLINT:
-  case TINYINT:
-intCoder.encode((int) value.getShort(idx), outStream, 
context.nested());
-break;
-  case DOUBLE:
-doubleCoder.encode(value.getDouble(idx), outStream, context.nested());
-break;
-  case FLOAT:
-doubleCoder.encode((double) value.getFloat(idx), outStream, 
context.nested());
-break;
-  case BIGINT:
-longCoder.encode(value.getLong(idx), outStream, context.nested());
-break;
-  case VARCHAR:
-stringCoder.encode(value.getString(idx), outStream, context.nested());
-break;
-
-  default:
-throw new 
UnsupportedDataTypeException(value.getDataType().getFieldsType().get(idx));
+case INTEGER:
+  intCoder.encode(value.getInteger(idx), outStream, context.nested());
+  break;
+case SMALLINT:
+case TINYINT:
+  intCoder.encode((int) value.getShort(idx), outStream, 
context.nested());
+  break;
+case DOUBLE:
+  doubleCoder.encode(value.getDouble(idx), outStream, 
context.nested());
+  break;
+case FLOAT:
+  doubleCoder.encode(Double.parseDouble(
+  String.valueOf(value.getFloat(idx))), outStream, 
context.nested());
+  break;
+case BIGINT:
+  longCoder.encode(value.getLong(idx), outStream, context.nested());
+  break;
+case VARCHAR:
+  stringCoder.encode(value.getString(idx), outStream, 
context.nested());
+  break;
+
+default:
+  throw new 
UnsupportedDataTypeException(value.getDataType().getFieldsType().get(idx));
   }
 }
 //add a dummy field to indicate the end of record
@@ -106,30 +107,30 @@ public class BeamSqlRowCoder extends 
StandardCoder{
   }
 
   switch (type.getFieldsType().get(idx)) {
-  case INTEGER:
-record.addField(idx, intCoder.decode(inStream, context.nested()));
-break;
-  case SMALLINT:
-record.addField(idx, intCoder.decode(inStream, 
context.nested()).shortValue());
-break;
-  case TINYINT:
-record.addField(idx, intCoder.decode(inStream, 
context.nested()).byteValue());
-break;
-  case DOUBLE:
-record.addField(idx, doubleCoder.decode(inStream, context.nested()));
-break;
-  case FLOAT:
-record.addField(idx, doubleCoder.decode(inStream, 
context.nested()).floatValue());
-break;
-  c

[2/2] beam git commit: This closes #2886

[davor]

This closes #2886


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f7ee8d33
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f7ee8d33
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f7ee8d33

Branch: refs/heads/DSL_SQL
Commit: f7ee8d33e13506a17314720c8c23fff486bff76c
Parents: cf95571 dd70852
Author: Davor Bonaci 
Authored: Sat May 6 19:24:04 2017 -0700
Committer: Davor Bonaci 
Committed: Sat May 6 19:24:04 2017 -0700

--
 dsls/sql/pom.xml|  9 +-
 .../beam/dsls/sql/schema/BeamSqlRowCoder.java   | 93 ++--
 .../dsls/sql/schema/BeamSqlRowCoderTest.java| 63 +
 3 files changed, 117 insertions(+), 48 deletions(-)
--

[1/2] beam git commit: [maven-release-plugin] prepare release v2.0.0-RC1

[davor]

Repository: beam
Updated Branches:
  refs/heads/release-2.0.0 1ad3f84c6 -> 3b7a62301


[maven-release-plugin] prepare release v2.0.0-RC1


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f97e52b3
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f97e52b3
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f97e52b3

Branch: refs/heads/release-2.0.0
Commit: f97e52b3b677a5a35bac7a2012366837b7bb15cb
Parents: 1ad3f84
Author: Davor Bonaci 
Authored: Fri May 5 18:46:31 2017 -0700
Committer: Davor Bonaci 
Committed: Fri May 5 18:46:31 2017 -0700

--
 examples/java/pom.xml   | 2 +-
 examples/java8/pom.xml  | 2 +-
 examples/pom.xml| 2 +-
 pom.xml | 4 ++--
 runners/apex/pom.xml| 2 +-
 runners/core-construction-java/pom.xml  | 2 +-
 runners/core-java/pom.xml   | 2 +-
 runners/direct-java/pom.xml | 2 +-
 runners/flink/pom.xml   | 2 +-
 runners/google-cloud-dataflow-java/pom.xml  | 2 +-
 runners/pom.xml | 2 +-
 runners/spark/pom.xml   | 2 +-
 sdks/common/fn-api/pom.xml  | 2 +-
 sdks/common/pom.xml | 2 +-
 sdks/common/runner-api/pom.xml  | 2 +-
 sdks/java/build-tools/pom.xml   | 2 +-
 sdks/java/core/pom.xml  | 2 +-
 sdks/java/extensions/google-cloud-platform-core/pom.xml | 2 +-
 sdks/java/extensions/jackson/pom.xml| 2 +-
 sdks/java/extensions/join-library/pom.xml   | 2 +-
 sdks/java/extensions/pom.xml| 2 +-
 sdks/java/extensions/protobuf/pom.xml   | 2 +-
 sdks/java/extensions/sorter/pom.xml | 2 +-
 sdks/java/harness/pom.xml   | 2 +-
 sdks/java/io/common/pom.xml | 2 +-
 sdks/java/io/elasticsearch/pom.xml  | 2 +-
 sdks/java/io/google-cloud-platform/pom.xml  | 2 +-
 sdks/java/io/hadoop-common/pom.xml  | 2 +-
 sdks/java/io/hadoop-file-system/pom.xml | 2 +-
 sdks/java/io/hadoop/input-format/pom.xml| 2 +-
 sdks/java/io/hadoop/jdk1.8-tests/pom.xml| 2 +-
 sdks/java/io/hadoop/pom.xml | 2 +-
 sdks/java/io/hbase/pom.xml  | 2 +-
 sdks/java/io/jdbc/pom.xml   | 2 +-
 sdks/java/io/jms/pom.xml| 2 +-
 sdks/java/io/kafka/pom.xml  | 2 +-
 sdks/java/io/kinesis/pom.xml| 2 +-
 sdks/java/io/mongodb/pom.xml| 2 +-
 sdks/java/io/mqtt/pom.xml   | 2 +-
 sdks/java/io/pom.xml| 2 +-
 sdks/java/io/xml/pom.xml| 2 +-
 sdks/java/java8tests/pom.xml| 2 +-
 sdks/java/javadoc/pom.xml   | 2 +-
 sdks/java/maven-archetypes/examples-java8/pom.xml   | 2 +-
 sdks/java/maven-archetypes/examples/pom.xml | 2 +-
 sdks/java/maven-archetypes/pom.xml  | 2 +-
 sdks/java/maven-archetypes/starter/pom.xml  | 2 +-
 sdks/java/pom.xml   | 2 +-
 sdks/pom.xml| 2 +-
 sdks/python/pom.xml | 2 +-
 50 files changed, 51 insertions(+), 51 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/f97e52b3/examples/java/pom.xml
--
diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index 1b7fedc..b4d4d05 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-2.0.0-SNAPSHOT
+2.0.0
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/f97e52b3/examples/java8/pom.xml
--
diff --git a/examples/java8/pom.xml b/examples/java8/pom.xml
index c777e19..df4af05 100644
--- a/examples/java8/pom.xml
+++ b/examples/java8/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-2.0.0-SNAPSHOT
+2.0.0
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/f97e52b3/examples/pom.xml

[beam] Git Push Summary

[davor]

Repository: beam
Updated Tags:  refs/tags/v2.0.0-RC1 [created] 53893ff1a

[2/2] beam git commit: [maven-release-plugin] rollback changes from release preparation of v2.0.0-RC1

[davor]

[maven-release-plugin] rollback changes from release preparation of v2.0.0-RC1


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3b7a6230
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3b7a6230
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3b7a6230

Branch: refs/heads/release-2.0.0
Commit: 3b7a62301fba55f3caf68d8876b39c53e80f171a
Parents: f97e52b
Author: Davor Bonaci 
Authored: Sat May 6 19:16:30 2017 -0700
Committer: Davor Bonaci 
Committed: Sat May 6 19:16:30 2017 -0700

--
 examples/java/pom.xml   | 2 +-
 examples/java8/pom.xml  | 2 +-
 examples/pom.xml| 2 +-
 pom.xml | 4 ++--
 runners/apex/pom.xml| 2 +-
 runners/core-construction-java/pom.xml  | 2 +-
 runners/core-java/pom.xml   | 2 +-
 runners/direct-java/pom.xml | 2 +-
 runners/flink/pom.xml   | 2 +-
 runners/google-cloud-dataflow-java/pom.xml  | 2 +-
 runners/pom.xml | 2 +-
 runners/spark/pom.xml   | 2 +-
 sdks/common/fn-api/pom.xml  | 2 +-
 sdks/common/pom.xml | 2 +-
 sdks/common/runner-api/pom.xml  | 2 +-
 sdks/java/build-tools/pom.xml   | 2 +-
 sdks/java/core/pom.xml  | 2 +-
 sdks/java/extensions/google-cloud-platform-core/pom.xml | 2 +-
 sdks/java/extensions/jackson/pom.xml| 2 +-
 sdks/java/extensions/join-library/pom.xml   | 2 +-
 sdks/java/extensions/pom.xml| 2 +-
 sdks/java/extensions/protobuf/pom.xml   | 2 +-
 sdks/java/extensions/sorter/pom.xml | 2 +-
 sdks/java/harness/pom.xml   | 2 +-
 sdks/java/io/common/pom.xml | 2 +-
 sdks/java/io/elasticsearch/pom.xml  | 2 +-
 sdks/java/io/google-cloud-platform/pom.xml  | 2 +-
 sdks/java/io/hadoop-common/pom.xml  | 2 +-
 sdks/java/io/hadoop-file-system/pom.xml | 2 +-
 sdks/java/io/hadoop/input-format/pom.xml| 2 +-
 sdks/java/io/hadoop/jdk1.8-tests/pom.xml| 2 +-
 sdks/java/io/hadoop/pom.xml | 2 +-
 sdks/java/io/hbase/pom.xml  | 2 +-
 sdks/java/io/jdbc/pom.xml   | 2 +-
 sdks/java/io/jms/pom.xml| 2 +-
 sdks/java/io/kafka/pom.xml  | 2 +-
 sdks/java/io/kinesis/pom.xml| 2 +-
 sdks/java/io/mongodb/pom.xml| 2 +-
 sdks/java/io/mqtt/pom.xml   | 2 +-
 sdks/java/io/pom.xml| 2 +-
 sdks/java/io/xml/pom.xml| 2 +-
 sdks/java/java8tests/pom.xml| 2 +-
 sdks/java/javadoc/pom.xml   | 2 +-
 sdks/java/maven-archetypes/examples-java8/pom.xml   | 2 +-
 sdks/java/maven-archetypes/examples/pom.xml | 2 +-
 sdks/java/maven-archetypes/pom.xml  | 2 +-
 sdks/java/maven-archetypes/starter/pom.xml  | 2 +-
 sdks/java/pom.xml   | 2 +-
 sdks/pom.xml| 2 +-
 sdks/python/pom.xml | 2 +-
 50 files changed, 51 insertions(+), 51 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/3b7a6230/examples/java/pom.xml
--
diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index b4d4d05..1b7fedc 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-2.0.0
+2.0.0-SNAPSHOT
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/3b7a6230/examples/java8/pom.xml
--
diff --git a/examples/java8/pom.xml b/examples/java8/pom.xml
index df4af05..c777e19 100644
--- a/examples/java8/pom.xml
+++ b/examples/java8/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-2.0.0
+2.0.0-SNAPSHOT
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/3b7a6230/examples/pom.xml
--
diff --git a/examples/pom.xml b/examples/pom.xm

[jira] [Commented] (BEAM-2150) Support for recursive wildcards in GcsPath

[Devon Meunier (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999640#comment-15999640
 ] 

Devon Meunier commented on BEAM-2150:
-

[~dhalp...@google.com] noticed that gsutil's globbing semantics don't quite 
match my PR.

He noted:

{quote}
[11:12:18 dhalperi@dhalperi:beam a3cbf5905* ] gsutil ls 
'gs://clouddfe-dhalperi/gcs-recursive/**/*.txt'[1]
gs://clouddfe-dhalperi/gcs-recursive/file1.txt
gs://clouddfe-dhalperi/gcs-recursive/somedir/file2.txt

[2:13] 
However that same glob passed to TextIO only gets the second file.
{quote}

However, testing against a shell also seems to have different semantics:

{code}
[I] » tree glob/  ~
glob/
├── dir
│   └── file2.txt
└── file1.txt

1 directory, 2 files
[I] » ls glob/**/*.txt~
glob/dir/file2.txt
[I] » ls glob/**.txt  ~
glob/dir/file2.txt glob/file1.txt
[I] » ~
{code}

My PR matches the behaviour of a shell, so gsutil seems like the odd one out. I 
think we can commit to it with more tests to make this behaviour explicit. What 
do you think?

> Support for recursive wildcards in GcsPath
> --
>
> Key: BEAM-2150
> URL: https://issues.apache.org/jira/browse/BEAM-2150
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-java-core, sdk-java-gcp
>Reporter: Devon Meunier
>Assignee: Devon Meunier
>Priority: Minor
>
> When working with heavily nested folder structures in Google Cloud Storage, 
> it's great to make use of recursive wildcards, which the current API 
> explicitly does not support.
> This code hasn't been touched in 2 years so it's likely that simply no one's 
> gotten around to it yet.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2707

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

[holdenk (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999608#comment-15999608
 ] 

holdenk commented on BEAM-981:
--

Sure thing, no mean to pressure - but let me know if I can help or answer any 
questions on the Spark side of things :)

> Not possible to directly submit a pipeline on spark cluster
> ---
>
> Key: BEAM-981
> URL: https://issues.apache.org/jira/browse/BEAM-981
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Affects Versions: 0.6.0
>Reporter: Jean-Baptiste Onofré
>Assignee: Kobi Salant
> Fix For: 2.0.0
>
>
> It's not possible to directly run a pipeline on the spark runner (for 
> instance using {{mvn exec:java}}. It fails with:
> {code}
> [appclient-register-master-threadpool-0] INFO 
> org.apache.spark.deploy.client.AppClient$ClientEndpoint - Connecting to 
> master spark://10.200.118.197:7077...
> [shuffle-client-0] ERROR org.apache.spark.network.client.TransportClient - 
> Failed to send RPC 6813731522650020739 to /10.200.118.197:7077: 
> java.lang.AbstractMethodError: 
> org.apache.spark.network.protocol.MessageWithHeader.touch(Ljava/lang/Object;)Lio/netty/util/ReferenceCounted;
> java.lang.AbstractMethodError: 
> org.apache.spark.network.protocol.MessageWithHeader.touch(Ljava/lang/Object;)Lio/netty/util/ReferenceCounted;
> at io.netty.util.ReferenceCountUtil.touch(ReferenceCountUtil.java:73)
> at 
> io.netty.channel.DefaultChannelPipeline.touch(DefaultChannelPipeline.java:107)
> at 
> io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:820)
> at 
> io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:733)
> at 
> io.netty.handler.codec.MessageToMessageEncoder.write(MessageToMessageEncoder.java:111)
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:748)
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:740)
> at 
> io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:826)
> at 
> io.netty.channel.AbstractChannelHandlerContext.write(AbstractChannelHandlerContext.java:733)
> at 
> io.netty.handler.timeout.IdleStateHandler.write(IdleStateHandler.java:284)
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeWrite0(AbstractChannelHandlerContext.java:748)
> at 
> io.netty.channel.AbstractChannelHandlerContext.invokeWrite(AbstractChannelHandlerContext.java:740)
> at 
> io.netty.channel.AbstractChannelHandlerContext.access$1900(AbstractChannelHandlerContext.java:38)
> at 
> io.netty.channel.AbstractChannelHandlerContext$AbstractWriteTask.write(AbstractChannelHandlerContext.java:1101)
> at 
> io.netty.channel.AbstractChannelHandlerContext$WriteAndFlushTask.write(AbstractChannelHandlerContext.java:1148)
> at 
> io.netty.channel.AbstractChannelHandlerContext$AbstractWriteTask.run(AbstractChannelHandlerContext.java:1090)
> at 
> io.netty.util.concurrent.SingleThreadEventExecutor.safeExecute(SingleThreadEventExecutor.java:451)
> at 
> io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:418)
> at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:401)
> at 
> io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:877)
> at java.lang.Thread.run(Thread.java:745)
> [appclient-register-master-threadpool-0] WARN 
> org.apache.spark.deploy.client.AppClient$ClientEndpoint - Failed to connect 
> to master 10.200.118.197:7077
> java.io.IOException: Failed to send RPC 6813731522650020739 to 
> /10.200.118.197:7077: java.lang.AbstractMethodError: 
> org.apache.spark.network.protocol.MessageWithHeader.touch(Ljava/lang/Object;)Lio/netty/util/ReferenceCounted;
> at 
> org.apache.spark.network.client.TransportClient$3.operationComplete(TransportClient.java:239)
> at 
> org.apache.spark.network.client.TransportClient$3.operationComplete(TransportClient.java:226)
> at 
> io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:514)
> at 
> io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:507)
> at 
> io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:486)
> at 
> io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:427)
> at 
> io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:129)
> at 
> io.netty.channel.AbstractChannelHandlerContext.notifyOutboundHandlerException(AbstractChannelHandlerContext

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3690

[Apache Jenkins Server]

See 

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Apex #1382

[Apache Jenkins Server]

See 

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2706

[Apache Jenkins Server]

See 

[jira] [Assigned] (BEAM-2202) Support DDL

[Xu Mingmin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xu Mingmin reassigned BEAM-2202:


Assignee: (was: Xu Mingmin)

> Support DDL
> ---
>
> Key: BEAM-2202
> URL: https://issues.apache.org/jira/browse/BEAM-2202
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: James Xu
>
> Mainly create table, drop table, alter table



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-2113) Apex Runner is not able to submit any job to YARN

[Luke Cwik (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999476#comment-15999476
 ] 

Luke Cwik commented on BEAM-2113:
-

For the examples, I think we do want some kind of binding for the user when 
they are executing their application so they get local execution logs and the 
Runner will need to deal with it. Even if we did something else with examples, 
users/libraries regularly specify their own SLF4J logging backend so only by 
ensuring that the workers have the correct SLF4J backend dependencies injected 
automatically earlier on the classpath can you get around this issue.



> Apex Runner is not able to submit any job to YARN
> -
>
> Key: BEAM-2113
> URL: https://issues.apache.org/jira/browse/BEAM-2113
> Project: Beam
>  Issue Type: Bug
>  Components: runner-apex
>Affects Versions: 2.0.0
> Environment: CentOS7 + HDP-2.5.5
> OpenJDK 1.8.0_131-b11
>Reporter: Tibor Kiss
>Assignee: Thomas Weise
>Priority: Blocker
> Fix For: 2.0.0
>
>
> Trying to execute the WordCount example using Apex Runner:
> {code}
> $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount 
> -Dexec.args="--inputFile=/tmp/input/pom.xml --output=/tmp/output/ 
> --runner=ApexRunner --embeddedExecution=false" -Papex-runner
> ...
> ...
> [INFO] --- exec-maven-plugin:1.5.0:java (default-cli) @ beam-examples-java ---
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-jdk14/1.7.14/slf4j-jdk14-1.7.14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
> Apr 28, 2017 1:51:13 PM org.apache.beam.runners.apex.ApexYarnLauncher 
> launchApp
> INFO: Executing: hadoop org.apache.beam.runners.apex.ApexYarnLauncher 
> /tmp/beam-runner-apex1201917541012785769params with 
> {HADOOP_USER_CLASSPATH_FIRST=1, 
> HADOOP_CLASSPATH=/tmp/beam-runners-apex-5810119727972429445.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-core/0.7.0-SNAPSHOT/beam-sdks-java-core-0.7.0-SNAPSHOT.j
> ar:/root/.m2/repository/org/apache/beam/beam-sdks-common-runner-api/0.7.0-SNAPSHOT/beam-sdks-common-runner-api-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/http-client/google-http-client-jackson/1.22.0/google-http-client-jackson-1.22.0.jar:/root/.m2/repository/com/google/http-client/google-http-client-protobuf/1.22.0/g
> oogle-http-client-protobuf-1.22.0.jar:/root/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.8.8/jackson-core-2.8.8.jar:/root/.m2/repository/com/fasterxml/ja
> ckson/core/jackson-annotations/2.8.8/jackson-annotations-2.8.8.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.8.8/jackson-databind-2.8.8.jar:/root/.m2/repository/net/bytebuddy/byte-buddy/1.6.8/byte-buddy-1.6.8.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.1.4-M3/snappy-java-1.1.4-M3.jar:/ro
> ot/.m2/repository/org/apache/commons/commons-compress/1.9/commons-compress-1.9.jar:/root/.m2/repository/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-extensions-gcp-core/0.7.0-SNAPSHOT/beam-sdks-java-extensions-gcp-core-0.7.0-SNAPSHOT.jar:/root/.m2/repository/c
> om/google/http-client/google-http-client-jackson2/1.22.0/google-http-client-jackson2-1.22.0.jar:/root/.m2/repository/com/google/cloud/bigdataoss/gcsio/1.4.5/gcsio-1.4.5.jar:/root/.m2/repository/com/google/apis/google-api-services-cloudresourcemanager/v1-rev6-1.22.0/google-api-services-cloudresourcemanager-v1-rev6-1.22.0.jar:
> /root/.m2/repository/com/google/apis/google-api-services-storage/v1-rev71-1.22.0/google-api-services-storage-v1-rev71-1.22.0.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-io-google-cloud-platform/0.7.0-SNAPSHOT/beam-sdks-java-io-google-cloud-platform-0.7.0-SNAPSHOT.jar:/root/.m2/repository/org/apache/beam/beam-sdks
> -java-extensions-protobuf/0.7.0-SNAPSHOT/beam-sdks-java-extensions-protobuf-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-pubsub-v1/0.1.0/grpc-google-pubsub-v1-0.1.0.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-iam-v1/0.1.0/grpc-google-iam-v1-0.1.0.jar:/root/.m2/repository/io/grpc/grpc-a
> uth/1.2.0/grpc-auth-1.2.0.jar:/root/.m2/repository/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar:/root/.m2/repository/com/google/errorpron

[GitHub] beam pull request #2892: [BEAM-1340,BEAM-1345] Useful moves of user-facing s...

[kennknowles]

Github user kennknowles closed the pull request at:

https://github.com/apache/beam/pull/2892


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-1340) Remove or make private public bits of the SDK that shouldn't be public

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999435#comment-15999435
 ] 

ASF GitHub Bot commented on BEAM-1340:
--

Github user kennknowles closed the pull request at:

https://github.com/apache/beam/pull/2892


> Remove or make private public bits of the SDK that shouldn't be public
> --
>
> Key: BEAM-1340
> URL: https://issues.apache.org/jira/browse/BEAM-1340
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core, sdk-java-extensions
>Reporter: Kenneth Knowles
>Priority: Blocker
>  Labels: backward-incompatible
> Fix For: 2.0.0
>
>
> This JIRA is for the many small changes that do not merit their own JIRA 
> towards getting the SDK's API surface right. For example, removal of 
> `DoFn.InputProvider` and `DoFn.OutputReceiver`.
> While the above is not quite backwards incompatible, succeeding at this task 
> surely will be.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Apex #1381

[Apache Jenkins Server]

See 

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3689

[Apache Jenkins Server]

See 

[jira] [Updated] (BEAM-2202) Support DDL

[James Xu (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

James Xu updated BEAM-2202:
---
Description: Mainly create table, drop table, alter table  (was: Mainly 
create table, drop table.)

> Support DDL
> ---
>
> Key: BEAM-2202
> URL: https://issues.apache.org/jira/browse/BEAM-2202
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: James Xu
>Assignee: Xu Mingmin
>
> Mainly create table, drop table, alter table



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2202) Support DDL

[James Xu (JIRA)]

James Xu created BEAM-2202:
--

 Summary: Support DDL
 Key: BEAM-2202
 URL: https://issues.apache.org/jira/browse/BEAM-2202
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu
Assignee: Xu Mingmin


Mainly create table, drop table.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Resolved] (BEAM-2113) Apex Runner is not able to submit any job to YARN

[Kenneth Knowles (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles resolved BEAM-2113.
---
   Resolution: Fixed
Fix Version/s: 2.0.0

> Apex Runner is not able to submit any job to YARN
> -
>
> Key: BEAM-2113
> URL: https://issues.apache.org/jira/browse/BEAM-2113
> Project: Beam
>  Issue Type: Bug
>  Components: runner-apex
>Affects Versions: 2.0.0
> Environment: CentOS7 + HDP-2.5.5
> OpenJDK 1.8.0_131-b11
>Reporter: Tibor Kiss
>Assignee: Thomas Weise
>Priority: Blocker
> Fix For: 2.0.0
>
>
> Trying to execute the WordCount example using Apex Runner:
> {code}
> $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount 
> -Dexec.args="--inputFile=/tmp/input/pom.xml --output=/tmp/output/ 
> --runner=ApexRunner --embeddedExecution=false" -Papex-runner
> ...
> ...
> [INFO] --- exec-maven-plugin:1.5.0:java (default-cli) @ beam-examples-java ---
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-jdk14/1.7.14/slf4j-jdk14-1.7.14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
> Apr 28, 2017 1:51:13 PM org.apache.beam.runners.apex.ApexYarnLauncher 
> launchApp
> INFO: Executing: hadoop org.apache.beam.runners.apex.ApexYarnLauncher 
> /tmp/beam-runner-apex1201917541012785769params with 
> {HADOOP_USER_CLASSPATH_FIRST=1, 
> HADOOP_CLASSPATH=/tmp/beam-runners-apex-5810119727972429445.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-core/0.7.0-SNAPSHOT/beam-sdks-java-core-0.7.0-SNAPSHOT.j
> ar:/root/.m2/repository/org/apache/beam/beam-sdks-common-runner-api/0.7.0-SNAPSHOT/beam-sdks-common-runner-api-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/http-client/google-http-client-jackson/1.22.0/google-http-client-jackson-1.22.0.jar:/root/.m2/repository/com/google/http-client/google-http-client-protobuf/1.22.0/g
> oogle-http-client-protobuf-1.22.0.jar:/root/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.8.8/jackson-core-2.8.8.jar:/root/.m2/repository/com/fasterxml/ja
> ckson/core/jackson-annotations/2.8.8/jackson-annotations-2.8.8.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.8.8/jackson-databind-2.8.8.jar:/root/.m2/repository/net/bytebuddy/byte-buddy/1.6.8/byte-buddy-1.6.8.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.1.4-M3/snappy-java-1.1.4-M3.jar:/ro
> ot/.m2/repository/org/apache/commons/commons-compress/1.9/commons-compress-1.9.jar:/root/.m2/repository/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-extensions-gcp-core/0.7.0-SNAPSHOT/beam-sdks-java-extensions-gcp-core-0.7.0-SNAPSHOT.jar:/root/.m2/repository/c
> om/google/http-client/google-http-client-jackson2/1.22.0/google-http-client-jackson2-1.22.0.jar:/root/.m2/repository/com/google/cloud/bigdataoss/gcsio/1.4.5/gcsio-1.4.5.jar:/root/.m2/repository/com/google/apis/google-api-services-cloudresourcemanager/v1-rev6-1.22.0/google-api-services-cloudresourcemanager-v1-rev6-1.22.0.jar:
> /root/.m2/repository/com/google/apis/google-api-services-storage/v1-rev71-1.22.0/google-api-services-storage-v1-rev71-1.22.0.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-io-google-cloud-platform/0.7.0-SNAPSHOT/beam-sdks-java-io-google-cloud-platform-0.7.0-SNAPSHOT.jar:/root/.m2/repository/org/apache/beam/beam-sdks
> -java-extensions-protobuf/0.7.0-SNAPSHOT/beam-sdks-java-extensions-protobuf-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-pubsub-v1/0.1.0/grpc-google-pubsub-v1-0.1.0.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-iam-v1/0.1.0/grpc-google-iam-v1-0.1.0.jar:/root/.m2/repository/io/grpc/grpc-a
> uth/1.2.0/grpc-auth-1.2.0.jar:/root/.m2/repository/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar:/root/.m2/repository/com/google/errorprone/error_prone_annotations/2.0.15/error_prone_annotations-2.0.15.jar:/root/.m2/repository/io/grpc/grpc-context/1.2.0/grpc-context-1.2.0.jar:/root/.m2/repository/com/google/instrumentation/ins
> trumentation-api/0.3.0/instrumentation-api-0.3.0.jar:/root/.m2/repository/io/grpc/grpc-netty/1.2.0/grpc-netty-1.2.0.jar:/root/.m2/repository/io/netty/netty-codec-http2/4.1.8.Final/netty-codec-http2-4.1.8.Final.jar:/root/.m2/repository/io/netty/netty-codec-http/4.1.8.

[jira] [Commented] (BEAM-2113) Apex Runner is not able to submit any job to YARN

[Kenneth Knowles (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999423#comment-15999423
 ] 

Kenneth Knowles commented on BEAM-2113:
---

Thanks, great!

The config isn't quite runner-specific, because there is also the 
example/user's main class that should be able to choose its binding independent 
of what is going on wherever their pipeline is shipped. Not sure how easy that 
is to set up properly. I haven't worked on our poms and logging configs as much 
as others ([~dhalp...@google.com] and/or [~lcwik]?) so I can't speak to the 
details. Perhaps filing a JIRA to track that particular discussion would be 
helpful.


> Apex Runner is not able to submit any job to YARN
> -
>
> Key: BEAM-2113
> URL: https://issues.apache.org/jira/browse/BEAM-2113
> Project: Beam
>  Issue Type: Bug
>  Components: runner-apex
>Affects Versions: 2.0.0
> Environment: CentOS7 + HDP-2.5.5
> OpenJDK 1.8.0_131-b11
>Reporter: Tibor Kiss
>Assignee: Thomas Weise
>Priority: Blocker
>
> Trying to execute the WordCount example using Apex Runner:
> {code}
> $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount 
> -Dexec.args="--inputFile=/tmp/input/pom.xml --output=/tmp/output/ 
> --runner=ApexRunner --embeddedExecution=false" -Papex-runner
> ...
> ...
> [INFO] --- exec-maven-plugin:1.5.0:java (default-cli) @ beam-examples-java ---
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-jdk14/1.7.14/slf4j-jdk14-1.7.14.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in 
> [jar:file:/root/.m2/repository/org/slf4j/slf4j-log4j12/1.7.5/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
> Apr 28, 2017 1:51:13 PM org.apache.beam.runners.apex.ApexYarnLauncher 
> launchApp
> INFO: Executing: hadoop org.apache.beam.runners.apex.ApexYarnLauncher 
> /tmp/beam-runner-apex1201917541012785769params with 
> {HADOOP_USER_CLASSPATH_FIRST=1, 
> HADOOP_CLASSPATH=/tmp/beam-runners-apex-5810119727972429445.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-core/0.7.0-SNAPSHOT/beam-sdks-java-core-0.7.0-SNAPSHOT.j
> ar:/root/.m2/repository/org/apache/beam/beam-sdks-common-runner-api/0.7.0-SNAPSHOT/beam-sdks-common-runner-api-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/http-client/google-http-client-jackson/1.22.0/google-http-client-jackson-1.22.0.jar:/root/.m2/repository/com/google/http-client/google-http-client-protobuf/1.22.0/g
> oogle-http-client-protobuf-1.22.0.jar:/root/.m2/repository/com/google/protobuf/protobuf-java/3.2.0/protobuf-java-3.2.0.jar:/root/.m2/repository/com/google/code/findbugs/jsr305/3.0.1/jsr305-3.0.1.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-core/2.8.8/jackson-core-2.8.8.jar:/root/.m2/repository/com/fasterxml/ja
> ckson/core/jackson-annotations/2.8.8/jackson-annotations-2.8.8.jar:/root/.m2/repository/com/fasterxml/jackson/core/jackson-databind/2.8.8/jackson-databind-2.8.8.jar:/root/.m2/repository/net/bytebuddy/byte-buddy/1.6.8/byte-buddy-1.6.8.jar:/root/.m2/repository/org/xerial/snappy/snappy-java/1.1.4-M3/snappy-java-1.1.4-M3.jar:/ro
> ot/.m2/repository/org/apache/commons/commons-compress/1.9/commons-compress-1.9.jar:/root/.m2/repository/org/apache/commons/commons-lang3/3.5/commons-lang3-3.5.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-extensions-gcp-core/0.7.0-SNAPSHOT/beam-sdks-java-extensions-gcp-core-0.7.0-SNAPSHOT.jar:/root/.m2/repository/c
> om/google/http-client/google-http-client-jackson2/1.22.0/google-http-client-jackson2-1.22.0.jar:/root/.m2/repository/com/google/cloud/bigdataoss/gcsio/1.4.5/gcsio-1.4.5.jar:/root/.m2/repository/com/google/apis/google-api-services-cloudresourcemanager/v1-rev6-1.22.0/google-api-services-cloudresourcemanager-v1-rev6-1.22.0.jar:
> /root/.m2/repository/com/google/apis/google-api-services-storage/v1-rev71-1.22.0/google-api-services-storage-v1-rev71-1.22.0.jar:/root/.m2/repository/org/apache/beam/beam-sdks-java-io-google-cloud-platform/0.7.0-SNAPSHOT/beam-sdks-java-io-google-cloud-platform-0.7.0-SNAPSHOT.jar:/root/.m2/repository/org/apache/beam/beam-sdks
> -java-extensions-protobuf/0.7.0-SNAPSHOT/beam-sdks-java-extensions-protobuf-0.7.0-SNAPSHOT.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-pubsub-v1/0.1.0/grpc-google-pubsub-v1-0.1.0.jar:/root/.m2/repository/com/google/api/grpc/grpc-google-iam-v1/0.1.0/grpc-google-iam-v1-0.1.0.jar:/root/.m2/repository/io/grpc/grpc-a
> uth/1.2.0/grpc-auth-1.2.0.jar:/root/.m2/repository/io/grpc/grpc-core/1.2.0/grpc-core-1.2.0.jar:/root/.m2/repository/com/google/error

[jira] [Created] (BEAM-2201) Support set statement

[James Xu (JIRA)]

James Xu created BEAM-2201:
--

 Summary: Support set statement
 Key: BEAM-2201
 URL: https://issues.apache.org/jira/browse/BEAM-2201
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2200) Support describe statement

[James Xu (JIRA)]

James Xu created BEAM-2200:
--

 Summary: Support describe statement
 Key: BEAM-2200
 URL: https://issues.apache.org/jira/browse/BEAM-2200
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2199) Support explain statement

[James Xu (JIRA)]

James Xu created BEAM-2199:
--

 Summary: Support explain statement
 Key: BEAM-2199
 URL: https://issues.apache.org/jira/browse/BEAM-2199
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2198) Support merge statement

[James Xu (JIRA)]

James Xu created BEAM-2198:
--

 Summary: Support merge statement
 Key: BEAM-2198
 URL: https://issues.apache.org/jira/browse/BEAM-2198
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2197) Support explain statement

[James Xu (JIRA)]

James Xu created BEAM-2197:
--

 Summary: Support explain statement
 Key: BEAM-2197
 URL: https://issues.apache.org/jira/browse/BEAM-2197
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1340) Remove or make private public bits of the SDK that shouldn't be public

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999418#comment-15999418
 ] 

ASF GitHub Bot commented on BEAM-1340:
--

GitHub user kennknowles opened a pull request:

https://github.com/apache/beam/pull/2940

[BEAM-1340] Move TestDataflowRunner into dataflow package

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---

R: @davorbonaci

I believe the cost/benefit of this change make it worth consideration for 
including in the first stable release.

There are two parts to this PR:

1. Register the `TestDataflowRunner` so that we don't have to fully qualify 
it on the command line. This simplifies our poms and every testers life. This 
is backwards compatible and makes configurations more robust. Note that every 
other runner has their test runner registered.

2. Move the runners.dataflow.testing package to the runners.dataflow 
package. This will allow the test runner to use package-private things, such as 
transport helpers, etc, etc, (the list will only grow).

After the registrar change is in place, the second one is backwards 
compatible except for programmatic uses, which would mean a user hardcoded the 
runner in their Java code. So, while it is backwards incompatible in a 
technical sense, the actual negative impact is ~zero.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kennknowles/beam DataflowRunner-testing

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2940.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2940


commit 307598202758f8d918e171dae3c8012ada50c38e
Author: Kenneth Knowles 
Date:   2017-05-06T12:13:34Z

Register the TestDataflowRunner via registrar

commit 204a5254dfb0e36e348d64f13c8ea0fa325b6575
Author: Kenneth Knowles 
Date:   2017-05-06T12:22:03Z

Move TestDataflowRunner into dataflow package




> Remove or make private public bits of the SDK that shouldn't be public
> --
>
> Key: BEAM-1340
> URL: https://issues.apache.org/jira/browse/BEAM-1340
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core, sdk-java-extensions
>Reporter: Kenneth Knowles
>Priority: Blocker
>  Labels: backward-incompatible
> Fix For: 2.0.0
>
>
> This JIRA is for the many small changes that do not merit their own JIRA 
> towards getting the SDK's API surface right. For example, removal of 
> `DoFn.InputProvider` and `DoFn.OutputReceiver`.
> While the above is not quite backwards incompatible, succeeding at this task 
> surely will be.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #2940: [BEAM-1340] Move TestDataflowRunner into dataflow p...

[kennknowles]

GitHub user kennknowles opened a pull request:

https://github.com/apache/beam/pull/2940

[BEAM-1340] Move TestDataflowRunner into dataflow package

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---

R: @davorbonaci

I believe the cost/benefit of this change make it worth consideration for 
including in the first stable release.

There are two parts to this PR:

1. Register the `TestDataflowRunner` so that we don't have to fully qualify 
it on the command line. This simplifies our poms and every testers life. This 
is backwards compatible and makes configurations more robust. Note that every 
other runner has their test runner registered.

2. Move the runners.dataflow.testing package to the runners.dataflow 
package. This will allow the test runner to use package-private things, such as 
transport helpers, etc, etc, (the list will only grow).

After the registrar change is in place, the second one is backwards 
compatible except for programmatic uses, which would mean a user hardcoded the 
runner in their Java code. So, while it is backwards incompatible in a 
technical sense, the actual negative impact is ~zero.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kennknowles/beam DataflowRunner-testing

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2940.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2940


commit 307598202758f8d918e171dae3c8012ada50c38e
Author: Kenneth Knowles 
Date:   2017-05-06T12:13:34Z

Register the TestDataflowRunner via registrar

commit 204a5254dfb0e36e348d64f13c8ea0fa325b6575
Author: Kenneth Knowles 
Date:   2017-05-06T12:22:03Z

Move TestDataflowRunner into dataflow package




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-2196) support UDF

[James Xu (JIRA)]

James Xu created BEAM-2196:
--

 Summary: support UDF
 Key: BEAM-2196
 URL: https://issues.apache.org/jira/browse/BEAM-2196
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2195) support conditional functions & operators

[James Xu (JIRA)]

James Xu created BEAM-2195:
--

 Summary: support conditional functions & operators
 Key: BEAM-2195
 URL: https://issues.apache.org/jira/browse/BEAM-2195
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu


https://calcite.apache.org/docs/reference.html#conditional-functions-and-operators



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2705

[Apache Jenkins Server]

See 

[jira] [Created] (BEAM-2194) JOIN: cross join, full outer join

[James Xu (JIRA)]

James Xu created BEAM-2194:
--

 Summary: JOIN: cross join, full outer join
 Key: BEAM-2194
 URL: https://issues.apache.org/jira/browse/BEAM-2194
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Created] (BEAM-2193) JOIN: inner join, left join, right join

[James Xu (JIRA)]

James Xu created BEAM-2193:
--

 Summary: JOIN: inner join, left join, right join
 Key: BEAM-2193
 URL: https://issues.apache.org/jira/browse/BEAM-2193
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1340) Remove or make private public bits of the SDK that shouldn't be public

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999410#comment-15999410
 ] 

ASF GitHub Bot commented on BEAM-1340:
--

GitHub user kennknowles opened a pull request:

https://github.com/apache/beam/pull/2939

[BEAM-1340] Move Dataflow PipelineOptions to Dataflow package

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---

R: @davorbonaci 

I believe the cost/benefit of this change make it worth consideration for 
including in the first stable release.

This takes the `runners.dataflow.options` package and moves it to the 
`runners.dataflow` package. This is a fully automated refactor (thanks, 
IntelliJ!). The first commit is just the refactor, for easy review. The second 
commit fixes imports automatically.

This will allow the options - particularly the factories for their 
defaults, such as the default file stager - to use package-private features of 
the runner.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kennknowles/beam Dataflow-PipelineOptions

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2939.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2939


commit 8f9712f9826c97b73e28a3776aca5d305d929bd5
Author: Kenneth Knowles 
Date:   2017-05-06T11:56:58Z

Move Dataflow PipelineOptions to Dataflow package

commit aab23bd8667cb514c4986f5c729d3d91b484
Author: Kenneth Knowles 
Date:   2017-05-06T12:07:06Z

fixup! Fix imports




> Remove or make private public bits of the SDK that shouldn't be public
> --
>
> Key: BEAM-1340
> URL: https://issues.apache.org/jira/browse/BEAM-1340
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core, sdk-java-extensions
>Reporter: Kenneth Knowles
>Priority: Blocker
>  Labels: backward-incompatible
> Fix For: 2.0.0
>
>
> This JIRA is for the many small changes that do not merit their own JIRA 
> towards getting the SDK's API surface right. For example, removal of 
> `DoFn.InputProvider` and `DoFn.OutputReceiver`.
> While the above is not quite backwards incompatible, succeeding at this task 
> surely will be.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #2939: [BEAM-1340] Move Dataflow PipelineOptions to Datafl...

[kennknowles]

GitHub user kennknowles opened a pull request:

https://github.com/apache/beam/pull/2939

[BEAM-1340] Move Dataflow PipelineOptions to Dataflow package

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`.
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.pdf).

---

R: @davorbonaci 

I believe the cost/benefit of this change make it worth consideration for 
including in the first stable release.

This takes the `runners.dataflow.options` package and moves it to the 
`runners.dataflow` package. This is a fully automated refactor (thanks, 
IntelliJ!). The first commit is just the refactor, for easy review. The second 
commit fixes imports automatically.

This will allow the options - particularly the factories for their 
defaults, such as the default file stager - to use package-private features of 
the runner.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kennknowles/beam Dataflow-PipelineOptions

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2939.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2939


commit 8f9712f9826c97b73e28a3776aca5d305d929bd5
Author: Kenneth Knowles 
Date:   2017-05-06T11:56:58Z

Move Dataflow PipelineOptions to Dataflow package

commit aab23bd8667cb514c4986f5c729d3d91b484
Author: Kenneth Knowles 
Date:   2017-05-06T12:07:06Z

fixup! Fix imports




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-2192) support DISTINCT select

[James Xu (JIRA)]

James Xu created BEAM-2192:
--

 Summary: support DISTINCT select
 Key: BEAM-2192
 URL: https://issues.apache.org/jira/browse/BEAM-2192
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu






--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (BEAM-1340) Remove or make private public bits of the SDK that shouldn't be public

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15999402#comment-15999402
 ] 

ASF GitHub Bot commented on BEAM-1340:
--

Github user kennknowles closed the pull request at:

https://github.com/apache/beam/pull/2872


> Remove or make private public bits of the SDK that shouldn't be public
> --
>
> Key: BEAM-1340
> URL: https://issues.apache.org/jira/browse/BEAM-1340
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core, sdk-java-extensions
>Reporter: Kenneth Knowles
>Priority: Blocker
>  Labels: backward-incompatible
> Fix For: 2.0.0
>
>
> This JIRA is for the many small changes that do not merit their own JIRA 
> towards getting the SDK's API surface right. For example, removal of 
> `DoFn.InputProvider` and `DoFn.OutputReceiver`.
> While the above is not quite backwards incompatible, succeeding at this task 
> surely will be.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[GitHub] beam pull request #2872: [BEAM-1340,BEAM-1345] Tighten the Dataflow runner's...

[kennknowles]

Github user kennknowles closed the pull request at:

https://github.com/apache/beam/pull/2872


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-2191) Support Set opeators

[James Xu (JIRA)]

James Xu created BEAM-2191:
--

 Summary: Support Set opeators
 Key: BEAM-2191
 URL: https://issues.apache.org/jira/browse/BEAM-2191
 Project: Beam
  Issue Type: New Feature
  Components: dsl-sql
Reporter: James Xu


support the set operators in query:

  query UNION [ ALL | DISTINCT ] query
  query EXCEPT [ ALL | DISTINCT ] query
  query MINUS [ ALL | DISTINCT ] query
  query INTERSECT [ ALL | DISTINCT ] query



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Updated] (BEAM-1672) Accumulable MetricsContainers.

[Aviem Zur (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-1672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aviem Zur updated BEAM-1672:

Fix Version/s: 2.0.0

> Accumulable MetricsContainers.
> --
>
> Key: BEAM-1672
> URL: https://issues.apache.org/jira/browse/BEAM-1672
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Aviem Zur
>Assignee: Aviem Zur
> Fix For: 2.0.0
>
>
> Make {{MetricsContainer}} accumulable. This can reduce duplication between 
> runners and make implementing metrics easier for runner authors.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3688

[Apache Jenkins Server]

See