[jira] [Created] (BEAM-2687) Python SDK support for Stateful Processing

Ahmet Altay created BEAM-2687: - Summary: Python SDK support for Stateful Processing Key: BEAM-2687 URL: https://issues.apache.org/jira/browse/BEAM-2687 Project: Beam Issue Type: New Feature

Build failed in Jenkins: beam_PostCommit_Python_Verify #2809

See -- [...truncated 558.38 KB...] File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3659

See

[GitHub] beam pull request #3650: Translate ParDo and GroupByKey operations through t...

GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3650 Translate ParDo and GroupByKey operations through the Runner API Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3658

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2714

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4463

See -- [...truncated 1.01 MB...] 2017-07-27T00:31:41.009 [INFO] Downloaded: https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/4.0.0/jna-4.0.0.pom (2 KB at

[jira] [Commented] (BEAM-2686) PTransform's should always set a Coder on their output PCollections

[ https://issues.apache.org/jira/browse/BEAM-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102521#comment-16102521 ] ASF GitHub Bot commented on BEAM-2686: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #3649: [BEAM-2686] Towards deprecating PCollection.setCode...

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3649 [BEAM-2686] Towards deprecating PCollection.setCoder() https://issues.apache.org/jira/browse/BEAM-2686 - Renames Source.getDefaultOutputCoder to Source.getOutputCoder (in a compatible way), to

[jira] [Created] (BEAM-2686) PTransform's should always set a Coder on their output PCollections

Eugene Kirpichov created BEAM-2686: -- Summary: PTransform's should always set a Coder on their output PCollections Key: BEAM-2686 URL: https://issues.apache.org/jira/browse/BEAM-2686 Project: Beam

Build failed in Jenkins: beam_PostCommit_Python_Verify #2808

See Changes: [robertwb] Migrate checkCombineFn in TestUtils to CombineFnTester -- [...truncated 562.27 KB...] Collecting setuptools (from pyhamcrest->-r

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2713

See

[jira] [Commented] (BEAM-2672) test merge in BeamSqlUdaf

[ https://issues.apache.org/jira/browse/BEAM-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102472#comment-16102472 ] ASF GitHub Bot commented on BEAM-2672: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3648: sync-up from master branch

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3648 sync-up from master branch BEAM-2672 requires a new function added in #3628 You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/beam master

[jira] [Commented] (BEAM-2558) Add a CombineFnTester

[ https://issues.apache.org/jira/browse/BEAM-2558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102466#comment-16102466 ] ASF GitHub Bot commented on BEAM-2558: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: Closes #3628

Repository: beam Updated Branches: refs/heads/master 673937b92 -> e206b1a41 Closes #3628 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e206b1a4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e206b1a4 Diff:

[2/2] beam git commit: Migrate checkCombineFn in TestUtils to CombineFnTester

Migrate checkCombineFn in TestUtils to CombineFnTester This makes CombineFnTester significantly more discoverable, and usable without having dependencies on the test JAR. Update existing tests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #3628: [BEAM-2558] Migrate checkCombineFn in TestUtils to ...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3628 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3657

See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4461

See

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102436#comment-16102436 ] Guillermo Rodríguez Cano commented on BEAM-2490: Sorry for the delay, I have been busy with

Build failed in Jenkins: beam_PostCommit_Python_Verify #2807

See Changes: [robertwb] Translate combining operations through the Runner API. -- [...truncated 558.89 KB...] File was already downloaded

[jira] [Commented] (BEAM-2566) Java SDK harness should not depend on any runner

[ https://issues.apache.org/jira/browse/BEAM-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102415#comment-16102415 ] ASF GitHub Bot commented on BEAM-2566: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #3647: [BEAM-2566] Remove References to CloudObject from t...

GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3647 [BEAM-2566] Remove References to CloudObject from the Java Harness Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2712

See

[jira] [Closed] (BEAM-1820) Source.getDefaultOutputCoder() should be @Nullable

[ https://issues.apache.org/jira/browse/BEAM-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1820. -- Resolution: Won't Fix Fix Version/s: Not applicable The consensus on dev@ is that

[jira] [Commented] (BEAM-1820) Source.getDefaultOutputCoder() should be @Nullable

[ https://issues.apache.org/jira/browse/BEAM-1820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102354#comment-16102354 ] ASF GitHub Bot commented on BEAM-1820: -- Github user jkff closed the pull request at:

[GitHub] beam pull request #3634: [BEAM-1820] Source.getDefaultOutputCoder() throws C...

Github user jkff closed the pull request at: https://github.com/apache/beam/pull/3634 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Translate combining operations through the Runner API.

Repository: beam Updated Branches: refs/heads/master b67a30bf1 -> 673937b92 Translate combining operations through the Runner API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/82cc1e1a Tree:

[2/2] beam git commit: Closes #3640

Closes #3640 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/673937b9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/673937b9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/673937b9 Branch: refs/heads/master

[jira] [Created] (BEAM-2685) Fix issue with abc.ABCMeta causing dill failures

Robert Bradshaw created BEAM-2685: - Summary: Fix issue with abc.ABCMeta causing dill failures Key: BEAM-2685 URL: https://issues.apache.org/jira/browse/BEAM-2685 Project: Beam Issue Type:

Build failed in Jenkins: beam_PostCommit_Python_Verify #2806

See -- [...truncated 568.35 KB...] Collecting six (from pyhamcrest->-r postcommit_requirements.txt (line 1)) File was already downloaded

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102317#comment-16102317 ] Xu Mingmin commented on BEAM-2676: -- SGTM, then we've all the type classes in one package. [~robertwb] make

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3656

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3655

See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4460

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2711

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2710

See

[jira] [Created] (BEAM-2684) AmqpIOTest is flaky

Eugene Kirpichov created BEAM-2684: -- Summary: AmqpIOTest is flaky Key: BEAM-2684 URL: https://issues.apache.org/jira/browse/BEAM-2684 Project: Beam Issue Type: Bug Components:

[GitHub] beam pull request #3646: Do not merge: scratch work 2

GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/3646 Do not merge: scratch work 2 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[1/4] beam git commit: Disable abc metaclass due to issues with pickling.

Repository: beam Updated Branches: refs/heads/master 69a51c988 -> b67a30bf1 Disable abc metaclass due to issues with pickling. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/24b39e45 Tree:

[GitHub] beam pull request #3635: Translate reads/sources through the Runner API

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3635 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[4/4] beam git commit: Closes #3635

Closes #3635 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b67a30bf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b67a30bf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b67a30bf Branch: refs/heads/master

[2/4] beam git commit: Use runner API for read operation.

Use runner API for read operation. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/22e49e60 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/22e49e60 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/22e49e60

[3/4] beam git commit: Create common superclass for all Sources.

Create common superclass for all Sources. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2d307f29 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2d307f29 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2d307f29

[GitHub] beam pull request #3645: Fixes BigQueryIO.Write javadoc for to(ValueInSingle...

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3645 Fixes BigQueryIO.Write javadoc for to(ValueInSingleWindow) R: @reuvenlax You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam

[jira] [Resolved] (BEAM-2681) TransformHierarchy.Node getInputs() TupleTags doesn't match previous ParDo.MultiOutput's getOutputs().

[ https://issues.apache.org/jira/browse/BEAM-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2681. --- Resolution: Not A Problem Fix Version/s: Not applicable This is expected. A {{TupleTag}} is a

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3654

See

[jira] [Commented] (BEAM-1534) Create a dockerized developer environment for Beam

[ https://issues.apache.org/jira/browse/BEAM-1534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101866#comment-16101866 ] Ismaël Mejía commented on BEAM-1534: Hi, I would like to know if you there is progress on this issue. I

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #4458

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2709

See

[jira] [Resolved] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2658. - Resolution: Fixed Fix Version/s: 2.2.0 > SerializableCoder has higher precedence over ProtoCoder in

[jira] [Assigned] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-2658: --- Assignee: Neville Li (was: Davor Bonaci) > SerializableCoder has higher precedence over ProtoCoder

[jira] [Commented] (BEAM-2658) SerializableCoder has higher precedence over ProtoCoder in CoderRegistry#getCoder

[ https://issues.apache.org/jira/browse/BEAM-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101760#comment-16101760 ] ASF GitHub Bot commented on BEAM-2658: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3617: [BEAM-2658] register SerializableCoder last

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3617 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2658] register SerializableCoder last

[BEAM-2658] register SerializableCoder last This closes #3617 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/69a51c98 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/69a51c98 Diff:

[1/2] beam git commit: [BEAM-2658] register DefaultCoder first and SerializableCoder last

Repository: beam Updated Branches: refs/heads/master bc72c9405 -> 69a51c988 [BEAM-2658] register DefaultCoder first and SerializableCoder last Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/809a7f86 Tree:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3653

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2708

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4457

See -- [...truncated 273.89 KB...] 2017-07-26T12:02:00.124 [INFO] Downloaded: https://repo.maven.apache.org/maven2/asm/asm/3.3.1/asm-3.3.1.pom (266 B at 10.0 KB/sec)

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3652

See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4456

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3651

See

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4454

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2707

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2706

See

[GitHub] beam pull request #3642: Sets desired bundle size on AvroIO.readAll

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3642 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Sets desired bundle size on AvroIO.readAll

Repository: beam Updated Branches: refs/heads/master a9fdc3bc4 -> bc72c9405 Sets desired bundle size on AvroIO.readAll Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/56a1bcea Tree:

[2/2] beam git commit: This closes #3642: Sets desired bundle size on AvroIO.readAll

This closes #3642: Sets desired bundle size on AvroIO.readAll Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bc72c940 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bc72c940 Diff:

[2/2] beam git commit: This closes #3630

This closes #3630 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a9fdc3bc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a9fdc3bc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a9fdc3bc Branch:

[GitHub] beam pull request #3630: We shouldn't write to re-created tables for 2 mins

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3630 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: We shouldn't write to re-created tables for 2 mins

Repository: beam Updated Branches: refs/heads/master d919394c7 -> a9fdc3bc4 We shouldn't write to re-created tables for 2 mins Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/483abc09 Tree: