[GitHub] incubator-beam pull request #1059: Fix Streaming Integration Test Failure in...

GitHub user markflyhigh opened a pull request: https://github.com/apache/incubator-beam/pull/1059 Fix Streaming Integration Test Failure in Precommit Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[jira] [Created] (BEAM-722) Add Display Data to the Python SDK

Pablo Estrada created BEAM-722: -- Summary: Add Display Data to the Python SDK Key: BEAM-722 URL: https://issues.apache.org/jira/browse/BEAM-722 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-626) AvroCoder not deserializing correctly in Kryo

[ https://issues.apache.org/jira/browse/BEAM-626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-626: - Assignee: Aviem Zur (was: Davor Bonaci) > AvroCoder not deserializing correctly in Kryo >

[jira] [Created] (BEAM-721) Travis CI fails to run Python tox tests on Mac

Pablo Estrada created BEAM-721: -- Summary: Travis CI fails to run Python tox tests on Mac Key: BEAM-721 URL: https://issues.apache.org/jira/browse/BEAM-721 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request #1058: Fixes a bug in avroio_test.py

GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/1058 Fixes a bug in avroio_test.py Fixes a bug in avroio_test.py where we open a binary file without 'b' mode. Without this, file can get corrupted in Windows and the test becomes flaky.

[GitHub] incubator-beam pull request #1057: Ignore: test travis

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1057 Ignore: test travis You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam travis-test-archetype Alternatively you can

[jira] [Issue Comment Deleted] (BEAM-719) Running WindowedWordCount Integration Test in Spark

[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-719: --- Comment: was deleted (was: As discussed in the mentioned PR, UnboundedReadFromBoundedSource support is

[jira] [Commented] (BEAM-719) Running WindowedWordCount Integration Test in Spark

[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550096#comment-15550096 ] Amit Sela commented on BEAM-719: As discussed in the mentioned PR, UnboundedReadFromBoundedSource support is

[jira] [Commented] (BEAM-719) Running WindowedWordCount Integration Test in Spark

[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550095#comment-15550095 ] Amit Sela commented on BEAM-719: As discussed in the mentioned PR, UnboundedReadFromBoundedSource support is

[jira] [Updated] (BEAM-540) Dataflow streaming jobs running on windmill do not need data disks

[ https://issues.apache.org/jira/browse/BEAM-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-540: -- Assignee: David Rieber (was: Davor Bonaci) > Dataflow streaming jobs running on windmill do not need

[jira] [Resolved] (BEAM-540) Dataflow streaming jobs running on windmill do not need data disks

[ https://issues.apache.org/jira/browse/BEAM-540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-540. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Dataflow streaming jobs running on windmill

[GitHub] incubator-beam pull request #1056: Static import Assert.assertEquals in Data...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1056 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Static import Assert.assertEquals in DataflowUnboundedReadFromBoundedSourceTest

Static import Assert.assertEquals in DataflowUnboundedReadFromBoundedSourceTest This closes #1056 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f27354f7 Tree:

[1/2] incubator-beam git commit: Static import Assert.assertEquals

Repository: incubator-beam Updated Branches: refs/heads/master 5918fed8a -> f27354f77 Static import Assert.assertEquals Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/099fd9c7 Tree:

[jira] [Created] (BEAM-720) Running WindowedWordCount Integration Test in Flink

Mark Liu created BEAM-720: - Summary: Running WindowedWordCount Integration Test in Flink Key: BEAM-720 URL: https://issues.apache.org/jira/browse/BEAM-720 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-719) Running WindowedWordCount Integration Test in Spark

Mark Liu created BEAM-719: - Summary: Running WindowedWordCount Integration Test in Spark Key: BEAM-719 URL: https://issues.apache.org/jira/browse/BEAM-719 Project: Beam Issue Type: Improvement

[GitHub] incubator-beam pull request #1056: Static import Assert.assertEquals in Data...

GitHub user swegner opened a pull request: https://github.com/apache/incubator-beam/pull/1056 Static import Assert.assertEquals in DataflowUnboundedReadFromBoundedSourceTest Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[2/2] incubator-beam git commit: This closes #863

This closes #863 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5918fed8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5918fed8 Diff:

[1/2] incubator-beam git commit: Place fired timers in the Global Window

Repository: incubator-beam Updated Branches: refs/heads/master e46127e5a -> 5918fed8a Place fired timers in the Global Window The runner is theoretically permitted to drop timers it recieves if they are not present in any window. This ensures that any element provided to any

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1273

See

[jira] [Closed] (BEAM-528) Add @experimental annotations

[ https://issues.apache.org/jira/browse/BEAM-528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-528. Resolution: Fixed Fix Version/s: Not applicable > Add @experimental annotations >

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1272

See

[jira] [Created] (BEAM-716) Migrate JmsIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-716: -- Summary: Migrate JmsIO to use AutoValue to reduce boilerplate Key: BEAM-716 URL: https://issues.apache.org/jira/browse/BEAM-716 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-718) Migrate KinesisIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-718: -- Summary: Migrate KinesisIO to use AutoValue to reduce boilerplate Key: BEAM-718 URL: https://issues.apache.org/jira/browse/BEAM-718 Project: Beam Issue Type:

[jira] [Created] (BEAM-717) Migrate KafkaIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-717: -- Summary: Migrate KafkaIO to use AutoValue to reduce boilerplate Key: BEAM-717 URL: https://issues.apache.org/jira/browse/BEAM-717 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-714) Migrate DatastoreV1 to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549629#comment-15549629 ] Eugene Kirpichov commented on BEAM-714: --- This is being done in

[jira] [Created] (BEAM-715) Migrate AvroHDFSFileSource/HDFSFileSource/HDFSFileSink to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-715: -- Summary: Migrate AvroHDFSFileSource/HDFSFileSource/HDFSFileSink to use AutoValue to reduce boilerplate Key: BEAM-715 URL: https://issues.apache.org/jira/browse/BEAM-715 Project:

[jira] [Created] (BEAM-714) Migrate DatastoreV1 to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-714: -- Summary: Migrate DatastoreV1 to use AutoValue to reduce boilerplate Key: BEAM-714 URL: https://issues.apache.org/jira/browse/BEAM-714 Project: Beam Issue Type:

[jira] [Created] (BEAM-712) Migrate BigQueryIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-712: -- Summary: Migrate BigQueryIO to use AutoValue to reduce boilerplate Key: BEAM-712 URL: https://issues.apache.org/jira/browse/BEAM-712 Project: Beam Issue Type:

[jira] [Created] (BEAM-713) Migrate BigTableIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-713: -- Summary: Migrate BigTableIO to use AutoValue to reduce boilerplate Key: BEAM-713 URL: https://issues.apache.org/jira/browse/BEAM-713 Project: Beam Issue Type:

[jira] [Created] (BEAM-711) Migrate XmlSource/XmlSink to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-711: -- Summary: Migrate XmlSource/XmlSink to use AutoValue to reduce boilerplate Key: BEAM-711 URL: https://issues.apache.org/jira/browse/BEAM-711 Project: Beam Issue Type:

[jira] [Updated] (BEAM-710) Migrate Read/Write to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-710: --- Summary: Migrate Read/Write to use AutoValue to reduce boilerplate (was: Migrate Read to use AutoValue to

[jira] [Updated] (BEAM-709) Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-709: --- Summary: Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate (was: Migrate

[jira] [Updated] (BEAM-707) Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

[ https://issues.apache.org/jira/browse/BEAM-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-707: --- Summary: Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

[jira] [Created] (BEAM-710) Migrate Read to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-710: -- Summary: Migrate Read to use AutoValue to reduce boilerplate Key: BEAM-710 URL: https://issues.apache.org/jira/browse/BEAM-710 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-709) Migrate CountingSource to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-709: -- Summary: Migrate CountingSource to use AutoValue to reduce boilerplate Key: BEAM-709 URL: https://issues.apache.org/jira/browse/BEAM-709 Project: Beam Issue Type:

[jira] [Created] (BEAM-708) Migrate BoundedReadFromUnboundedSource to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-708: -- Summary: Migrate BoundedReadFromUnboundedSource to use AutoValue to reduce boilerplate Key: BEAM-708 URL: https://issues.apache.org/jira/browse/BEAM-708 Project: Beam

[jira] [Created] (BEAM-707) Migrate PubsubIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-707: -- Summary: Migrate PubsubIO to use AutoValue to reduce boilerplate Key: BEAM-707 URL: https://issues.apache.org/jira/browse/BEAM-707 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-706) Migrate TextIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-706: -- Summary: Migrate TextIO to use AutoValue to reduce boilerplate Key: BEAM-706 URL: https://issues.apache.org/jira/browse/BEAM-706 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-705) Migrate AvroIO to use AutoValue to reduce boilerplate

Luke Cwik created BEAM-705: -- Summary: Migrate AvroIO to use AutoValue to reduce boilerplate Key: BEAM-705 URL: https://issues.apache.org/jira/browse/BEAM-705 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-561) Add WindowedWordCountIT

[ https://issues.apache.org/jira/browse/BEAM-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549563#comment-15549563 ] ASF GitHub Bot commented on BEAM-561: - Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: [BEAM-561] Add Streaming IT in Jenkins Pre-commit

[BEAM-561] Add Streaming IT in Jenkins Pre-commit Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f028f1c0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f028f1c0 Diff:

[GitHub] incubator-beam pull request #1045: [BEAM-561] Add Streaming IT to Jenkins Pr...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1045 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Closes #1045

Repository: incubator-beam Updated Branches: refs/heads/master 565319bd7 -> e46127e5a Closes #1045 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e46127e5 Tree:

[jira] [Commented] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549524#comment-15549524 ] ASF GitHub Bot commented on BEAM-259: - GitHub user amitsela opened a pull request:

[GitHub] incubator-beam pull request #1055: [BEAM-259] Enable RunnableOnService for b...

GitHub user amitsela opened a pull request: https://github.com/apache/incubator-beam/pull/1055 [BEAM-259] Enable RunnableOnService for batch. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1271

See

[jira] [Commented] (BEAM-259) Execute selected RunnableOnService tests with Spark runner

[ https://issues.apache.org/jira/browse/BEAM-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549371#comment-15549371 ] Amit Sela commented on BEAM-259: While this ticket is talking about "enabling" the ROS tests for the Spark

[jira] [Commented] (BEAM-564) Update source framework so that remaining and consumed number of split points can be reported

[ https://issues.apache.org/jira/browse/BEAM-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549324#comment-15549324 ] ASF GitHub Bot commented on BEAM-564: - Github user chamikaramj closed the pull request at:

[GitHub] incubator-beam pull request #881: [BEAM-564] Updates sources to report consu...

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/881 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

[ https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549295#comment-15549295 ] ASF GitHub Bot commented on BEAM-547: - Github user aaltay closed the pull request at:

[GitHub] incubator-beam pull request #855: [BEAM-547] Read version information from t...

Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/855 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-175) Don't leak garbage collection timers in GlobalWindow

[ https://issues.apache.org/jira/browse/BEAM-175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549289#comment-15549289 ] ASF GitHub Bot commented on BEAM-175: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-523) Minor typo in aggregator_test.py

[ https://issues.apache.org/jira/browse/BEAM-523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549290#comment-15549290 ] ASF GitHub Bot commented on BEAM-523: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

[ https://issues.apache.org/jira/browse/BEAM-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549288#comment-15549288 ] ASF GitHub Bot commented on BEAM-160: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-548) Combine$PerKeyWithHotKeyFanout should propagate Display Data

[ https://issues.apache.org/jira/browse/BEAM-548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549287#comment-15549287 ] ASF GitHub Bot commented on BEAM-548: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #656: Removed BatchWrite from DataflowRunner

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/656 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #139: [BEAM-175][BEAM-32] Don't leak state in Gl...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/139 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #798: [BEAM-523] Fixed typo in aggregator_test.p...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/798 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #366: [BEAM-160] NexMark

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/366 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #847: [BEAM-548] Fixed Combine display data

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/847 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

incubator-beam git commit: Empty commit to close some stale PRs

Repository: incubator-beam Updated Branches: refs/heads/master 087dcef1e -> 565319bd7 Empty commit to close some stale PRs Close #139 - abandoned Close #366 - abandoned Close #656 - abandoned Close #798 - merged to Python Close #847 - merged as part of #906 Project:

[jira] [Created] (BEAM-704) KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark.

Amit Sela created BEAM-704: -- Summary: KafkaIO should handle "latest offset" evenly, and persist it as part of the CheckpointMark. Key: BEAM-704 URL: https://issues.apache.org/jira/browse/BEAM-704 Project:

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1270

See

[jira] [Commented] (BEAM-698) Use AutoValue and deal with Document instead of String in MongoDbIO

[ https://issues.apache.org/jira/browse/BEAM-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15548115#comment-15548115 ] ASF GitHub Bot commented on BEAM-698: - GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request #1054: [BEAM-698] Use AutoValue in MongoDB GridF...

GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/1054 [BEAM-698] Use AutoValue in MongoDB GridFS Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is

[jira] [Updated] (BEAM-570) Update AvroSource to support more compression types

[ https://issues.apache.org/jira/browse/BEAM-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-570: Assignee: (was: Frances Perry) > Update AvroSource to support more compression types >

[jira] [Updated] (BEAM-570) Update AvroSource to support more compression types

[ https://issues.apache.org/jira/browse/BEAM-570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath updated BEAM-570: Assignee: Frances Perry (was: Chamikara Jayalath) > Update AvroSource to support more