[jira] [Commented] (BEAM-456) Add MongoDBIO

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380486#comment-15380486 ] ASF GitHub Bot commented on BEAM-456: - GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request #671: [BEAM-456] Add MongoDbIO

2016-07-15 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/671 [BEAM-456] Add MongoDbIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like:

[GitHub] incubator-beam pull request #638: Clarify RequiresWindowAccess error message

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/638 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Clarify RequiresWindowAccess error message

2016-07-15 Thread dhalperi
Clarify RequiresWindowAccess error message An error message is printed when a DoFn needs access to the window but does not implement RequiresWindowAccess. This PR changes to the error message to print the interface name instead of just "RequiresWindow", which makes it more clear which interface

[1/2] incubator-beam git commit: Make step encodings consistently use WindowedValueCoders

2016-07-15 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 1305c108a -> b8e3a7b52 Make step encodings consistently use WindowedValueCoders This change is needed for size-estimation aggregators. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #669: Make step encodings consistently use Windo...

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/669 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #670: Clarifies that 'TextFileSource' only suppo...

2016-07-15 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/670 Clarifies that 'TextFileSource' only supports UTF-8 and ASCII encodings. You can merge this pull request into a Git repository by running: $ git pull

[jira] [Resolved] (BEAM-457) Upgrade Avro

2016-07-15 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-457. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Upgrade Avro > > >

[jira] [Commented] (BEAM-457) Upgrade Avro

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380294#comment-15380294 ] ASF GitHub Bot commented on BEAM-457: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/master 695247138 -> 7a945a741 Upgrade to Avro 1.8.1 This version has some important fixes for potential memory leaks. (It does not have a fix for [AVRO-607] yet, but still has good fixes.) Project:

[GitHub] incubator-beam pull request #664: [BEAM-457] Upgrade to Avro 1.8.1

2016-07-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/664 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: [BEAM-457] Upgrade to Avro 1.8.1

2016-07-15 Thread lcwik
[BEAM-457] Upgrade to Avro 1.8.1 This closes #664 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7a945a74 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7a945a74 Diff:

[GitHub] incubator-beam pull request #669: Make step encodings consistently use Windo...

2016-07-15 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/incubator-beam/pull/669 Make step encodings consistently use WindowedValueCoders This change is needed for size-estimation aggregators. You can merge this pull request into a Git repository by running:

[GitHub] incubator-beam pull request #644: Fix typo in Dataflow runner monitoring mes...

2016-07-15 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/incubator-beam/pull/644 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Updated] (BEAM-460) Implement Python support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-460: -- Summary: Implement Python support for size-estimation aggregators (was: Implement support for

[jira] [Updated] (BEAM-460) Implement support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Chen updated BEAM-460: -- Component/s: sdk-py > Implement support for size-estimation aggregators >

[jira] [Created] (BEAM-460) Implement support for size-estimation aggregators

2016-07-15 Thread Charles Chen (JIRA)
Charles Chen created BEAM-460: - Summary: Implement support for size-estimation aggregators Key: BEAM-460 URL: https://issues.apache.org/jira/browse/BEAM-460 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-439) The start_bundle/finish_bundle should not allow side inputs

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380101#comment-15380101 ] ASF GitHub Bot commented on BEAM-439: - GitHub user silviulica opened a pull request:

[GitHub] incubator-beam pull request #668: [BEAM-439] Remove optional args from start...

2016-07-15 Thread silviulica
GitHub user silviulica opened a pull request: https://github.com/apache/incubator-beam/pull/668 [BEAM-439] Remove optional args from start/finish bundle methods @robertwb can you please take a look? (take II -- I abandoned previous PR due to bad merge on my part)

[jira] [Assigned] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jesse Anderson reassigned BEAM-459: --- Assignee: Jesse Anderson > Add BigInteger to TypeDescriptors >

[jira] [Commented] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380023#comment-15380023 ] Jesse Anderson commented on BEAM-459: - Sure > Add BigInteger to TypeDescriptors >

[jira] [Commented] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15380020#comment-15380020 ] Kenneth Knowles commented on BEAM-459: -- [~eljefe6aa] want to take this one? > Add BigInteger to

[jira] [Updated] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-210: - Description: Today, ON_TIME panes are emitted whether or not they are empty. We had decided that

[jira] [Updated] (BEAM-210) Allow control of empty ON_TIME panes analogous to final panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-210: - Summary: Allow control of empty ON_TIME panes analogous to final panes (was: Be consistent with

[jira] [Assigned] (BEAM-210) Be consistent with emitting final empty panes

2016-07-15 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-210: Assignee: Kenneth Knowles (was: Mark Shields) > Be consistent with emitting final empty

[jira] [Created] (BEAM-459) Add BigInteger to TypeDescriptors

2016-07-15 Thread Jesse Anderson (JIRA)
Jesse Anderson created BEAM-459: --- Summary: Add BigInteger to TypeDescriptors Key: BEAM-459 URL: https://issues.apache.org/jira/browse/BEAM-459 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-458) Support for Flink Metrics

2016-07-15 Thread Sumit Chawla (JIRA)
Sumit Chawla created BEAM-458: - Summary: Support for Flink Metrics Key: BEAM-458 URL: https://issues.apache.org/jira/browse/BEAM-458 Project: Beam Issue Type: New Feature Components:

[jira] [Updated] (BEAM-384) Streaming BigQueryIO should support user-provided IDs

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-384: - Assignee: (was: Daniel Halperin) > Streaming BigQueryIO should support user-provided IDs >

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-445. -- Resolution: Fixed Fix Version/s: Not applicable > Beam-examples-java build failed through

[jira] [Resolved] (BEAM-285) Make MinLongFn and MaxLongFn mimic SumLongFn and use BinaryCombineLongFn

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-285. -- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Make MinLongFn and MaxLongFn mimic

[jira] [Commented] (BEAM-455) Implement a test harness for verifying correctness of custom sources

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379826#comment-15379826 ] ASF GitHub Bot commented on BEAM-455: - GitHub user chamikaramj opened a pull request:

[GitHub] incubator-beam pull request #667: [BEAM-455] Adds a test harnesses and utili...

2016-07-15 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/incubator-beam/pull/667 [BEAM-455] Adds a test harnesses and utilities framework for sources. Helper functions and test harnesses for checking correctness of source (``iobase.BoundedSource``) and range tracker

[jira] [Closed] (BEAM-430) Introducing gcpTempLocation that default to tempLocation

2016-07-15 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-430. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > Introducing gcpTempLocation that default to tempLocation >

[GitHub] incubator-beam pull request #666: Make TransformEvaluatorFactory reuse Expli...

2016-07-15 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/666 Make TransformEvaluatorFactory reuse Explicit Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-360) Add a framework for creating Python-SDK sources for new file types

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379759#comment-15379759 ] ASF GitHub Bot commented on BEAM-360: - Github user chamikaramj closed the pull request at:

[GitHub] incubator-beam pull request #599: [BEAM-360] Some updates related to dynamic...

2016-07-15 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/599 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #665: Shade everything but a whitelist in core J...

2016-07-15 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/665 Shade everything but a whitelist in core Java SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure tests pass

[jira] [Commented] (BEAM-37) Run DoFnWithContext without conversion to vanilla DoFn

2016-07-15 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-37?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379728#comment-15379728 ] Ben Chambers commented on BEAM-37: -- Notes on remaining tasks to complete this: 1. Modify DoFnRunner to

[2/2] incubator-beam git commit: Fixes several issues related to 'filebasedsource'.

2016-07-15 Thread robertwb
Fixes several issues related to 'filebasedsource'. Adds a method 'fileio.ChannelFactory.size_in_bytes()' that can be used to determine the size of a single file. Implements this method for 'ChannelFactory' implementations for GCS and local files. Updates 'filebasedsource' to use this method

[1/2] incubator-beam git commit: Closes #599

2016-07-15 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk d898d56ae -> 1305c108a Closes #599 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1305c108 Tree:

[jira] [Closed] (BEAM-391) Exceptions in gcsio upload thread causes pipeline to stall

2016-07-15 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-391. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Exceptions in gcsio upload thread causes pipeline

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379630#comment-15379630 ] Daniel Halperin commented on BEAM-445: -- Thanks -- it's good to make sure everyone involved knows that

[jira] [Commented] (BEAM-445) Beam-examples-java build failed through local "mvn install"

2016-07-15 Thread Scott Wegner (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379622#comment-15379622 ] Scott Wegner commented on BEAM-445: --- I've opened an issue with Bigtable to see if they can upgrade their

[jira] [Created] (BEAM-457) Upgrade Avro

2016-07-15 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-457: Summary: Upgrade Avro Key: BEAM-457 URL: https://issues.apache.org/jira/browse/BEAM-457 Project: Beam Issue Type: Improvement Components:

[GitHub] incubator-beam pull request #664: Upgrade to Avro 1.8.1

2016-07-15 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/664 Upgrade to Avro 1.8.1 This version has some important fixes for potential memory leaks. (It does not have a fix for [AVRO-607] yet, but still has good fixes.) You can merge this

[jira] [Assigned] (BEAM-450) Modules are shaded to the same path

2016-07-15 Thread Manu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manu Zhang reassigned BEAM-450: --- Assignee: Manu Zhang > Modules are shaded to the same path > --- > >

[jira] [Commented] (BEAM-328) CoderRegistry does not provide SerializableCoder for `T extends Serializable`

2016-07-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15379536#comment-15379536 ] ASF GitHub Bot commented on BEAM-328: - GitHub user manuzhang opened a pull request:

[jira] [Updated] (BEAM-456) Add MongoDBIO

2016-07-15 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-456: -- Summary: Add MongoDBIO (was: Add MongoIO) > Add MongoDBIO > - > >

[jira] [Created] (BEAM-456) Add MongoIO

2016-07-15 Thread JIRA
Jean-Baptiste Onofré created BEAM-456: - Summary: Add MongoIO Key: BEAM-456 URL: https://issues.apache.org/jira/browse/BEAM-456 Project: Beam Issue Type: New Feature Components:

[jira] [Created] (BEAM-455) Implement a test harness for verifying correcness of custom sources

2016-07-15 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-455: --- Summary: Implement a test harness for verifying correcness of custom sources Key: BEAM-455 URL: https://issues.apache.org/jira/browse/BEAM-455 Project: Beam