[GitHub] beam pull request #4102: Set save_main_session to True for csv module
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/4102 Set save_main_session to True for csv module Parsing the game events requires the `csv` module, so we also needed to set `save_main_session` to True for this to work in Dataflow. R: @aaltay You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam user_score Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/4102.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #4102 commit 89e9c34e839180b990b6abe4e546d0acc83e04fe Author: David Cavazos <dcava...@google.com> Date: 2017-11-08T23:32:03Z Set save_main_session to True for csv module ---
[GitHub] beam pull request #3900: Created Java snippets file
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3900 Created Java snippets file R: @tgroh for Java code R: @melap for snippet tags Starting out with just the CoGroupByKey snippet to make the PR small. Eventually we want to migrate all the hard-coded snippets from the documentation to these files to make sure they are tested. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam java_snippets Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3900.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3900 commit b7cd18485fb9d3c89bc5177ad8ab8742faa39c06 Author: David Cavazos <dcava...@google.com> Date: 2017-09-26T17:38:38Z Created Java snippets file ---
[GitHub] beam pull request #3867: Included immediate results after CoGroupByKey for b...
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3867 Included immediate results after CoGroupByKey for better readability in docs R: @melap R: @aaltay This makes the outputs show the data structures after the `CoGroupByKey` transform. The `formatted_results` shows how the data is affected after using the data. This will make for a clearer explanation in [BEAM-1934](https://github.com/apache/beam-site/pull/302) - Changed `snippets_test.py:model_group_by_key_cogroupbykey_tuple_outputs` to show the data structures. - Added `snippets_test.py:model_group_by_key_cogroupbykey_tuple_formatted_outputs` to show the data after using it in another transform. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam cgbk_snippet Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3867.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3867 commit 8bf2c02fa929f916fce05164606b085158c87761 Author: David Cavazos <dcava...@google.com> Date: 2017-09-19T19:15:38Z Included immediate results after CoGroupByKey for better readability in docs ---
[GitHub] beam pull request #3798: CoGroupByKey snippet with concrete example
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3798 CoGroupByKey snippet with concrete example R: @aaltay R: @melap Having a concrete common example for the docs, Python, and Java will allow referencing the same example on every language. This is more consistent and also allows tests to validate what is described in the docs. This PR creates new tags `model_group_by_key_cogroupbykey_tuple_inputs` and `model_group_by_key_cogroupbykey_tuple_outputs`, in `snippets_test.py`, to be used as a concrete example for `CoGroupByKey` snippet. It also slightly changes the output formatting to make more evident how to use the results of the transform. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam cgbk_snippet Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3798.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3798 commit a3fe833b6fee4f22a955a925dd6b4ed84cdc1470 Author: David Cavazos <dcava...@google.com> Date: 2017-08-31T19:24:46Z Added concrete example for CoGroupByKey snippet commit aaed1815c557eeb98b859dd179cc105b1fe5a69e Author: David Cavazos <dcava...@google.com> Date: 2017-08-31T19:32:57Z Made unique labels for model_co_group_by_key_tuple transforms commit 817045d4743ec9751f5cd8e6520493198691b289 Author: David Cavazos <dcava...@google.com> Date: 2017-08-31T21:50:25Z Fixed model_co_group_by_key_tuple output format --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3776: Added snippet tags for documentation
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3776 Added snippet tags for documentation Hi @aaltay, Adding tags to extract code snippets for the documentation. These are following the same sections as in the Java version. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam examples_tags Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3776.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3776 commit 2a5004344718add0bd2c9b84972cf69909e18f96 Author: David Cavazos <dcava...@google.com> Date: 2017-08-28T22:24:20Z Added snippet tags for documentation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3756: Tests for python gaming examples
Github user davidcavazos closed the pull request at: https://github.com/apache/beam/pull/3756 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3728: Combine globally
Github user davidcavazos closed the pull request at: https://github.com/apache/beam/pull/3728 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3756: Added tests for python gaming examples
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3756 Added tests for python gaming examples Adds unit tests for the examples added on [BEAM-2484] You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam examples_tests Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3756.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3756 commit 38098a3d049788df73c052a4d28d338c5b89ea2d Author: David Cavazos <dcava...@google.com> Date: 2017-08-24T18:43:23Z Added tests for python gaming examples --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3728: Combine globally
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3728 Combine globally Hi @aaltay, This just gives a more convenient way to call global combiners when needed as views or without defaults. e.g. ``beam.combiners.Mean.Globally(as_view=True)`` ``beam.combiners.Mean.Globally(has_defaults=False)`` instead of: ``beam.CombineGlobally(beam.combiners.MeanCombineFn()).as_singleton_view()`` ``beam.CombineGlobally(beam.combiners.MeanCombineFn()).without_defaults()`` You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam combine_globally Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3728.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3728 commit b9ca9ff249e5f45788de1bba8fab425306e7290d Author: David Cavazos <dcava...@google.com> Date: 2017-08-17T21:17:37Z Fixed indentation error on pydoc commit 692e00a064e38575fe4c49e9c7ac209fc38a9c6a Author: David Cavazos <dcava...@google.com> Date: 2017-08-17T21:28:05Z Add 'as_view' and 'has_defaults' to combiners that use CombineGlobally --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3613: [BEAM-2655] Makes Python API reference generation m...
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3613 [BEAM-2655] Makes Python API reference generation more strict This changes the Python API reference theme to something more readable. It also makes cross reference checking more strict and fixes all the broken cross references. Pages are also now separated by files and the affected docs were reformatted to respect the reStructuredText format that Sphinx expects. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam pydoc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3613.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3613 commit 04fbd1de89ce401c3f3c265b3a8476233aaa8d22 Author: David Cavazos <dcava...@google.com> Date: 2017-07-21T16:58:11Z Changed sphinx API reference theme commit b3275af572aced372bd027763b1eb89230926053 Author: David Cavazos <dcava...@google.com> Date: 2017-07-21T16:59:30Z Fixed broken type cross references --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] beam pull request #3483: [BEAM-2484] Add Python mobile gaming streaming exam...
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3483 [BEAM-2484] Add Python mobile gaming streaming examples Hi @aaltay, This adds leader_board.py and game_stats.py for streaming examples in the mobile game series. It also removes the BigQuery output for both user_score.py and hourly_team_score.py to remove the GCP dependency as well as simplify the examples. You can merge this pull request into a Git repository by running: $ git pull https://github.com/davidcavazos/beam python-streaming-examples Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3483.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3483 commit 76f2f64d8240a073157cff16ed4b0b40aae2608b Author: David Cavazos <dcava...@google.com> Date: 2017-06-30T17:27:25Z Add Python mobile gaming streaming examples commit 1797c9dc78f2b955cac8cd2b79b9af911e546b95 Author: David Cavazos <dcava...@google.com> Date: 2017-06-30T20:44:40Z Fixed lint warnings --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
