[jira] [Commented] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156680#comment-16156680 ] Vincent Spiewak commented on BEAM-2840: --- I use DataflowRunner with 1 to 5 n1-standard-4 instances (4

Build failed in Jenkins: beam_PostCommit_Python_Verify #3082

See -- [...truncated 560.43 KB...] copying apache_beam/io/tfrecordio_test.py -> apache-beam-2.2.0.dev0/apache_beam/io copying apache_beam/io/gcp/__init__.py ->

[jira] [Comment Edited] (BEAM-2840) BigQueryIO write is slow/fail with a bounded source

[ https://issues.apache.org/jira/browse/BEAM-2840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16156680#comment-16156680 ] Vincent Spiewak edited comment on BEAM-2840 at 9/7/17 8:47 AM: --- I use

[GitHub] beam pull request #3816: JStorm-runner: Implementation of processing timer

GitHub user bastiliu opened a pull request: https://github.com/apache/beam/pull/3816 JStorm-runner: Implementation of processing timer Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[1/2] beam git commit: JStorm-runner: Implementation of processing timer

Repository: beam Updated Branches: refs/heads/jstorm-runner 80bd7f8be -> d24d2831d JStorm-runner: Implementation of processing timer Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6a0d3896 Tree:

[2/2] beam git commit: This closes #3816

This closes #3816 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d24d2831 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d24d2831 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d24d2831 Branch:

[GitHub] beam pull request #3816: JStorm-runner: Implementation of processing timer

Github user bastiliu closed the pull request at: https://github.com/apache/beam/pull/3816 ---

[12/36] beam git commit: mr-runner: refactors and creates Graph data structures to handle general Beam pipelines.

mr-runner: refactors and creates Graph data structures to handle general Beam pipelines. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/16e63205 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/16e63205 Diff:

[34/36] beam git commit: mr-runner: Removes WordCountTest, fixes checkstyle, findbugs, and addressed comments.

mr-runner: Removes WordCountTest, fixes checkstyle, findbugs, and addressed comments. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/32aeb7ac Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/32aeb7ac Diff:

[18/36] beam git commit: mr-runner: support multiple SourceOperations by composing and partitioning.

mr-runner: support multiple SourceOperations by composing and partitioning. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e562a443 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e562a443 Diff:

[05/36] beam git commit: mr-runner: add ParDoOperation and support ParDos chaining.

mr-runner: add ParDoOperation and support ParDos chaining. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/389b02b5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/389b02b5 Diff:

[17/36] beam git commit: mr-runner: support PCollections materialization with multiple MR jobs.

mr-runner: support PCollections materialization with multiple MR jobs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/40396d75 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/40396d75 Diff:

[11/36] beam git commit: mr-runner: refactors and creates Graph data structures to handle general Beam pipelines.

http://git-wip-us.apache.org/repos/asf/beam/blob/16e63205/runners/map-reduce/src/main/java/org/apache/beam/runners/mapreduce/translation/JobPrototype.java -- diff --git

[07/36] beam git commit: core-java: InMemoryTimerInternals expose getTimers() for timer firings in mr-runner.

core-java: InMemoryTimerInternals expose getTimers() for timer firings in mr-runner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d09fb427 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d09fb427 Diff:

[13/36] beam git commit: mr-runner: add JarClassInstanceFactory to run ValidatesRunner tests.

mr-runner: add JarClassInstanceFactory to run ValidatesRunner tests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ee1cce92 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ee1cce92 Diff:

[06/36] beam git commit: mr-runner: add JobPrototype and translate it to a MR job.

mr-runner: add JobPrototype and translate it to a MR job. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0cbdc5b7 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0cbdc5b7 Diff:

[01/36] beam git commit: Initial commit for MapReduceRunner.

Repository: beam Updated Branches: refs/heads/mr-runner 2fa4fdecd -> 5fa0b14d2 Initial commit for MapReduceRunner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9fffd554 Tree:

[02/36] beam git commit: MapReduceRunner: add unit tests for GraphConverter and GraphPlanner.

MapReduceRunner: add unit tests for GraphConverter and GraphPlanner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a8b366de Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a8b366de Diff:

[24/36] beam git commit: mr-runner: remove the hard-coded GlobalWindow coder, and fixes WindowingTest.

mr-runner: remove the hard-coded GlobalWindow coder, and fixes WindowingTest. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2d8b12a6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2d8b12a6 Diff:

[03/36] beam git commit: MapReduceRunner: add Graph and its visitors.

MapReduceRunner: add Graph and its visitors. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/092380cf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/092380cf Diff:

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157488#comment-16157488 ] Solomon Duskis commented on BEAM-2545: -- Yes. 1.0.0-pre3 is the proper version to choose. It should

[jira] [Created] (BEAM-2863) Add support for Side Inputs over the Fn API

Luke Cwik created BEAM-2863: --- Summary: Add support for Side Inputs over the Fn API Key: BEAM-2863 URL: https://issues.apache.org/jira/browse/BEAM-2863 Project: Beam Issue Type: Improvement

[2/2] beam git commit: This closes #3727

This closes #3727 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3bd68ecf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3bd68ecf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3bd68ecf Branch:

[1/2] beam git commit: [BEAM-2764] Change document size range to fix flakiness on SolrIO tests

Repository: beam Updated Branches: refs/heads/master bd4eab032 -> 3bd68ecfd [BEAM-2764] Change document size range to fix flakiness on SolrIO tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3cba56a6 Tree:

[jira] [Reopened] (BEAM-2527) Test queries on unbounded PCollections with BeamSql dsl API

[ https://issues.apache.org/jira/browse/BEAM-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reopened BEAM-2527: -- > Test queries on unbounded PCollections with BeamSql dsl API >

[jira] [Reopened] (BEAM-2550) test JOINs with DSL methods

[ https://issues.apache.org/jira/browse/BEAM-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reopened BEAM-2550: -- > test JOINs with DSL methods > --- > > Key: BEAM-2550 >

[jira] [Updated] (BEAM-2560) Add integration test for arithmetic operators

[ https://issues.apache.org/jira/browse/BEAM-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2560: - Fix Version/s: (was: 2.2.0) Not applicable > Add integration test for arithmetic

[jira] [Closed] (BEAM-2565) Add integration test for CASE operators

[ https://issues.apache.org/jira/browse/BEAM-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2565. > Add integration test for CASE operators > --- > > Key:

[jira] [Closed] (BEAM-2550) test JOINs with DSL methods

[ https://issues.apache.org/jira/browse/BEAM-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2550. Resolution: Fixed Fix Version/s: (was: 2.2.0) Not applicable > test JOINs with

[jira] [Updated] (BEAM-2563) Add integration test for math operators

[ https://issues.apache.org/jira/browse/BEAM-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2563: - Fix Version/s: (was: 2.2.0) Not applicable > Add integration test for math

[jira] [Updated] (BEAM-2562) Add integration test for logical operators

[ https://issues.apache.org/jira/browse/BEAM-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2562: - Fix Version/s: (was: 2.2.0) Not applicable > Add integration test for logical

[jira] [Updated] (BEAM-2565) Add integration test for CASE operators

[ https://issues.apache.org/jira/browse/BEAM-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2565: - Fix Version/s: (was: 2.2.0) Not applicable > Add integration test for CASE

[jira] [Updated] (BEAM-2559) Add integration test for the sql functions

[ https://issues.apache.org/jira/browse/BEAM-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2559: - Fix Version/s: (was: 2.2.0) Not applicable > Add integration test for the sql

[jira] [Closed] (BEAM-2559) Add integration test for the sql functions

[ https://issues.apache.org/jira/browse/BEAM-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2559. > Add integration test for the sql functions > -- > >

[jira] [Closed] (BEAM-2527) Test queries on unbounded PCollections with BeamSql dsl API

[ https://issues.apache.org/jira/browse/BEAM-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2527. Resolution: Fixed Fix Version/s: (was: 2.2.0) Not applicable > Test queries on

[jira] [Updated] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-2859: - Affects Version/s: 2.0.0 > Processing time based timers are not properly fired in case the watermark >

[jira] [Updated] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-2859: - Description: {{AfterProcessingTime}} based timers are not fired when the input watermark does not

[jira] [Created] (BEAM-2860) SDF blog post discusses Match, which no longer exists

Kenneth Knowles created BEAM-2860: - Summary: SDF blog post discusses Match, which no longer exists Key: BEAM-2860 URL: https://issues.apache.org/jira/browse/BEAM-2860 Project: Beam Issue

[jira] [Updated] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-2859: - Description: {{AfterProcessingTime}} based timers are not fired when the input watermark does not

[jira] [Created] (BEAM-2861) test_delete_bq_table_succeeds fails with GOOGLE_APPLICATION_CREDENTIALS

Ahmet Altay created BEAM-2861: - Summary: test_delete_bq_table_succeeds fails with GOOGLE_APPLICATION_CREDENTIALS Key: BEAM-2861 URL: https://issues.apache.org/jira/browse/BEAM-2861 Project: Beam

[jira] [Updated] (BEAM-2421) Migrate Apache Beam to use impulse primitive as the only root primitive

[ https://issues.apache.org/jira/browse/BEAM-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2421: Summary: Migrate Apache Beam to use impulse primitive as the only root primitive (was: Migrate Dataflow to

[jira] [Updated] (BEAM-1962) Connection should be closed in case start() throws exception

[ https://issues.apache.org/jira/browse/BEAM-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1962: - Description: In JmsIO#start() : {code} try { Connection connection; if (spec.getUsername()

[GitHub] beam pull request #3727: BEAM-2764: Set right range for min_doc_size and max...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3727 ---

[jira] [Commented] (BEAM-2764) SolrIOTest fails in master branch

[ https://issues.apache.org/jira/browse/BEAM-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157550#comment-16157550 ] ASF GitHub Bot commented on BEAM-2764: -- Github user asfgit closed the pull request at:

[jira] [Updated] (BEAM-2822) Add support for progress reporting in fn API

[ https://issues.apache.org/jira/browse/BEAM-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2822: Description: https://s.apache.org/beam-fn-api-progress-reporting (was: https) > Add support for progress

[jira] [Commented] (BEAM-2862) Add support for User State over the Fn API

[ https://issues.apache.org/jira/browse/BEAM-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157426#comment-16157426 ] Luke Cwik commented on BEAM-2862: - A lot of the work for the Java SDK harness was captured underneath

[jira] [Updated] (BEAM-2862) Add support for User State over the Fn API

[ https://issues.apache.org/jira/browse/BEAM-2862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2862: Description: https://s.apache.org/beam-fn-api-state-api (was: Design:

[jira] [Updated] (BEAM-2822) Add support for progress reporting in fn API

[ https://issues.apache.org/jira/browse/BEAM-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-2822: Description: https > Add support for progress reporting in fn API >

[36/36] beam git commit: This closes #3705: [BEAM-165] Initial implementation of the MapReduce runner

This closes #3705: [BEAM-165] Initial implementation of the MapReduce runner mr-runner: Removes WordCountTest, fixes checkstyle, findbugs, and addressed comments. mr-runner-hack: disable unrelated modules to shorten build time during development. mr-runner: support SourceMetrics, this

[28/36] beam git commit: mr-runner: fail early in the runner when MapReduce job fails.

mr-runner: fail early in the runner when MapReduce job fails. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/989d7d8e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/989d7d8e Diff:

[31/36] beam git commit: mr-runner: introduces duplicateFactor in FlattenOperation, this fixes testFlattenInputMultipleCopies().

mr-runner: introduces duplicateFactor in FlattenOperation, this fixes testFlattenInputMultipleCopies(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5248ce42 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5248ce42

[15/36] beam git commit: mr-runner: setup file paths for read and write sides of materialization.

mr-runner: setup file paths for read and write sides of materialization. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b87ae78b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b87ae78b Diff:

[14/36] beam git commit: mr-runner: support reduce side ParDos and WordCount.

mr-runner: support reduce side ParDos and WordCount. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c6a3a18d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c6a3a18d Diff:

[22/36] beam git commit: mr-runner: use the correct step name in ParDoTranslator, this fixes MetricsTest.testAttemptedCounterMetrics().

mr-runner: use the correct step name in ParDoTranslator, this fixes MetricsTest.testAttemptedCounterMetrics(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0b371875 Tree:

[27/36] beam git commit: mr-runner: filter out unsupported features in ValidatesRunner tests.

mr-runner: filter out unsupported features in ValidatesRunner tests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d71975ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d71975ed Diff:

[08/36] beam git commit: mr-runner: support BoundedSource with BeamInputFormat.

mr-runner: support BoundedSource with BeamInputFormat. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a884a2f0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a884a2f0 Diff:

[16/36] beam git commit: mr-runner: support side inputs by reading in all views contents.

mr-runner: support side inputs by reading in all views contents. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0ebd14c4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0ebd14c4 Diff:

[10/36] beam git commit: mr-runner: support graph visualization with dotfiles.

mr-runner: support graph visualization with dotfiles. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/98da2a2a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/98da2a2a Diff:

[19/36] beam git commit: [BEAM-2783] support metrics in MapReduceRunner.

[BEAM-2783] support metrics in MapReduceRunner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6c2390a1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6c2390a1 Diff:

[30/36] beam git commit: mr-runner: translate empty flatten into EmptySource, this fixes few empty FalttenTests.

mr-runner: translate empty flatten into EmptySource, this fixes few empty FalttenTests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/99bffd2a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/99bffd2a Diff:

[32/36] beam git commit: mr-runner: Graph.getSteps() to return with topological order, this fixes few CombineTests.

mr-runner: Graph.getSteps() to return with topological order, this fixes few CombineTests. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e330d360 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e330d360 Diff:

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3705 ---

[35/36] beam git commit: mr-runner-hack: disable unrelated modules to shorten build time during development.

mr-runner-hack: disable unrelated modules to shorten build time during development. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9d1db98a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9d1db98a Diff:

[09/36] beam git commit: mr-runner: hack to get around that ViewAsXXX.expand() return wrong output PValue.

mr-runner: hack to get around that ViewAsXXX.expand() return wrong output PValue. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5905efd3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5905efd3 Diff:

[20/36] beam git commit: mr-runner: fix the bug that steps are attached multiple times in diamond shaped DAG.

mr-runner: fix the bug that steps are attached multiple times in diamond shaped DAG. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4e7062cd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4e7062cd Diff:

[26/36] beam git commit: mr-runner: use InMemoryStateInternals in ParDoOperation, this fixed ParDoTest that uses state.

mr-runner: use InMemoryStateInternals in ParDoOperation, this fixed ParDoTest that uses state. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9f312c56 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9f312c56 Diff:

[25/36] beam git commit: mr-runner: handle no files case in FileSideInputReader for empty views.

mr-runner: handle no files case in FileSideInputReader for empty views. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ca0b15ad Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ca0b15ad Diff:

[33/36] beam git commit: mr-runner: support SourceMetrics, this fixes MetricsTest.testBoundedSourceMetrics().

mr-runner: support SourceMetrics, this fixes MetricsTest.testBoundedSourceMetrics(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c62b3ad4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c62b3ad4 Diff:

[29/36] beam git commit: mr-runner: ensure Operation only start/finish once for diamond shaped DAG, this fixes ParDoLifecycleTest.

mr-runner: ensure Operation only start/finish once for diamond shaped DAG, this fixes ParDoLifecycleTest. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8627913e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8627913e

[04/36] beam git commit: mr-runner: add BeamReducer and support GroupByKey.

mr-runner: add BeamReducer and support GroupByKey. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/923190dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/923190dc Diff:

[21/36] beam git commit: mr-runner: setMetricsSupported to run ValidatesRunner tests with TestPipeline.

mr-runner: setMetricsSupported to run ValidatesRunner tests with TestPipeline. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8d3386d4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8d3386d4 Diff:

[23/36] beam git commit: mr-runner: fix NPE in PipelineTest.testIdentityTransform().

mr-runner: fix NPE in PipelineTest.testIdentityTransform(). Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/807f9034 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/807f9034 Diff:

[jira] [Commented] (BEAM-165) Add Hadoop MapReduce runner

[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157414#comment-16157414 ] ASF GitHub Bot commented on BEAM-165: - Github user asfgit closed the pull request at:

[jira] [Comment Edited] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157488#comment-16157488 ] Solomon Duskis edited comment on BEAM-2545 at 9/7/17 7:32 PM: -- Yes.

[jira] [Updated] (BEAM-2764) SolrIOTest fails in master branch

[ https://issues.apache.org/jira/browse/BEAM-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2764: --- Fix Version/s: Not applicable > SolrIOTest fails in master branch > -

[jira] [Updated] (BEAM-2764) SolrIOTest fails in master branch

[ https://issues.apache.org/jira/browse/BEAM-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2764: --- Fix Version/s: (was: Not applicable) 2.2.0 > SolrIOTest fails in master branch

[jira] [Resolved] (BEAM-2764) SolrIOTest fails in master branch

[ https://issues.apache.org/jira/browse/BEAM-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2764. Resolution: Fixed > SolrIOTest fails in master branch > - > >

[jira] [Created] (BEAM-2862) Add support for User State over the Fn API

Luke Cwik created BEAM-2862: --- Summary: Add support for User State over the Fn API Key: BEAM-2862 URL: https://issues.apache.org/jira/browse/BEAM-2862 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157507#comment-16157507 ] Solomon Duskis commented on BEAM-2545: -- FYI, the Cloud Bigtable team released a version of

[jira] [Commented] (BEAM-2764) SolrIOTest fails in master branch

[ https://issues.apache.org/jira/browse/BEAM-2764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157533#comment-16157533 ] Ted Yu commented on BEAM-2764: -- lgtm > SolrIOTest fails in master branch > -

[jira] [Updated] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-2859: - Description: {{AfterProcessingTime}} based timers are not fired when the input watermark does not

Jenkins build is back to normal : beam_PostCommit_Python_Verify #3083

See

[GitHub] beam pull request #3805: Fix typo in variable name: window_fn --> windowfn

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3805 ---

[1/2] beam git commit: Closes #3805

Repository: beam Updated Branches: refs/heads/master df1476d82 -> bd4eab032 Closes #3805 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd4eab03 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd4eab03 Diff:

[jira] [Updated] (BEAM-2621) rename BeamSqlRecordType to BeamSqlRowType

[ https://issues.apache.org/jira/browse/BEAM-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2621: - Fix Version/s: (was: 2.2.0) > rename BeamSqlRecordType to BeamSqlRowType >

[jira] [Updated] (BEAM-2621) rename BeamSqlRecordType to BeamSqlRowType

[ https://issues.apache.org/jira/browse/BEAM-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2621: - Fix Version/s: Not applicable > rename BeamSqlRecordType to BeamSqlRowType >

[jira] [Closed] (BEAM-2435) test SQL DSL methods

[ https://issues.apache.org/jira/browse/BEAM-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2435. Resolution: Fixed Fix Version/s: (was: 2.2.0) Not applicable > test SQL DSL

[jira] [Updated] (BEAM-2355) support comparison operator

[ https://issues.apache.org/jira/browse/BEAM-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2355: - Fix Version/s: (was: 2.2.0) Not applicable > support comparison operator >

[jira] [Reopened] (BEAM-2289) add unit tests for BeamSQLFilterFn and BeamSQLProjectFn

[ https://issues.apache.org/jira/browse/BEAM-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reopened BEAM-2289: -- > add unit tests for BeamSQLFilterFn and BeamSQLProjectFn >

[jira] [Updated] (BEAM-2309) support relation operator: Values

[ https://issues.apache.org/jira/browse/BEAM-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2309: - Fix Version/s: (was: 2.2.0) Not applicable > support relation operator: Values >

[jira] [Updated] (BEAM-2384) CEIL, FLOOR, TRUNCATE, PI, ATAN2 math function

[ https://issues.apache.org/jira/browse/BEAM-2384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2384: - Fix Version/s: (was: 2.2.0) Not applicable > CEIL, FLOOR, TRUNCATE, PI, ATAN2 math

[jira] [Assigned] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

[ https://issues.apache.org/jira/browse/BEAM-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin reassigned BEAM-2859: Assignee: Stas Levin (was: Amit Sela) > Processing time based timers are not properly fired in

[jira] [Created] (BEAM-2859) Processing time based timers are not properly fired in case the watermark stays put

Stas Levin created BEAM-2859: Summary: Processing time based timers are not properly fired in case the watermark stays put Key: BEAM-2859 URL: https://issues.apache.org/jira/browse/BEAM-2859 Project:

[jira] [Closed] (BEAM-2842) python test failure in local maven build

[ https://issues.apache.org/jira/browse/BEAM-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2842. Resolution: Duplicate Fix Version/s: Not applicable > python test failure in local maven build >

[jira] [Commented] (BEAM-2858) temp file garbage collection in BigQuery sink should be in a separate DoFn

[ https://issues.apache.org/jira/browse/BEAM-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157354#comment-16157354 ] Chamikara Jayalath commented on BEAM-2858: -- I tried intentionally deleting one of the files before

[2/2] beam git commit: Fix typo in variable name: window_fn --> windowfn

Fix typo in variable name: window_fn --> windowfn `window_fn` is an undefined name in this context while `windowfn` is a parameter to this function and is used in three lines above and the line just after. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Reopened] (BEAM-2435) test SQL DSL methods

[ https://issues.apache.org/jira/browse/BEAM-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reopened BEAM-2435: -- > test SQL DSL methods > > > Key: BEAM-2435 > URL:

[jira] [Updated] (BEAM-2310) support data type: DECIMAL

[ https://issues.apache.org/jira/browse/BEAM-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2310: - Fix Version/s: (was: 2.2.0) Not applicable > support data type: DECIMAL >

[jira] [Closed] (BEAM-2204) support TUMBLE/HOP/SESSION_START

[ https://issues.apache.org/jira/browse/BEAM-2204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin closed BEAM-2204. Resolution: Fixed Fix Version/s: (was: 2.2.0) Not applicable > support

[jira] [Updated] (BEAM-2195) support conditional functions & operators

[ https://issues.apache.org/jira/browse/BEAM-2195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2195: - Fix Version/s: (was: 2.2.0) Not applicable > support conditional functions &

  1   2   >