Build failed in Jenkins: beam_PostCommit_Python_Verify #1963

2017-04-23 Thread Apache Jenkins Server
See Changes: [jbonofre] [BEAM-2044] Downgrade HBaseIO to use the stable HBase client version -- [...truncated 739.35 KB...] pik.dump(obj) File "/usr/lib

[jira] [Created] (BEAM-2056) Add tests for exporting Beam Metrics to Flink Metrics

2017-04-23 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created BEAM-2056: -- Summary: Add tests for exporting Beam Metrics to Flink Metrics Key: BEAM-2056 URL: https://issues.apache.org/jira/browse/BEAM-2056 Project: Beam Issue Ty

[jira] [Assigned] (BEAM-2056) Add tests for exporting Beam Metrics to Flink Metrics

2017-04-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-2056: -- Assignee: (was: Aljoscha Krettek) > Add tests for exporting Beam Metrics to Flink Me

[jira] [Created] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2057: --- Summary: Test metrics are reported to Spark Metrics sink. Key: BEAM-2057 URL: https://issues.apache.org/jira/browse/BEAM-2057 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-2057: --- Assignee: (was: Amit Sela) > Test metrics are reported to Spark Metrics sink. > --

[jira] [Updated] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2057: Description: Test that metrics are reported to Spark's metric sink. Use {{InMemoryMetrics}} and {{InMemoryMe

Build failed in Jenkins: beam_PerformanceTests_Dataflow #337

2017-04-23 Thread Apache Jenkins Server
See Changes: [lcwik] Validates that input and output GCS paths specify a bucket [kirpichov] Makes cachedSplitResult transient in BigQuerySourceBase [lcwik] Update Dataflow Worker Version [tgroh] C

Build failed in Jenkins: beam_PerformanceTests_JDBC #143

2017-04-23 Thread Apache Jenkins Server
See Changes: [lcwik] Validates that input and output GCS paths specify a bucket [kirpichov] Makes cachedSplitResult transient in BigQuerySourceBase [lcwik] Update Dataflow Worker Version [tgroh] Coder

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1754

2017-04-23 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1964

2017-04-23 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2645: Fix dataflow staging path to be unique

2017-04-23 Thread sb2nov
Github user sb2nov closed the pull request at: https://github.com/apache/beam/pull/2645 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Resolved] (BEAM-1520) Implement TFRecordIO (Reading/writing Tensorflow Standard format)

2017-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-1520. Resolution: Fixed Fix Version/s: First stable release Marking as fixed since this seem to have

[jira] [Resolved] (BEAM-1836) Reopen BigQuery utils after #2271

2017-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-1836. Resolution: Fixed Fix Version/s: Not applicable Resolving since the fix is already merged. >

[2/2] beam git commit: This closes #2643

2017-04-23 Thread altay
This closes #2643 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a6701973 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a6701973 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a6701973 Branch: refs/heads/maste

[GitHub] beam pull request #2643: [BEAM-1988] Migrate from utils.path to BFS

2017-04-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2643 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-1988] Migrate from utils.path to BFS

2017-04-23 Thread altay
Repository: beam Updated Branches: refs/heads/master 1dce98f07 -> a67019739 [BEAM-1988] Migrate from utils.path to BFS Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9b7bbc2d Tree: http://git-wip-us.apache.org/repos/asf/bea

[jira] [Commented] (BEAM-1988) utils.path.join does not correctly handle GCS bucket roots

2017-04-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980517#comment-15980517 ] ASF GitHub Bot commented on BEAM-1988: -- Github user asfgit closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Python_Verify #1965

2017-04-23 Thread Apache Jenkins Server
See -- [...truncated 247.33 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted] (none)

[jira] [Created] (BEAM-2058) BigQuery load job id should be generated at run time, not submission time

2017-04-23 Thread Reuven Lax (JIRA)
Reuven Lax created BEAM-2058: Summary: BigQuery load job id should be generated at run time, not submission time Key: BEAM-2058 URL: https://issues.apache.org/jira/browse/BEAM-2058 Project: Beam

[GitHub] beam pull request #2657: [BEAM-2058] Generate BigQuery load job at runtime

2017-04-23 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2657 [BEAM-2058] Generate BigQuery load job at runtime Generate the load job at run time instead of submission time. You can merge this pull request into a Git repository by running: $ git pull htt

[jira] [Commented] (BEAM-2058) BigQuery load job id should be generated at run time, not submission time

2017-04-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980519#comment-15980519 ] ASF GitHub Bot commented on BEAM-2058: -- GitHub user reuvenlax opened a pull request:

[jira] [Resolved] (BEAM-715) Migrate AvroHDFSFileSource/HDFSFileSource/HDFSFileSink to use AutoValue to reduce boilerplate

2017-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-715. --- Resolution: Implemented Fix Version/s: Not applicable I checked the implementation and somebody e

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1755

2017-04-23 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2025) WordCount Example lacks a link to Python full source code

2017-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2025: --- Summary: WordCount Example lacks a link to Python full source code (was: WordCount Example lacks a lin

[jira] [Commented] (BEAM-1946) Add IO module for restful api

2017-04-23 Thread JiJun Tang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980604#comment-15980604 ] JiJun Tang commented on BEAM-1946: -- Another example: http://sberyozkin.blogspot.com/2016/0

Build failed in Jenkins: beam_PerformanceTests_Dataflow #338

2017-04-23 Thread Apache Jenkins Server
See Changes: [altay] [BEAM-1988] Migrate from utils.path to BFS -- [...truncated 270.92 KB...] error: unable to resolve reference refs/remotes/origin/pr/2505/

Build failed in Jenkins: beam_PerformanceTests_JDBC #144

2017-04-23 Thread Apache Jenkins Server
See Changes: [altay] [BEAM-1988] Migrate from utils.path to BFS -- [...truncated 843.58 KB...] at com.google.cloud.dataflow.worker.runners.worker.MapTask

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2017-04-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980645#comment-15980645 ] Pei He commented on BEAM-644: - I think this also applies to a more general issue: data unordered

[jira] [Assigned] (BEAM-1942) Add Source Watermark Metrics in Flink Runner

2017-04-23 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1942: -- Assignee: Jingsong Lee > Add Source Watermark Metrics in Flink Runner >

[jira] [Assigned] (BEAM-1941) Add Source Watermark Metrics in Runners

2017-04-23 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1941: -- Assignee: Jingsong Lee > Add Source Watermark Metrics in Runners > -

[jira] [Assigned] (BEAM-1944) Add Source Watermark Metrics in Spark runner

2017-04-23 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee reassigned BEAM-1944: -- Assignee: Jingsong Lee > Add Source Watermark Metrics in Spark runner >

[2/2] beam git commit: This closes #2593

2017-04-23 Thread chamikara
This closes #2593 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e5507d82 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e5507d82 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e5507d82 Branch: refs/heads/maste

[1/2] beam git commit: Adding validatesrunner test for sources

2017-04-23 Thread chamikara
Repository: beam Updated Branches: refs/heads/master a67019739 -> e5507d827 Adding validatesrunner test for sources Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9b6e74e8 Tree: http://git-wip-us.apache.org/repos/asf/beam/t

[GitHub] beam pull request #2593: [BEAM-1575] Adding validatesrunner test for metrics...

2017-04-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2593 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-04-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980683#comment-15980683 ] ASF GitHub Bot commented on BEAM-1575: -- Github user asfgit closed the pull request at:

[jira] [Assigned] (BEAM-1919) Standard IO Metrics

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1919: --- Assignee: (was: Aviem Zur) > Standard IO Metrics > --- > > Key: BE

[jira] [Assigned] (BEAM-1758) Option to disable metrics reporting (Metrics API)

2017-04-23 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1758: --- Assignee: Ismaël Mejía (was: Aviem Zur) > Option to disable metrics reporting (Metrics API) > ---

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1966

2017-04-23 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2658: [BEAM-1998] Add ValueProvider tests to json_value_t...

2017-04-23 Thread mariapython
GitHub user mariapython opened a pull request: https://github.com/apache/beam/pull/2658 [BEAM-1998] Add ValueProvider tests to json_value_test.py You can merge this pull request into a Git repository by running: $ git pull https://github.com/mariapython/incubator-beam ppp_aft

[jira] [Commented] (BEAM-1998) Update json_values_test.py for ValueProvider

2017-04-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980723#comment-15980723 ] ASF GitHub Bot commented on BEAM-1998: -- GitHub user mariapython opened a pull request:

[jira] [Commented] (BEAM-1946) Add IO module for restful api

2017-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15980734#comment-15980734 ] Jean-Baptiste Onofré commented on BEAM-1946: FYI, Sergey and I are working in t