[jira] [Commented] (BEAM-6552) Upgrade bigdataoss_gcsio dependency

2019-01-30 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16756808#comment-16756808 ] Udi Meiri commented on BEAM-6552: - 1.9.12 was release today - already using it here: http

[jira] [Commented] (BEAM-6266) Newest AWS SDK causes errors on startup without usage

2019-02-06 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16762235#comment-16762235 ] Udi Meiri commented on BEAM-6266: - Also here: https://stackoverflow.com/questions/5404683

[jira] [Commented] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

2019-02-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16763819#comment-16763819 ] Udi Meiri commented on BEAM-6636: - Detailed log are actually available: https://builds.ap

[jira] [Resolved] (BEAM-4741) Upgrade Python BigQuery client to latest version

2018-11-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4741. - Resolution: Duplicate Fix Version/s: Not applicable > Upgrade Python BigQuery client to latest vers

[jira] [Commented] (BEAM-6072) add encrypt/decrypt permissions for Cloud KMS key testing

2018-11-30 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16705290#comment-16705290 ] Udi Meiri commented on BEAM-6072: - Figured out which service account needs permissions: h

[jira] [Resolved] (BEAM-6072) add encrypt/decrypt permissions for Cloud KMS key testing

2018-11-30 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6072. - Resolution: Fixed Fix Version/s: Not applicable > add encrypt/decrypt permissions for Cloud KMS key

[jira] [Created] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

2018-12-03 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6171: --- Summary: beam_PostCommit_Java_GradleBuild timing out (4 hours) Key: BEAM-6171 URL: https://issues.apache.org/jira/browse/BEAM-6171 Project: Beam Issue Type: Task

[jira] [Updated] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

2018-12-03 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6171: Issue Type: Bug (was: Task) > beam_PostCommit_Java_GradleBuild timing out (4 hours) > -

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

2018-12-03 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708060#comment-16708060 ] Udi Meiri commented on BEAM-6171: - Failing tests: 12:05:11 org.apache.beam.sdk.extensions.

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

2018-12-03 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16708064#comment-16708064 ] Udi Meiri commented on BEAM-6171: - [~charleschen] > beam_PostCommit_Java_GradleBuild timi

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

2018-12-04 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709474#comment-16709474 ] Udi Meiri commented on BEAM-6171: - Any updates? > beam_PostCommit_Java_GradleBuild timing

[jira] [Resolved] (BEAM-6196) NExmark result in google redirects to non-existent site

2018-12-07 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6196. - Resolution: Fixed Fix Version/s: Not applicable > NExmark result in google redirects to non-existen

[jira] [Assigned] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

2018-12-12 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5539: --- Assignee: Heejong Lee (was: Udi Meiri) > Beam Dependency Update Request: google-cloud-pubsub > -

[jira] [Created] (BEAM-6251) perfkit tests log should include gradle logs

2018-12-17 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6251: --- Summary: perfkit tests log should include gradle logs Key: BEAM-6251 URL: https://issues.apache.org/jira/browse/BEAM-6251 Project: Beam Issue Type: Bug Compo

[jira] [Commented] (BEAM-6251) perfkit tests log should include gradle logs

2018-12-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16723409#comment-16723409 ] Udi Meiri commented on BEAM-6251: - Fix will probably be in this code: https://github.com/

[jira] [Created] (BEAM-6272) :beam-sdks-java-io-hadoop-format:test fails due to static port conflict

2018-12-19 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6272: --- Summary: :beam-sdks-java-io-hadoop-format:test fails due to static port conflict Key: BEAM-6272 URL: https://issues.apache.org/jira/browse/BEAM-6272 Project: Beam Iss

[jira] [Resolved] (BEAM-6272) :beam-sdks-java-io-hadoop-format:test fails due to static port conflict

2018-12-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6272. - Resolution: Duplicate Fix Version/s: Not applicable > :beam-sdks-java-io-hadoop-format:test fails d

[jira] [Resolved] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-12-21 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5779. - Resolution: Cannot Reproduce Fix Version/s: Not applicable > Failure in beam_PostCommit_Python_Veri

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-12-21 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726998#comment-16726998 ] Udi Meiri commented on BEAM-5779: - Went away on its own. Closing, please reopen if this ha

[jira] [Created] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

2019-02-12 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6658: --- Summary: Add kms_key to BigQuery transforms, pass to Dataflow Key: BEAM-6658 URL: https://issues.apache.org/jira/browse/BEAM-6658 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

2019-02-12 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6658: Priority: Blocker (was: Major) > Add kms_key to BigQuery transforms, pass to Dataflow > ---

[jira] [Created] (BEAM-6660) Integration tests for KMS: BigQuery Dataflow native IO

2019-02-12 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6660: --- Summary: Integration tests for KMS: BigQuery Dataflow native IO Key: BEAM-6660 URL: https://issues.apache.org/jira/browse/BEAM-6660 Project: Beam Issue Type: Improveme

[jira] [Resolved] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

2019-02-12 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6658. - Resolution: Fixed Fix Version/s: Not applicable > Add kms_key to BigQuery transforms, pass to Dataf

[jira] [Created] (BEAM-6664) Temporarily convert dataflowKmsKey flag to experimental flag for Dataflow

2019-02-13 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6664: --- Summary: Temporarily convert dataflowKmsKey flag to experimental flag for Dataflow Key: BEAM-6664 URL: https://issues.apache.org/jira/browse/BEAM-6664 Project: Beam I

[jira] [Assigned] (BEAM-6380) apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6380: --- Assignee: Udi Meiri > apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed > -

[jira] [Created] (BEAM-6668) use add experiment methods (Java and Python)

2019-02-13 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6668: --- Summary: use add experiment methods (Java and Python) Key: BEAM-6668 URL: https://issues.apache.org/jira/browse/BEAM-6668 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-6669) revert service_default_cmek_config experiment flag

2019-02-13 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6669: --- Summary: revert service_default_cmek_config experiment flag Key: BEAM-6669 URL: https://issues.apache.org/jira/browse/BEAM-6669 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-6668) use add experiment methods (Java and Python)

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6668: Labels: beginner easyfix newbie (was: ) > use add experiment methods (Java and Python) > --

[jira] [Commented] (BEAM-6380) apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767773#comment-16767773 ] Udi Meiri commented on BEAM-6380: - Reference doc: https://googleapis.github.io/google-res

[jira] [Commented] (BEAM-5959) Add Cloud KMS support to GCS creates and copies

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1676#comment-1676 ] Udi Meiri commented on BEAM-5959: - Copy support is done (implemented as a rewrite call). C

[jira] [Resolved] (BEAM-5959) Add Cloud KMS support to GCS copies

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5959. - Resolution: Fixed Fix Version/s: 2.11.0 > Add Cloud KMS support to GCS copies > ---

[jira] [Updated] (BEAM-5959) Add Cloud KMS support to GCS copies

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5959: Summary: Add Cloud KMS support to GCS copies (was: Add Cloud KMS support to GCS creates and copies) > Add

[jira] [Assigned] (BEAM-2801) Implement a BigQuery custom sink

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-2801: --- Assignee: Pablo Estrada (was: Udi Meiri) > Implement a BigQuery custom sink > --

[jira] [Resolved] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6636. - Resolution: Fixed Fix Version/s: Not applicable > [beam_PostCommit_Java] testGcsWriteWithKmsKey tes

[jira] [Commented] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767785#comment-16767785 ] Udi Meiri commented on BEAM-6636: - I believe this is fixed. Java post-commits are currentl

[jira] [Commented] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16767784#comment-16767784 ] Udi Meiri commented on BEAM-6636: - I believe this is fixed. Java post-commits are currentl

[jira] [Updated] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

2019-02-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6658: Fix Version/s: (was: Not applicable) 2.11.0 > Add kms_key to BigQuery transforms, pas

[jira] [Commented] (BEAM-6380) apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed

2019-02-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772250#comment-16772250 ] Udi Meiri commented on BEAM-6380: - Debugging info from #7837: NotImplementedError: offset:

[jira] [Assigned] (BEAM-6459) gradle clean depends on setupVirtualEnv, which installs lots of stuff

2019-02-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6459: --- Assignee: Udi Meiri > gradle clean depends on setupVirtualEnv, which installs lots of stuff > ---

[jira] [Resolved] (BEAM-6459) gradle clean depends on setupVirtualEnv, which installs lots of stuff

2019-02-20 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6459. - Resolution: Fixed Fix Version/s: Not applicable > gradle clean depends on setupVirtualEnv, which in

[jira] [Assigned] (BEAM-3713) Consider moving away from nose to nose2 or pytest.

2019-02-27 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-3713: --- Assignee: Udi Meiri > Consider moving away from nose to nose2 or pytest. > --

[jira] [Commented] (BEAM-5352) BigQuery IO Source is not Exporting to GCS as written in documentation

2019-03-04 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16783699#comment-16783699 ] Udi Meiri commented on BEAM-5352: - I believe [~pabloem] is working on a custom sink (http

[jira] [Resolved] (BEAM-1267) BigQueryIO.Write should support the ignoreUnknownValues option

2019-03-04 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-1267. - Resolution: Duplicate Fix Version/s: Not applicable This has been implemented. > BigQueryIO.Write

[jira] [Created] (BEAM-6775) Fix "unparseable args" warning for --kms_key_name

2019-03-07 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6775: --- Summary: Fix "unparseable args" warning for --kms_key_name Key: BEAM-6775 URL: https://issues.apache.org/jira/browse/BEAM-6775 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-2969) BigQueryIO fails when reading then writing timestamps before 1970

2019-03-12 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-2969: --- Assignee: Udi Meiri > BigQueryIO fails when reading then writing timestamps before 1970 > ---

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

2019-03-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16799407#comment-16799407 ] Udi Meiri commented on BEAM-1440: - Any progress on this? This would allow templates to set

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

2019-03-25 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16800901#comment-16800901 ] Udi Meiri commented on BEAM-1440: - [~pabloem] To be clear, this bug is for sources not sin

[jira] [Resolved] (BEAM-2969) BigQueryIO fails when reading then writing timestamps before 1970

2019-03-25 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-2969. - Resolution: Fixed Fix Version/s: 2.12.0 > BigQueryIO fails when reading then writing timestamps bef

[jira] [Created] (BEAM-6917) ClickHouseIOTest failing in Java Precommits

2019-03-26 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-6917: --- Summary: ClickHouseIOTest failing in Java Precommits Key: BEAM-6917 URL: https://issues.apache.org/jira/browse/BEAM-6917 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-6668) use add experiment methods (Java and Python)

2019-03-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16805335#comment-16805335 ] Udi Meiri commented on BEAM-6668: - [~tvalentyn] > use add experiment methods (Java and Py

[jira] [Commented] (BEAM-6210) Conflicting Libraries

2019-04-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812614#comment-16812614 ] Udi Meiri commented on BEAM-6210: - I'm afraid this bug will stay unresolved until https:/

[jira] [Commented] (BEAM-5067) Switch from datastore-v1-protos to proto-google-cloud-datastore-v1

2019-04-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812619#comment-16812619 ] Udi Meiri commented on BEAM-5067: - The PR was merged so I'm closing this as resolved. Plea

[jira] [Resolved] (BEAM-5067) Switch from datastore-v1-protos to proto-google-cloud-datastore-v1

2019-04-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5067. - Resolution: Fixed Fix Version/s: Not applicable > Switch from datastore-v1-protos to proto-google-c

[jira] [Created] (BEAM-7046) fix http_proxy warnings from grpc in tests

2019-04-09 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7046: --- Summary: fix http_proxy warnings from grpc in tests Key: BEAM-7046 URL: https://issues.apache.org/jira/browse/BEAM-7046 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-7062) pydoc broken for @retry annotations

2019-04-11 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7062: --- Summary: pydoc broken for @retry annotations Key: BEAM-7062 URL: https://issues.apache.org/jira/browse/BEAM-7062 Project: Beam Issue Type: Bug Components: sd

[jira] [Created] (BEAM-7089) Update pydocs front page

2019-04-16 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7089: --- Summary: Update pydocs front page Key: BEAM-7089 URL: https://issues.apache.org/jira/browse/BEAM-7089 Project: Beam Issue Type: Bug Components: website

[jira] [Commented] (BEAM-5278) feature-branches.md orphaned

2019-04-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16820367#comment-16820367 ] Udi Meiri commented on BEAM-5278: - New path after migration from apache/beam-site is: htt

[jira] [Created] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (precommit)

2019-04-18 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7111: --- Summary: apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (precommit) Key: BEAM-7111 URL: https://issues.apache.org/jira/browse/BEAM-7111 Project:

[jira] [Updated] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7111: Summary: apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit) (was:

[jira] [Commented] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821600#comment-16821600 ] Udi Meiri commented on BEAM-7111: - I believe the culprit is: https://github.com/apache/bea

[jira] [Commented] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821601#comment-16821601 ] Udi Meiri commented on BEAM-7111: - Basically, the error message is saying that the pipelin

[jira] [Commented] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821602#comment-16821602 ] Udi Meiri commented on BEAM-7111: - pubsub_integration_test handles this case so you might

[jira] [Commented] (BEAM-7063) beam_PostCommit_Python_Verify is consistently failing due to a sideinput materialization related issue

2019-04-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821991#comment-16821991 ] Udi Meiri commented on BEAM-7063: - apache_beam.examples.wordcount_it_test.WordCountIT fail

[jira] [Assigned] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7111: --- Assignee: Pablo Estrada (was: Udi Meiri) > apache_beam.examples.wordcount_it_test.WordCountIT: failu

[jira] [Commented] (BEAM-7111) apache_beam.examples.wordcount_it_test.WordCountIT: failure in streaming mode (postcommit)

2019-04-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822126#comment-16822126 ] Udi Meiri commented on BEAM-7111: - Possible fix: https://github.com/apache/beam/commit/d7

[jira] [Commented] (BEAM-6660) Integration tests for KMS: BigQuery Dataflow native IO

2019-04-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823543#comment-16823543 ] Udi Meiri commented on BEAM-6660: - Resolved: Dataflow support is in and integration test i

[jira] [Closed] (BEAM-6660) Integration tests for KMS: BigQuery Dataflow native IO

2019-04-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri closed BEAM-6660. --- Resolution: Fixed Fix Version/s: 2.13.0 > Integration tests for KMS: BigQuery Dataflow native IO >

[jira] [Created] (BEAM-7153) pydoc broken for @deprecated annotations

2019-04-25 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7153: --- Summary: pydoc broken for @deprecated annotations Key: BEAM-7153 URL: https://issues.apache.org/jira/browse/BEAM-7153 Project: Beam Issue Type: Bug Component

[jira] [Commented] (BEAM-7153) pydoc broken for @deprecated annotations

2019-04-26 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827204#comment-16827204 ] Udi Meiri commented on BEAM-7153: - [~tvalentyn] > pydoc broken for @deprecated annotation

[jira] [Commented] (BEAM-3364) Use multiprocess nose plugin to improve unit test run time

2019-04-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829430#comment-16829430 ] Udi Meiri commented on BEAM-3364: - Closing this, as I'm in favor of migrating to pytest in

[jira] [Closed] (BEAM-3364) Use multiprocess nose plugin to improve unit test run time

2019-04-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri closed BEAM-3364. --- Resolution: Won't Fix Fix Version/s: Not applicable > Use multiprocess nose plugin to improve unit test

[jira] [Commented] (BEAM-4543) Remove dependency on googledatastore in favor of google-cloud-datastore.

2019-04-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16829573#comment-16829573 ] Udi Meiri commented on BEAM-4543: - PR merged > Remove dependency on googledatastore in fa

[jira] [Resolved] (BEAM-4543) Remove dependency on googledatastore in favor of google-cloud-datastore.

2019-04-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4543. - Resolution: Fixed Fix Version/s: 2.13.0 > Remove dependency on googledatastore in favor of google-c

[jira] [Commented] (BEAM-7218) LTS backport: Upper bound for pytz dependency

2019-05-03 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16832777#comment-16832777 ] Udi Meiri commented on BEAM-7218: - Is this bug for removing the upper bound? > LTS backpo

[jira] [Resolved] (BEAM-7062) pydoc broken for @retry annotations

2019-05-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7062. - Resolution: Fixed Fix Version/s: Not applicable > pydoc broken for @retry annotations > ---

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16835758#comment-16835758 ] Udi Meiri commented on BEAM-7060: - Doc is ready for review: https://docs.google.com/docum

[jira] [Created] (BEAM-7251) Testing BigQuery client fails queries if job results aren't immediately available

2019-05-08 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7251: --- Summary: Testing BigQuery client fails queries if job results aren't immediately available Key: BEAM-7251 URL: https://issues.apache.org/jira/browse/BEAM-7251 Project: Beam

[jira] [Updated] (BEAM-7251) Testing BigQuery client fails queries if job results aren't immediately available

2019-05-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7251: Description: Correction: the test client is using a synchronous query with a default timeout of 10s: https:

[jira] [Updated] (BEAM-7251) Testing BigQuery client fails queries if job results aren't immediately available

2019-05-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7251: Status: Open (was: Triage Needed) > Testing BigQuery client fails queries if job results aren't immediately

[jira] [Assigned] (BEAM-7251) Testing BigQuery client fails queries if job results aren't immediately available

2019-05-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7251: --- Assignee: Udi Meiri > Testing BigQuery client fails queries if job results aren't immediately > avai

[jira] [Commented] (BEAM-5706) PubSub dependency upgrade causes internal issues for Dataflow

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650802#comment-16650802 ] Udi Meiri commented on BEAM-5706: - Internal investigation showed that the internal issues

[jira] [Commented] (BEAM-5663) Add tox suites for various Python 3 versions

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650919#comment-16650919 ] Udi Meiri commented on BEAM-5663: - I've summarized my thoughts on running tests using Baze

[jira] [Resolved] (BEAM-5711) dockerized-jenkins broken in copy phase

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5711. - Resolution: Fixed Fix Version/s: Not applicable > dockerized-jenkins broken in copy phase > ---

[jira] [Commented] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650953#comment-16650953 ] Udi Meiri commented on BEAM-5539: - https://github.com/apache/beam/pull/6697 upgrades to 0.

[jira] [Resolved] (BEAM-5706) PubSub dependency upgrade causes internal issues for Dataflow

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5706. - Resolution: Fixed > PubSub dependency upgrade causes internal issues for Dataflow > --

[jira] [Commented] (BEAM-5315) Finish Python 3 porting for io module

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650993#comment-16650993 ] Udi Meiri commented on BEAM-5315: - Hi, I'm working on upgrading Beam's datastore client de

[jira] [Commented] (BEAM-5712) Need an integration test for Datastore IO in Python

2018-10-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651005#comment-16651005 ] Udi Meiri commented on BEAM-5712: - https://github.com/apache/beam/pull/6642 > Need an int

[jira] [Resolved] (BEAM-4492) Update Python bigquery library to latest version

2018-10-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4492. - Resolution: Duplicate Fix Version/s: Not applicable I'm taking over upgrading bigquery client. See

[jira] [Commented] (BEAM-4543) Remove dependency on googledatastore in favor of google-cloud-datastore.

2018-10-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16653939#comment-16653939 ] Udi Meiri commented on BEAM-4543: - Wrote a doc summarizing the upgrade path: https://docs

[jira] [Comment Edited] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657012#comment-16657012 ] Udi Meiri edited comment on BEAM-5779 at 10/19/18 4:16 PM: --- The

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657012#comment-16657012 ] Udi Meiri commented on BEAM-5779: - The log from 6317 shows TestDataflowRunner attempting t

[jira] [Created] (BEAM-5794) TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline

2018-10-19 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-5794: --- Summary: TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline Key: BEAM-5794 URL: https://issues.apache.org/jira/browse/BEAM-5794 Project: B

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657078#comment-16657078 ] Udi Meiri commented on BEAM-5779: - Sadly it doesn't. The on_success_matcher is only run af

[jira] [Commented] (BEAM-5794) TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline

2018-10-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657097#comment-16657097 ] Udi Meiri commented on BEAM-5794: - Note that this would require reviewing all matchers to

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16657103#comment-16657103 ] Udi Meiri commented on BEAM-5779: - I think the error in 6321 is similar in nature: the job

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16661104#comment-16661104 ] Udi Meiri commented on BEAM-5779: - Still failing: https://builds.apache.org/job/beam_Post

[jira] [Resolved] (BEAM-5537) Beam Dependency Update Request: google-cloud-bigquery

2018-10-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5537. - Resolution: Fixed Fix Version/s: 2.9.0 > Beam Dependency Update Request: google-cloud-bigquery > --

[jira] [Created] (BEAM-5927) FnApiRunner KeyError

2018-10-30 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-5927: --- Summary: FnApiRunner KeyError Key: BEAM-5927 URL: https://issues.apache.org/jira/browse/BEAM-5927 Project: Beam Issue Type: Bug Components: sdk-py-core

[jira] [Assigned] (BEAM-5927) FnApiRunner KeyError

2018-10-30 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5927: --- Assignee: Robert Bradshaw (was: Ahmet Altay) > FnApiRunner KeyError > > >

[jira] [Commented] (BEAM-4256) Gradle setupVirtualenv task fails on Jenkins

2018-10-31 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16670820#comment-16670820 ] Udi Meiri commented on BEAM-4256: - I can verify that shortening the path solved the issue,

<    3   4   5   6   7   8   9   10   11   12   >