[jira] [Commented] (BEAM-9388) Consider using github actions for building python wheels and more (aka. Transition from Travis)

2020-06-01 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121328#comment-17121328 ] Ahmet Altay commented on BEAM-9388: --- Adding more details: We can add a Beam setup for running github

[jira] [Assigned] (BEAM-10055) Add --region to 3 of the python examples

2020-05-21 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-10055: -- Assignee: Ted Romer > Add --region to 3 of the python examples >

[jira] [Updated] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-: -- Labels: beam-fixit (was: ) > Remove support for EOLed runners (Apex, etc.) >

[jira] [Commented] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108766#comment-17108766 ] Ahmet Altay commented on BEAM-: --- Thank you for the quick comments. Do you think it will be worth

[jira] [Commented] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108506#comment-17108506 ] Ahmet Altay commented on BEAM-9975: --- Thank you Brian. - Solving the subclass problem is probably a

[jira] [Commented] (BEAM-10007) PortableRunner doesn't handle ValueProvider instances when converting pipeline options

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108503#comment-17108503 ] Ahmet Altay commented on BEAM-10007: Converting valueproviders to actual values should be always

[jira] [Commented] (BEAM-10006) PipelineOptions can pick up definitions from unrelated tests

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108499#comment-17108499 ] Ahmet Altay commented on BEAM-10006: Flakes probably depends on the test order. This is a known

[jira] [Commented] (BEAM-10003) Need two PR to submit snippets to website

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108469#comment-17108469 ] Ahmet Altay commented on BEAM-10003: Nam, could you change the script to generate snippets from the

[jira] [Assigned] (BEAM-10003) Need two PR to submit snippets to website

2020-05-15 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-10003: -- Assignee: Aizhamal Nurmamat kyzy > Need two PR to submit snippets to website >

[jira] [Created] (BEAM-9999) Remove support for EOLed runners (Apex, etc.)

2020-05-14 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-: - Summary: Remove support for EOLed runners (Apex, etc.) Key: BEAM- URL: https://issues.apache.org/jira/browse/BEAM- Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-12 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105894#comment-17105894 ] Ahmet Altay edited comment on BEAM-9975 at 5/13/20, 2:26 AM: - Could we add a

[jira] [Commented] (BEAM-9975) PortableRunnerTest flake "ParseError: Unexpected type for Value message."

2020-05-12 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105894#comment-17105894 ] Ahmet Altay commented on BEAM-9975: --- Could we add a log error before the raise and log the value instead

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-12 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105858#comment-17105858 ] Ahmet Altay commented on BEAM-9767: --- https://github.com/apache/beam/pull/11663 is merged. Does this

[jira] [Commented] (BEAM-9001) Allow setting environment ID to all transforms in the SDK

2020-05-11 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104777#comment-17104777 ] Ahmet Altay commented on BEAM-9001: --- Does this need to be a blocker for 2.21? Is it a regression? Which

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-07 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102163#comment-17102163 ] Ahmet Altay commented on BEAM-9767: --- https://github.com/apache/beam/pull/11624 is merged. Can we close

[jira] [Commented] (BEAM-9907) apache_beam.transforms.external_test.ExternalTransformTest.test_nested flaky

2020-05-07 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102161#comment-17102161 ] Ahmet Altay commented on BEAM-9907: --- https://github.com/apache/beam/pull/11631 is merged. Can we close

[jira] [Commented] (BEAM-9907) apache_beam.transforms.external_test.ExternalTransformTest.test_nested flaky

2020-05-07 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101931#comment-17101931 ] Ahmet Altay commented on BEAM-9907: --- [~bhulette] - mentioned that this could be related to

[jira] [Commented] (BEAM-9907) apache_beam.transforms.external_test.ExternalTransformTest.test_nested flaky

2020-05-07 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101898#comment-17101898 ] Ahmet Altay commented on BEAM-9907: --- Any updates on this issue? What is the next action here? >

[jira] [Commented] (BEAM-9907) apache_beam.transforms.external_test.ExternalTransformTest.test_nested flaky

2020-05-06 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101104#comment-17101104 ] Ahmet Altay commented on BEAM-9907: --- [~chamikara] / [~heejong] - Could you please fix or disable this

[jira] [Assigned] (BEAM-9907) apache_beam.transforms.external_test.ExternalTransformTest.test_nested flaky

2020-05-06 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9907: - Assignee: Chamikara Madhusanka Jayalath >

[jira] [Commented] (BEAM-9767) test_streaming_wordcount flaky timeouts

2020-05-06 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101103#comment-17101103 ] Ahmet Altay commented on BEAM-9767: --- Sam, could you please disable the flaky test. This is resulting

[jira] [Updated] (BEAM-7246) Add Google Spanner IO on Python SDK

2020-05-01 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-7246: -- Fix Version/s: (was: 2.20.0) 2.21.0 > Add Google Spanner IO on Python SDK >

[jira] [Updated] (BEAM-6795) Improve Release Scripts

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6795: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Improvement) > Improve Release Scripts >

[jira] [Updated] (BEAM-6613) build_release_candidate.sh fails if RC > 1 but there's no SVN directory on dist.apache.org

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6613: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > build_release_candidate.sh fails if RC > 1

[jira] [Updated] (BEAM-6441) cut_release_branch.sh should not push to master without verification and a PR

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6441: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > cut_release_branch.sh should not push to

[jira] [Updated] (BEAM-6614) Release candidate does not require --no-parallel

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6614: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > Release candidate does not require

[jira] [Updated] (BEAM-6598) build_release_candidate.sh fails because of leftover RC tags in working git clone

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6598: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > build_release_candidate.sh fails because

[jira] [Updated] (BEAM-6595) build_release_candidate.sh should not push to apache org on github

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-6595: -- Parent: BEAM-7887 Issue Type: Sub-task (was: Bug) > build_release_candidate.sh should not push

[jira] [Commented] (BEAM-6586) Design and implement a release process for Beam SDK harness containers.

2020-04-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088191#comment-17088191 ] Ahmet Altay commented on BEAM-6586: --- I believe this is fixed by [~hannahjiang]'s work. Anything else to

[jira] [Commented] (BEAM-9685) Don't release Go SDK container until Go is officially supported.

2020-04-16 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085101#comment-17085101 ] Ahmet Altay commented on BEAM-9685: --- Kyle, Hannah, is this fixed? Or should this be re-opened? > Don't

[jira] [Created] (BEAM-9771) colab links in example notebooks don't work

2020-04-16 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9771: - Summary: colab links in example notebooks don't work Key: BEAM-9771 URL: https://issues.apache.org/jira/browse/BEAM-9771 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9750) Streaming Word Count Example Documents is out of date (Python)

2020-04-13 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9750: - Summary: Streaming Word Count Example Documents is out of date (Python) Key: BEAM-9750 URL: https://issues.apache.org/jira/browse/BEAM-9750 Project: Beam Issue

[jira] [Commented] (BEAM-9484) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests is flaky in DirectRunner Postcommits

2020-04-08 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078910#comment-17078910 ] Ahmet Altay commented on BEAM-9484: --- Any update on this. This is one of the top issues impacting python

[jira] [Comment Edited] (BEAM-9484) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests is flaky in DirectRunner Postcommits

2020-04-08 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078910#comment-17078910 ] Ahmet Altay edited comment on BEAM-9484 at 4/9/20, 4:43 AM: Any update on

[jira] [Commented] (BEAM-9626) pymongo should be an optional requirement

2020-03-27 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069151#comment-17069151 ] Ahmet Altay commented on BEAM-9626: --- Why do we want to make this change especially retroactively for an

[jira] [Commented] (BEAM-9557) Error setting processing time timers near end-of-window

2020-03-23 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17064984#comment-17064984 ] Ahmet Altay commented on BEAM-9557: --- For reference commit from description

[jira] [Assigned] (BEAM-9549) Flaky portableWordCountBatch and portableWordCountStreaming tests

2020-03-18 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9549: - Assignee: Ankur Goenka > Flaky portableWordCountBatch and portableWordCountStreaming tests >

[jira] [Commented] (BEAM-9484) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests is flaky in DirectRunner Postcommits

2020-03-17 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061242#comment-17061242 ] Ahmet Altay commented on BEAM-9484: --- cc: [~pabloem] >

[jira] [Assigned] (BEAM-9484) apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests is flaky in DirectRunner Postcommits

2020-03-17 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9484: - Assignee: Chamikara Madhusanka Jayalath >

[jira] [Commented] (BEAM-9507) Beam dependency check failing

2020-03-16 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060556#comment-17060556 ] Ahmet Altay commented on BEAM-9507: --- cc: [~yifanzou] > Beam dependency check failing >

[jira] [Assigned] (BEAM-9510) Dependencies in base_image_requirements.txt are not compatible with each other

2020-03-16 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9510: - Assignee: Hannah Jiang > Dependencies in base_image_requirements.txt are not compatible with

[jira] [Commented] (BEAM-9510) Dependencies in base_image_requirements.txt are not compatible with each other

2020-03-16 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060457#comment-17060457 ] Ahmet Altay commented on BEAM-9510: --- This file looks out of date. We can update it to match

[jira] [Created] (BEAM-9497) Update "Managing Python Pipeline Dependencies" page

2020-03-12 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9497: - Summary: Update "Managing Python Pipeline Dependencies" page Key: BEAM-9497 URL: https://issues.apache.org/jira/browse/BEAM-9497 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-9487) GBKs on unbounded pcolls with global windows and no triggers should fail

2020-03-11 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9487: -- Labels: EaseOfUse starter (was: starter) > GBKs on unbounded pcolls with global windows and no

[jira] [Updated] (BEAM-9487) GBKs on unbounded pcolls with global windows and no triggers should fail

2020-03-11 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9487: -- Labels: EaseOf starter (was: EaseOfUse starter) > GBKs on unbounded pcolls with global windows and no

[jira] [Updated] (BEAM-9487) GBKs on unbounded pcolls with global windows and no triggers should fail

2020-03-11 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9487: -- Labels: starter (was: EaseOf starter) > GBKs on unbounded pcolls with global windows and no triggers

[jira] [Created] (BEAM-9388) Consider using github actions for building python wheels and more (aka. Transition from Travis)

2020-02-26 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9388: - Summary: Consider using github actions for building python wheels and more (aka. Transition from Travis) Key: BEAM-9388 URL: https://issues.apache.org/jira/browse/BEAM-9388

[jira] [Resolved] (BEAM-9248) [Python] PTransform that integrates Cloud Natural Language functionality

2020-02-26 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-9248. --- Resolution: Fixed > [Python] PTransform that integrates Cloud Natural Language functionality >

[jira] [Updated] (BEAM-9248) [Python] PTransform that integrates Cloud Natural Language functionality

2020-02-26 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9248: -- Fix Version/s: 2.20.0 > [Python] PTransform that integrates Cloud Natural Language functionality >

[jira] [Commented] (BEAM-8618) Tear down unused DoFns periodically in Python SDK harness

2020-02-25 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044707#comment-17044707 ] Ahmet Altay commented on BEAM-8618: --- Do we need a fix version set for this? This appears to be an

[jira] [Commented] (BEAM-9250) Improve beam release script based on 2.19.0 release experience

2020-02-25 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044706#comment-17044706 ] Ahmet Altay commented on BEAM-9250: --- Is this a blocker for 2.20? > Improve beam release script based on

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041441#comment-17041441 ] Ahmet Altay commented on BEAM-9319: --- Thank you! Do we still need to address the leaking problem? >

[jira] [Commented] (BEAM-9119) apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky

2020-02-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041277#comment-17041277 ] Ahmet Altay commented on BEAM-9119: --- This come up again here: https://github.com/apache/beam/pull/10731

[jira] [Reopened] (BEAM-1080) python sdk apiclient needs proper unit tests

2020-02-18 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reopened BEAM-1080: --- Assignee: (was: Pablo Estrada) > python sdk apiclient needs proper unit tests >

[jira] [Updated] (BEAM-1080) python sdk apiclient needs proper unit tests

2020-02-18 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1080: -- Fix Version/s: (was: 2.17.0) > python sdk apiclient needs proper unit tests >

[jira] [Commented] (BEAM-9185) Publish pre-release python artifacts (RCs) to PyPI

2020-02-18 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039269#comment-17039269 ] Ahmet Altay commented on BEAM-9185: --- Thank you [~zhitao]. During an RC validation there will be a fixed

[jira] [Commented] (BEAM-9185) Publish pre-release python artifacts (RCs) to PyPI

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037402#comment-17037402 ] Ahmet Altay commented on BEAM-9185: --- As an alternative, could we ask users to do `pip install

[jira] [Commented] (BEAM-9252) Problem shading Beam pipeline with Beam 2.20.0-SNAPSHOT

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037396#comment-17037396 ] Ahmet Altay commented on BEAM-9252: --- Would this be resolved when

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037390#comment-17037390 ] Ahmet Altay commented on BEAM-9319: --- Brian, can you cleanup some older topics to at least enable the

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037389#comment-17037389 ] Ahmet Altay commented on BEAM-9319: --- I do not know if pubsub supports TTLs for topics. Subscriptions

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037246#comment-17037246 ] Ahmet Altay commented on BEAM-9319: --- - Let's start with cleaning up leaked resources. - If possible, it

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037189#comment-17037189 ] Ahmet Altay commented on BEAM-9319: --- Looking at

[jira] [Commented] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037170#comment-17037170 ] Ahmet Altay commented on BEAM-9319: --- /cc: [~markflyhigh] > ResourceExhausted: topics-per-project >

[jira] [Created] (BEAM-9319) ResourceExhausted: topics-per-project

2020-02-14 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9319: - Summary: ResourceExhausted: topics-per-project Key: BEAM-9319 URL: https://issues.apache.org/jira/browse/BEAM-9319 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-9318) Py 2 Precommit Flake: PortableRunnerTestWithLocalDocker test flaky

2020-02-14 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9318: - Summary: Py 2 Precommit Flake: PortableRunnerTestWithLocalDocker test flaky Key: BEAM-9318 URL: https://issues.apache.org/jira/browse/BEAM-9318 Project: Beam

[jira] [Commented] (BEAM-9247) [Python] PTransform that integrates Cloud Vision functionality

2020-02-13 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036348#comment-17036348 ] Ahmet Altay commented on BEAM-9247: --- I think this will be a confusing API. I will suggest 2 PTransforms

[jira] [Resolved] (BEAM-9202) lintPy37 precommit broken

2020-01-27 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-9202. --- Fix Version/s: Not applicable Resolution: Fixed > lintPy37 precommit broken >

[jira] [Commented] (BEAM-9202) lintPy37 precommit broken

2020-01-27 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024807#comment-17024807 ] Ahmet Altay commented on BEAM-9202: --- Yes, it is fixed here: [https://github.com/apache/beam/pull/10697]

[jira] [Created] (BEAM-9185) Publish pre-release python artifacts (RCs) to PyPI

2020-01-23 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-9185: - Summary: Publish pre-release python artifacts (RCs) to PyPI Key: BEAM-9185 URL: https://issues.apache.org/jira/browse/BEAM-9185 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-9137) beam_PostCommit_Py_ValCont should run with dataflow_worker_jar

2020-01-17 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9137: -- Parent: BEAM-8193 Issue Type: Sub-task (was: Bug) > beam_PostCommit_Py_ValCont should run with

[jira] [Assigned] (BEAM-9137) beam_PostCommit_Py_ValCont should run with dataflow_worker_jar

2020-01-17 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9137: - Assignee: Valentyn Tymofieiev > beam_PostCommit_Py_ValCont should run with dataflow_worker_jar >

[jira] [Updated] (BEAM-7689) Temporary directory for WriteOperation may not be unique in FileBaseSink

2020-01-17 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-7689: -- Affects Version/s: 2.5.0 2.6.0 2.7.0

[jira] [Assigned] (BEAM-9078) Large Tarball Artifacts Should Use GCS Resumable Upload

2020-01-09 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-9078: - Assignee: Brad West > Large Tarball Artifacts Should Use GCS Resumable Upload >

[jira] [Updated] (BEAM-9013) Multi-output TestStream breaks the DataflowRunner

2020-01-06 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-9013: -- Fix Version/s: 2.18.0 > Multi-output TestStream breaks the DataflowRunner >

[jira] [Commented] (BEAM-8944) Python SDK harness performance degradation with UnboundedThreadPoolExecutor

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001589#comment-17001589 ] Ahmet Altay commented on BEAM-8944: --- Could this be closed after the cherry pick PR

[jira] [Commented] (BEAM-8974) apache_beam.runners.worker.log_handler_test.FnApiLogRecordHandlerTest.test_exc_info is flaky

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001562#comment-17001562 ] Ahmet Altay commented on BEAM-8974: --- What is the next action here with respect to 2.18 release? *

[jira] [Commented] (BEAM-8337) Add Flink job server container images to release process

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001455#comment-17001455 ] Ahmet Altay commented on BEAM-8337: --- Do we have containers built? > Add Flink job server container

[jira] [Commented] (BEAM-8825) OOM when writing large numbers of 'narrow' rows

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001437#comment-17001437 ] Ahmet Altay commented on BEAM-8825: --- Closing this. cherry pick PR is merged. > OOM when writing large

[jira] [Resolved] (BEAM-8825) OOM when writing large numbers of 'narrow' rows

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-8825. --- Resolution: Fixed > OOM when writing large numbers of 'narrow' rows >

[jira] [Resolved] (BEAM-8882) Allow Dataflow to automatically choose portability or not.

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-8882. --- Resolution: Fixed > Allow Dataflow to automatically choose portability or not. >

[jira] [Commented] (BEAM-8882) Allow Dataflow to automatically choose portability or not.

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001365#comment-17001365 ] Ahmet Altay commented on BEAM-8882: --- Closing this. I do not see any other open PRs related to this JIRA.

[jira] [Assigned] (BEAM-8906) Long BigQuery dry runs cause avalanche delay

2019-12-20 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-8906: - Assignee: Chamikara Madhusanka Jayalath > Long BigQuery dry runs cause avalanche delay >

[jira] [Commented] (BEAM-8825) OOM when writing large numbers of 'narrow' rows

2019-12-19 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000338#comment-17000338 ] Ahmet Altay commented on BEAM-8825: --- Could this issue be closed? > OOM when writing large numbers of

[jira] [Commented] (BEAM-8195) Quota exceeded for create requests

2019-12-19 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000330#comment-17000330 ] Ahmet Altay commented on BEAM-8195: --- dataflow_v1b3_client.py is an auto generated file I believe. Is it

[jira] [Updated] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-8912: -- Parent: BEAM-8193 Issue Type: Sub-task (was: Bug) > PreCommit_Python2_PVR_Flink_Commit flaky >

[jira] [Created] (BEAM-8912) PreCommit_Python2_PVR_Flink_Commit flaky

2019-12-06 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8912: - Summary: PreCommit_Python2_PVR_Flink_Commit flaky Key: BEAM-8912 URL: https://issues.apache.org/jira/browse/BEAM-8912 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-6694) ApproximateQuantiles transform for Python SDK

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-6694. - Fix Version/s: 2.16.0 Resolution: Fixed > ApproximateQuantiles transform for Python SDK >

[jira] [Resolved] (BEAM-7018) Regex transform for Python SDK

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-7018. --- Fix Version/s: 2.16.0 Resolution: Fixed > Regex transform for Python SDK >

[jira] [Commented] (BEAM-7018) Regex transform for Python SDK

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987110#comment-16987110 ] Ahmet Altay commented on BEAM-7018: --- Can we close this? I believe this is completed. > Regex transform

[jira] [Commented] (BEAM-7018) Regex transform for Python SDK

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987109#comment-16987109 ] Ahmet Altay commented on BEAM-7018: --- Can we close this? I believe this is completed. > Regex transform

[jira] [Commented] (BEAM-6694) ApproximateQuantiles transform for Python SDK

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16987107#comment-16987107 ] Ahmet Altay commented on BEAM-6694: --- Can we close this? I believe this is completed. >

[jira] [Updated] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-03 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-8877: -- Parent: BEAM-8193 Issue Type: Sub-task (was: Bug) > beam_PostCommit_Py_VR_Dataflow is timing

[jira] [Created] (BEAM-8877) beam_PostCommit_Py_VR_Dataflow is timing out

2019-12-03 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8877: - Summary: beam_PostCommit_Py_VR_Dataflow is timing out Key: BEAM-8877 URL: https://issues.apache.org/jira/browse/BEAM-8877 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-8653) installGcpTest task is flaky

2019-12-02 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-8653: - Assignee: Udi Meiri > installGcpTest task is flaky > > >

[jira] [Commented] (BEAM-8653) installGcpTest task is flaky

2019-12-02 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986564#comment-16986564 ] Ahmet Altay commented on BEAM-8653: --- [~udim] is this fixed with your recent changes to setup_requires

[jira] [Updated] (BEAM-8868) BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit

2019-12-02 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-8868: -- Parent: BEAM-8193 Issue Type: Sub-task (was: Bug) >

[jira] [Created] (BEAM-8868) BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit

2019-12-02 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8868: - Summary: BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit Key: BEAM-8868 URL: https://issues.apache.org/jira/browse/BEAM-8868

[jira] [Updated] (BEAM-8867) sparkValidatesRunner - python post commit flaky

2019-12-02 Thread Ahmet Altay (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-8867: -- Parent: BEAM-8193 Issue Type: Sub-task (was: Bug) > sparkValidatesRunner - python post commit

[jira] [Created] (BEAM-8867) sparkValidatesRunner - python post commit flaky

2019-12-02 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8867: - Summary: sparkValidatesRunner - python post commit flaky Key: BEAM-8867 URL: https://issues.apache.org/jira/browse/BEAM-8867 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-8866) portableWordCountFlinkRunnerStreaming - flaky post commits

2019-12-02 Thread Ahmet Altay (Jira)
Ahmet Altay created BEAM-8866: - Summary: portableWordCountFlinkRunnerStreaming - flaky post commits Key: BEAM-8866 URL: https://issues.apache.org/jira/browse/BEAM-8866 Project: Beam Issue Type:

  1   2   3   4   5   6   >