[jira] [Created] (BEAM-5613) Snapshot Python dependencies and add to Python_NightlySnapshot

2018-10-02 Thread Mark Liu (JIRA)
Mark Liu created BEAM-5613: -- Summary: Snapshot Python dependencies and add to Python_NightlySnapshot Key: BEAM-5613 URL: https://issues.apache.org/jira/browse/BEAM-5613 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-21 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-5334. Resolution: Fixed Fix Version/s: Not applicable > [beam_PerformanceTests_Python] Incompatible

[jira] [Commented] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-21 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623759#comment-16623759 ] Mark Liu commented on BEAM-5334: beam_PerformanceTests_Python is green again in 

[jira] [Assigned] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-20 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-5334: -- Assignee: Mark Liu > [beam_PerformanceTests_Python] Incompatible packages in dependencies >

[jira] [Commented] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-20 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623075#comment-16623075 ] Mark Liu commented on BEAM-5334: [https://github.com/apache/beam/pull/6456] is out for review. It should

[jira] [Comment Edited] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-17 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617989#comment-16617989 ] Mark Liu edited comment on BEAM-5334 at 9/17/18 8:07 PM: -

[jira] [Commented] (BEAM-5334) [beam_PerformanceTests_Python] Incompatible packages in dependencies

2018-09-17 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617989#comment-16617989 ] Mark Liu commented on BEAM-5334: https://github.com/apache/beam/pull/6392 enables Python benchmark to

[jira] [Comment Edited] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605115#comment-16605115 ] Mark Liu edited comment on BEAM-5296 at 9/6/18 12:55 AM: - Investigations are made

[jira] [Comment Edited] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605115#comment-16605115 ] Mark Liu edited comment on BEAM-5296 at 9/6/18 12:54 AM: - Investigations are made

[jira] [Comment Edited] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605115#comment-16605115 ] Mark Liu edited comment on BEAM-5296 at 9/6/18 12:52 AM: - Investigations are made

[jira] [Commented] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605115#comment-16605115 ] Mark Liu commented on BEAM-5296: Investigations are made by Lukasz and summarized in 

[jira] [Created] (BEAM-5329) Increase test coverage of Perfkit benchmark for Python case

2018-09-05 Thread Mark Liu (JIRA)
Mark Liu created BEAM-5329: -- Summary: Increase test coverage of Perfkit benchmark for Python case Key: BEAM-5329 URL: https://issues.apache.org/jira/browse/BEAM-5329 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-5302) Improve performance test documentation

2018-09-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-5302: -- Assignee: (was: Jason Kuster) > Improve performance test documentation >

[jira] [Created] (BEAM-5302) Improve performance test documentation

2018-09-04 Thread Mark Liu (JIRA)
Mark Liu created BEAM-5302: -- Summary: Improve performance test documentation Key: BEAM-5302 URL: https://issues.apache.org/jira/browse/BEAM-5302 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-5300) Add Python benchmark to beam_PerformanceTests_Analysis

2018-09-04 Thread Mark Liu (JIRA)
Mark Liu created BEAM-5300: -- Summary: Add Python benchmark to beam_PerformanceTests_Analysis Key: BEAM-5300 URL: https://issues.apache.org/jira/browse/BEAM-5300 Project: Beam Issue Type: Task

[jira] [Comment Edited] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603465#comment-16603465 ] Mark Liu edited comment on BEAM-5296 at 9/4/18 7:11 PM: This flag is defined in

[jira] [Comment Edited] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603465#comment-16603465 ] Mark Liu edited comment on BEAM-5296 at 9/4/18 7:08 PM: This flag is defined in

[jira] [Commented] (BEAM-5296) python beam_integration_benchmark(0) continuously failed.

2018-09-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603465#comment-16603465 ] Mark Liu commented on BEAM-5296: This flag is defined in BeamTestPlugin and seems it's failed to load due

[jira] [Updated] (BEAM-5108) Improve Python test framework to prevent streaming pipeline leaks

2018-08-08 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-5108: --- Summary: Improve Python test framework to prevent streaming pipeline leaks (was: Python test framework

[jira] [Closed] (BEAM-3809) beam_PerformanceTests_Python failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-3809. -- > beam_PerformanceTests_Python failing > > > Key: BEAM-3809 >

[jira] [Resolved] (BEAM-3809) beam_PerformanceTests_Python failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-3809. Resolution: Fixed Fix Version/s: Not applicable > beam_PerformanceTests_Python failing >

[jira] [Closed] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-3230. -- > beam_PerformanceTests_Python is failing > --- > > Key:

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570810#comment-16570810 ] Mark Liu commented on BEAM-3230: Fix is merged. Latest schedule build passed:

[jira] [Resolved] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-3230. Resolution: Fixed Fix Version/s: Not applicable > beam_PerformanceTests_Python is failing >

[jira] [Assigned] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-3230: -- Assignee: Mark Liu (was: Ankur Goenka) > beam_PerformanceTests_Python is failing >

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570809#comment-16570809 ] Mark Liu commented on BEAM-3230: https://github.com/apache/beam/pull/6142 will do the fix >

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

2018-08-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568427#comment-16568427 ] Mark Liu commented on BEAM-3230: Works in https://github.com/apache/beam/pull/6074 is trying to fix this

[jira] [Closed] (BEAM-4859) Run Python ValidatesRunner tests in streaming

2018-07-26 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-4859. -- > Run Python ValidatesRunner tests in streaming > - > >

[jira] [Resolved] (BEAM-4859) Run Python ValidatesRunner tests in streaming

2018-07-26 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-4859. Resolution: Done Fix Version/s: Not applicable > Run Python ValidatesRunner tests in streaming >

[jira] [Commented] (BEAM-4859) Run Python ValidatesRunner tests in streaming

2018-07-26 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558474#comment-16558474 ] Mark Liu commented on BEAM-4859: Python ValidatesRunner tests are enabled in streaming and added to same

[jira] [Created] (BEAM-5025) Fix test_multi_valued_singleton_side_input on DataflowRunner in streaming

2018-07-25 Thread Mark Liu (JIRA)
Mark Liu created BEAM-5025: -- Summary: Fix test_multi_valued_singleton_side_input on DataflowRunner in streaming Key: BEAM-5025 URL: https://issues.apache.org/jira/browse/BEAM-5025 Project: Beam

[jira] [Commented] (BEAM-1124) Python ValidateRunner Test test_multi_valued_singleton_side_input Break Postcommit

2018-07-25 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556453#comment-16556453 ] Mark Liu commented on BEAM-1124: The fix should work. This test is passing for a while. Latest green

[jira] [Created] (BEAM-4859) Run Python ValidatesRunner tests in streaming

2018-07-24 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4859: -- Summary: Run Python ValidatesRunner tests in streaming Key: BEAM-4859 URL: https://issues.apache.org/jira/browse/BEAM-4859 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-4492) Update Python bigquery library to latest version

2018-07-19 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16549747#comment-16549747 ] Mark Liu commented on BEAM-4492: Following link shows places that use google-cloud-bigquery library:

[jira] [Closed] (BEAM-4512) Move DataflowRunner off of Maven build files

2018-07-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-4512. -- > Move DataflowRunner off of Maven build files > > >

[jira] [Resolved] (BEAM-4512) Move DataflowRunner off of Maven build files

2018-07-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-4512. Resolution: Fixed Fix Version/s: 2.6.0 > Move DataflowRunner off of Maven build files >

[jira] [Comment Edited] (BEAM-4512) Move DataflowRunner off of Maven build files

2018-07-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537751#comment-16537751 ] Mark Liu edited comment on BEAM-4512 at 7/9/18 10:57 PM: - The work inside Google

[jira] [Commented] (BEAM-4512) Move DataflowRunner off of Maven build files

2018-07-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537751#comment-16537751 ] Mark Liu commented on BEAM-4512: The work inside Google that moves project build dependency from Maven pom

[jira] [Closed] (BEAM-4743) jars are overwritten during release with -Ppublishing

2018-07-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-4743. -- Resolution: Duplicate Fix Version/s: Not applicable duplicated with BEAM-4744 > jars are overwritten

[jira] [Created] (BEAM-4744) Jars are overwritten during release with -Ppublishing

2018-07-09 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4744: -- Summary: Jars are overwritten during release with -Ppublishing Key: BEAM-4744 URL: https://issues.apache.org/jira/browse/BEAM-4744 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4743) jars are overwritten during release with -Ppublishing

2018-07-09 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4743: -- Summary: jars are overwritten during release with -Ppublishing Key: BEAM-4743 URL: https://issues.apache.org/jira/browse/BEAM-4743 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-4512) Move DataflowRunner off of Maven build files

2018-06-22 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520655#comment-16520655 ] Mark Liu commented on BEAM-4512: We made a good progress in recent days: - migrate build_rules script to

[jira] [Created] (BEAM-4492) Update Python bigquery library to latest version

2018-06-05 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4492: -- Summary: Update Python bigquery library to latest version Key: BEAM-4492 URL: https://issues.apache.org/jira/browse/BEAM-4492 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-3944) Convert beam_PerformanceTests_Python to use Gradle

2018-05-09 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469294#comment-16469294 ] Mark Liu commented on BEAM-3944: https://issues.apache.org/jira/browse/BEAM-3809 is tracking the Python

[jira] [Closed] (BEAM-4092) Enable Python ValidatesRunner test against TestDataflowRunner in streaming

2018-04-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-4092. -- Resolution: Duplicate Fix Version/s: Not applicable > Enable Python ValidatesRunner test against

[jira] [Created] (BEAM-4093) Support Python ValidatesRunner test against TestDataflowRunner in streaming

2018-04-16 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4093: -- Summary: Support Python ValidatesRunner test against TestDataflowRunner in streaming Key: BEAM-4093 URL: https://issues.apache.org/jira/browse/BEAM-4093 Project: Beam

[jira] [Created] (BEAM-4092) Enable Python ValidatesRunner test against TestDataflowRunner in streaming

2018-04-16 Thread Mark Liu (JIRA)
Mark Liu created BEAM-4092: -- Summary: Enable Python ValidatesRunner test against TestDataflowRunner in streaming Key: BEAM-4092 URL: https://issues.apache.org/jira/browse/BEAM-4092 Project: Beam

[jira] [Resolved] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-3946. Resolution: Fixed Fix Version/s: Not applicable > Python SDK tests are failing if no

[jira] [Commented] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426204#comment-16426204 ] Mark Liu commented on BEAM-3946: https://github.com/apache/beam/pull/5021 should fix this problem. >

[jira] [Resolved] (BEAM-2861) test_delete_bq_table_succeeds fails with GOOGLE_APPLICATION_CREDENTIALS

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-2861. Resolution: Fixed Fix Version/s: Not applicable > test_delete_bq_table_succeeds fails with

[jira] [Closed] (BEAM-2861) test_delete_bq_table_succeeds fails with GOOGLE_APPLICATION_CREDENTIALS

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-2861. -- > test_delete_bq_table_succeeds fails with GOOGLE_APPLICATION_CREDENTIALS >

[jira] [Resolved] (BEAM-1033) BigQueryMatcher is flaky

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-1033. Resolution: Fixed Fix Version/s: Not applicable > BigQueryMatcher is flaky >

[jira] [Closed] (BEAM-1033) BigQueryMatcher is flaky

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-1033. -- > BigQueryMatcher is flaky > > > Key: BEAM-1033 > URL:

[jira] [Resolved] (BEAM-1583) Separate GCP test required packages from general GCP dependencies

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-1583. Resolution: Done Fix Version/s: Not applicable > Separate GCP test required packages from general GCP

[jira] [Commented] (BEAM-1583) Separate GCP test required packages from general GCP dependencies

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426032#comment-16426032 ] Mark Liu commented on BEAM-1583: Currently, there is a separate dependency group GCP_REQUIREMENTS in

[jira] [Closed] (BEAM-1583) Separate GCP test required packages from general GCP dependencies

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-1583. -- > Separate GCP test required packages from general GCP dependencies >

[jira] [Commented] (BEAM-3946) Python SDK tests are failing if no GOOGLE_APPLICATION_CREDENTIALS was set

2018-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425826#comment-16425826 ] Mark Liu commented on BEAM-3946: Sorry for late response. I think the cause is that pubsub client is

[jira] [Assigned] (BEAM-3922) beam_PostCommit_Python_Verify is broken

2018-03-23 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-3922: -- Assignee: Robert Bradshaw (was: Jason Kuster) > beam_PostCommit_Python_Verify is broken >

[jira] [Assigned] (BEAM-3922) beam_PostCommit_Python_Verify is broken

2018-03-23 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-3922: -- Assignee: Jason Kuster (was: Anton Kedin) > beam_PostCommit_Python_Verify is broken >

[jira] [Created] (BEAM-3922) beam_PostCommit_Python_Verify is broken

2018-03-23 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3922: -- Summary: beam_PostCommit_Python_Verify is broken Key: BEAM-3922 URL: https://issues.apache.org/jira/browse/BEAM-3922 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-3861) Build test infra for end-to-end streaming test in Python SDK

2018-03-15 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3861: -- Summary: Build test infra for end-to-end streaming test in Python SDK Key: BEAM-3861 URL: https://issues.apache.org/jira/browse/BEAM-3861 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-1584) Support clean-up step in integration test

2018-03-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-1584. Resolution: Fixed Fix Version/s: Not applicable > Support clean-up step in integration test >

[jira] [Assigned] (BEAM-2339) Jenkins cross JDK version test on Windows

2018-03-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-2339: -- Assignee: Davor Bonaci (was: Mark Liu) > Jenkins cross JDK version test on Windows >

[jira] [Closed] (BEAM-3841) Python TestDataflowRunner should oeverride run_pipeline

2018-03-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-3841. -- > Python TestDataflowRunner should oeverride run_pipeline > ---

[jira] [Resolved] (BEAM-3841) Python TestDataflowRunner should oeverride run_pipeline

2018-03-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-3841. Resolution: Fixed Fix Version/s: Not applicable > Python TestDataflowRunner should oeverride

[jira] [Commented] (BEAM-3841) Python TestDataflowRunner should oeverride run_pipeline

2018-03-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401182#comment-16401182 ] Mark Liu commented on BEAM-3841: Fix PR [4856|https://github.com/apache/beam/pull/4856] is merged.  >

[jira] [Created] (BEAM-3841) Python TestDataflowRunner should oeverride run_pipeline

2018-03-12 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3841: -- Summary: Python TestDataflowRunner should oeverride run_pipeline Key: BEAM-3841 URL: https://issues.apache.org/jira/browse/BEAM-3841 Project: Beam Issue Type: Test

[jira] [Updated] (BEAM-3841) Python TestDataflowRunner should oeverride run_pipeline

2018-03-12 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-3841: --- Issue Type: Bug (was: Test) > Python TestDataflowRunner should oeverride run_pipeline >

[jira] [Created] (BEAM-3810) Add new matcher to check output file content for WordCountIT and WindowedWordCountIT

2018-03-08 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3810: -- Summary: Add new matcher to check output file content for WordCountIT and WindowedWordCountIT Key: BEAM-3810 URL: https://issues.apache.org/jira/browse/BEAM-3810 Project: Beam

[jira] [Comment Edited] (BEAM-3809) beam_PerformanceTests_Python failing

2018-03-08 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391749#comment-16391749 ] Mark Liu edited comment on BEAM-3809 at 3/8/18 7:11 PM: The command pkb use to

[jira] [Commented] (BEAM-3809) beam_PerformanceTests_Python failing

2018-03-08 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16391749#comment-16391749 ] Mark Liu commented on BEAM-3809: The command pkb use to execute pipeline is: python setup.py nosetests

[jira] [Created] (BEAM-3750) Integration test will fail when use TestPipeline.convertToArgs in some special cases

2018-02-26 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3750: -- Summary: Integration test will fail when use TestPipeline.convertToArgs in some special cases Key: BEAM-3750 URL: https://issues.apache.org/jira/browse/BEAM-3750 Project: Beam

[jira] [Commented] (BEAM-3364) Use multiprocess nose plugin to improve unit test run time

2017-12-15 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16293413#comment-16293413 ] Mark Liu commented on BEAM-3364: Integration tests in PostCommit are enabled with miltiprocess. AFAIK, the

[jira] [Updated] (BEAM-3068) Document Jenkins ghprb commands

2017-10-17 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-3068: --- Component/s: (was: build-system) testing > Document Jenkins ghprb commands >

[jira] [Created] (BEAM-3068) Document Jenkins ghprb commands

2017-10-17 Thread Mark Liu (JIRA)
Mark Liu created BEAM-3068: -- Summary: Document Jenkins ghprb commands Key: BEAM-3068 URL: https://issues.apache.org/jira/browse/BEAM-3068 Project: Beam Issue Type: Task Components:

[jira] [Commented] (BEAM-3059) Timeout option for individual integration tests

2017-10-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206677#comment-16206677 ] Mark Liu commented on BEAM-3059: Some explanation: we want to have a timeout option for each individual

[jira] [Resolved] (BEAM-2999) Split validatesrunner tests from Python postcommit

2017-10-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-2999. Resolution: Done Fix Version/s: Not applicable > Split validatesrunner tests from Python postcommit >

[jira] [Updated] (BEAM-2999) Split validatesrunner tests from Python postcommit

2017-10-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2999: --- Issue Type: Task (was: Bug) > Split validatesrunner tests from Python postcommit >

[jira] [Closed] (BEAM-2999) Split validatesrunner tests from Python postcommit

2017-10-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-2999. -- > Split validatesrunner tests from Python postcommit > -- > >

[jira] [Created] (BEAM-2999) Split validatesrunner tests from Python postcommit

2017-09-27 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2999: -- Summary: Split validatesrunner tests from Python postcommit Key: BEAM-2999 URL: https://issues.apache.org/jira/browse/BEAM-2999 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2813) error: option --test-pipeline-options not recognized

2017-08-28 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144523#comment-16144523 ] Mark Liu commented on BEAM-2813: Not sure if pinning a dependency will work since both pyasn1 and

[jira] [Comment Edited] (BEAM-2813) error: option --test-pipeline-options not recognized

2017-08-28 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144500#comment-16144500 ] Mark Liu edited comment on BEAM-2813 at 8/28/17 10:58 PM: -- I think this is a

[jira] [Commented] (BEAM-2813) error: option --test-pipeline-options not recognized

2017-08-28 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144500#comment-16144500 ] Mark Liu commented on BEAM-2813: I think this is a version mismatch in dependencies. This line may related

[jira] [Commented] (BEAM-2755) Wordcount it test fail

2017-08-11 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124110#comment-16124110 ] Mark Liu commented on BEAM-2755: This build run against my PR (https://github.com/apache/beam/pull/3688),

[jira] [Updated] (BEAM-2762) Coverage report for Python code

2017-08-10 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2762: --- Description: It's good to have code coverage in Python SDK to show the test coverage. Java is using

[jira] [Updated] (BEAM-2762) Coverage report for Python code

2017-08-10 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2762: --- Description: It's good to have code coverage in Python SDK to show the test coverage. Java is using

[jira] [Created] (BEAM-2762) Coverage report for Python code

2017-08-10 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2762: -- Summary: Coverage report for Python code Key: BEAM-2762 URL: https://issues.apache.org/jira/browse/BEAM-2762 Project: Beam Issue Type: Task Components:

[jira] [Commented] (BEAM-2648) beam_PerformanceTests_Python failing since 2017-07-17

2017-07-25 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101035#comment-16101035 ] Mark Liu commented on BEAM-2648: PR is merged. Recent Jenkins run passed.

[jira] [Commented] (BEAM-2648) beam_PerformanceTests_Python failing since 2017-07-17

2017-07-21 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096694#comment-16096694 ] Mark Liu commented on BEAM-2648: fix PR:

[jira] [Updated] (BEAM-2633) Update contribution guide to include information on running wordcount with modified sdk from head

2017-07-20 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2633: --- Description: [Quickstart-Python - Execute a pipeline locally -

[jira] [Created] (BEAM-2649) Add documents for performance test

2017-07-20 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2649: -- Summary: Add documents for performance test Key: BEAM-2649 URL: https://issues.apache.org/jira/browse/BEAM-2649 Project: Beam Issue Type: Task Components:

[jira] [Created] (BEAM-2633) Missing --sdk_location in Quickstart-Python - run wordcount.py with DataflowRunner

2017-07-18 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2633: -- Summary: Missing --sdk_location in Quickstart-Python - run wordcount.py with DataflowRunner Key: BEAM-2633 URL: https://issues.apache.org/jira/browse/BEAM-2633 Project: Beam

[jira] [Commented] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077350#comment-16077350 ] Mark Liu commented on BEAM-2542: Build back to stable:

[jira] [Resolved] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-2542. Resolution: Fixed Fix Version/s: Not applicable > Python performance test failed in Beam repo init >

[jira] [Closed] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-06 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-2542. -- > Python performance test failed in Beam repo init > > >

[jira] [Comment Edited] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075654#comment-16075654 ] Mark Liu edited comment on BEAM-2542 at 7/6/17 12:00 AM: - it's merged. Waiting for

[jira] [Commented] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075654#comment-16075654 ] Mark Liu commented on BEAM-2542: it's merged. Waiting for next scheduled run to verify the fix. > Python

[jira] [Commented] (BEAM-2542) Python performance test failed in Beam repo init

2017-07-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075476#comment-16075476 ] Mark Liu commented on BEAM-2542: PR: https://github.com/GoogleCloudPlatform/PerfKitBenchmarker/pull/1427 is

[jira] [Closed] (BEAM-2475) Add Jenkins Suite for Python Performance Test

2017-07-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-2475. -- > Add Jenkins Suite for Python Performance Test > - > >

[jira] [Resolved] (BEAM-2475) Add Jenkins Suite for Python Performance Test

2017-07-05 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu resolved BEAM-2475. Resolution: Done Fix Version/s: Not applicable > Add Jenkins Suite for Python Performance Test >

  1   2   3   >