[ 
https://issues.apache.org/jira/browse/BEAM-2001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aviem Zur updated BEAM-2001:
----------------------------
    Description: 
Currently, {{PAssert}} assertions may not happen and tests will pass while 
silently hiding issues.

For {{ValidatesRunner}} tests to truly validate a runner supports the model we 
need to verify the {{PAssert}} assertions actually ran.

See [dev list 
discussion|https://lists.apache.org/thread.html/9e6b9e6a21d2a657a1dd293b8cc8497c76a8a66fa3a1358733c02101@%3Cdev.beam.apache.org%3E].

In order to reduce duplication, for runners which support metrics we could 
verify this in {{TestPipeline}}, removing the need for the runner itself to 
make this assertion (See https://issues.apache.org/jira/browse/BEAM-1763).

  was:
Currently, {{PAssert}} assertions may not happen and tests will pass while 
silently hiding issues.

For {{ValidatesRunner}} tests to truly validate a runner supports the model we 
need to verify the {{PAssert}} assertions actually ran.

See [dev list 
discussion|https://lists.apache.org/thread.html/9e6b9e6a21d2a657a1dd293b8cc8497c76a8a66fa3a1358733c02101@%3Cdev.beam.apache.org%3E].

In order to reduce duplication, for runners which support metrics we could 
verify this in {{TestPipeline}}, removing the need for the runner itself to 
make this assertion.


> Verify PAssert execution in all runners
> ---------------------------------------
>
>                 Key: BEAM-2001
>                 URL: https://issues.apache.org/jira/browse/BEAM-2001
>             Project: Beam
>          Issue Type: Test
>          Components: runner-core
>            Reporter: Aviem Zur
>            Assignee: Kenneth Knowles
>            Priority: Blocker
>
> Currently, {{PAssert}} assertions may not happen and tests will pass while 
> silently hiding issues.
> For {{ValidatesRunner}} tests to truly validate a runner supports the model 
> we need to verify the {{PAssert}} assertions actually ran.
> See [dev list 
> discussion|https://lists.apache.org/thread.html/9e6b9e6a21d2a657a1dd293b8cc8497c76a8a66fa3a1358733c02101@%3Cdev.beam.apache.org%3E].
> In order to reduce duplication, for runners which support metrics we could 
> verify this in {{TestPipeline}}, removing the need for the runner itself to 
> make this assertion (See https://issues.apache.org/jira/browse/BEAM-1763).



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to