[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-12-21 Thread Udi Meiri (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726998#comment-16726998
 ] 

Udi Meiri commented on BEAM-5779:
-

Went away on its own. Closing, please reopen if this happens again.

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
> Fix For: Not applicable
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-23 Thread Udi Meiri (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661104#comment-16661104
 ] 

Udi Meiri commented on BEAM-5779:
-

Still failing: 
https://builds.apache.org/job/beam_PostCommit_Python_Verify/6354/consoleFull

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657103#comment-16657103
 ] 

Udi Meiri commented on BEAM-5779:
-

I think the error in 6321 is similar in nature: the job was cancelled 
(successfully this time) before it managed to process and write the expected 
output.

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657078#comment-16657078
 ] 

Udi Meiri commented on BEAM-5779:
-

Sadly it doesn't. The on_success_matcher is only run after the "timeout". Since 
it's a streaming job it always times out.

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Kenneth Knowles (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657063#comment-16657063
 ] 

Kenneth Knowles commented on BEAM-5779:
---

https://builds.apache.org/job/beam_PostCommit_Python_Verify/6321/

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Udi Meiri (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657012#comment-16657012
 ] 

Udi Meiri commented on BEAM-5779:
-

The log from 6317 shows TestDataflowRunner attempting to cancel the job at 
about 17:27:40 (expected since streaming jobs never end).
However, the job is still starting up and fails at 17:28:07 with the message:

Workflow failed. Causes: Step 
"setup_resource_projects/apache-beam-testing/subscriptions/psit_subscription_input1a6def20-8a5b-4de7-a10b-609290f545b4__df_internale53817409a1b9ef015"
 failed., Step 
setup_resource_projects/apache-beam-testing/subscriptions/psit_subscription_input1a6def20-8a5b-4de7-a10b-609290f545b4__df_internale53817409a1b9ef015:
 Set up of resource 
projects/apache-beam-testing/subscriptions/psit_subscription_input1a6def20-8a5b-4de7-a10b-609290f545b4__df_internale53817409a1b9ef0
 failed, Getting metadata for pubsub subscription 
projects/apache-beam-testing/subscriptions/psit_subscription_input1a6def20-8a5b-4de7-a10b-609290f545b4
 failed with error: Resource not found 
(resource=psit_subscription_input1a6def20-8a5b-4de7-a10b-609290f545b4).

I believe increasing TEST_PIPELINE_DURATION_MS, which affects how long we wait 
for the pipeline to complete.
I think I set it aggressively low at 30s, while streaming_wordcount_it_test 
uses 3m.

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Udi Meiri
>Priority: Major
>  Labels: flake
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

2018-10-19 Thread Kenneth Knowles (JIRA) 


[ 
https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656971#comment-16656971
 ] 

Kenneth Knowles commented on BEAM-5779:
---

This now occurred in the Cron of the Python precommit. Checking the job, no 
messages were read from pubsub. A flaky initialization maybe?

> Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow
> --
>
> Key: BEAM-5779
> URL: https://issues.apache.org/jira/browse/BEAM-5779
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Kenneth Knowles
>Assignee: Ahmet Altay
>Priority: Major
>  Labels: flake
>
> https://builds.apache.org/job/beam_PostCommit_Python_Verify/6296/
> Path to failure:
> * (Jenkins) beam_PostCommit_Python_Verify
> * (gradle) :beam-sdks-python:postCommitITTests
> * (py module) test_streaming_data_only
> * (test class) 
> apache_beam.io.gcp.pubsub_integration_test.PubSubIntegrationTest
> {code}
> AssertionError: 
> Expected: (Test pipeline expected terminated in state: RUNNING and Expected 2 
> messages.)
>  but: Expected 2 messages. Got 0 messages. Diffs (item, count):
>   Expected but not in actual: [('data002-seen', 1), ('data001-seen', 1)]
>   Unexpected: []
> {code}
> Looks like a legitimate failure. It is flakey as it went green later.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)