Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-13611: CrossLanguageJdbcIOTest.test_xlang_jdbc_write failing in Python PostCommits (created 2022-01-07) https://issues.apache.org/jira/browse/BEAM-13575: Flink testParDoRequiresStableInput flaky (created 2021-12-28) https://issues.apache.org/jira/browse/BEAM-13525: Java VR (Dataflow, V2, Streaming) failing: ParDoTest$TimestampTests/OnWindowExpirationTests (created 2021-12-22) https://issues.apache.org/jira/browse/BEAM-13519: Java precommit flaky (timing out) (created 2021-12-22) https://issues.apache.org/jira/browse/BEAM-13453: Flake in org.apache.beam.sdk.io.mqtt.MqttIOTest.testReadObject: Address already in use (created 2021-12-13) https://issues.apache.org/jira/browse/BEAM-13367: [beam_PostCommit_Python36] [ apache_beam.io.gcp.experimental.spannerio_read_it_test] Failure summary (created 2021-12-01) https://issues.apache.org/jira/browse/BEAM-13312: org.apache.beam.sdk.transforms.ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundle is flaky in Java Spark ValidatesRunner suite (created 2021-11-23) https://issues.apache.org/jira/browse/BEAM-13311: org.apache.beam.sdk.transforms.ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElementStateful is flaky in Java ValidatesRunner Flink suite. (created 2021-11-23) https://issues.apache.org/jira/browse/BEAM-13234: Flake in StreamingWordCountIT.test_streaming_wordcount_it (created 2021-11-12) https://issues.apache.org/jira/browse/BEAM-13083: XVR Flink and XVR Spark failing (created 2021-10-20) https://issues.apache.org/jira/browse/BEAM-13025: pubsublite.ReadWriteIT flaky in beam_PostCommit_Java_DataflowV2 (created 2021-10-08) https://issues.apache.org/jira/browse/BEAM-12928: beam_PostCommit_Python36 - CrossLanguageSpannerIOTest - flakey failing (created 2021-09-21) https://issues.apache.org/jira/browse/BEAM-12859: org.apache.beam.runners.dataflow.worker.fn.logging.BeamFnLoggingServiceTest.testMultipleClientsFailingIsHandledGracefullyByServer is flaky (created 2021-09-08) https://issues.apache.org/jira/browse/BEAM-12858: org.apache.beam.sdk.io.gcp.datastore.RampupThrottlingFnTest.testRampupThrottler is flaky (created 2021-09-08) https://issues.apache.org/jira/browse/BEAM-12809: testTwoTimersSettingEachOtherWithCreateAsInputBounded flaky (created 2021-08-26) https://issues.apache.org/jira/browse/BEAM-12794: PortableRunnerTestWithExternalEnv.test_pardo_timers flaky (created 2021-08-24) https://issues.apache.org/jira/browse/BEAM-12793: beam_PostRelease_NightlySnapshot failed (created 2021-08-24) https://issues.apache.org/jira/browse/BEAM-12766: Already Exists: Dataset apache-beam-testing:python_bq_file_loads_NNN (created 2021-08-16) https://issues.apache.org/jira/browse/BEAM-12515: Python PreCommit flaking in PipelineOptionsTest.test_display_data (created 2021-06-18) https://issues.apache.org/jira/browse/BEAM-12322: Python precommit flaky: Failed to read inputs in the data plane (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12320: PubsubTableProviderIT.testSQLSelectsArrayAttributes[0] failing in SQL PostCommit (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-11837: Java build flakes: "Memory constraints are impeding performance" (created 2021-02-18) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11641: Bigquery Read tests are flaky on Flink runner in Python PostCommit suites (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (FlinkJobNotFoundException) (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
Flaky test issue report (40)
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to determine the quality of the software. https://issues.apache.org/jira/browse/BEAM-12322: FnApiRunnerTestWithGrpcAndMultiWorkers flaky (py precommit) (created 2021-05-10) https://issues.apache.org/jira/browse/BEAM-12309: PubSubIntegrationTest.test_streaming_data_only flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12307: PubSubBigQueryIT.test_file_loads flake (created 2021-05-07) https://issues.apache.org/jira/browse/BEAM-12303: Flake in PubSubIntegrationTest.test_streaming_with_attributes (created 2021-05-06) https://issues.apache.org/jira/browse/BEAM-12293: FlinkSavepointTest.testSavepointRestoreLegacy flakes due to FlinkJobNotFoundException (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12291: org.apache.beam.runners.flink.ReadSourcePortableTest.testExecution[streaming: false] is flaky (created 2021-05-05) https://issues.apache.org/jira/browse/BEAM-12200: SamzaStoreStateInternalsTest is flaky (created 2021-04-20) https://issues.apache.org/jira/browse/BEAM-12163: Python GHA PreCommits flake with grpc.FutureTimeoutError on SDK harness startup (created 2021-04-13) https://issues.apache.org/jira/browse/BEAM-12061: beam_PostCommit_SQL failing on KafkaTableProviderIT.testFakeNested (created 2021-03-27) https://issues.apache.org/jira/browse/BEAM-12019: apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized.test_flink_metrics is flaky (created 2021-03-18) https://issues.apache.org/jira/browse/BEAM-11792: Python precommit failed (flaked?) installing package (created 2021-02-10) https://issues.apache.org/jira/browse/BEAM-11666: apache_beam.runners.interactive.recording_manager_test.RecordingManagerTest.test_basic_execution is flaky (created 2021-01-20) https://issues.apache.org/jira/browse/BEAM-11662: elasticsearch tests failing (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11661: hdfsIntegrationTest flake: network not found (py38 postcommit) (created 2021-01-19) https://issues.apache.org/jira/browse/BEAM-11645: beam_PostCommit_XVR_Flink failing (created 2021-01-15) https://issues.apache.org/jira/browse/BEAM-11541: testTeardownCalledAfterExceptionInProcessElement flakes on direct runner. (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-11540: Linter sometimes flakes on apache_beam.dataframe.frames_test (created 2020-12-30) https://issues.apache.org/jira/browse/BEAM-10995: Java + Universal Local Runner: WindowingTest.testWindowPreservation fails (created 2020-09-30) https://issues.apache.org/jira/browse/BEAM-10987: stager_test.py::StagerTest::test_with_main_session flaky on windows py3.6,3.7 (created 2020-09-29) https://issues.apache.org/jira/browse/BEAM-10968: flaky test: org.apache.beam.sdk.metrics.MetricsTest$AttemptedMetricTests.testAttemptedDistributionMetrics (created 2020-09-25) https://issues.apache.org/jira/browse/BEAM-10955: Flink Java Runner test flake: Could not find Flink job (created 2020-09-23) https://issues.apache.org/jira/browse/BEAM-10866: PortableRunnerTestWithSubprocesses.test_register_finalizations flaky on macOS (created 2020-09-09) https://issues.apache.org/jira/browse/BEAM-10504: Failure / flake in ElasticSearchIOTest > testWriteFullAddressing and testWriteWithIndexFn (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10501: CheckGrafanaStalenessAlerts and PingGrafanaHttpApi fail with Connection refused (created 2020-07-15) https://issues.apache.org/jira/browse/BEAM-10485: Failure / flake: ElasticsearchIOTest > testWriteWithIndexFn (created 2020-07-14) https://issues.apache.org/jira/browse/BEAM-9649: beam_python_mongoio_load_test started failing due to mismatched results (created 2020-03-31) https://issues.apache.org/jira/browse/BEAM-9392: TestStream tests are all flaky (created 2020-02-27) https://issues.apache.org/jira/browse/BEAM-9232: BigQueryWriteIntegrationTests is flaky coercing to Unicode (created 2020-01-31) https://issues.apache.org/jira/browse/BEAM-9119: apache_beam.runners.portability.fn_api_runner_test.FnApiRunnerTest[...].test_large_elements is flaky (created 2020-01-14) https://issues.apache.org/jira/browse/BEAM-8101: Flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundleStateful for Direct, Spark, Flink (created 2019-08-27) https://issues.apache.org/jira/browse/BEAM-8035: [beam_PreCommit_Java_Phrase] [WatchTest.testMultiplePollsWithManyResults] Flake: Outputs must be in timestamp order (created 2019-08-22) https://issues.apache.org/jira/browse/BEAM-7992: Unhandled type_constraint in
