tvalentyn commented on PR #40345: URL: https://github.com/apache/beam/pull/40345#issuecomment-5915324745
looks like test suites fail on master too as per ## Integration test triage — PR #40345 _apache/beam @ 43e878dd4 · 6 failing job(s) · triaged in 28.5s_ **12 failing test(s)** across 6 suite(s) — **5 distinct root cause(s)**. > [!WARNING] > At least one failure looks like a **real defect**, not a flake. | Failing suite | Jobs | Failures | On `master` | |---|---|---|---| | PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) | 1 | 3 | [❌ failing (1h ago)](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python.yml?query=branch%3Amaster) — `gha_triage https://github.com/apache/beam/actions/runs/36735247726` | | PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14) | 1 | 3 | [❌ failing (1h ago)](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python.yml?query=branch%3Amaster) — `gha_triage https://github.com/apache/beam/actions/runs/36735247726` | | PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) | 1 | 3 | [❌ failing (1h ago)](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python_Coverage.yml?query=branch%3Amaster) — `gha_triage https://github.com/apache/beam/actions/runs/36732375686` | | PreCommit Python / Python 3.10 Test Results ()<br>ⓘ _published via the Checks API — not a job in this workflow_ | 1 | 1 | [❌ failing (1h ago)](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python.yml?query=branch%3Amaster) — `gha_triage https://github.com/apache/beam/actions/runs/36735247726` | | PreCommit Python / Test Results<br>ⓘ _published via the Checks API — not a job in this workflow_ | 1 | 1 | [❌ failing (1h ago)](https://github.com/apache/beam/actions/workflows/beam_PreCommit_Python.yml?query=branch%3Amaster) — `gha_triage https://github.com/apache/beam/actions/runs/36735247726` | | Build python source distribution and wheels / Build python cp310- wheels on auto for ubuntu-24.04 | 1 | 1 | [✅ passing (1h ago)](https://github.com/apache/beam/actions/workflows/build_wheels.yml?query=branch%3Amaster) | | # | Suite | Verdict | Tests | Root cause | |---|-------|---------|-------|------------| | 1 | PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) (+2) | LIKELY REAL BUG | 6 | AssertionError: Exception not raised | | 2 | PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) (+2) | LIKELY REAL BUG | 3 | AssertionError: False is not true : Did not find write call metric with status: already_exists | | 3 | PreCommit Python / Python 3.10 Test Results () | unknown | 1 | test_write_batch_error_surfaces_from_async_flush (apache_beam.io.gcp.bigtableio_test.TestWriteBigTable) failed — sdks/py | | 4 | PreCommit Python / Test Results | unknown | 1 | classMethod (org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsubE2ETest) failed — examples/java/build/test-res | | 5 | Build python source distribution and wheels / Build python cp310- wheels on auto for ubuntu-24.04 | not a test failure | 1 | Process completed with exit code 1. | ### 1. LIKELY REAL BUG — TestWriteBigTable (+5 more) **Suite:** PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10), PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14), PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) **Root cause:** `AssertionError: Exception not raised` **Why this verdict:** a test assertion failed **Affected tests:** - `TestWriteBigTable.test_write_batch_error_surfaces_from_async_flush` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589722859) - `TestWriteBigTable.test_write_batch_error_surfaces_from_buffered_rows` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589722859) - `TestWriteBigTable.test_write_batch_error_surfaces_from_async_flush` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589723078) - `TestWriteBigTable.test_write_batch_error_surfaces_from_buffered_rows` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589723078) - `TestWriteBigTable.test_write_batch_error_surfaces_from_async_flush` (0s) — PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081479/job/109589726959) - `TestWriteBigTable.test_write_batch_error_surfaces_from_buffered_rows` (0s) — PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081479/job/109589726959) <details><summary>Log excerpt</summary> ``` [gw5] linux -- Python 3.10.21 /runner/_work/beam/beam/sdks/python/test-suites/tox/py310/build/srcs/sdks/python/target/.tox-py310-cloud/py310-cloud/bin/python self = <apache_beam.io.gcp.bigtableio_test.TestWriteBigTable testMethod=test_write_batch_error_surfaces_from_async_flush> def test_write_batch_error_surfaces_from_async_flush(self): write_fn = bigtableio._BigTableWriteFn( self._PROJECT_ID, self._INSTANCE_ID, self._TABLE_ID, flush_count=1, max_row_bytes=5242880) write_fn.table = self.table write_fn.start_bundle() direct_rows = [self.generate_row(i) for i in range(5)] with patch.object(Table, 'mutate_rows', side_effect=Exception('batch RPC failed')): for direct_row in direct_rows: write_fn.process(direct_row) > with self.assertRaises(Exception): E AssertionError: Exception not raised apache_beam/io/gcp/bigtableio_test.py:359: AssertionError ``` </details> ### 2. LIKELY REAL BUG — TestWriteBigTable (+2 more) **Suite:** PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10), PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14), PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) **Root cause:** `AssertionError: False is not true : Did not find write call metric with status: already_exists` **Why this verdict:** a test assertion failed **Affected tests:** - `TestWriteBigTable.test_write_metrics` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589722859) - `TestWriteBigTable.test_write_metrics` (0s) — PreCommit Python / beam_PreCommit_Python (Run Python PreCommit 3.14) — [job log](https://github.com/apache/beam/actions/runs/36622081228/job/109589723078) - `TestWriteBigTable.test_write_metrics` (0s) — PreCommit Python Coverage / beam_PreCommit_Python_Coverage (Run Python_Coverage PreCommit 3.10) — [job log](https://github.com/apache/beam/actions/runs/36622081479/job/109589726959) **Where (app code):** ``` apache_beam/io/gcp/bigtableio_test.py:438 in verify_write_call_metric ``` <details><summary>Log excerpt</summary> ``` [gw5] linux -- Python 3.10.21 /runner/_work/beam/beam/sdks/python/test-suites/tox/py310/build/srcs/sdks/python/target/.tox-py310-cloud/py310-cloud/bin/python self = <apache_beam.io.gcp.bigtableio_test.TestWriteBigTable testMethod=test_write_metrics> def test_write_metrics(self): MetricsEnvironment.process_wide_container().reset() write_fn = bigtableio._BigTableWriteFn( self._PROJECT_ID, self._INSTANCE_ID, self._TABLE_ID, flush_count=1000, max_row_bytes=5242880) write_fn.table = self.table write_fn.start_bundle() number_of_rows = 2 error = Status() error.message = 'Entity already exists.' error.code = ALREADY_EXISTS success = Status() success.message = 'Success' success.code = OK rows_response = [error, success] * number_of_rows with patch.object(Table, 'mutate_rows', return_value=rows_response): direct_rows = [self.generate_row(i) for i in range(number_of_rows * 2)] for direct_row in direct_rows: write_fn.process(direct_row) try: write_fn.finish_bundle() except: # pylint: disable=bare-except # Currently we fail the bundle when there are any failures. # TODO(https://github.com/apache/beam/issues/21396): remove after # bigtableio can selectively retry. ``` </details> ### 3. unknown — job-level failure **Suite:** PreCommit Python / Python 3.10 Test Results () **Root cause:** `test_write_batch_error_surfaces_from_async_flush (apache_beam.io.gcp.bigtableio_test.TestWriteBigTable) failed — sdks/python/test-suites/tox/py310/build/srcs/sdks/python/pytest_py310-cloudcoverage.xml [took 0s]` **Why this verdict:** published via the Checks API — not a job in this workflow **Affected tests:** - `job-level failure.PreCommit Python / Python 3.10 Test Results ()` (0s) — PreCommit Python / Python 3.10 Test Results () — [job log](https://github.com/apache/beam/runs/109605936238) <details><summary>Log excerpt</summary> ``` test_write_batch_error_surfaces_from_async_flush (apache_beam.io.gcp.bigtableio_test.TestWriteBigTable) failed — sdks/python/test-suites/tox/py310/build/srcs/sdks/python/pytest_py310-cloudcoverage.xml [took 0s] test_write_batch_error_surfaces_from_buffered_rows (apache_beam.io.gcp.bigtableio_test.TestWriteBigTable) failed — sdks/python/test-suites/tox/py310/build/srcs/sdks/python/pytest_py310-cloudcoverage.xml [took 0s] test_write_metrics (apache_beam.io.gcp.bigtableio_test.TestWriteBigTable) failed — sdks/python/test-suites/tox/py310/build/srcs/sdks/python/pytest_py310-cloudcoverage.xml [took 1s] ``` </details> ### 4. unknown — job-level failure **Suite:** PreCommit Python / Test Results **Root cause:** `classMethod (org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsubE2ETest) failed — examples/java/build/test-results/test/TEST-org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsubE2ETest.xml [took 0s]` **Why this verdict:** published via the Checks API — not a job in this workflow **Affected tests:** - `job-level failure.PreCommit Python / Test Results` (0s) — PreCommit Python / Test Results — [job log](https://github.com/apache/beam/runs/109636758904) <details><summary>Log excerpt</summary> ``` classMethod (org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsubE2ETest) failed — examples/java/build/test-results/test/TEST-org.apache.beam.examples.complete.kafkatopubsub.KafkaToPubsubE2ETest.xml [took 0s] ``` </details> ### 5. not a test failure — job-level failure **Suite:** Build python source distribution and wheels / Build python cp310- wheels on auto for ubuntu-24.04 **Root cause:** `Process completed with exit code 1.` **Why this verdict:** job failed outside of a test (policy check, setup, runner, or timeout) **Affected tests:** - `job-level failure.Build python source distribution and wheels / Build python cp310- wheels on auto for ubuntu-24.04` (0s) — Build python source distribution and wheels / Build python cp310- wheels on auto for ubuntu-24.04 — [job log](https://github.com/apache/beam/actions/runs/36622085357/job/109590372347) <details><summary>Log excerpt</summary> ``` Process completed with exit code 1. ``` </details> _This tool can make mistakes. It is only meant to surface errors faster, and may not surface all of them accurately._ _Generated by gha_triage_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
