The GitHub Actions job "Tests (ARM)" on airflow.git/main has succeeded.
Run started by GitHub user potiuk (triggered by potiuk).

Head commit for run:
d74039c075138a43bde41663d8f82690abd53a73 / Shahar Epstein 
<[email protected]>
fix `BigQueryStreamingBufferEmptySensor.poke()` always raise `NotFound` (#66962)

* Fix BigQueryStreamingBufferEmptySensor failing against real BigQuery

The sensor passed the legacy ``project:dataset.table`` string to
``Client.get_table``, which only accepts a ``TableReference`` or a
standard-SQL ``project.dataset.table`` string. Against real BigQuery the
poke always raised ``NotFound``, so the system test DAG could never get
past ``check_streaming_buffer_empty``. Build an explicit
``TableReference`` instead, mirroring ``BigQueryHook.insert_all``.

Co-Authored-By: Claude Opus 4.7 <[email protected]>

* Fix streaming_insert in BigQuery sensors system test

The streaming_insert task passed rows in the {"json": {...}} REST-API
envelope to BigQueryHook.insert_all, which feeds them to the client
library's insert_rows -- that expects plain row dicts, so the insert
failed with "no such field: json" and no row was ever streamed. Pass
plain row dicts instead, and set fail_on_error=True so a broken
streaming insert fails the task loudly instead of silently no-ooping.

The misleading {"json": {...}} format came straight from the insert_all
docstring, so fix that (and its unit-test fixtures) too.

Co-Authored-By: Claude Opus 4.7 <[email protected]>

* Make BigQuery sensors system test resilient to streaming buffer metadata lag

BigQuery's streamingBuffer table metadata is eventually consistent: for a
few seconds after a streaming insert the row is in the buffer but
table.streaming_buffer is still None, so check_streaming_buffer_empty can
falsely pass before the buffer is reported at all. The streaming_insert
task now waits for the metadata to appear before completing, making the
system test deterministic.

This is a workaround for a known sensor limitation, documented in the
sensor docstring and tracked at
https://github.com/apache/airflow/issues/66963

Co-Authored-By: Claude Opus 4.7 <[email protected]>

---------

Co-authored-by: Claude Opus 4.7 <[email protected]>

Report URL: https://github.com/apache/airflow/actions/runs/25900695496

With regards,
GitHub Actions via GitBox


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to