Can you elucidate? All BeamSQL pipelines use schemas and I believe those test are working just fine on the Dataflow runner. In addition, there are a number of ValidatesRunner schema-aware pipelines that are running regularly on the Dataflow runner.
On Sun, Jan 12, 2020 at 1:43 AM Alex Van Boxel <[email protected]> wrote: > Hey all, > > anyone tried master with a *schema aware pipeline* on Dataflow? I'm > testing some PR's to see if the run on Dataflow (as they are working on > Direct) but they got: > > > Workflow failed. Causes: The Dataflow job appears to be stuck because no > worker activity has been seen in the last 1h. You can get help with Cloud > Dataflow at > > because I got this I wanted to see if master (without my changes) also > have the same behaviour. > > It's easy to simulate: Just read for BigQuery with: > > BigQueryIO.readTableRowsWithSchema() > > it works with the classic: readTableRows(). > > _/ > _/ Alex Van Boxel >
