Re: BigQueryIO TableRow ARRAY fields

2019-05-19 Thread Charith Ellawala
Thanks Reuven. That is what I suspected. On 2019/05/19 16:28:13, Reuven Lax wrote: > The code to convert a TableRow to a Beam row is very new, and hasn't been> > tested extensively. It would not surprise me if there are bugs in it.> > > On Sun, May 19, 2019 at 8:13 AM Charith Ellawala > > wrote:>

Re: BigQueryIO TableRow ARRAY fields

2019-05-19 Thread Reuven Lax
The code to convert a TableRow to a Beam row is very new, and hasn't been tested extensively. It would not surprise me if there are bugs in it. On Sun, May 19, 2019 at 8:13 AM Charith Ellawala wrote: > Hi, > > I am working on adding schema support to BigQuery reads (BEAM-6673) and I > am a bit c

BigQueryIO TableRow ARRAY fields

2019-05-19 Thread Charith Ellawala
Hi, I am working on adding schema support to BigQuery reads (BEAM-6673) and I am a bit confused by two contradictory code paths that deal with ARRAY type fields in TableRow objects. The TableRowParser implementation in BigQueryIO ultimately calls BigQueryAvroUtils#convertRepeatedField ( https://g