Is “the result” being printed or viewed via debugger? Is there a chance
that the __repr__ or similar method for proto produces a dict strictly for
printing/serialization?
Thanks,
Evan
On Sun, Oct 17, 2021 at 01:50 Mark Striebeck <mark.strieb...@gmail.com>
wrote:
> Hi,
>
> I have the following BigQuery table:
>
> Name: DailyVwap
> Field name Type
> TIMESTAMP DATE
> SYMBOL_NAME STRING
> DAILY_VWAP STRING
> inserted_time TIMESTAMP
>
> I want to read it into the following proto:
> message DailyVwap {
> google.protobuf.Timestamp TIMESTAMP = 1;
> string SYMBOL_NAME = 2;
> float DAILY_VWAP = 3;
> google.protobuf.Timestamp inserted_time = 4;
> }
>
> This is the call that I make in my pipeline:
> ReadFromBigQuery(query='SELECT * FROM `my_project.my_dataset.DailyVwap`',
> use_standard_sql=True,
> project='my_project',
> coder=beam.coders.ProtoCoder(DailyVwap().__class__),
> gcs_location=temp_location)
>
> But the result is always a dictionary in the form:
> {'TIMESTAMP': datetime.date(2021, 9, 17), 'SYMBOL_NAME': 'AACIU',
> 'DAILY_VWAP': 'null', 'inserted_time': datetime.datetime(2021, 9, 27, 16,
> 45, 33, 779000, tzinfo=datetime.timezone.utc)}
>
> With or without the coder in the call. No error message or warning in the
> logs.
>
> Any help our pointer appreciated!
>
> Thanks
> Mark
>
