[ 
https://issues.apache.org/jira/browse/BEAM-8098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anonymous updated BEAM-8098:
----------------------------
    Status: Triage Needed  (was: Resolved)

> BigQueryIO needs documentation on how data types in BigQuery and in Beam SDK 
> correspond
> ---------------------------------------------------------------------------------------
>
>                 Key: BEAM-8098
>                 URL: https://issues.apache.org/jira/browse/BEAM-8098
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>            Reporter: Robin Qiu
>            Assignee: Robin Qiu
>            Priority: P3
>             Fix For: 2.17.0
>
>          Time Spent: 40m
>  Remaining Estimate: 0h
>
> While working on [https://github.com/apache/beam/pull/9144], I realized there 
> is a gap in BigQueryIO documentation on mapping between data types defined in 
> BigQuery and in Beam SDK.
>  
> For example, if a user reads a BYTES field from BigQuery into Beam, it will 
> be represented as java.nio.ByteBuffer type in Beam Java SDK. The user will 
> need to do an explicit type cast to ByteBuffer in order to use the data, but 
> there is no easy way the user can know which type they should cast to, unless 
> digging into BigQueryIO's implementation (Java - Avro - BigQuery).



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to