[
https://issues.apache.org/jira/browse/BEAM-9652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Luke Cwik resolved BEAM-9652.
-----------------------------
Resolution: Fixed
> BigQueryIO MultiPartitionsWriteTables fails with ClassCastException:
> java.lang.Object cannot be cast to org.apache.beam.sdk.values.KV
> -------------------------------------------------------------------------------------------------------------------------------------
>
> Key: BEAM-9652
> URL: https://issues.apache.org/jira/browse/BEAM-9652
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Affects Versions: 2.19.0
> Reporter: Luke Cwik
> Assignee: Luke Cwik
> Priority: Major
> Fix For: 2.21.0
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> It looks like the coder inference fails for BatchLoad.writeTempTables and
> selects an avro coder:
> {code:java}
> object_value: <
> type: "org.apache.beam.sdk.coders.AvroCoder"
> parameters: <
> name: "type"
> value: <
> string_value: "java.lang.Object"
> >
> >
> parameters: <
> name: "schema"
> value: <
> string_value:
> "{\"type\":\"record\",\"name\":\"Object\",\"namespace\":\"java.lang\",\"fields\":[]}"
> >
> >
> {code}
> Full exception:
> {code:java}
> exception: "java.lang.ClassCastException: java.lang.Object cannot be cast to
> org.apache.beam.sdk.values.KV at
> org.apache.beam.sdk.coders.KvCoder.registerByteSizeObserver(KvCoder.java:36)
> at
> org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:191)
> at
> org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)
> at
> org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:623)
> at
> org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:539)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$ElementByteSizeObservableCoder.registerByteSizeObserver(IntrinsicMapTaskExecutorFactory.java:400)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
