Julien G. created NIFI-13630:
--------------------------------
Summary: Avro MAP type doesn't work with the PutBigQuery processor
Key: NIFI-13630
URL: https://issues.apache.org/jira/browse/NIFI-13630
Project: Apache NiFi
Issue Type: Improvement
Reporter: Julien G.
Attachments: schema.avsc
When writing a record with the map to BigQuery using the PutBigQuery processor.
The processor fails to generate the Proto message with the following error. You
can find the avro schema and the BigQuery schema attached to the issue.
{code:java}
2024-08-05 14:51:23,493 ERROR [Timer-Driven Process Thread-10]
o.a.n.p.gcp.bigquery.PutBigQuery
PutBigQuery[id=f5225062-a703-1f89-ffff-ffffea37b541] Stream processing failed
java.lang.ClassCastException: class java.util.HashMap cannot be cast to class
java.util.Collection (java.util.HashMap and java.util.Collection are in module
java.base of loader 'bootstrap') at
org.apache.nifi.processors.gcp.bigquery.proto.ProtoUtils.createMessage(ProtoUtils.java:49)
at
org.apache.nifi.processors.gcp.bigquery.proto.ProtoUtils.createMessage(ProtoUtils.java:52)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.recordToProtoMessage(PutBigQuery.java:289)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.writeRecordsToStream(PutBigQuery.java:263)
at
org.apache.nifi.processors.gcp.bigquery.PutBigQuery.onTrigger(PutBigQuery.java:247)
at
org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
at
org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1361)
at
org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:247)
at
org.apache.nifi.controller.scheduling.AbstractTimeBasedSchedulingAgent.lambda$doScheduleOnce$0(AbstractTimeBasedSchedulingAgent.java:59)
at
org.apache.nifi.engine.FlowEngine$2.run(FlowEngine.java:110)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at
java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Unknown
Source)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)