[
https://issues.apache.org/jira/browse/NIFI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526011#comment-15526011
]
ASF GitHub Bot commented on NIFI-2811:
--------------------------------------
Github user combineads commented on the issue:
https://github.com/apache/nifi/pull/1053
Hello. @mattyb149.
Could you review this PR?
Actually, we have this problem.
My System has bigint(20) type column in MySql with some small value. e.i.
936398
At the time NiFi throws below an exception.
Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException:
org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]: 936398
Please, review this. We operate own NiFi branch because this issue doesn't
merge master branch.
I hope to use NiFi master branch one day soon.
Thank you for your effort.
> JdbcCommon doesn't convert bigint(20) column.
> ---------------------------------------------
>
> Key: NIFI-2811
> URL: https://issues.apache.org/jira/browse/NIFI-2811
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.0.0
> Reporter: Byunghwa Yun
>
> JdbcCommon doesn't convert SQL-to-Avro that has bigint(20) column with the
> small value.
> Even column type is BIGINT(20), MySQL JDBC driver can return number type
> value when the return value is small.
> Related Exception:
> 2016-09-23 10:50:22,191 ERROR [Timer-Driven Process Thread-8]
> o.a.n.p.standard.QueryDatabaseTable
> org.apache.nifi.processor.exception.ProcessException: Error during database
> query or conversion of records to Avro.
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:255)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable$$Lambda$132/464322944.process(Unknown
> Source) ~[na:na]
> at
> org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2123)
> ~[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:249)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1064)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_51]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException:
> org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]:
> 936398
> at
> org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:296)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.nifi.processors.standard.util.JdbcCommon.convertToAvroStream(JdbcCommon.java:207)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:253)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> ... 14 common frames omitted
> Caused by: org.apache.avro.UnresolvedUnionException: Not in union
> ["null","string"]: 936398
> at
> org.apache.avro.generic.GenericData.resolveUnion(GenericData.java:604)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:151)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:71)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:114)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:58)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:290)
> ~[avro-1.7.7.jar:1.7.7]
> ... 16 common frames omitted
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
