[
https://issues.apache.org/jira/browse/NIFI-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15526242#comment-15526242
]
ASF GitHub Bot commented on NIFI-2811:
--------------------------------------
Github user mattyb149 commented on the issue:
https://github.com/apache/nifi/pull/1053
+1 Looks good to me, thank you for the fix! It's been very frustrating
trying to find out how each database handles various types, some return a
different JDBC type than the corresponding Java type, and some even differ from
each other if the underlying data type is signed or unsigned (which is what
happened in this case, the unsigned path was fixed in NIFI-2531 (#823) but the
signed path was not).
Tested with various bigint fields in different databases, signed bigint
fields with small values (represented in MySQL as java Longs) are processed
correctly. Merging to master.
> JdbcCommon doesn't convert bigint(20) column.
> ---------------------------------------------
>
> Key: NIFI-2811
> URL: https://issues.apache.org/jira/browse/NIFI-2811
> Project: Apache NiFi
> Issue Type: Bug
> Components: Extensions
> Affects Versions: 1.0.0
> Reporter: Byunghwa Yun
>
> JdbcCommon doesn't convert SQL-to-Avro that has bigint(20) column with the
> small value.
> Even column type is BIGINT(20), MySQL JDBC driver can return number type
> value when the return value is small.
> Related Exception:
> 2016-09-23 10:50:22,191 ERROR [Timer-Driven Process Thread-8]
> o.a.n.p.standard.QueryDatabaseTable
> org.apache.nifi.processor.exception.ProcessException: Error during database
> query or conversion of records to Avro.
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:255)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable$$Lambda$132/464322944.process(Unknown
> Source) ~[na:na]
> at
> org.apache.nifi.controller.repository.StandardProcessSession.write(StandardProcessSession.java:2123)
> ~[nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:249)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1064)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:132)
> [nifi-framework-core-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> [na:1.8.0_51]
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
> [na:1.8.0_51]
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> [na:1.8.0_51]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_51]
> Caused by: org.apache.avro.file.DataFileWriter$AppendWriteException:
> org.apache.avro.UnresolvedUnionException: Not in union ["null","string"]:
> 936398
> at
> org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:296)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.nifi.processors.standard.util.JdbcCommon.convertToAvroStream(JdbcCommon.java:207)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> at
> org.apache.nifi.processors.standard.QueryDatabaseTable.lambda$onTrigger$0(QueryDatabaseTable.java:253)
> ~[nifi-standard-processors-1.1.0-SNAPSHOT.jar:1.1.0-SNAPSHOT]
> ... 14 common frames omitted
> Caused by: org.apache.avro.UnresolvedUnionException: Not in union
> ["null","string"]: 936398
> at
> org.apache.avro.generic.GenericData.resolveUnion(GenericData.java:604)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.resolveUnion(GenericDatumWriter.java:151)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:71)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:114)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:104)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:66)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:58)
> ~[avro-1.7.7.jar:1.7.7]
> at
> org.apache.avro.file.DataFileWriter.append(DataFileWriter.java:290)
> ~[avro-1.7.7.jar:1.7.7]
> ... 16 common frames omitted
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
