[ https://issues.apache.org/jira/browse/FLINK-33039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874152#comment-17874152 ]
Nicolas Ferrario commented on FLINK-33039: ------------------------------------------ Same here. It also happens when reading Parquet files using an Avro schema with logical types. > Avro Specific Record Logical timestamp is not serialized in Parquet > ------------------------------------------------------------------- > > Key: FLINK-33039 > URL: https://issues.apache.org/jira/browse/FLINK-33039 > Project: Flink > Issue Type: Bug > Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile) > Affects Versions: 1.17.1 > Reporter: Ahmed Elhassany > Priority: Major > > I'm trying to save a SpecificRecord to S3 Parquet, which contains a field > with a logical timestmap. It's defined as > {code:java} > { > "name": "ts", > "type": { > "type": "long", > "logicalType": "timestamp-millis" > } > } > {code} > And I'm using the following method to save it > {code:java} > final FileSink<MyObj> sinkFlowAggregationAvro = > FileSink.forBulkFormat(path, > AvroParquetWriters.forSpecificRecord(MyObj.class)) > .withOutputFileConfig(OutputFileConfig > .builder() > .withPartSuffix(".parquet") > .build()) > .build(); {code} > > However, I'm getting the following casting errors: > > {noformat} > flink-taskmanager-b467cbff9-n28zp taskmanager > 2023-09-05T16:10:02.124425478+02:00 Caused by: java.lang.ClassCastException: > class java.time.Instant cannot be cast to class java.lang.Number > (java.time.Instant and java.lang.Number are in module java.base of loader > 'bootstrap') > flink-taskmanager-b467cbff9-n28zp taskmanager > 2023-09-05T16:10:02.124425478+02:00 at > org.apache.parquet.avro.AvroWriteSupport.writeValueWithoutConversion(AvroWriteSupport.java:340) > > ~[blob_p-22acff48719adf70603f57842bd158d7f5538a47-e40c3e350efab078d53261fe2bc38640:?] > flink-taskmanager-b467cbff9-wt8p9 taskmanager > 2023-09-05T16:10:01.868385407+02:00 at > org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29) > ~[flink-dist-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-n28zp taskmanager > 2023-09-05T16:10:02.124425478+02:00 at > org.apache.parquet.avro.AvroWriteSupport.writeValue(AvroWriteSupport.java:288) > > ~[blob_p-22acff48719adf70603f57842bd158d7f5538a47-e40c3e350efab078d53261fe2bc38640:?] > flink-taskmanager-b467cbff9-wt8p9 taskmanager > 2023-09-05T16:10:01.868385407+02:00 at > org.apache.flink.streaming.api.operators.StreamFilter.processElement(StreamFilter.java:39) > ~[flink-dist-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-wt8p9 taskmanager > 2023-09-05T16:10:01.868385407+02:00 at > org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput.java:75) > ~[flink-dist-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-wt8p9 taskmanager > 2023-09-05T16:10:01.868385407+02:00 ... 21 more > flink-taskmanager-b467cbff9-m5gdt taskmanager > 2023-09-05T16:10:01.979428558+02:00 at > org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.collect(CopyingChainingOutput.java:29) > ~[flink-dist-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-wt8p9 taskmanager > 2023-09-05T16:10:01.868385407+02:00 Caused by: > org.apache.flink.streaming.runtime.tasks.ExceptionInChainedOperatorException: > Could not forward element to next operator > flink-taskmanager-b467cbff9-2xn5w taskmanager > 2023-09-05T16:10:01.871644827+02:00 at > org.apache.flink.connector.base.source.reader.SourceReaderBase.pollNext(SourceReaderBase.java:144) > ~[flink-connector-base-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-m5gdt taskmanager > 2023-09-05T16:10:01.979428558+02:00 at > org.apache.flink.streaming.api.operators.StreamFilter.processElement(StreamFilter.java:39) > ~[flink-dist-1.17.1.jar:1.17.1] > flink-taskmanager-b467cbff9-pqjqr taskmanager > 2023-09-05T16:10:02.276107852+02:00 ... 21 more > flink-taskmanager-b467cbff9-m5gdt taskmanager > 2023-09-05T16:10:01.979428558+02:00 at > org.apache.flink.streaming.runtime.tasks.CopyingChainingOutput.pushToOperator(CopyingChainingOutput^Cflink-taskmanager-b467cbff9-m5gdt > taskmanager 2023-09-05T16:10:01.979428558+02:00 ... 21 more{noformat} -- This message was sent by Atlassian Jira (v8.20.10#820010)