chennurchaitanya opened a new issue, #11070:
URL: https://github.com/apache/iceberg/issues/11070
select * from <tablename>$files
Caused by: org.apache.iceberg.exceptions.RuntimeIOException: Failed to open
file:
s3a://siem-datamarts/datamarts/dm_bigipasm/metadata/a5cfd565-eb2e-4aa3-b39f-73d7921458dd-m0.avro
at
org.apache.iceberg.avro.AvroIterable.newFileReader(AvroIterable.java:104)
at org.apache.iceberg.avro.AvroIterable.iterator(AvroIterable.java:77)
at
org.apache.iceberg.io.CloseableIterable$7$1.<init>(CloseableIterable.java:188)
at
org.apache.iceberg.io.CloseableIterable$7.iterator(CloseableIterable.java:187)
at
org.apache.iceberg.io.CloseableIterable.lambda$filter$0(CloseableIterable.java:109)
at
org.apache.iceberg.io.CloseableIterable$2.iterator(CloseableIterable.java:72)
at
org.apache.iceberg.io.CloseableIterable.lambda$filter$1(CloseableIterable.java:136)
at
org.apache.iceberg.io.CloseableIterable$2.iterator(CloseableIterable.java:72)
at
org.apache.iceberg.io.CloseableIterable$7$1.<init>(CloseableIterable.java:188)
at
org.apache.iceberg.io.CloseableIterable$7.iterator(CloseableIterable.java:187)
at org.apache.iceberg.ManifestGroup$1.iterator(ManifestGroup.java:346)
at org.apache.iceberg.ManifestGroup$1.iterator(ManifestGroup.java:304)
at
org.apache.iceberg.util.ParallelIterable$ParallelIterator.lambda$new$1(ParallelIterable.java:69)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1570)
Caused by: org.apache.avro.InvalidAvroMagicException: Not an Avro data file
at
org.apache.avro.file.DataFileReader.openReader(DataFileReader.java:79)
at
org.apache.iceberg.avro.AvroIterable.newFileReader(AvroIterable.java:102)
... 17 more
our storage engine is minio/s3
Ingesting data using spark to minio as iceberg formate
spark run time used is 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
