Iceberg today does not support non optional unions and that is the right behaviour, but we do have a lot of datasets which have non-optional union fields. I'm wondering whether Iceberg should allow reading these datasets as long as the user does not project the union field.
I tried it out and today is throws an exception during column pruning. If we think this should be support, I'll create an issue for this. -Best, R.
