lidavidm commented on pull request #9686:
URL: https://github.com/apache/arrow/pull/9686#issuecomment-799406858


   As it stands implementing fragment scan options for a union dataset is a bit 
tricky, because the fragment doesn't know which dataset it originally belonged 
to (and it would be weird for every scan task implementation to have to know 
about a hypothetical UnionFragmentScanOptions). We could add a 
FragmentScanOptions field to Fragment, allowing UnionDataset::GetFragmentsImpl 
to do the work of matching up options to fragments there. (That'd also let an 
advanced caller manually specify per-fragment options if they really wanted to.)
   
   However given we might just delete UnionDataset I'm going to leave this out 
of this PR for now.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to