nathanielc opened a new issue, #6672: URL: https://github.com/apache/arrow-rs/issues/6672
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** <!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] (This section helps Arrow developers understand the context and *why* for this feature, in addition to the *what*) --> I am implementing a flight sql server using datafusion. See [this](https://github.com/datafusion-contrib/datafusion-federation/blob/main/datafusion-flight-sql-server/src/service.rs#L275) logic that simply reports the flight_info schema as the result of the query schema. The `FlightDataEncoder` has two modes for dictionary handling. In one mode it hydrates dictionaries thus changing the schema of the data during transport. The flight sql server needs to reflect the hydrated schema otherwise clients will be confused as the data received will not match the reported schema. **Describe the solution you'd like** <!-- A clear and concise description of what you want to happen. --> A simple solution would be to make this [function](https://github.com/apache/arrow-rs/blob/master/arrow-flight/src/encode.rs#L527) public API so it can be reused. **Describe alternatives you've considered** <!-- A clear and concise description of any alternative solutions or features you've considered. --> I have seen but not followed closely work to create logical types separate from physical types. Possibly there is room for flight_info requests to report logical schemas and for the server to use any valid physical encoding of the data. This however requires much more coordination between clients and servers. Additionally its not clear that flight_info requests should actually deal in logical instead of physical schemas. **Additional context** <!-- Add any other context or screenshots about the feature request here. --> My solution for now is to copy to the logic into the server implementation. I'd be happy to submit a PR to make the function public if that is what we think is a good solution. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
