alamb opened a new issue, #4712:
URL: https://github.com/apache/arrow-rs/issues/4712

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   
   We are consider using the "don't use dictionary interning" in DataFusion for 
high cardinality columns: 
https://github.com/apache/arrow-datafusion/issues/7200#issuecomment-1679274520
   
   @tustvold  mentioned this mode could be made faster
   
   
   
   
   **Describe the solution you'd like**
   Review and optimize `Code::DictionaryValues`
   
   
https://github.com/apache/arrow-rs/blob/b810e8f207bbc70294b01acba4be32153c18a6ab/arrow-row/src/lib.rs#L437C14-L437C14
   
   Perhaps this could be made faster: 
https://github.com/apache/arrow-rs/blob/b810e8f207bbc70294b01acba4be32153c18a6ab/arrow-row/src/lib.rs#L1417
 
   
   (I am not sure)
   
   **Describe alternatives you've considered**
   There may not be any way to make this faster, but I wanted to file the 
ticket as follow on to the meeting
   
   **Additional context**
   <!--
   Add any other context or screenshots about the feature request here.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to