pandalee99 opened a new issue, #1964: URL: https://github.com/apache/fury/issues/1964
### Feature Request Earlier, I implemented utf16 to utf8 and used simd to speed up the process. ``` c++ std::string utf16ToUtf8(const std::u16string &utf16, bool is_little_endian) ``` Now, you also need to implement utf8 to utf16. Because now in java, using utf8, 16, latin1 is becoming very common, now we need to implement it in py as well. But for speed reasons, we might consider using a direct call to a c++ module. For simd acceleration, it is necessary to adapt to x86 architecture, arm and risc-v. The solution is that you can use the avx2 instruction set under x86 and so on... ### Is your feature request related to a problem? Please describe Module lack utf8 utf16. ### Describe the solution you'd like Implement utf8 to utf16, and use simd acceleration. ### Describe alternatives you've considered _No response_ ### Additional context _No response_ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
