Arraymancer looks fantastic! Also, thanks for the links, I’m sure they might be helpful for community members browsing the forum; however, I think the library I’m working on is a more general purpose library, akin to OpenFST. It appears that BlingFire only supports FSAs (and I am not sure if it supports weighted FSAs), and both sentencepiece and BlingFire seem highly focused on tokenization. FSA/FST libraries (well, library singular, as the only actively maintained one that I am aware of is OpenFST) especially weighted ones are far more versatile, and can be directly used for translation, generating word inflections, etc... I hope that it will be of use to Nim users that previously relied on OpenFST! That library is an enormous C++ codebase that isn’t very portable.
- Proposal to start a Nim-Scientific Community hugogranstrom
- Re: Proposal to start a Nim-Scientific Community Stefan_Salewski
- Re: Proposal to start a Nim-Scientific Community hugogranstrom
- Re: Proposal to start a Nim-Scientific Commun... Stefan_Salewski
- Re: Proposal to start a Nim-Scientific Co... sschwarzer
- Re: Proposal to start a Nim-Scientif... bobd
- Re: Proposal to start a Nim-Scie... cdome
- Re: Proposal to start a Nim-... mratsim
- Re: Proposal to start a Nim-... minierolls
- Re: Proposal to start a Nim-... mratsim
- Re: Proposal to start a Nim-... minierolls
- Re: Proposal to start a Nim-... hugogranstrom
- Re: Proposal to start a Nim-... mratsim
- Re: Proposal to start a Nim-... miran
- Re: Proposal to start a Nim-... hugogranstrom
- Re: Proposal to start a Nim-... hugogranstrom
- Re: Proposal to start a Nim-... hugogranstrom
- Re: Proposal to start a Nim-... chemist69
- Re: Proposal to start a Nim-... mratsim
- Re: Proposal to start a Nim-... Allin
- Re: Proposal to start a Nim-... hugogranstrom