Hi all,
This is my first time writing to the forum and made a few small
contributions to the project under the due guidance of my colleague Jeff
Zemerick.
While going through the documentation and related implementation, I wanted
to float an idea of renaming the TrainingParam 'isAlphaNumopt' to
'skipAlphaNumopt' to make more sense of what it actually does.
As per help doc:
-alphaNumOpt isAlphaNumOpt
Optimization flag to skip alpha numeric tokens for
further tokenization
Please let me know your thoughts.
Thank you,
Best,
Atita
