On Mon, Mar 30, 2015 at 12:14 PM, Michal Diamantstein < michal.diamantst...@genesys.com> wrote:
> *What is the reason for not allowing numbers?* > > > No reason, it was just a simple tokenizer that worked for Arabic. Since Lucene 3.1, StandardTokenizer can tokenize arabic (and work with numbers and other stuff), and ArabicAnalyzer uses that instead. This tokenizer was then deprecated. See https://issues.apache.org/jira/browse/LUCENE-2747
