Revision: 19469
          http://sourceforge.net/p/gate/code/19469
Author:   dgmaynard
Date:     2016-07-15 09:40:50 +0000 (Fri, 15 Jul 2016)
Log Message:
-----------
don't recombine emoticons when they're preceded directly by a number with no 
space, as it's almost certainly not an emoticon and probably a date, time etc.

Modified Paths:
--------------
    gate/trunk/plugins/Twitter/resources/tokeniser/twitter.jape

Modified: gate/trunk/plugins/Twitter/resources/tokeniser/twitter.jape
===================================================================
--- gate/trunk/plugins/Twitter/resources/tokeniser/twitter.jape 2016-07-15 
01:23:08 UTC (rev 19468)
+++ gate/trunk/plugins/Twitter/resources/tokeniser/twitter.jape 2016-07-15 
09:40:50 UTC (rev 19469)
@@ -125,8 +125,19 @@
 }
 */
 
-Rule: RecombineEmoticon
+Rule: NotRecombineEmoticon
+Priority: 100
+/* Do not recombine emoticon if it's preceded directly by a number, as it's 
probably not an emoticon, e.g. 8:30 */
 (
+ {Token.kind == number}
+ {Lookup.majorType=="emoticon"}
+ )
+ -->
+ {}
+ 
+ 
+ Rule: RecombineEmoticon
+(
        {Lookup.majorType=="emoticon"}
 ):match
 -->

This was sent by the SourceForge.net collaborative development platform, the 
world's largest Open Source development site.


------------------------------------------------------------------------------
What NetFlow Analyzer can do for you? Monitors network bandwidth and traffic
patterns at an interface-level. Reveals which users, apps, and protocols are 
consuming the most bandwidth. Provides multi-vendor support for NetFlow, 
J-Flow, sFlow and other flows. Make informed decisions using capacity planning
reports.http://sdm.link/zohodev2dev
_______________________________________________
GATE-cvs mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/gate-cvs

Reply via email to