Russell Jurney created PIG-3197: ----------------------------------- Summary: Add the Stanford Tokenizer to the list of Tokenizers in Pig: StanfordTokenize Key: PIG-3197 URL: https://issues.apache.org/jira/browse/PIG-3197 Project: Pig Issue Type: Bug Components: internal-udfs Reporter: Russell Jurney Assignee: Russell Jurney
See https://github.com/Ganglion/varaha/blob/master/src/main/java/varaha/text/StanfordTokenize.java More about the stanford tokenizer here: http://nlp.stanford.edu/software/tokenizer.shtml -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira