[ https://issues.apache.org/jira/browse/TIKA-1614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14508325#comment-14508325 ]
ASF GitHub Bot commented on TIKA-1614: -------------------------------------- GitHub user AranyaLi opened a pull request: https://github.com/apache/tika/pull/43 TIKA-1614 Geo Topic Parser You can merge this pull request into a Git repository by running: $ git pull https://github.com/AranyaLi/tika trunk Alternatively you can review and apply these changes as the patch at: https://github.com/apache/tika/pull/43.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #43 ---- commit c6c402451c7133769aa94cdb6bbe075687e7c519 Author: aranyali <aranyaelen...@gmail.com> Date: 2015-04-23T02:23:18Z add geo topic parser commit 51ef0cde472f3b7bd1e38318a1036af596135689 Author: aranyali <aranyaelen...@gmail.com> Date: 2015-04-23T02:23:52Z delete ~ ---- > Geo Topic Parser > ---------------- > > Key: TIKA-1614 > URL: https://issues.apache.org/jira/browse/TIKA-1614 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Anya Yun Li > > ##Description > This program aims to provide the support to identify geonames for any > unstructured text data in the project NSF polar research. > https://github.com/NSF-Polar-Cyberinfrastructure/datavis-hackathon/issues/1 > This project is a content-based geotagging solution, made of a variaty of NLP > tools and could be used for any geotagging purposes. > ##Workingflow > 1. Plain text input is passed to geoparser > 2. Location names are extracted from the text using OpenNLP NER > 3. Provide two roles: > * The most frequent location name choosed as the best match for the > input text > * Other extracted locations are treated as alternatives (equal) > 4. location extracted above, search the best GeoName object and return the > resloved objects with fields (name in gazetteer, longitude, latitude) > ##How to Use > *Cautions*: This program requires at least 1.2 GB disk space for building > Lucene Index > ```Java > function A(stream){ > Metadata metadata = new Metadata(); > ParseContext context=new ParseContext(); > GeoParserConfig config= new GeoParserConfig(); > config.setGazetterPath(gazetteerPath); > config.setNERModelPath(nerPath); > context.set(GeoParserConfig.class, config); > > geoparser.parse( > stream, > new BodyContentHandler(), > metadata, > context); > > for(String name: metadata.names()){ > String value=metadata.get(name); > System.out.println(name +" " + value); > } > } > ``` > This parser generates useful geographical information to Tika's Metadata > Object. > Fields for best matched location: > ``` > Geographic_NAME > Geographic_LONGTITUDE > Geographic_LATITUDE > ``` > Fields for alternatives: > ``` > Geographic_NAME1 > Geographic_LONGTITUDE1 > Geographic_LATITUDE1 > Geographic_NAME2 > Geographic_LONGTITUDE2 > Geographic_LATITUDE2 > ... > ``` > If you have any questions, contact me: anyayu...@gmail.com -- This message was sent by Atlassian JIRA (v6.3.4#6332)