Thanks Adam, It seems like Nutch use to solve most of my concerns.
i would be great if you can have share resources for Nutch with us.
/ Pankaj Bhatt.
On Tue, Jan 25, 2011 at 7:21 PM, Estrada Groups <
estrada.adam.gro...@gmail.com> wrote:
> I would just use Nutch and specify the -solr param on the command line.
> That will add the extracted content your instance of solr.
>
> Adam
>
> Sent from my iPhone
>
> On Jan 25, 2011, at 5:29 AM, pankaj bhatt <panbh...@gmail.com> wrote:
>
> > Hi All,
> > I need to index the documents presents in my file system at
> various
> > locations (e.g. C:\docs , d:\docs ).
> > Is there any way through which i can specify this in my DIH
> > Configuration.
> > Here is my configuration:-
> >
> > <document>
> > <entity name="sd"
> > processor="FileListEntityProcessor"
> > fileName="docx$|doc$|pdf$|xls$|xlsx|html$|rtf$|txt$|zip$"
> > *baseDir="G:\\Desktop\\"*
> > recursive="false"
> > rootEntity="true"
> > transformer="DateFormatTransformer"
> > onerror="continue">
> > <entity name="tikatest"
> > processor="org.apache.solr.handler.dataimport.TikaEntityProcessor"
> > url="${sd.fileAbsolutePath}" format="text" dataSource="bin">
> > <field column="Author" name="author" meta="true"/>
> > <field column="Content-Type" name="title" meta="true"/>
> > <!-- field column="title" name="title" meta="true"/ -->
> > <field column="text" name="all_text"/>
> > </entity>
> >
> > <!-- field column="fileLastModified" name="date"
> > dateTimeFormat="yyyy-MM-dd'T'hh:mm:ss" / -->
> > <field column="fileSize" name="size"/>
> > <field column="file" name="filename"/>
> > </entity>
> > <!--baseDir="../site"-->
> > </document>
> >
> > / Pankaj Bhatt.
>
