On Wednesday 08 February 2012 14:22:36 Julien Nioche wrote:
> sorry don't understand what your issue is. We have a dependency on
> tika-parsers and the actual parser implementations (listed in tika parsers'
> POM) are pulled transitively just like any other dependency managed by Ivy.
> They end up being copied in runtime/local/plugins/parse-tika/ or put in
> the job in runtime/deploy/
My problem is that i am working on some code for Tika-parsers 1.1-SNAPSHOT
that i need to use in Nutch. However, when i build tika-parsers and put it in
Nutch' lib directory i still seem to be missing dependencies. Then trouble
begins:
Exception in thread "main" java.lang.NoClassDefFoundError: Could not
initialize class org.apache.tika.parser.dwg.DWGParser
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at sun.misc.Service$LazyIterator.next(Service.java:271)
at org.apache.nutch.parse.tika.TikaConfig.<init>(TikaConfig.java:149)
at
org.apache.nutch.parse.tika.TikaConfig.getDefaultConfig(TikaConfig.java:211)
at org.apache.nutch.parse.tika.TikaParser.setConf(TikaParser.java:254)
at
org.apache.nutch.plugin.Extension.getExtensionInstance(Extension.java:162)
at
org.apache.nutch.parse.ParserFactory.getParsers(ParserFactory.java:132)
at org.apache.nutch.parse.ParseUtil.parse(ParseUtil.java:71)
at org.apache.nutch.parse.ParserChecker.run(ParserChecker.java:101)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.parse.ParserChecker.main(ParserChecker.java:138)
Nick told me to remove DWG from the org.apache.tika.parsers.Parsers config
file, which i did. But then other dependency issues come and go. The more
parsers i remove from the config file the better it goes, but then Tika won't
build anymore because of failing tests.
I asked this on the Nutch list because i wasn't sure anymore how Nutch deals
with these its own deps, which you explained well.
I'll give up for now :)
>
> On 8 February 2012 13:03, Markus Jelsma <markus.jel...@openindex.io> wrote:
> > Yes, it looks like it! It should also be upgraded to Tika 1.0. But that's
> > something else.
> >
> > dependencies, dependencies, dependencies.... :(
> >
> > On Wednesday 08 February 2012 14:04:26 Julien Nioche wrote:
> > > The dependencies for the plugins are defined locally as shown in the
> > > URL below, where you can see the ref to tika-parsers for parse-tika.
> > > Is that more clear for you Markus?
> > >
> > > On 8 February 2012 12:58, Lewis John Mcgibbney
> >
> > <lewis.mcgibb...@gmail.com>wrote:
> > > > Hi Markus,
> > > >
> > > > For starters
> >
> > http://svn.apache.org/viewvc/nutch/trunk/src/plugin/parse-tika/ivy.xml?vi
> >
> > > > ew=markup
> > > >
> > > > Can we pick our way through this?
> > > >
> > > > Thanks
> > > >
> > > >
> > > > On Wed, Feb 8, 2012 at 12:50 PM, Markus Jelsma
> > > > <markus.jel...@openindex.io
> > > >
> > > > > wrote:
> > > >> Hi,
> > > >>
> > > >> Can anyone shed light on this? We don't have any parsers in our libs
> >
> > dir
> >
> > > >> and
> > > >> we don't have tika-parsers jar, only the tika-core jar. Where are
> > > >> the parsers
> > > >> and how does this all work?
> > > >>
> > > >> I've posted a question (same subject) on the Tika list and Nick
> > > >> tells
> >
> > me
> >
> > > >> there
> > > >> must be parsers somewhere. Well, i have no idea how we do it in
> > > >> Nutch, do you?
> > > >>
> > > >> Thanks
> > > >
> > > > --
> > > > *Lewis*
> >
> > --
> > Markus Jelsma - CTO - Openindex
--
Markus Jelsma - CTO - Openindex
