Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-23 Thread Doğacan Güney
So, is it OK to remove pmd-ext directory for now? It is not clear if
we need it when
we have the infrastructure but we don't have the infrastructure now
anyway :D. So,
I suggest that we remove it for now (and we trim 2.2MB ), and add it
back after 1.0
and actually use it.

Is everyone OK with this?

On Wed, Jan 21, 2009 at 12:01 AM, Piotr Kosiorowski
 wrote:
> I have configured hudson for 10 or more projects and always used pmd
> plugin to display the pmd results only - the actual pmd task to
> generate report was run from ant script. Maybe there is such
> possibility tu run pmd reports directly in hudson (not through project
> build scripts) but I have never come accross it.
> Piotr
>
> On Tue, Jan 20, 2009 at 10:39 PM, Otis Gospodnetic
>  wrote:
>> They've had pmd integrated with Hudson for many months now, I believe.  I've 
>> seen patches in JIRA that were the result of fixes for problems reported by 
>> pmd.  Or maybe they run pmd by hand?
>>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>
>>
>>
>> - Original Message 
>>> From: Doğacan Güney 
>>> To: nutch-dev@lucene.apache.org
>>> Sent: Tuesday, January 20, 2009 3:40:20 PM
>>> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
>>> versions
>>>
>>> On Tue, Jan 20, 2009 at 10:35 PM, Otis Gospodnetic
>>> wrote:
>>> > That I don't know...
>>> >
>>> > I don't see the jars here: 
>>> > http://svn.apache.org/viewvc/hadoop/core/trunk/lib/
>>> >
>>> > But who knows, maybe maven/ivy fetch them on demand.  I don't know.
>>> >
>>>
>>> Hmm, does 0.19 use ivy(0.19 also doesn't have pmd)?
>>>
>>> http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/lib/
>>>
>>> > Otis
>>> > --
>>> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>> >
>>> >
>>> >
>>> > - Original Message 
>>> >> From: Doğacan Güney
>>> >> To: nutch-dev@lucene.apache.org
>>> >> Sent: Tuesday, January 20, 2009 1:13:20 PM
>>> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
>>> versions
>>> >>
>>> >> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
>>> >> wrote:
>>> >> > Lucene doesn't use anything.
>>> >> > Hadoop uses pmd integrate in Hudson.
>>> >> >
>>> >>
>>> >> Does this mean we do not need pmd jars in nutch ( are they provided by
>>> hudson)?
>>> >>
>>> >> > Otis
>>> >> > --
>>> >> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>> >> >
>>> >> >
>>> >> >
>>> >> > - Original Message 
>>> >> >> From: Doğacan Güney
>>> >> >> To: nutch-dev@lucene.apache.org
>>> >> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
>>> >> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to 
>>> >> >> latest
>>> >> versions
>>> >> >>
>>> >> >> 2009/1/20 Piotr Kosiorowski :
>>> >> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
>>> >> >> > committed them long time ago in an attempt to bring some static
>>> >> >> > analysis toools to nutch sources. There was a short discussion 
>>> >> >> > around
>>> >> >> > it and we all thought t was worth doing but it never gained enough
>>> >> >> > momentum.   There is a pmd target in build.xml file that uses it -
>>> >> >> > they are not needed in runtime nor for standard builds.
>>> >> >> > As nutch is built using hudson now I think it would be worth to
>>> >> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
>>> >> >> > interesting) - hudson has very nice plugins for such tools. I am 
>>> >> >> > using
>>> >> >> > it in my daily job and I found it valuable.
>>> >> >>
>>> >> >> Thanks for the explanation. I am definitely +1 on having some sort of
>>> >> >> static analysis tools for nutch.
>>> >> >>
>>> &

Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Piotr Kosiorowski
I have configured hudson for 10 or more projects and always used pmd
plugin to display the pmd results only - the actual pmd task to
generate report was run from ant script. Maybe there is such
possibility tu run pmd reports directly in hudson (not through project
build scripts) but I have never come accross it.
Piotr

On Tue, Jan 20, 2009 at 10:39 PM, Otis Gospodnetic
 wrote:
> They've had pmd integrated with Hudson for many months now, I believe.  I've 
> seen patches in JIRA that were the result of fixes for problems reported by 
> pmd.  Or maybe they run pmd by hand?
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> - Original Message 
>> From: Doğacan Güney 
>> To: nutch-dev@lucene.apache.org
>> Sent: Tuesday, January 20, 2009 3:40:20 PM
>> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
>> versions
>>
>> On Tue, Jan 20, 2009 at 10:35 PM, Otis Gospodnetic
>> wrote:
>> > That I don't know...
>> >
>> > I don't see the jars here: 
>> > http://svn.apache.org/viewvc/hadoop/core/trunk/lib/
>> >
>> > But who knows, maybe maven/ivy fetch them on demand.  I don't know.
>> >
>>
>> Hmm, does 0.19 use ivy(0.19 also doesn't have pmd)?
>>
>> http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/lib/
>>
>> > Otis
>> > --
>> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>> >
>> >
>> >
>> > - Original Message 
>> >> From: Doğacan Güney
>> >> To: nutch-dev@lucene.apache.org
>> >> Sent: Tuesday, January 20, 2009 1:13:20 PM
>> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
>> versions
>> >>
>> >> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
>> >> wrote:
>> >> > Lucene doesn't use anything.
>> >> > Hadoop uses pmd integrate in Hudson.
>> >> >
>> >>
>> >> Does this mean we do not need pmd jars in nutch ( are they provided by
>> hudson)?
>> >>
>> >> > Otis
>> >> > --
>> >> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>> >> >
>> >> >
>> >> >
>> >> > - Original Message 
>> >> >> From: Doğacan Güney
>> >> >> To: nutch-dev@lucene.apache.org
>> >> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
>> >> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
>> >> versions
>> >> >>
>> >> >> 2009/1/20 Piotr Kosiorowski :
>> >> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
>> >> >> > committed them long time ago in an attempt to bring some static
>> >> >> > analysis toools to nutch sources. There was a short discussion around
>> >> >> > it and we all thought t was worth doing but it never gained enough
>> >> >> > momentum.   There is a pmd target in build.xml file that uses it -
>> >> >> > they are not needed in runtime nor for standard builds.
>> >> >> > As nutch is built using hudson now I think it would be worth to
>> >> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
>> >> >> > interesting) - hudson has very nice plugins for such tools. I am 
>> >> >> > using
>> >> >> > it in my daily job and I found it valuable.
>> >> >>
>> >> >> Thanks for the explanation. I am definitely +1 on having some sort of
>> >> >> static analysis tools for nutch.
>> >> >>
>> >> >> Does anyone know what hadoop/hbase/lucene use for this? or do
>> >> >> they use something at all?
>> >> >>
>> >> >> > But as I am not active committer now (I only try to follow mailing
>> >> >> > lists) I do not think it is my call.  But if everyone will be
>> >> >> > interested I can try to look at integration (but it will move forward
>> >> >> > slowly - my youngest kid was born just 2 months ago and it takes a 
>> >> >> > lot
>> >> >> > of attention).
>> >> >>
>> >> >> Congratulations!
>> >> >>
>> >> >> > Piotr
>> >> >> >
>&

Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Otis Gospodnetic
They've had pmd integrated with Hudson for many months now, I believe.  I've 
seen patches in JIRA that were the result of fixes for problems reported by 
pmd.  Or maybe they run pmd by hand?

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
> From: Doğacan Güney 
> To: nutch-dev@lucene.apache.org
> Sent: Tuesday, January 20, 2009 3:40:20 PM
> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
> versions
> 
> On Tue, Jan 20, 2009 at 10:35 PM, Otis Gospodnetic
> wrote:
> > That I don't know...
> >
> > I don't see the jars here: 
> > http://svn.apache.org/viewvc/hadoop/core/trunk/lib/
> >
> > But who knows, maybe maven/ivy fetch them on demand.  I don't know.
> >
> 
> Hmm, does 0.19 use ivy(0.19 also doesn't have pmd)?
> 
> http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/lib/
> 
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >
> >
> >
> > - Original Message ----
> >> From: Doğacan Güney 
> >> To: nutch-dev@lucene.apache.org
> >> Sent: Tuesday, January 20, 2009 1:13:20 PM
> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
> versions
> >>
> >> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
> >> wrote:
> >> > Lucene doesn't use anything.
> >> > Hadoop uses pmd integrate in Hudson.
> >> >
> >>
> >> Does this mean we do not need pmd jars in nutch ( are they provided by 
> hudson)?
> >>
> >> > Otis
> >> > --
> >> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >> >
> >> >
> >> >
> >> > - Original Message 
> >> >> From: Doğacan Güney
> >> >> To: nutch-dev@lucene.apache.org
> >> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
> >> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
> >> versions
> >> >>
> >> >> 2009/1/20 Piotr Kosiorowski :
> >> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
> >> >> > committed them long time ago in an attempt to bring some static
> >> >> > analysis toools to nutch sources. There was a short discussion around
> >> >> > it and we all thought t was worth doing but it never gained enough
> >> >> > momentum.   There is a pmd target in build.xml file that uses it -
> >> >> > they are not needed in runtime nor for standard builds.
> >> >> > As nutch is built using hudson now I think it would be worth to
> >> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
> >> >> > interesting) - hudson has very nice plugins for such tools. I am using
> >> >> > it in my daily job and I found it valuable.
> >> >>
> >> >> Thanks for the explanation. I am definitely +1 on having some sort of
> >> >> static analysis tools for nutch.
> >> >>
> >> >> Does anyone know what hadoop/hbase/lucene use for this? or do
> >> >> they use something at all?
> >> >>
> >> >> > But as I am not active committer now (I only try to follow mailing
> >> >> > lists) I do not think it is my call.  But if everyone will be
> >> >> > interested I can try to look at integration (but it will move forward
> >> >> > slowly - my youngest kid was born just 2 months ago and it takes a lot
> >> >> > of attention).
> >> >>
> >> >> Congratulations!
> >> >>
> >> >> > Piotr
> >> >> >
> >> >> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
> >> >> >> Update external jars to latest versions
> >> >> >> ---
> >> >> >>
> >> >> >> Key: NUTCH-680
> >> >> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
> >> >> >> Project: Nutch
> >> >> >>  Issue Type: Improvement
> >> >> >>Reporter: Doğacan Güney
> >> >> >>Assignee: Doğacan Güney
> >> >> >>Priority: Minor
> >> >> >> Fix For: 1.0.0
> >> >> >>
> >> >> >>
> >> >> >> This issue will be used to update external libraries nutch uses.
> >> >> >>
> >> >> >> These are the libraries that are outdated (upon a quick glance):
> >> >> >>
> >> >> >> nekohtml (1.9.9)
> >> >> >> lucene-highlighter (2.4.0)
> >> >> >> jdom (1.1)
> >> >> >> carrot2 - as mentioned in another issue
> >> >> >> jets3t - above
> >> >> >> icu4j (4.0.1)
> >> >> >> jakarta-oro (2.0.8)
> >> >> >>
> >> >> >> We should probably update tika to whatever the latest is as well 
> >> >> >> before
> >> 1.0.
> >> >> >>
> >> >> >>
> >> >> >> Please add ones  I missed in comments.
> >> >> >>
> >> >> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen
> >> >> there.
> >> >> >>
> >> >> >> --
> >> >> >> This message is automatically generated by JIRA.
> >> >> >> -
> >> >> >> You can reply to this email to add a comment to the issue online.
> >> >> >>
> >> >> >>
> >> >> >
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> Doğacan Güney
> >> >
> >> >
> >>
> >>
> >>
> >> --
> >> Doğacan Güney
> >
> >
> 
> 
> 
> -- 
> Doğacan Güney



Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Piotr Kosiorowski
>From what I know (the way we use hudson) is that hudson has plugins
for presenting tool results only and the tools need to be executed
during build - and libraries need to be included so they are available
to ant.
Piotr

On Tue, Jan 20, 2009 at 9:40 PM, Doğacan Güney  wrote:
> On Tue, Jan 20, 2009 at 10:35 PM, Otis Gospodnetic
>  wrote:
>> That I don't know...
>>
>> I don't see the jars here: 
>> http://svn.apache.org/viewvc/hadoop/core/trunk/lib/
>>
>> But who knows, maybe maven/ivy fetch them on demand.  I don't know.
>>
>
> Hmm, does 0.19 use ivy(0.19 also doesn't have pmd)?
>
> http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/lib/
>
>> Otis
>> --
>> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>
>>
>>
>> - Original Message ----
>>> From: Doğacan Güney 
>>> To: nutch-dev@lucene.apache.org
>>> Sent: Tuesday, January 20, 2009 1:13:20 PM
>>> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
>>> versions
>>>
>>> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
>>> wrote:
>>> > Lucene doesn't use anything.
>>> > Hadoop uses pmd integrate in Hudson.
>>> >
>>>
>>> Does this mean we do not need pmd jars in nutch ( are they provided by 
>>> hudson)?
>>>
>>> > Otis
>>> > --
>>> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>>> >
>>> >
>>> >
>>> > - Original Message 
>>> >> From: Doğacan Güney
>>> >> To: nutch-dev@lucene.apache.org
>>> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
>>> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
>>> versions
>>> >>
>>> >> 2009/1/20 Piotr Kosiorowski :
>>> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
>>> >> > committed them long time ago in an attempt to bring some static
>>> >> > analysis toools to nutch sources. There was a short discussion around
>>> >> > it and we all thought t was worth doing but it never gained enough
>>> >> > momentum.   There is a pmd target in build.xml file that uses it -
>>> >> > they are not needed in runtime nor for standard builds.
>>> >> > As nutch is built using hudson now I think it would be worth to
>>> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
>>> >> > interesting) - hudson has very nice plugins for such tools. I am using
>>> >> > it in my daily job and I found it valuable.
>>> >>
>>> >> Thanks for the explanation. I am definitely +1 on having some sort of
>>> >> static analysis tools for nutch.
>>> >>
>>> >> Does anyone know what hadoop/hbase/lucene use for this? or do
>>> >> they use something at all?
>>> >>
>>> >> > But as I am not active committer now (I only try to follow mailing
>>> >> > lists) I do not think it is my call.  But if everyone will be
>>> >> > interested I can try to look at integration (but it will move forward
>>> >> > slowly - my youngest kid was born just 2 months ago and it takes a lot
>>> >> > of attention).
>>> >>
>>> >> Congratulations!
>>> >>
>>> >> > Piotr
>>> >> >
>>> >> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
>>> >> >> Update external jars to latest versions
>>> >> >> ---
>>> >> >>
>>> >> >> Key: NUTCH-680
>>> >> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
>>> >> >> Project: Nutch
>>> >> >>  Issue Type: Improvement
>>> >> >>Reporter: Doğacan Güney
>>> >> >>Assignee: Doğacan Güney
>>> >> >>Priority: Minor
>>> >> >> Fix For: 1.0.0
>>> >> >>
>>> >> >>
>>> >> >> This issue will be used to update external libraries nutch uses.
>>> >> >>
>>> >> >> These are the libraries that are outdated (upon a quick glance):
>>> >> >>
>>> >> >> nekohtml (1.9.9)
>>> >> >> lucene-highlighter (2.4.0)
>>> >> >> jdom (1.1)
>>> >> >> carrot2 - as mentioned in another issue
>>> >> >> jets3t - above
>>> >> >> icu4j (4.0.1)
>>> >> >> jakarta-oro (2.0.8)
>>> >> >>
>>> >> >> We should probably update tika to whatever the latest is as well 
>>> >> >> before
>>> 1.0.
>>> >> >>
>>> >> >>
>>> >> >> Please add ones  I missed in comments.
>>> >> >>
>>> >> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen
>>> >> there.
>>> >> >>
>>> >> >> --
>>> >> >> This message is automatically generated by JIRA.
>>> >> >> -
>>> >> >> You can reply to this email to add a comment to the issue online.
>>> >> >>
>>> >> >>
>>> >> >
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Doğacan Güney
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Doğacan Güney
>>
>>
>
>
>
> --
> Doğacan Güney
>


Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Doğacan Güney
On Tue, Jan 20, 2009 at 10:35 PM, Otis Gospodnetic
 wrote:
> That I don't know...
>
> I don't see the jars here: http://svn.apache.org/viewvc/hadoop/core/trunk/lib/
>
> But who knows, maybe maven/ivy fetch them on demand.  I don't know.
>

Hmm, does 0.19 use ivy(0.19 also doesn't have pmd)?

http://svn.apache.org/viewvc/hadoop/core/branches/branch-0.19/lib/

> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> - Original Message 
>> From: Doğacan Güney 
>> To: nutch-dev@lucene.apache.org
>> Sent: Tuesday, January 20, 2009 1:13:20 PM
>> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
>> versions
>>
>> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
>> wrote:
>> > Lucene doesn't use anything.
>> > Hadoop uses pmd integrate in Hudson.
>> >
>>
>> Does this mean we do not need pmd jars in nutch ( are they provided by 
>> hudson)?
>>
>> > Otis
>> > --
>> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>> >
>> >
>> >
>> > - Original Message 
>> >> From: Doğacan Güney
>> >> To: nutch-dev@lucene.apache.org
>> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
>> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest
>> versions
>> >>
>> >> 2009/1/20 Piotr Kosiorowski :
>> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
>> >> > committed them long time ago in an attempt to bring some static
>> >> > analysis toools to nutch sources. There was a short discussion around
>> >> > it and we all thought t was worth doing but it never gained enough
>> >> > momentum.   There is a pmd target in build.xml file that uses it -
>> >> > they are not needed in runtime nor for standard builds.
>> >> > As nutch is built using hudson now I think it would be worth to
>> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
>> >> > interesting) - hudson has very nice plugins for such tools. I am using
>> >> > it in my daily job and I found it valuable.
>> >>
>> >> Thanks for the explanation. I am definitely +1 on having some sort of
>> >> static analysis tools for nutch.
>> >>
>> >> Does anyone know what hadoop/hbase/lucene use for this? or do
>> >> they use something at all?
>> >>
>> >> > But as I am not active committer now (I only try to follow mailing
>> >> > lists) I do not think it is my call.  But if everyone will be
>> >> > interested I can try to look at integration (but it will move forward
>> >> > slowly - my youngest kid was born just 2 months ago and it takes a lot
>> >> > of attention).
>> >>
>> >> Congratulations!
>> >>
>> >> > Piotr
>> >> >
>> >> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
>> >> >> Update external jars to latest versions
>> >> >> ---
>> >> >>
>> >> >> Key: NUTCH-680
>> >> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
>> >> >> Project: Nutch
>> >> >>  Issue Type: Improvement
>> >> >>Reporter: Doğacan Güney
>> >> >>Assignee: Doğacan Güney
>> >> >>Priority: Minor
>> >> >> Fix For: 1.0.0
>> >> >>
>> >> >>
>> >> >> This issue will be used to update external libraries nutch uses.
>> >> >>
>> >> >> These are the libraries that are outdated (upon a quick glance):
>> >> >>
>> >> >> nekohtml (1.9.9)
>> >> >> lucene-highlighter (2.4.0)
>> >> >> jdom (1.1)
>> >> >> carrot2 - as mentioned in another issue
>> >> >> jets3t - above
>> >> >> icu4j (4.0.1)
>> >> >> jakarta-oro (2.0.8)
>> >> >>
>> >> >> We should probably update tika to whatever the latest is as well before
>> 1.0.
>> >> >>
>> >> >>
>> >> >> Please add ones  I missed in comments.
>> >> >>
>> >> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen
>> >> there.
>> >> >>
>> >> >> --
>> >> >> This message is automatically generated by JIRA.
>> >> >> -
>> >> >> You can reply to this email to add a comment to the issue online.
>> >> >>
>> >> >>
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> Doğacan Güney
>> >
>> >
>>
>>
>>
>> --
>> Doğacan Güney
>
>



-- 
Doğacan Güney


Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Otis Gospodnetic
That I don't know...

I don't see the jars here: http://svn.apache.org/viewvc/hadoop/core/trunk/lib/

But who knows, maybe maven/ivy fetch them on demand.  I don't know.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
> From: Doğacan Güney 
> To: nutch-dev@lucene.apache.org
> Sent: Tuesday, January 20, 2009 1:13:20 PM
> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
> versions
> 
> On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
> wrote:
> > Lucene doesn't use anything.
> > Hadoop uses pmd integrate in Hudson.
> >
> 
> Does this mean we do not need pmd jars in nutch ( are they provided by 
> hudson)?
> 
> > Otis
> > --
> > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
> >
> >
> >
> > - Original Message 
> >> From: Doğacan Güney 
> >> To: nutch-dev@lucene.apache.org
> >> Sent: Tuesday, January 20, 2009 10:49:44 AM
> >> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
> versions
> >>
> >> 2009/1/20 Piotr Kosiorowski :
> >> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
> >> > committed them long time ago in an attempt to bring some static
> >> > analysis toools to nutch sources. There was a short discussion around
> >> > it and we all thought t was worth doing but it never gained enough
> >> > momentum.   There is a pmd target in build.xml file that uses it -
> >> > they are not needed in runtime nor for standard builds.
> >> > As nutch is built using hudson now I think it would be worth to
> >> > integrate pmd (and checkstyle/findbugs/cobertura might be also
> >> > interesting) - hudson has very nice plugins for such tools. I am using
> >> > it in my daily job and I found it valuable.
> >>
> >> Thanks for the explanation. I am definitely +1 on having some sort of
> >> static analysis tools for nutch.
> >>
> >> Does anyone know what hadoop/hbase/lucene use for this? or do
> >> they use something at all?
> >>
> >> > But as I am not active committer now (I only try to follow mailing
> >> > lists) I do not think it is my call.  But if everyone will be
> >> > interested I can try to look at integration (but it will move forward
> >> > slowly - my youngest kid was born just 2 months ago and it takes a lot
> >> > of attention).
> >>
> >> Congratulations!
> >>
> >> > Piotr
> >> >
> >> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
> >> >> Update external jars to latest versions
> >> >> ---
> >> >>
> >> >> Key: NUTCH-680
> >> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
> >> >> Project: Nutch
> >> >>  Issue Type: Improvement
> >> >>Reporter: Doğacan Güney
> >> >>Assignee: Doğacan Güney
> >> >>Priority: Minor
> >> >> Fix For: 1.0.0
> >> >>
> >> >>
> >> >> This issue will be used to update external libraries nutch uses.
> >> >>
> >> >> These are the libraries that are outdated (upon a quick glance):
> >> >>
> >> >> nekohtml (1.9.9)
> >> >> lucene-highlighter (2.4.0)
> >> >> jdom (1.1)
> >> >> carrot2 - as mentioned in another issue
> >> >> jets3t - above
> >> >> icu4j (4.0.1)
> >> >> jakarta-oro (2.0.8)
> >> >>
> >> >> We should probably update tika to whatever the latest is as well before 
> 1.0.
> >> >>
> >> >>
> >> >> Please add ones  I missed in comments.
> >> >>
> >> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen
> >> there.
> >> >>
> >> >> --
> >> >> This message is automatically generated by JIRA.
> >> >> -
> >> >> You can reply to this email to add a comment to the issue online.
> >> >>
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> Doğacan Güney
> >
> >
> 
> 
> 
> -- 
> Doğacan Güney



Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Doğacan Güney
On Tue, Jan 20, 2009 at 7:48 PM, Otis Gospodnetic
 wrote:
> Lucene doesn't use anything.
> Hadoop uses pmd integrate in Hudson.
>

Does this mean we do not need pmd jars in nutch ( are they provided by hudson)?

> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> - Original Message 
>> From: Doğacan Güney 
>> To: nutch-dev@lucene.apache.org
>> Sent: Tuesday, January 20, 2009 10:49:44 AM
>> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
>> versions
>>
>> 2009/1/20 Piotr Kosiorowski :
>> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
>> > committed them long time ago in an attempt to bring some static
>> > analysis toools to nutch sources. There was a short discussion around
>> > it and we all thought t was worth doing but it never gained enough
>> > momentum.   There is a pmd target in build.xml file that uses it -
>> > they are not needed in runtime nor for standard builds.
>> > As nutch is built using hudson now I think it would be worth to
>> > integrate pmd (and checkstyle/findbugs/cobertura might be also
>> > interesting) - hudson has very nice plugins for such tools. I am using
>> > it in my daily job and I found it valuable.
>>
>> Thanks for the explanation. I am definitely +1 on having some sort of
>> static analysis tools for nutch.
>>
>> Does anyone know what hadoop/hbase/lucene use for this? or do
>> they use something at all?
>>
>> > But as I am not active committer now (I only try to follow mailing
>> > lists) I do not think it is my call.  But if everyone will be
>> > interested I can try to look at integration (but it will move forward
>> > slowly - my youngest kid was born just 2 months ago and it takes a lot
>> > of attention).
>>
>> Congratulations!
>>
>> > Piotr
>> >
>> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
>> >> Update external jars to latest versions
>> >> ---
>> >>
>> >> Key: NUTCH-680
>> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
>> >> Project: Nutch
>> >>  Issue Type: Improvement
>> >>Reporter: Doğacan Güney
>> >>Assignee: Doğacan Güney
>> >>Priority: Minor
>> >> Fix For: 1.0.0
>> >>
>> >>
>> >> This issue will be used to update external libraries nutch uses.
>> >>
>> >> These are the libraries that are outdated (upon a quick glance):
>> >>
>> >> nekohtml (1.9.9)
>> >> lucene-highlighter (2.4.0)
>> >> jdom (1.1)
>> >> carrot2 - as mentioned in another issue
>> >> jets3t - above
>> >> icu4j (4.0.1)
>> >> jakarta-oro (2.0.8)
>> >>
>> >> We should probably update tika to whatever the latest is as well before 
>> >> 1.0.
>> >>
>> >>
>> >> Please add ones  I missed in comments.
>> >>
>> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen
>> there.
>> >>
>> >> --
>> >> This message is automatically generated by JIRA.
>> >> -
>> >> You can reply to this email to add a comment to the issue online.
>> >>
>> >>
>> >
>>
>>
>>
>> --
>> Doğacan Güney
>
>



-- 
Doğacan Güney


Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Otis Gospodnetic
Lucene doesn't use anything.
Hadoop uses pmd integrate in Hudson.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
> From: Doğacan Güney 
> To: nutch-dev@lucene.apache.org
> Sent: Tuesday, January 20, 2009 10:49:44 AM
> Subject: Re: [jira] Created: (NUTCH-680) Update external jars to latest 
> versions
> 
> 2009/1/20 Piotr Kosiorowski :
> > pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
> > committed them long time ago in an attempt to bring some static
> > analysis toools to nutch sources. There was a short discussion around
> > it and we all thought t was worth doing but it never gained enough
> > momentum.   There is a pmd target in build.xml file that uses it -
> > they are not needed in runtime nor for standard builds.
> > As nutch is built using hudson now I think it would be worth to
> > integrate pmd (and checkstyle/findbugs/cobertura might be also
> > interesting) - hudson has very nice plugins for such tools. I am using
> > it in my daily job and I found it valuable.
> 
> Thanks for the explanation. I am definitely +1 on having some sort of
> static analysis tools for nutch.
> 
> Does anyone know what hadoop/hbase/lucene use for this? or do
> they use something at all?
> 
> > But as I am not active committer now (I only try to follow mailing
> > lists) I do not think it is my call.  But if everyone will be
> > interested I can try to look at integration (but it will move forward
> > slowly - my youngest kid was born just 2 months ago and it takes a lot
> > of attention).
> 
> Congratulations!
> 
> > Piotr
> >
> > On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA) wrote:
> >> Update external jars to latest versions
> >> ---
> >>
> >> Key: NUTCH-680
> >> URL: https://issues.apache.org/jira/browse/NUTCH-680
> >> Project: Nutch
> >>  Issue Type: Improvement
> >>Reporter: Doğacan Güney
> >>Assignee: Doğacan Güney
> >>Priority: Minor
> >> Fix For: 1.0.0
> >>
> >>
> >> This issue will be used to update external libraries nutch uses.
> >>
> >> These are the libraries that are outdated (upon a quick glance):
> >>
> >> nekohtml (1.9.9)
> >> lucene-highlighter (2.4.0)
> >> jdom (1.1)
> >> carrot2 - as mentioned in another issue
> >> jets3t - above
> >> icu4j (4.0.1)
> >> jakarta-oro (2.0.8)
> >>
> >> We should probably update tika to whatever the latest is as well before 
> >> 1.0.
> >>
> >>
> >> Please add ones  I missed in comments.
> >>
> >> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen 
> there.
> >>
> >> --
> >> This message is automatically generated by JIRA.
> >> -
> >> You can reply to this email to add a comment to the issue online.
> >>
> >>
> >
> 
> 
> 
> -- 
> Doğacan Güney



Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Doğacan Güney
2009/1/20 Piotr Kosiorowski :
> pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
> committed them long time ago in an attempt to bring some static
> analysis toools to nutch sources. There was a short discussion around
> it and we all thought t was worth doing but it never gained enough
> momentum.   There is a pmd target in build.xml file that uses it -
> they are not needed in runtime nor for standard builds.
> As nutch is built using hudson now I think it would be worth to
> integrate pmd (and checkstyle/findbugs/cobertura might be also
> interesting) - hudson has very nice plugins for such tools. I am using
> it in my daily job and I found it valuable.

Thanks for the explanation. I am definitely +1 on having some sort of
static analysis tools for nutch.

Does anyone know what hadoop/hbase/lucene use for this? or do
they use something at all?

> But as I am not active committer now (I only try to follow mailing
> lists) I do not think it is my call.  But if everyone will be
> interested I can try to look at integration (but it will move forward
> slowly - my youngest kid was born just 2 months ago and it takes a lot
> of attention).

Congratulations!

> Piotr
>
> On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA)  wrote:
>> Update external jars to latest versions
>> ---
>>
>> Key: NUTCH-680
>> URL: https://issues.apache.org/jira/browse/NUTCH-680
>> Project: Nutch
>>  Issue Type: Improvement
>>Reporter: Doğacan Güney
>>Assignee: Doğacan Güney
>>Priority: Minor
>> Fix For: 1.0.0
>>
>>
>> This issue will be used to update external libraries nutch uses.
>>
>> These are the libraries that are outdated (upon a quick glance):
>>
>> nekohtml (1.9.9)
>> lucene-highlighter (2.4.0)
>> jdom (1.1)
>> carrot2 - as mentioned in another issue
>> jets3t - above
>> icu4j (4.0.1)
>> jakarta-oro (2.0.8)
>>
>> We should probably update tika to whatever the latest is as well before 1.0.
>>
>>
>> Please add ones  I missed in comments.
>>
>> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen 
>> there.
>>
>> --
>> This message is automatically generated by JIRA.
>> -
>> You can reply to this email to add a comment to the issue online.
>>
>>
>



-- 
Doğacan Güney


Re: [jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-20 Thread Piotr Kosiorowski
pmd-ext contains PMD (http://pmd.sourceforge.net/) libraries. I have
committed them long time ago in an attempt to bring some static
analysis toools to nutch sources. There was a short discussion around
it and we all thought t was worth doing but it never gained enough
momentum.   There is a pmd target in build.xml file that uses it -
they are not needed in runtime nor for standard builds.
As nutch is built using hudson now I think it would be worth to
integrate pmd (and checkstyle/findbugs/cobertura might be also
interesting) - hudson has very nice plugins for such tools. I am using
it in my daily job and I found it valuable.
But as I am not active committer now (I only try to follow mailing
lists) I do not think it is my call.  But if everyone will be
interested I can try to look at integration (but it will move forward
slowly - my youngest kid was born just 2 months ago and it takes a lot
of attention).
Piotr

On Mon, Jan 19, 2009 at 3:02 PM, Doğacan Güney (JIRA)  wrote:
> Update external jars to latest versions
> ---
>
> Key: NUTCH-680
> URL: https://issues.apache.org/jira/browse/NUTCH-680
> Project: Nutch
>  Issue Type: Improvement
>Reporter: Doğacan Güney
>Assignee: Doğacan Güney
>Priority: Minor
> Fix For: 1.0.0
>
>
> This issue will be used to update external libraries nutch uses.
>
> These are the libraries that are outdated (upon a quick glance):
>
> nekohtml (1.9.9)
> lucene-highlighter (2.4.0)
> jdom (1.1)
> carrot2 - as mentioned in another issue
> jets3t - above
> icu4j (4.0.1)
> jakarta-oro (2.0.8)
>
> We should probably update tika to whatever the latest is as well before 1.0.
>
>
> Please add ones  I missed in comments.
>
> Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen 
> there.
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
>


[jira] Created: (NUTCH-680) Update external jars to latest versions

2009-01-19 Thread JIRA
Update external jars to latest versions
---

 Key: NUTCH-680
 URL: https://issues.apache.org/jira/browse/NUTCH-680
 Project: Nutch
  Issue Type: Improvement
Reporter: Doğacan Güney
Assignee: Doğacan Güney
Priority: Minor
 Fix For: 1.0.0


This issue will be used to update external libraries nutch uses. 

These are the libraries that are outdated (upon a quick glance):

nekohtml (1.9.9)
lucene-highlighter (2.4.0)
jdom (1.1)
carrot2 - as mentioned in another issue
jets3t - above
icu4j (4.0.1)
jakarta-oro (2.0.8)

We should probably update tika to whatever the latest is as well before 1.0.


Please add ones  I missed in comments.

Also what exactly is pmd-ext? There is an extra jakarta-oro and jaxen there.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.