[jira] [Commented] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Hudson (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644524#comment-17644524
 ] 

Hudson commented on NUTCH-2977:
---

FAILURE: Integrated in Jenkins build Nutch » Nutch-trunk #89 (See 
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/89/])
NUTCH-2977 (markus: 
[https://github.com/apache/nutch/commit/d806aa4507c59dcd680eac6f116df1eab22d996a])
* (edit) build.xml


> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ ant dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Build failed in Jenkins: Nutch » Nutch-trunk #89

2022-12-07 Thread Apache Jenkins Server
See 


Changes:

[Markus Jelsma] NUTCH-2977


--
[...truncated 1.71 MB...]
[dependency-check] NVD CVE requires several updates; this could take a couple 
of minutes.
[dependency-check] Download Started for NVD CVE - 2002
[dependency-check] Download Complete for NVD CVE - 2002  (704 ms)
[dependency-check] Processing Started for NVD CVE - 2002
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by 
com.fasterxml.jackson.module.afterburner.util.MyClassLoader 
(
 to method java.lang.ClassLoader.findLoadedClass(java.lang.String)
WARNING: Please consider reporting this to the maintainers of 
com.fasterxml.jackson.module.afterburner.util.MyClassLoader
WARNING: Use --illegal-access=warn to enable warnings of further illegal 
reflective access operations
WARNING: All illegal access operations will be denied in a future release
[dependency-check] Download Started for NVD CVE - 2003
[dependency-check] Download Complete for NVD CVE - 2003  (560 ms)
[dependency-check] Processing Started for NVD CVE - 2003
[dependency-check] Processing Complete for NVD CVE - 2003  (1674 ms)
[dependency-check] Processing Complete for NVD CVE - 2002  (6397 ms)
[dependency-check] Download Started for NVD CVE - 2004
[dependency-check] Download Complete for NVD CVE - 2004  (643 ms)
[dependency-check] Processing Started for NVD CVE - 2004
[dependency-check] Processing Complete for NVD CVE - 2004  (2544 ms)
[dependency-check] Download Started for NVD CVE - 2005
[dependency-check] Download Complete for NVD CVE - 2005  (699 ms)
[dependency-check] Processing Started for NVD CVE - 2005
[dependency-check] Processing Complete for NVD CVE - 2005  (3914 ms)
[dependency-check] Download Started for NVD CVE - 2006
[dependency-check] Download Complete for NVD CVE - 2006  (761 ms)
[dependency-check] Processing Started for NVD CVE - 2006
[dependency-check] Download Started for NVD CVE - 2007
[dependency-check] Download Complete for NVD CVE - 2007  (690 ms)
[dependency-check] Processing Started for NVD CVE - 2007
[dependency-check] Processing Complete for NVD CVE - 2006  (5870 ms)
[dependency-check] Download Started for NVD CVE - 2008
[dependency-check] Download Complete for NVD CVE - 2008  (702 ms)
[dependency-check] Processing Started for NVD CVE - 2008
[dependency-check] Processing Complete for NVD CVE - 2007  (5500 ms)
[dependency-check] Download Started for NVD CVE - 2009
[dependency-check] Download Complete for NVD CVE - 2009  (687 ms)
[dependency-check] Processing Started for NVD CVE - 2009
[dependency-check] Processing Complete for NVD CVE - 2008  (7324 ms)
[dependency-check] Download Started for NVD CVE - 2010
[dependency-check] Download Complete for NVD CVE - 2010  (679 ms)
[dependency-check] Processing Started for NVD CVE - 2010
[dependency-check] Processing Complete for NVD CVE - 2009  (8130 ms)
[dependency-check] Download Started for NVD CVE - 2011
[dependency-check] Download Complete for NVD CVE - 2011  (681 ms)
[dependency-check] Processing Started for NVD CVE - 2011
[dependency-check] Download Started for NVD CVE - 2012
[dependency-check] Download Complete for NVD CVE - 2012  (685 ms)
[dependency-check] Processing Started for NVD CVE - 2012
[dependency-check] Processing Complete for NVD CVE - 2010  (9390 ms)
[dependency-check] Download Started for NVD CVE - 2013
[dependency-check] Download Complete for NVD CVE - 2013  (874 ms)
[dependency-check] Processing Started for NVD CVE - 2013
[dependency-check] Processing Complete for NVD CVE - 2011  (11344 ms)
[dependency-check] Download Started for NVD CVE - 2014
[dependency-check] Error retrieving 
https://nvd.nist.gov/feeds/json/cve/1.1/nvdcve-1.1-2014.json.gz; received 
response code 503; Service Unavailable
[dependency-check] Download Attempt 2 for NVD CVE - 2014
[dependency-check] Processing Complete for NVD CVE - 2012  (13102 ms)
[dependency-check] Error retrieving 
https://nvd.nist.gov/feeds/json/cve/1.1/nvdcve-1.1-2014.json.gz; received 
response code 503; Service Unavailable
[dependency-check] Download Attempt 3 for NVD CVE - 2014
[dependency-check] Processing Complete for NVD CVE - 2013  (11642 ms)
[dependency-check] Error retrieving 
https://nvd.nist.gov/feeds/json/cve/1.1/nvdcve-1.1-2014.json.gz; received 
response code 503; Service Unavailable
[dependency-check] Download Attempt 4 for NVD CVE - 2014
[dependency-check] Error retrieving 
https://nvd.nist.gov/feeds/json/cve/1.1/nvdcve-1.1-2014.json.gz; received 
response code 503; Service Unavailable
[dependency-check] Download Failed for NVD CVE - 2014
[dependency-check] Some CVEs may not be reported. Reason: Download failed, 
unable to copy 
'https://nvd.nist.gov/feeds/json/cve/1.1/nvdcve-1.1-2014.json.gz' to 
'/tmp/dctemp47701cf4-02d2-4d1b-888

[jira] [Commented] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Markus Jelsma (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644491#comment-17644491
 ] 

Markus Jelsma commented on NUTCH-2978:
--

Yes, i saw the slf4j present in the plugin, it troubled my already when i 
attempted an upgrade to a newer Tika version.

Regarding reload4j, i was already worried it might not run in distributed mode 
but haven't tested it yet. For now i am glad enough Nutch runs our Tika based 
parser in local mode.

To be continued

> Move to slf4j2 and remove log4j1 and reload4j
> -
>
> Key: NUTCH-2978
> URL: https://issues.apache.org/jira/browse/NUTCH-2978
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2978.patch
>
>
> I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
> today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
> moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
> log4j -> reload4j.
>  
> This patch fixes it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2924) Generate maxCount expr evaluated only once

2022-12-07 Thread Markus Jelsma (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644489#comment-17644489
 ] 

Markus Jelsma commented on NUTCH-2924:
--

Yes, that is expected. This patch requires a hostdb to be configured and 
present, i will add a check for that.

> Generate maxCount expr evaluated only once
> --
>
> Key: NUTCH-2924
> URL: https://issues.apache.org/jira/browse/NUTCH-2924
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.16
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2924-1.patch, NUTCH-2924-2.patch, 
> NUTCH-2924-3.patch, NUTCH-2924-4.patch, NUTCH-2924.patch
>
>
> The generate.maxCount expression is evaluated only once in the generator's 
> reducer, instead, it must be set once per host.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2924) Generate maxCount expr evaluated only once

2022-12-07 Thread Sebastian Nagel (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644461#comment-17644461
 ] 

Sebastian Nagel commented on NUTCH-2924:


Hi Markus, I've tried your patch: the Generator tests fail because the MR job 
run in the tests fails. Same for the Fetcher tests which also run a Generator 
job.

> Generate maxCount expr evaluated only once
> --
>
> Key: NUTCH-2924
> URL: https://issues.apache.org/jira/browse/NUTCH-2924
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.16
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2924-1.patch, NUTCH-2924-2.patch, 
> NUTCH-2924-3.patch, NUTCH-2924-4.patch, NUTCH-2924.patch
>
>
> The generate.maxCount expression is evaluated only once in the generator's 
> reducer, instead, it must be set once per host.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Sebastian Nagel (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644453#comment-17644453
 ] 

Sebastian Nagel commented on NUTCH-2978:


Hi Markus,

- the unit test of the plugin any23 fails
{noformat}
java.lang.NoSuchMethodError: 'void 
org.apache.logging.slf4j.Log4jLoggerFactory.(org.apache.logging.slf4j.Log4jMarkerFactory)'
at 
org.apache.logging.slf4j.SLF4JServiceProvider.initialize(SLF4JServiceProvider.java:54)
at org.slf4j.LoggerFactory.bind(LoggerFactory.java:183)
...
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:414)
at org.apache.hadoop.conf.Configuration.(Configuration.java:229)
at 
org.apache.nutch.util.NutchConfiguration.create(NutchConfiguration.java:64)
at 
org.apache.nutch.any23.TestAny23IndexingFilter.testAny23TriplesFields(TestAny23IndexingFilter.java:39)
{noformat}
  There are already exclusions for slf4j in src/plugin/any23/ivy.xml, looks 
like this requires a closer look.

- Hadoop by now depends on reload4j (see HADOOP-18088): Did you already test 
whether this causes issues in distributed mode?

> Move to slf4j2 and remove log4j1 and reload4j
> -
>
> Key: NUTCH-2978
> URL: https://issues.apache.org/jira/browse/NUTCH-2978
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2978.patch
>
>
> I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
> today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
> moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
> log4j -> reload4j.
>  
> This patch fixes it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Resolved] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma resolved NUTCH-2977.
--
Fix Version/s: 1.20
   Resolution: Fixed

> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ ant dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Markus Jelsma (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644436#comment-17644436
 ] 

Markus Jelsma commented on NUTCH-2977:
--

{color:#00}Committed:{color}
  ed7b6615b..d806aa450  master -> master

> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ ant dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Sebastian Nagel (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel updated NUTCH-2977:
---
Description: 
I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
especially reload4j. I desperately need this function for that.

 

$ ant dependencytree

 

will now show the tree.

  was:
I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
especially reload4j. I desperately need this function for that.

 

$ and dependencytree

 

will now show the tree.


> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ ant dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Sebastian Nagel (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644433#comment-17644433
 ] 

Sebastian Nagel commented on NUTCH-2977:


+1

Nice!

> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ and dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2978:
-
Description: 
I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
log4j -> reload4j.

 

This patch fixes it.

  was:
I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
log4j -> reload4j.

 

 


> Move to slf4j2 and remove log4j1 and reload4j
> -
>
> Key: NUTCH-2978
> URL: https://issues.apache.org/jira/browse/NUTCH-2978
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2978.patch
>
>
> I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
> today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
> moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
> log4j -> reload4j.
>  
> This patch fixes it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2978:
-
Description: 
I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
log4j -> reload4j.

 

 

> Move to slf4j2 and remove log4j1 and reload4j
> -
>
> Key: NUTCH-2978
> URL: https://issues.apache.org/jira/browse/NUTCH-2978
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2978.patch
>
>
> I got in trouble upgrading some dependencies and got a lot of LinkageErrors 
> today, or with a Tika upgrade, disappearing logs. This patch fixes that by 
> moving to slf4j2, using the corrent log4j2-slfj4-impl2 and getting rid of old 
> log4j -> reload4j.
>  
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2978:
-
Attachment: NUTCH-2978.patch

> Move to slf4j2 and remove log4j1 and reload4j
> -
>
> Key: NUTCH-2978
> URL: https://issues.apache.org/jira/browse/NUTCH-2978
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2978.patch
>
>




--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (NUTCH-2978) Move to slf4j2 and remove log4j1 and reload4j

2022-12-07 Thread Markus Jelsma (Jira)
Markus Jelsma created NUTCH-2978:


 Summary: Move to slf4j2 and remove log4j1 and reload4j
 Key: NUTCH-2978
 URL: https://issues.apache.org/jira/browse/NUTCH-2978
 Project: Nutch
  Issue Type: Task
Reporter: Markus Jelsma
 Attachments: NUTCH-2978.patch





--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2977:
-
Attachment: NUTCH-2977.patch

> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2977:
-
Description: 
I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
especially reload4j. I desperately need this function for that.

 

$ and dependencytree

 

will now show the tree.

  was:I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
especially reload4j. I desperately need this function for that.


> Support for showing dependency tree
> ---
>
> Key: NUTCH-2977
> URL: https://issues.apache.org/jira/browse/NUTCH-2977
> Project: Nutch
>  Issue Type: Task
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Attachments: NUTCH-2977.patch
>
>
> I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
> especially reload4j. I desperately need this function for that.
>  
> $ and dependencytree
>  
> will now show the tree.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (NUTCH-2977) Support for showing dependency tree

2022-12-07 Thread Markus Jelsma (Jira)
Markus Jelsma created NUTCH-2977:


 Summary: Support for showing dependency tree
 Key: NUTCH-2977
 URL: https://issues.apache.org/jira/browse/NUTCH-2977
 Project: Nutch
  Issue Type: Task
Reporter: Markus Jelsma
Assignee: Markus Jelsma


I am upgrading Nutch to slf4j 2 and need to get rid of old 1.7 stuff, and 
especially reload4j. I desperately need this function for that.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Commented] (NUTCH-2924) Generate maxCount expr evaluated only once

2022-12-07 Thread Markus Jelsma (Jira)


[ 
https://issues.apache.org/jira/browse/NUTCH-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644298#comment-17644298
 ] 

Markus Jelsma commented on NUTCH-2924:
--

Updated patch for master.

> Generate maxCount expr evaluated only once
> --
>
> Key: NUTCH-2924
> URL: https://issues.apache.org/jira/browse/NUTCH-2924
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.16
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2924-1.patch, NUTCH-2924-2.patch, 
> NUTCH-2924-3.patch, NUTCH-2924-4.patch, NUTCH-2924.patch
>
>
> The generate.maxCount expression is evaluated only once in the generator's 
> reducer, instead, it must be set once per host.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Updated] (NUTCH-2924) Generate maxCount expr evaluated only once

2022-12-07 Thread Markus Jelsma (Jira)


 [ 
https://issues.apache.org/jira/browse/NUTCH-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Markus Jelsma updated NUTCH-2924:
-
Attachment: NUTCH-2924-4.patch

> Generate maxCount expr evaluated only once
> --
>
> Key: NUTCH-2924
> URL: https://issues.apache.org/jira/browse/NUTCH-2924
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.16
>Reporter: Markus Jelsma
>Assignee: Markus Jelsma
>Priority: Major
> Fix For: 1.20
>
> Attachments: NUTCH-2924-1.patch, NUTCH-2924-2.patch, 
> NUTCH-2924-3.patch, NUTCH-2924-4.patch, NUTCH-2924.patch
>
>
> The generate.maxCount expression is evaluated only once in the generator's 
> reducer, instead, it must be set once per host.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)