[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827060#comment-17827060 ] Hudson commented on NUTCH-3029: --- SUCCESS: Integrated in Jenkins build Nutch » Nutch-trunk #153 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/153/]) NUTCH-3029 (markus: [https://github.com/apache/nutch/commit/98902236d782615ea1b8676a477bfa735499810a]) * (edit) src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Sebastian Nagel >Priority: Minor > Fix For: 1.20 > > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827048#comment-17827048 ] Markus Jelsma commented on NUTCH-3029: -- comment describing throws is also required these days. a8ec17ca8..98902236d master -> master > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Sebastian Nagel >Priority: Minor > Fix For: 1.20 > > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826846#comment-17826846 ] Hudson commented on NUTCH-3029: --- FAILURE: Integrated in Jenkins build Nutch » Nutch-trunk #152 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/152/]) NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler (markus: [https://github.com/apache/nutch/commit/a8ec17ca853b2488bf5d96538915a00a05064a31]) * (edit) src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826823#comment-17826823 ] Markus Jelsma commented on NUTCH-3029: -- throws was missing too 84cda2abd..a8ec17ca8 master -> master > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826806#comment-17826806 ] Hudson commented on NUTCH-3029: --- FAILURE: Integrated in Jenkins build Nutch » Nutch-trunk #151 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/151/]) NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler (markus: [https://github.com/apache/nutch/commit/84cda2abd500667222fdb00e503780ee0bdaaab4]) * (edit) src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826783#comment-17826783 ] Markus Jelsma commented on NUTCH-3029: -- Thanks Lewis! 5ba50c0c6..84cda2abd master -> master > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[
https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826776#comment-17826776
]
Lewis John McGibbney commented on NUTCH-3029:
-
Hi [~martin.dj] [~markus17] it looks like we are missing some Javadoc
{quote} [javadoc] Standard Doclet version 11.0.22 {quote}
{quote} [javadoc] Building tree for all the packages and classes...
[javadoc]
/home/runner/work/nutch/nutch/src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java:193:
warning: no @param for url
[javadoc] public static String getHostName(String url) throws
URISyntaxException {
[javadoc] ^
[javadoc]
/home/runner/work/nutch/nutch/src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java:193:
warning: no @return
[javadoc] public static String getHostName(String url) throws
URISyntaxException {
[javadoc] ^
[javadoc]
/home/runner/work/nutch/nutch/src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java:193:
warning: no @throws for java.net.URISyntaxException
[javadoc] public static String getHostName(String url) throws
URISyntaxException {
[javadoc] ^
[javadoc]
/home/runner/work/nutch/nutch/src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java:205:
warning: no @return
[javadoc] public float getMaxInterval(Text url, float defaultMaxInterval){
[javadoc] ^
[javadoc]
/home/runner/work/nutch/nutch/src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java:227:
warning: no @return
[javadoc] public float getMinInterval(Text url, float defaultMinInterval){
{quote}
{quote} [javadoc] ^{quote}
> Host specific max. and min. intervals in adaptive scheduler
> ---
>
> Key: NUTCH-3029
> URL: https://issues.apache.org/jira/browse/NUTCH-3029
> Project: Nutch
> Issue Type: New Feature
>Affects Versions: 1.19, 1.20
>Reporter: Martin Djukanovic
>Assignee: Markus Jelsma
>Priority: Minor
> Attachments: adaptive-host-specific-intervals.txt.template,
> new_adaptive_fetch_schedule-1.patch
>
>
> This patch implements custom max. and min. refetching intervals for specific
> hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt
> configuration file (template also attached).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826772#comment-17826772 ] Hudson commented on NUTCH-3029: --- FAILURE: Integrated in Jenkins build Nutch » Nutch-trunk #150 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/150/]) NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler (markus: [https://github.com/apache/nutch/commit/5ba50c0c6091a95818d3788f0d5b7c0ff49bec57]) * (edit) src/java/org/apache/nutch/crawl/AdaptiveFetchSchedule.java > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826759#comment-17826759 ] Markus Jelsma commented on NUTCH-3029: -- 4f62dec0f..5ba50c0c6 master -> master actual change was missing from the commit for some reason > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (NUTCH-3029) Host specific max. and min. intervals in adaptive scheduler
[ https://issues.apache.org/jira/browse/NUTCH-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17826060#comment-17826060 ] Hudson commented on NUTCH-3029: --- SUCCESS: Integrated in Jenkins build Nutch » Nutch-trunk #149 (See [https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/149/]) NUTCH-3029 Host specific max. and min. intervals in adaptive scheduler (markus: [https://github.com/apache/nutch/commit/4642c30c2aeb2a1fa2436541bd4af877d0aad86a]) * (add) conf/adaptive-host-specific-intervals.txt.template > Host specific max. and min. intervals in adaptive scheduler > --- > > Key: NUTCH-3029 > URL: https://issues.apache.org/jira/browse/NUTCH-3029 > Project: Nutch > Issue Type: New Feature >Affects Versions: 1.19, 1.20 >Reporter: Martin Djukanovic >Assignee: Markus Jelsma >Priority: Minor > Attachments: adaptive-host-specific-intervals.txt.template, > new_adaptive_fetch_schedule-1.patch > > > This patch implements custom max. and min. refetching intervals for specific > hosts, in the AdaptiveFetchSchedule class. The intervals are set up in a .txt > configuration file (template also attached). -- This message was sent by Atlassian Jira (v8.20.10#820010)
