[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238373#comment-14238373 ] Hudson commented on NUTCH-1829: --- SUCCESS: Integrated in Nutch-nutchgora #1257 (See [https://builds.apache.org/job/Nutch-nutchgora/1257/]) NUTCH-1829 Generator : unable to distinguish real errors (snagel: http://svn.apache.org/viewvc/nutch/branches/2.x/?view=rev&rev=1643899) * /nutch/branches/2.x/CHANGES.txt * /nutch/branches/2.x/src/java/org/apache/nutch/crawl/GeneratorJob.java > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > Attachments: NUTCH-1829-2x-v2.patch, NUTCH-1829-2x-v3.patch > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236127#comment-14236127 ] Lewis John McGibbney commented on NUTCH-1829: - +1 commit Seb tested with NUTCH-1778 > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > Attachments: NUTCH-1829-2x-v2.patch, NUTCH-1829-2x-v3.patch > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122742#comment-14122742 ] Hudson commented on NUTCH-1829: --- SUCCESS: Integrated in Nutch-trunk #2769 (See [https://builds.apache.org/job/Nutch-trunk/2769/]) NUTCH-1829 Generator : unable to distinguish real errors (Mathieu Bouchard via jnioche) (jnioche: http://svn.apache.org/viewvc/nutch/trunk/?view=rev&rev=1622650) * /nutch/trunk/CHANGES.txt * /nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14122732#comment-14122732 ] Hudson commented on NUTCH-1829: --- SUCCESS: Integrated in Nutch-nutchgora #1143 (See [https://builds.apache.org/job/Nutch-nutchgora/1143/]) NUTCH-1829 Generator : unable to distinguish real errors (Mathieu Bouchard via jnioche) (jnioche: http://svn.apache.org/viewvc/nutch/branches/2.x/?view=rev&rev=1622649) * /nutch/branches/2.x/CHANGES.txt * /nutch/branches/2.x/src/java/org/apache/nutch/crawl/GeneratorJob.java > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116358#comment-14116358 ] Markus Jelsma commented on NUTCH-1829: -- Well, any other arbitrary is probably ok, but how about just 1? +1 > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115149#comment-14115149 ] Julien Nioche commented on NUTCH-1829: -- This would definitely be the right thing to do. We could then use this in scripts to retry generating later instead of exiting. What value should we use for indicating that there aren't any segments? > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard >Assignee: Julien Nioche > Fix For: 2.3, 1.10 > > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (NUTCH-1829) Generator : unable to distinguish real errors
[ https://issues.apache.org/jira/browse/NUTCH-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110193#comment-14110193 ] lufeng commented on NUTCH-1829: --- yes, I think we should distinguish different return result using different return code. So we can determine the next action according to this return code. > Generator : unable to distinguish real errors > - > > Key: NUTCH-1829 > URL: https://issues.apache.org/jira/browse/NUTCH-1829 > Project: Nutch > Issue Type: Bug > Components: nutchNewbie >Affects Versions: 1.9, 2.2.1 > Environment: Ubuntu Server 14.04, OpenJDK 7 >Reporter: Mathieu Bouchard > > The bin/nutch generate command is returning the same error code (-1) if there > is an error or no new segment to process, so there is no way to tell if the > error is real or not from a shell script. This problem is related to > NUTCH-1828. > The problem can be fixed by modifying the following Java source file: > http://svn.apache.org/viewvc/nutch/trunk/src/java/org/apache/nutch/crawl/Generator.java?revision=1619934&view=markup > At line 711, if there are no new segment, the generator returns -1, which is > the same return code returned at line 714 if there was an error. -- This message was sent by Atlassian JIRA (v6.2#6252)
