[jira] [Commented] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread Hudson (JIRA) 


[ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505176#comment-16505176
 ] 

Hudson commented on NUTCH-2505:
---

SUCCESS: Integrated in Jenkins build Nutch-trunk #3531 (See 
[https://builds.apache.org/job/Nutch-trunk/3531/])
fix for NUTCH-2505 contributed by lianyuzhe (lianyzh: 
[https://github.com/apache/nutch/commit/d6106a2a58c729642c3ea689f1bc45d0b2d865a8])
* (edit) src/java/org/apache/nutch/crawl/Generator.java


> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Assignee: Sebastian Nagel
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel resolved NUTCH-2505.

Resolution: Fixed

Fixed/merged. Thanks, [~ajoylian]!

> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Assignee: Sebastian Nagel
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread ASF GitHub Bot (JIRA) 


[ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505136#comment-16505136
 ] 

ASF GitHub Bot commented on NUTCH-2505:
---

sebastian-nagel closed pull request #282: fix for NUTCH-2505 contributed by 
lianyuzhe
URL: https://github.com/apache/nutch/pull/282
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/src/java/org/apache/nutch/crawl/Generator.java 
b/src/java/org/apache/nutch/crawl/Generator.java
index 6c74aab73..d5aea1ca3 100644
--- a/src/java/org/apache/nutch/crawl/Generator.java
+++ b/src/java/org/apache/nutch/crawl/Generator.java
@@ -752,6 +752,7 @@ public Generator(Configuration conf) {
   }
 } catch (Exception e) {
   LOG.warn("Generator: exception while partitioning segments, exiting 
...");
+  LockUtil.removeLockFile(getConf(),lock);
   fs.delete(tempDir, true);
   return null;
 }


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Assignee: Sebastian Nagel
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel updated NUTCH-2505:
---
Fix Version/s: 1.15

> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel updated NUTCH-2505:
---
Affects Version/s: 1.14

> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (NUTCH-2505) nutch does not delete the .locked file, when the generator partition got an exception

2018-06-07 Thread Sebastian Nagel (JIRA) 


 [ 
https://issues.apache.org/jira/browse/NUTCH-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sebastian Nagel reassigned NUTCH-2505:
--

Assignee: Sebastian Nagel

> nutch does not delete the .locked file, when the generator partition got an 
> exception
> -
>
> Key: NUTCH-2505
> URL: https://issues.apache.org/jira/browse/NUTCH-2505
> Project: Nutch
>  Issue Type: Bug
>  Components: generator
>Affects Versions: 1.14
>Reporter: Ajoy Lian
>Assignee: Sebastian Nagel
>Priority: Major
> Fix For: 1.15
>
>
> nutch does not delete the .locked file when the generator partition got an 
> exception. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Crawler-Commons 0.10 released

2018-06-07 Thread Julien Nioche 
Hi

We are glad to announce the 0.10 release of Crawler-Commons. See the
CHANGES.txt

file
included with the release for a full list of details. This version contains
among other things improvements to the Sitemap parsing and the removal of
the Tika dependency.

As usual, this latest version contains numerous improvements and bugfixes
and all users are invited to upgrade to it.

Thanks to all committers, contributors and users.

Julien

-- 

*Open Source Solutions for Text Engineering*

http://www.digitalpebble.com
http://digitalpebble.blogspot.com/
#digitalpebble