[jira] [Commented] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Diego Gullo (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283774#comment-15283774
 ] 

Diego Gullo commented on NUTCH-2259:


No prob - PR ready https://github.com/apache/nutch/pull/110

> Nutch 2.x HBase Docker requires a logs folder to run exception free
> ---
>
> Key: NUTCH-2259
> URL: https://issues.apache.org/jira/browse/NUTCH-2259
> Project: Nutch
>  Issue Type: Bug
>  Components: docker
>Affects Versions: 2.3.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 2.4
>
>
> When running an inject
> {code}
> hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
> directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
> at java.io.FileOutputStream.(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at 
> org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
> at 
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
> at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
> at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
> at 
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
> at org.apache.log4j.LogManager.(LogManager.java:127)
> at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
> at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
> log4j:ERROR Either File or DatePattern options are not set for appender 
> [DRFA].
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Lewis John McGibbney (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283773#comment-15283773
 ] 

Lewis John McGibbney commented on NUTCH-2259:
-

Can you please submit a new PR? Thanks for following up




-- 
*Lewis*


> Nutch 2.x HBase Docker requires a logs folder to run exception free
> ---
>
> Key: NUTCH-2259
> URL: https://issues.apache.org/jira/browse/NUTCH-2259
> Project: Nutch
>  Issue Type: Bug
>  Components: docker
>Affects Versions: 2.3.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 2.4
>
>
> When running an inject
> {code}
> hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
> directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
> at java.io.FileOutputStream.(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at 
> org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
> at 
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
> at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
> at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
> at 
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
> at org.apache.log4j.LogManager.(LogManager.java:127)
> at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
> at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
> log4j:ERROR Either File or DatePattern options are not set for appender 
> [DRFA].
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] nutch pull request: NUTCH-2259 - moved creation of nutch logs fold...

2016-05-14 Thread bizmate 
GitHub user bizmate opened a pull request:

https://github.com/apache/nutch/pull/110

NUTCH-2259 - moved creation of nutch logs folder 

after the link to nutch is created

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bizmate/nutch-official 2.x

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nutch/pull/110.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #110


commit e312d5a83b3300b8ebb1e6148e2292287a427388
Author: bizmate 
Date:   2016-05-15T01:22:30Z

NUTCH-2259 - moved creation of nutch logs folder after the link to nutch is 
created




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Diego Gullo (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283772#comment-15283772
 ] 

Diego Gullo commented on NUTCH-2259:


Hi [~lewismc]
my PR was a good little input. But with the wrong output. Docker build was not 
working because the /opt/nutch link is created later in the file. I have moved 
this around. 
Added a commit in my repo 
https://github.com/bizmate/nutch-official/commit/e312d5a83b3300b8ebb1e6148e2292287a427388
 with this Jira ticket and going to create a new PR.

Also I have spotted a few different bad practices in the docker files. Once I 
will manage to run the container and spin Nutch I will progressively change the 
Docker file with new PRs.

Image is now available at https://hub.docker.com/r/diegogullo/nutch/ or by 
running docker pull diegogullo/nutch:2

An example of docker compose (as per my previous email in the malinglist) 
https://github.com/bizmate/nutch/blob/master/docker-compose.yml

> Nutch 2.x HBase Docker requires a logs folder to run exception free
> ---
>
> Key: NUTCH-2259
> URL: https://issues.apache.org/jira/browse/NUTCH-2259
> Project: Nutch
>  Issue Type: Bug
>  Components: docker
>Affects Versions: 2.3.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 2.4
>
>
> When running an inject
> {code}
> hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
> directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
> at java.io.FileOutputStream.(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at 
> org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
> at 
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
> at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
> at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
> at 
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
> at org.apache.log4j.LogManager.(LogManager.java:127)
> at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
> at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
> log4j:ERROR Either File or DatePattern options are not set for appender 
> [DRFA].
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is back to normal : Nutch-nutchgora #1555

2016-05-14 Thread Apache Jenkins Server 
See

[jira] [Resolved] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Lewis John McGibbney (JIRA) 

 [ 
https://issues.apache.org/jira/browse/NUTCH-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved NUTCH-2259.
-
Resolution: Fixed

> Nutch 2.x HBase Docker requires a logs folder to run exception free
> ---
>
> Key: NUTCH-2259
> URL: https://issues.apache.org/jira/browse/NUTCH-2259
> Project: Nutch
>  Issue Type: Bug
>  Components: docker
>Affects Versions: 2.3.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 2.4
>
>
> When running an inject
> {code}
> hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
> directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
> at java.io.FileOutputStream.(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at 
> org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
> at 
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
> at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
> at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
> at 
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
> at org.apache.log4j.LogManager.(LogManager.java:127)
> at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
> at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
> log4j:ERROR Either File or DatePattern options are not set for appender 
> [DRFA].
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] nutch pull request: Nutch requires a logs folder to run exception ...

2016-05-14 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/nutch/pull/109


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Lewis John McGibbney (JIRA) 

[ 
https://issues.apache.org/jira/browse/NUTCH-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15283643#comment-15283643
 ] 

Lewis John McGibbney commented on NUTCH-2259:
-

PR is available at https://github.com/apache/nutch/pull/109

> Nutch 2.x HBase Docker requires a logs folder to run exception free
> ---
>
> Key: NUTCH-2259
> URL: https://issues.apache.org/jira/browse/NUTCH-2259
> Project: Nutch
>  Issue Type: Bug
>  Components: docker
>Affects Versions: 2.3.1
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
> Fix For: 2.4
>
>
> When running an inject
> {code}
> hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
> log4j:ERROR setFile(null,true) call failed.
> java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
> directory)
> at java.io.FileOutputStream.open(Native Method)
> at java.io.FileOutputStream.(FileOutputStream.java:221)
> at java.io.FileOutputStream.(FileOutputStream.java:142)
> at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
> at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
> at 
> org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
> at 
> org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
> at 
> org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
> at 
> org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
> at 
> org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
> at 
> org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
> at 
> org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
> at 
> org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
> at org.apache.log4j.LogManager.(LogManager.java:127)
> at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
> at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
> at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
> log4j:ERROR Either File or DatePattern options are not set for appender 
> [DRFA].
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (NUTCH-2259) Nutch 2.x HBase Docker requires a logs folder to run exception free

2016-05-14 Thread Lewis John McGibbney (JIRA) 
Lewis John McGibbney created NUTCH-2259:
---

 Summary: Nutch 2.x HBase Docker requires a logs folder to run 
exception free
 Key: NUTCH-2259
 URL: https://issues.apache.org/jira/browse/NUTCH-2259
 Project: Nutch
  Issue Type: Bug
  Components: docker
Affects Versions: 2.3.1
Reporter: Lewis John McGibbney
Assignee: Lewis John McGibbney
 Fix For: 2.4


When running an inject
{code}
hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:221)
at java.io.FileOutputStream.(FileOutputStream.java:142)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at 
org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
at 
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
at 
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
at 
org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
at 
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.(LogManager.java:127)
at org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
log4j:ERROR Either File or DatePattern options are not set for appender [DRFA].
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] nutch pull request: Nutch requires a logs folder to run exception ...

2016-05-14 Thread bizmate 
GitHub user bizmate opened a pull request:

https://github.com/apache/nutch/pull/109

Nutch requires a logs folder to run exception free

When running a inject, throws exception

```
hduser@028ce34179ee:/opt/nutch$ bin/nutch inject urls/seed.txt 
log4j:ERROR setFile(null,true) call failed.
java.io.FileNotFoundException: /opt/nutch/logs/hadoop.log (No such file or 
directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:221)
at java.io.FileOutputStream.(FileOutputStream.java:142)
at org.apache.log4j.FileAppender.setFile(FileAppender.java:294)
at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:165)
at 
org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:223)
at 
org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:307)
at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:172)
at 
org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:104)
at 
org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:842)
at 
org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:768)
at 
org.apache.log4j.PropertyConfigurator.configureRootCategory(PropertyConfigurator.java:648)
at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:514)
at 
org.apache.log4j.PropertyConfigurator.doConfigure(PropertyConfigurator.java:580)
at 
org.apache.log4j.helpers.OptionConverter.selectAndConfigure(OptionConverter.java:526)
at org.apache.log4j.LogManager.(LogManager.java:127)
at 
org.slf4j.impl.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:66)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:277)
at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:288)
at org.apache.nutch.crawl.InjectorJob.(InjectorJob.java:64)
log4j:ERROR Either File or DatePattern options are not set for appender 
[DRFA].
```

Folder is now set in Dockerfile

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bizmate/nutch-official 2.x

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/nutch/pull/109.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #109


commit 61a33fcdb18c989c6e927fd8ce96e8b84de21bd8
Author: bizmate 
Date:   2016-05-14T13:40:03Z

Nutch requires a logs folder




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---