CVE-2021-40146: A Remote Code Execution (RCE) vulnerability exists in Apache Any23 YAMLExtractor.java

2021-09-10 Thread lewis john mcgibbney
Description: A Remote Code Execution (RCE) vulnerability was discovered in the Any23 YAMLExtractor.java file and is known to affect Any23 versions < 2.5. RCE vulnerabilities allow a malicious actor to execute any code of their choice on a remote machine over LAN, WAN, or internet. RCE belongs to

CVE-2021-38555: An XML external entity (XXE) injection vulnerability exists in Apache Any23 StreamUtils.java

2021-09-10 Thread lewis john mcgibbney
Severity: critical Description: An XML external entity (XXE) injection vulnerability was discovered in the Any23 StreamUtils.java file and is known to affect Any23 versions < 2.5. XML external entity injection (also known as XXE) is a web security vulnerability that allows an attacker to

CVE-2021-38555: An XML external entity (XXE) injection vulnerability exists in Apache Any23 StreamUtils.java

2021-09-10 Thread lewis john mcgibbney
Severity: critical Description: An XML external entity (XXE) injection vulnerability was discovered in the Any23 StreamUtils.java file and is known to affect Any23 versions < 2.5. XML external entity injection (also known as XXE) is a web security vulnerability that allows an attacker to

[ANNOUNCE] Apache Any23 2.5 Release

2021-09-10 Thread lewis john mcgibbney
*What?* The Apache Any23 Team is pleased to announce the release of Apache Any23 2.5. Apache Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a variety of Web documents. *Where?* Download:

[ANNOUNCE] Apache Any23 2.5 Release

2021-09-10 Thread lewis john mcgibbney
*What?* The Apache Any23 Team is pleased to announce the release of Apache Any23 2.5. Apache Anything To Triples (Any23) is a library, a web service and a command line tool that extracts structured data in RDF format from a variety of Web documents. *Where?* Download:

Re: Re: Dependabot-like solution for Apache projects

2021-08-30 Thread Lewis John McGibbney
che Common's components' are happy users of Dependabot, which is > used on our GitHub mirrored repositories. > > Gary > > > On Sun, Aug 29, 2021, 10:38 lewis john mcgibbney wrote: > > > Hi builds@, > > I was advised to ask my question here instead of general@in

Dependabot-like solution for Apache projects

2021-08-29 Thread lewis john mcgibbney
Hi builds@, I was advised to ask my question here instead of general@incubator. Thanks for any feedback > I understand that we cannot use automated tooling, specifically Dependbot ( > https://dependabot.com/) because it requests write access to the ASF > project source code. > I have found this

Dependabot solutions for ASF projects

2021-08-27 Thread lewis john mcgibbney
Hi general@, I understand that we cannot use automated tooling, specifically Dependbot ( https://dependabot.com/) because it requests write access to the ASF project source code. I have found this functionality to be really useful and wondered if there are any suggestions out there for automating

[jira] [Commented] (NUTCH-2826) Migrate Nutch Site from Apache CMS to Hugo

2021-08-26 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405604#comment-17405604 ] Lewis John McGibbney commented on NUTCH-2826: - OK I've made some progress on the Website

Fwd: [IMPORTANT] PMCs/pPMCs: Apache Project visibility and promotion (please read)

2021-08-25 Thread lewis john mcgibbney
Hi Folks, It looks like we need to move the company logos off of the OODT website homepage. I have no idea how to do this. Do we have a Website update HOWTO? Thanks lewismc -- Forwarded message - From: Sally Khudairi Date: Wed, Aug 25, 2021 at 8:41 PM Subject: [IMPORTANT]

[jira] [Resolved] (TIKA-3483) Implement a network policy for Helm Chart

2021-08-11 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved TIKA-3483. Resolution: Fixed > Implement a network policy for Helm Ch

[jira] [Updated] (TIKA-3483) Implement a network policy for Helm Chart

2021-08-11 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated TIKA-3483: --- Fix Version/s: (was: 2.0.0-BETA) 2.0.1 > Implement a netw

[jira] [Commented] (NUTCH-1999) Add http://nutch.apache.org/robots.txt

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395449#comment-17395449 ] Lewis John McGibbney commented on NUTCH-1999: - I will implement as part of NUTCH-2826 >

[jira] [Assigned] (NUTCH-1999) Add http://nutch.apache.org/robots.txt

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney reassigned NUTCH-1999: --- Assignee: Lewis John McGibbney > Add http://nutch.apache.org/robots.

[jira] [Commented] (NUTCH-2827) Migrate site repository

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395447#comment-17395447 ] Lewis John McGibbney commented on NUTCH-2827: - [~balakuntala] I'm going to take this task

[jira] [Assigned] (NUTCH-2827) Migrate site repository

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney reassigned NUTCH-2827: --- Assignee: Lewis John McGibbney > Migrate site reposit

[jira] [Commented] (NUTCH-2826) Migrate Nutch Site from Apache CMS to Hugo

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17395446#comment-17395446 ] Lewis John McGibbney commented on NUTCH-2826: - OK I've built HUGO site and working

[jira] [Assigned] (NUTCH-2826) Migrate Nutch Site from Apache CMS to Hugo

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney reassigned NUTCH-2826: --- Assignee: Lewis John McGibbney (was: Shashanka Balakuntala Srinivasa

[jira] [Updated] (NUTCH-2826) Migrate Nutch Site from Apache CMS to Hugo

2021-08-07 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated NUTCH-2826: Component/s: website > Migrate Nutch Site from Apache CMS to H

[jira] [Resolved] (NUTCH-2885) Upgrade to Log4j2

2021-08-04 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved NUTCH-2885. - Resolution: Fixed Thanks [~snagel] > Upgrade to Log

Re: Guidance/best practice for mocking task instance output for unit testing DAGs

2021-08-04 Thread Lewis John McGibbney
ext=True That's what we are going off. lewismc On 2021/07/29 16:39:02, Lewis John McGibbney wrote: > Hi users@, > Say I want to unit test Task A which accepts one or more parameters. These > parameters are the outputs of some other task which I want to mock. Can > someone provide a c

Re: Guidance/best practice for mocking task instance output for unit testing DAGs

2021-08-04 Thread Lewis John McGibbney
and push constructs as follows pulled_value = ti.xcom_pull(key='someKey', task_ids='push_to_xcoms') Is this the correct way to write task instance unit tests which require input parameters from XCom? Thanks lewismc On 2021/07/29 16:39:02, Lewis John McGibbney wrote: > Hi users@, > Say

Re: Guidance/best practice for mocking task instance output for unit testing DAGs

2021-08-04 Thread Lewis John McGibbney
Hi users@, Is anyone able to assist here? Does my example make sense? Thank you lewismc On 2021/07/29 16:39:02, Lewis John McGibbney wrote: > Hi users@, > Say I want to unit test Task A which accepts one or more parameters. These > parameters are the outputs of some other task whi

Guidance/best practice for mocking task instance output for unit testing DAGs

2021-07-29 Thread Lewis John McGibbney
Hi users@, Say I want to unit test Task A which accepts one or more parameters. These parameters are the outputs of some other task which I want to mock. Can someone provide a code example of how I would do that? We are using pytest as opposed to unittest but an example of either would be

Re: 2.0.1?

2021-07-28 Thread Lewis John McGibbney
Hi Tim, In short, yes :0) A couple of questions 1. I see the 2.0.0-BETA development drive is still open in JIRA - https://issues.apache.org/jira/projects/TIKA/versions/12350403 should this be cleaned up/released/closed? 2. Same for 1.28?

Re: Running Nutch on Hadoop with S3 filesystem; 'URLNormlizer not found'

2021-07-16 Thread Lewis John McGibbney
Hi Clark, This is a lot of information... thank you for compiling it all. Ideally the version of Hadoop being used with Nutch should ALWAYS match the hadoop binaries referenced in https://github.com/apache/nutch/blob/master/ivy/ivy.xml. This way you wont run into the classpath issues. I would

[jira] [Closed] (ANY23-484) Need for Effective google earth game in Education

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-484. -- Resolution: Invalid > Need for Effective google earth game in Educat

[jira] [Closed] (ANY23-483) A Look At Distance geo guessr Education

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-483. -- Resolution: Invalid > A Look At Distance geo guessr Educat

[jira] [Closed] (ANY23-482) Natural google maps game Education - 5 Popular Studies

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-482. -- Resolution: Invalid > Natural google maps game Education - 5 Popular Stud

[jira] [Closed] (ANY23-481) 7 Tips For geo guesser Education Online

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-481. -- Resolution: Invalid > 7 Tips For geo guesser Education Onl

[jira] [Closed] (ANY23-478) Is Adult Education What You hubspot careers Are Looking For?

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-478. -- Resolution: Invalid > Is Adult Education What You hubspot careers Are Look

[jira] [Closed] (ANY23-480) The Benefits of geoguessr free Education

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-480. -- Resolution: Invalid > The Benefits of geoguessr free Educat

[jira] [Closed] (ANY23-479) Physical Therapy Education hubspot email signature

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-479. -- Resolution: Invalid > Physical Therapy Education hubspot email signat

[jira] [Closed] (ANY23-475) What Is A 21st Century hubspot login Education?

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-475. -- Resolution: Invalid > What Is A 21st Century hubspot login Educat

[jira] [Closed] (ANY23-477) Direct Education hubspot pricing Online

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-477. -- Resolution: Invalid > Direct Education hubspot pricing Onl

[jira] [Closed] (ANY23-476) What an Education Loan hubspot crm Can Help You Achieve

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-476. -- Resolution: Invalid > What an Education Loan hubspot crm Can Help You Achi

[jira] [Closed] (ANY23-473) Online Education Counseling - The Benefits

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-473. -- Resolution: Invalid > Online Education Counseling - The Benef

[jira] [Closed] (ANY23-474) Education Career - Top 10 Job Opportunities in Education

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-474. -- Resolution: Invalid > Education Career - Top 10 Job Opportunities in Educat

[jira] [Closed] (ANY23-471) Speaking Plainly, What Is a Psycho-Educational Assessment?

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-471. -- Resolution: Invalid > Speaking Plainly, What Is a Psycho-Educational Assessm

[jira] [Closed] (ANY23-472) Careers With An Education Degree

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-472. -- Resolution: Invalid > Careers With An Education Deg

[jira] [Closed] (ANY23-470) Continuing Education for Counselors - Benefits of Online CEUs

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/ANY23-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed ANY23-470. -- Resolution: Invalid > Continuing Education for Counselors - Benefits of Online C

[jira] [Updated] (TIKA-3483) Implement a network policy for Helm Chart

2021-07-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated TIKA-3483: --- Summary: Implement a network policy for Helm Chart (was: Implement a network policy

[jira] [Created] (TIKA-3483) Implement a network policy

2021-07-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created TIKA-3483: -- Summary: Implement a network policy Key: TIKA-3483 URL: https://issues.apache.org/jira/browse/TIKA-3483 Project: Tika Issue Type: Improvement

Re: dev Digest 15 Jul 2021 12:23:14 -0000 Issue 1528

2021-07-15 Thread lewis john mcgibbney
Nice! On Thu, Jul 15, 2021 at 05:23 wrote: > > dev Digest 15 Jul 2021 12:23:14 - Issue 1528 > > Topics (messages 9074 through 9074) > > [REPORT] OODT - July 2021 > 9074 by: Imesha Sudasingha > > Administrivia: > > -

Re: Regression in Airflow Hel Chart

2021-07-14 Thread Lewis John McGibbney
e adding of any repo. > > The new version of Helm Chart 1.1.0 ( > https://github.com/apache/airflow/milestone/39) would be released in next > couple of week. > > Regards, > Kaxil > > On Wed, Jul 14, 2021 at 9:49 PM Lewis John McGibbney > wrote: > > >

Regression in Airflow Hel Chart

2021-07-14 Thread Lewis John McGibbney
Hi dev@, We have been customizing the Helm Chart values.yaml file and deploying to K8s without any issues prior to 2.1.1. % cd $AIRFLOW_HOME/chart % helm install airflow . -n airflow-test Now it appears that the deployment logic has to also accommodate installation of the Bitnami PostgreSQL

[jira] [Created] (NUTCH-2887) Migrate to JUnit 5 Jupiter

2021-07-13 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2887: --- Summary: Migrate to JUnit 5 Jupiter Key: NUTCH-2887 URL: https://issues.apache.org/jira/browse/NUTCH-2887 Project: Nutch Issue Type

[jira] [Resolved] (NUTCH-2886) Move Nutch WebApp to separate repository

2021-07-13 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved NUTCH-2886. - Resolution: Fixed > Move Nutch WebApp to separate reposit

Re: Suggestions for 9-month senior capstone project with Oregon State University

2021-07-12 Thread Lewis John McGibbney
OK I made the submission. If accepted, the project would start in September and run for a duration of 9 months. lewismc On 2021/07/08 02:59:26, Lewis John McGibbney wrote: > Hi dev@, > I've been presented with an opportunity to propose a project to the senior > computer science

[jira] [Created] (NUTCH-2886) Move Nutch WebApp to separate repository

2021-07-12 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2886: --- Summary: Move Nutch WebApp to separate repository Key: NUTCH-2886 URL: https://issues.apache.org/jira/browse/NUTCH-2886 Project: Nutch Issue

[jira] [Work stopped] (NUTCH-2884) Security Layer for 1.x

2021-07-10 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on NUTCH-2884 stopped by Lewis John McGibbney. --- > Security Layer for

[jira] [Created] (NUTCH-2885) Upgrade to Log4j2

2021-07-10 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2885: --- Summary: Upgrade to Log4j2 Key: NUTCH-2885 URL: https://issues.apache.org/jira/browse/NUTCH-2885 Project: Nutch Issue Type: Improvement

[jira] [Work started] (NUTCH-2885) Upgrade to Log4j2

2021-07-10 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on NUTCH-2885 started by Lewis John McGibbney. --- > Upgrade to Log4j2 > - > >

[jira] [Updated] (NUTCH-2884) Security Layer to 1.x

2021-07-09 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated NUTCH-2884: Summary: Security Layer to 1.x (was: Backport NUTCH-1756 Security Layer to 1.x

[jira] [Updated] (NUTCH-2884) Security Layer for 1.x

2021-07-09 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated NUTCH-2884: Summary: Security Layer for 1.x (was: Security Layer to 1.x) > Security La

[jira] [Updated] (NUTCH-2884) Security Layer to 1.x

2021-07-09 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated NUTCH-2884: Description: We should implement the equivalent of NUTCH-1756 in 1.x. (was: We

[jira] [Work started] (NUTCH-2884) Backport NUTCH-1756 Security Layer to 1.x

2021-07-09 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on NUTCH-2884 started by Lewis John McGibbney. --- > Backport NUTCH-1756 Security Layer to

[jira] [Created] (NUTCH-2884) Backport NUTCH-1756 Security Layer to 1.x

2021-07-09 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2884: --- Summary: Backport NUTCH-1756 Security Layer to 1.x Key: NUTCH-2884 URL: https://issues.apache.org/jira/browse/NUTCH-2884 Project: Nutch Issue

Re: Suggestions for 9-month senior capstone project with Oregon State University

2021-07-08 Thread Lewis John McGibbney
Hi Shashanka, Thanks for your comments. See inline On 2021/07/08 08:57:49, Shashanka Balakuntala wrote: > I would initially prefer we go with #1 I tend to agree here. > (also want to discuss if we > want to move to maven or grade). Well there was some previous work done with Maven... that

Re: Crawling pages behind SSO authentication (SAML/OIDC)

2021-07-08 Thread Lewis John McGibbney
nUpCycle: 5000 > gridTimeout: 360 > gridBrowserTimeout: 120 > gridMaxSession: 5 > gridUnregisterIfStillDownAfter: 60 > chrome: > enabled: true > image: "selenium/node-chrome" > tag: "3.141.59" > replicas: 60 > nodeMaxSession: 5 > nodeRegistr

Suggestions for 9-month senior capstone project with Oregon State University

2021-07-07 Thread Lewis John McGibbney
Hi dev@, I've been presented with an opportunity to propose a project to the senior computer science capstone program at Oreogon State University. It is anticipated to last 9-months which means that a significant project could be undertaken. My thoughts are as follows 1. Convert the Ant + Ivy

[RESULT] WAS Re: [VOTE] Accept the nutch-helm project into Apache Nutch project

2021-07-07 Thread Lewis John McGibbney
NOT accept the nutch-helm donation into Nutch PMC... please state why *Nutch PMC-binding I'll go ahead with the remaining IP CLEARANCE. Thanks lewismc On 2021/07/03 03:45:49, Lewis John McGibbney wrote: > dev@, > This is a VOTE to accept the nutch-helm project [0] as a donation to the &g

Re: [VOTE] Accept the nutch-helm project into Apache Nutch project

2021-07-06 Thread Lewis John McGibbney
Hi Seb, On 2021/07/05 20:29:43, Sebastian Nagel wrote: > +1 Thanks for casting your VOTE > > From recent questions of users on the mailing list and on stackoverflow, > it's evident that some are required to run Nutch on K8s or similar > deployments. > So, it's definitely worth to support

[VOTE] Accept the nutch-helm project into Apache Nutch project

2021-07-02 Thread Lewis John McGibbney
dev@, This is a VOTE to accept the nutch-helm project [0] as a donation to the Apache Nutch PMC. nutch-helm is a Helm chart I wrote to deploy Apache Nutch (containers) on Kubernetes. It makes it really easy to establish a Nutch REST server and WebApp (should you wish) as well as a Nutch

Looking for ntesters - Nutch Dockerfile

2021-07-01 Thread Lewis John McGibbney
Hi user@, Are you interested in the Nutch Dockerfile? If so, keep reading. We are looking for some assistance to test proposed additions to the Nutch Dockerfile. Essentially the changes would facilitate installing and running the Nutch REST server and/or the Nutch WebApp in addition to the Nutch

Re: Crawling pages behind SSO authentication (SAML/OIDC)

2021-07-01 Thread Lewis John McGibbney
Hi Abhay, On 2021/06/10 22:27:42, Abhay Ratnaparkhi wrote: > > Based on selenium I created a microservice (which handles all required SSO > redirections/ OTP handlings etc) and hosted that with a selenium grid in > the kubernetes cluster for scaling. > I found that we couldn't scale this

[jira] [Resolved] (NUTCH-2882) Configure NutchUiServer for DEPLOYMENT and improve logging

2021-06-28 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved NUTCH-2882. - Resolution: Fixed > Configure NutchUiServer for DEPLOYMENT and improve logg

[jira] [Created] (NUTCH-2883) Provide means to run server and webapp as persistent services in Docker container

2021-06-27 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2883: --- Summary: Provide means to run server and webapp as persistent services in Docker container Key: NUTCH-2883 URL: https://issues.apache.org/jira/browse/NUTCH-2883

[jira] [Work started] (NUTCH-2882) Configure NutchUiServer for DEPLOYMENT and improve logging

2021-06-27 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on NUTCH-2882 started by Lewis John McGibbney. --- > Configure NutchUiServer for DEPLOYMENT and improve logg

[jira] [Created] (NUTCH-2882) Configure NutchUiServer for DEPLOYMENT and improve logging

2021-06-27 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2882: --- Summary: Configure NutchUiServer for DEPLOYMENT and improve logging Key: NUTCH-2882 URL: https://issues.apache.org/jira/browse/NUTCH-2882 Project: Nutch

Re: [ANNOUNCE] Release of Apache Flagon UserALE.js (Incubating) v2.2.0

2021-06-27 Thread lewis john mcgibbney
Sterling job. On Sun, Jun 27, 2021 at 01:18 Gedd Johnson wrote: > The Flagon team is pleased to announce the immediate availability of > Apache Flagon UserALE.js (Incubating) version 2.2.0. > > Apache Flagon UserALE.js (Incubating) is a free, open-source application > for thin-client behavioral

Re: [ANNOUNCE] Release of Apache Flagon UserALE.js (Incubating) v2.2.0

2021-06-27 Thread lewis john mcgibbney
Sterling job. On Sun, Jun 27, 2021 at 01:18 Gedd Johnson wrote: > The Flagon team is pleased to announce the immediate availability of > Apache Flagon UserALE.js (Incubating) version 2.2.0. > > Apache Flagon UserALE.js (Incubating) is a free, open-source application > for thin-client behavioral

[jira] [Resolved] (NUTCH-2881) bug in 'nutch' symlink in docker container

2021-06-26 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved NUTCH-2881. - Resolution: Fixed > bug in 'nutch' symlink in docker contai

[jira] [Created] (NUTCH-2881) bug in 'nutch' symlink in docker container

2021-06-25 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2881: --- Summary: bug in 'nutch' symlink in docker container Key: NUTCH-2881 URL: https://issues.apache.org/jira/browse/NUTCH-2881 Project: Nutch Issue

[jira] [Comment Edited] (TIKA-3454) Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369234#comment-17369234 ] Lewis John McGibbney edited comment on TIKA-3454 at 6/25/21, 4:46 AM

[jira] [Commented] (TIKA-3454) Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17369234#comment-17369234 ] Lewis John McGibbney commented on TIKA-3454: There are a couple of confusing statements

[jira] [Updated] (TIKA-3454) Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated TIKA-3454: --- Description: I need an easy way to configure, for example, the [AmazonTranscribe

[jira] [Created] (TIKA-3454) Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm

2021-06-24 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created TIKA-3454: -- Summary: Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm Key: TIKA-3454 URL: https://issues.apache.org/jira

[jira] [Updated] (TIKA-3454) Facilitate configuration of translation and transcription impls in tika-server/tika-docker/tika-helm

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated TIKA-3454: --- Description: I need an easy way to configure, for example, the [AmazonTranscribe

[jira] [Resolved] (TIKA-3403) Create example for Transcription

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved TIKA-3403. Resolution: Fixed > Create example for Transcript

[jira] [Resolved] (TIKA-3453) SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Defaulting to no-operation (NOP) logger implementation for tika-docker 2.0.0-BETA

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney resolved TIKA-3453. Resolution: Fixed > SLF4J: Failed to load class "org.slf4j.impl.StaticLogg

[jira] [Commented] (TIKA-3453) SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Defaulting to no-operation (NOP) logger implementation for tika-docker 2.0.0-BETA

2021-06-24 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1736#comment-1736 ] Lewis John McGibbney commented on TIKA-3453: Excellent [~tallison] I'll close this off

[jira] [Commented] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368531#comment-17368531 ] Lewis John McGibbney commented on TIKA-3452: I think the correct way for this to be done

[jira] [Commented] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368528#comment-17368528 ] Lewis John McGibbney commented on TIKA-3452: OK the issue stems from TIKA-3381 cf. https

[jira] [Created] (TIKA-3453) SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Defaulting to no-operation (NOP) logger implementation for tika-docker 2.0.0-BETA

2021-06-23 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created TIKA-3453: -- Summary: SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder" Defaulting to no-operation (NOP) logger implementation for tika-docker 2.0.0-BETA Key:

[jira] [Comment Edited] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368524#comment-17368524 ] Lewis John McGibbney edited comment on TIKA-3452 at 6/23/21, 11:06 PM

[jira] [Commented] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368524#comment-17368524 ] Lewis John McGibbney commented on TIKA-3452: OK, so building and running tika:2.0.0-BETA-full

[jira] [Updated] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/TIKA-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney updated TIKA-3452: --- Component/s: helm > java.nio.file.FileSystemException Read-only file system in 2.

[jira] [Created] (TIKA-3452) java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker

2021-06-23 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created TIKA-3452: -- Summary: java.nio.file.FileSystemException Read-only file system in 2.0.0-BETA tika-docker Key: TIKA-3452 URL: https://issues.apache.org/jira/browse/TIKA-3452

Re: Fireant dependency updates for ivy/ivy.xml

2021-06-16 Thread Lewis John McGibbney
to create A LOT OF JIRA issues and Github pull requests... I'll leave this thread open for a while so people can voice their opinions. Thanks lewismc On 2021/06/14 02:41:44, Lewis John McGibbney wrote: > Hi dev@, > I just opened several pull requests using Fireant. The scope of the pull >

[jira] [Closed] (NUTCH-2877) fireant upgrade dependency t-digest in ivy/ivy.xml from 3.2 to 3.3

2021-06-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed NUTCH-2877. --- Resolution: Invalid > fireant upgrade dependency t-digest in ivy/ivy.xml from

[jira] [Closed] (NUTCH-2878) fireant upgrade dependency hadoop-common in ivy/ivy.xml from 3.1.3 to 3.3.1

2021-06-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed NUTCH-2878. --- Resolution: Invalid > fireant upgrade dependency hadoop-common in ivy/ivy.xml f

[jira] [Created] (NUTCH-2879) fireant upgrade dependency hadoop-hdfs in ivy/ivy.xml from 3.1.3 to 3.3.1

2021-06-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2879: --- Summary: fireant upgrade dependency hadoop-hdfs in ivy/ivy.xml from 3.1.3 to 3.3.1 Key: NUTCH-2879 URL: https://issues.apache.org/jira/browse/NUTCH-2879

[jira] [Created] (NUTCH-2878) fireant upgrade dependency hadoop-common in ivy/ivy.xml from 3.1.3 to 3.3.1

2021-06-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2878: --- Summary: fireant upgrade dependency hadoop-common in ivy/ivy.xml from 3.1.3 to 3.3.1 Key: NUTCH-2878 URL: https://issues.apache.org/jira/browse/NUTCH-2878

[jira] [Created] (NUTCH-2877) fireant upgrade dependency t-digest in ivy/ivy.xml from 3.2 to 3.3

2021-06-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2877: --- Summary: fireant upgrade dependency t-digest in ivy/ivy.xml from 3.2 to 3.3 Key: NUTCH-2877 URL: https://issues.apache.org/jira/browse/NUTCH-2877

[jira] [Created] (NUTCH-2876) TEST

2021-06-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2876: --- Summary: TEST Key: NUTCH-2876 URL: https://issues.apache.org/jira/browse/NUTCH-2876 Project: Nutch Issue Type: Improvement

[jira] [Closed] (NUTCH-2876) TEST

2021-06-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed NUTCH-2876. --- Resolution: Invalid > TEST > > > Key

[jira] [Closed] (NUTCH-2875) TEST

2021-06-16 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed NUTCH-2875. --- Resolution: Invalid > TEST > > > Key

[jira] [Created] (NUTCH-2875) TEST

2021-06-16 Thread Lewis John McGibbney (Jira)
Lewis John McGibbney created NUTCH-2875: --- Summary: TEST Key: NUTCH-2875 URL: https://issues.apache.org/jira/browse/NUTCH-2875 Project: Nutch Issue Type: Improvement

[jira] [Closed] (NUTCH-2874) TEST

2021-06-15 Thread Lewis John McGibbney (Jira)
[ https://issues.apache.org/jira/browse/NUTCH-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lewis John McGibbney closed NUTCH-2874. --- Resolution: Invalid > TEST > > > Key

<    3   4   5   6   7   8   9   10   11   12   >