Hello Matthias and David, Thanks again for your swift responses, I'm in a different time zone most likely so apologies for late replies.
@Matthias Dellweg <mdell...@redhat.com> , when running the v3/status I get this: ╰─$ (⎈ k8s01.aops-dev.activeops.local:kube-system) http https://pulp-dev.activeops.io/pulp/api/v3/status HTTP/1.1 301 Moved Permanently Access-Control-Expose-Headers: Correlation-ID Connection: keep-alive Content-Length: 0 Content-Type: text/html; charset=utf-8 Correlation-ID: 4a98ac4213d44645ae9c963c81873780 Date: Tue, 13 Apr 2021 00:40:05 GMT Location: /pulp/api/v3/status/ Server: nginx/1.16.1 Strict-Transport-Security: max-age=15768000 (ansible-venv) ╭─ericv@ip-10-80-1-57 ~ Tracing journalctl gives me the below when I run the /pulp/content with http. ╰─$ (⎈ k8s01.aops-dev.activeops.local:kube-system) sudo journalctl -f -u pulpcore-content -- Logs begin at Thu 2020-06-04 07:04:49 UTC. -- Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in _handle_request Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: resp = await self._request_handler(request) Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/aiohttp/web_app.py", line 499, in _handle Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: resp = await handler(request) Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/content/handler.py", line 121, in list_distributions Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: directory_list = ["{}/".format(d.base_path) for d in base_paths] Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/content/handler.py", line 121, in <listcomp> Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: directory_list = ["{}/".format(d.base_path) for d in base_paths] Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: AttributeError: 'str' object has no attribute 'base_path' Apr 13 00:42:45 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: 127.0.0.1 [13/Apr/2021:00:42:45 +0000] "GET /pulp/content/ HTTP/1.0" 500 231 "-" "HTTPie/0.9.4" Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: [2021-04-13 00:43:40 +0000] [1452] [ERROR] Error handling request Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: Traceback (most recent call last): Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/aiohttp/web_protocol.py", line 422, in _handle_request Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: resp = await self._request_handler(request) Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/aiohttp/web_app.py", line 499, in _handle Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: resp = await handler(request) Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/content/handler.py", line 121, in list_distributions Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: directory_list = ["{}/".format(d.base_path) for d in base_paths] Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: File "/usr/local/lib/pulp/lib64/python3.6/site-packages/pulpcore/content/handler.py", line 121, in <listcomp> Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: directory_list = ["{}/".format(d.base_path) for d in base_paths] Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: AttributeError: 'str' object has no attribute 'base_path' Apr 13 00:43:40 ip-10-80-1-57.ap-northeast-1.compute.internal gunicorn[1216]: 127.0.0.1 [13/Apr/2021:00:43:40 +0000] "GET /pulp/content/ HTTP/1.0" 500 231 "-" "HTTPie/0.9.4" Kind regards, *Eric Van Steenbergen* *E-mail: vs.e...@gmail.com <vs.e...@gmail.com>* *Skype: ericvs2014* *LinkedIn: Eric Van Steenbergen <http://es.linkedin.com/pub/eric-van-steenbergen/b/8a4/51b>* On Mon, Apr 12, 2021 at 9:55 AM David Davis <davidda...@redhat.com> wrote: > It could potentially be this bug which was fixed in pulpcore 3.12: > https://pulp.plan.io/issues/8447 > > The stacktrace would be helpful though to know for sure. > > David > > > On Mon, Apr 12, 2021 at 5:27 AM Matthias Dellweg <mdell...@redhat.com> > wrote: > >> Can you monitor "journalctl -f -u pulpcore-content" while performing that >> call? >> >> On Mon, Apr 12, 2021 at 11:17 AM Matthias Dellweg <mdell...@redhat.com> >> wrote: >> >>> Sorry, typo (e and 3 are too close on my k3yboard). Should have been >>> .../pulp/api/v3/status >>> >>> On Mon, Apr 12, 2021 at 11:06 AM Eric VS <vs.e...@gmail.com> wrote: >>> >>>> Hey Matthias, >>>> >>>> I installed Pulp using the pulp_installer Ansible playbook, no errors. >>>> >>>> This is the output from `pulp status` since the query using http didn't >>>> work either: >>>> >>>> ╰─$ (⎈ k8s01.aops-dev.activeops.local:kube-system) pulp status >>>> { >>>> "versions": [ >>>> { >>>> "component": "core", >>>> "version": "3.11.0" >>>> }, >>>> { >>>> "component": "rpm", >>>> "version": "3.10.0" >>>> } >>>> ], >>>> "online_workers": [ >>>> { >>>> "pulp_created": "2021-03-31T07:59:28.269742Z", >>>> "pulp_href": >>>> "/pulp/api/v3/workers/77c08991-a27a-49d6-a2c7-87cd8c26877c/", >>>> "name": "resource-manager", >>>> "last_heartbeat": "2021-04-12T09:02:03.424149Z" >>>> }, >>>> { >>>> "pulp_created": "2021-04-05T06:46:11.689705Z", >>>> "pulp_href": >>>> "/pulp/api/v3/workers/ed4c9dca-db6d-4d52-9f0b-331a937d2755/", >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:03.624644Z" >>>> }, >>>> { >>>> "pulp_created": "2021-04-05T06:46:11.689909Z", >>>> "pulp_href": >>>> "/pulp/api/v3/workers/9d538294-a3aa-48d4-95ab-e0a213bae94f/", >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:11.745839Z" >>>> } >>>> ], >>>> "online_content_apps": [ >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:10.886966Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:13.566778Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:13.568876Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:15.876728Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:15.881384Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:15.881615Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:15.883369Z" >>>> }, >>>> { >>>> "name": "1...@ip-10-80-1-57.ap-northeast-1.compute.internal", >>>> "last_heartbeat": "2021-04-12T09:02:15.885268Z" >>>> } >>>> ], >>>> "database_connection": { >>>> "connected": true >>>> }, >>>> "redis_connection": { >>>> "connected": true >>>> }, >>>> "storage": { >>>> "total": 161008844800, >>>> "used": 109256830976, >>>> "free": 51752013824 >>>> } >>>> } >>>> >>>> For reference this is the query you requested using api/ve/status >>>> >>>> ╰─$ (⎈ k8s01.aops-dev.activeops.local:kube-system) http >>>> https://pulp-dev.activeops.io/pulp/api/ve/status >>>> HTTP/1.1 404 Not Found >>>> Access-Control-Expose-Headers: Correlation-ID >>>> Connection: keep-alive >>>> Content-Length: 77 >>>> Content-Type: text/html >>>> Correlation-ID: 14cab8b25dc64591a243fd391424924f >>>> Date: Mon, 12 Apr 2021 09:04:06 GMT >>>> Server: nginx/1.16.1 >>>> X-Frame-Options: SAMEORIGIN >>>> >>>> <h1>Not Found</h1><p>The requested resource was not found on this >>>> server.</p> >>>> >>>> Kind regards, >>>> >>>> *Eric Van Steenbergen* >>>> >>>> *E-mail: vs.e...@gmail.com <vs.e...@gmail.com>* >>>> *Skype: ericvs2014* >>>> *LinkedIn: Eric Van Steenbergen >>>> <http://es.linkedin.com/pub/eric-van-steenbergen/b/8a4/51b>* >>>> >>>> >>>> On Mon, Apr 12, 2021 at 4:00 AM Matthias Dellweg <mdell...@redhat.com> >>>> wrote: >>>> >>>>> Hi Eric, >>>>> can you provide more info on this? >>>>> Helpful would be: >>>>> How is the server installed? (container, pulp_installer, by hand from >>>>> pypi) >>>>> What versions of the components are installed? (http https:// >>>>> <FQDN>/pulp/api/ve/status) >>>>> Thanks in advance! >>>>> >>>>> On Mon, Apr 12, 2021 at 10:57 AM Eric VS <vs.e...@gmail.com> wrote: >>>>> >>>>>> Hi Matthias, >>>>>> >>>>>> When I run `http https://<FQDN>/pulp/content/` is when I get the 500 >>>>>> error. >>>>>> I can query the all the content with the API (pulp rpm >>>>>> repository/remote/publication/distribution) without any issue. >>>>>> >>>>>> Kind regards, >>>>>> >>>>>> *Eric Van Steenbergen* >>>>>> >>>>>> *E-mail: vs.e...@gmail.com <vs.e...@gmail.com>* >>>>>> *Skype: ericvs2014* >>>>>> *LinkedIn: Eric Van Steenbergen >>>>>> <http://es.linkedin.com/pub/eric-van-steenbergen/b/8a4/51b>* >>>>>> >>>>>> >>>>>> On Mon, Apr 12, 2021 at 3:48 AM Matthias Dellweg <mdell...@redhat.com> >>>>>> wrote: >>>>>> >>>>>>> Can you isolate the command that leads to this server response? >>>>>>> >>>>>>> On Mon, Apr 12, 2021 at 1:55 AM Eric VS <vs.e...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> I've been setting up another Pulp server, replicating repositories >>>>>>>> from my main one for 'local' use in an environment. When I was adding >>>>>>>> remotes and repositories at one point in time I started getting the >>>>>>>> below >>>>>>>> error: >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> *HTTP/1.1 500 Internal Server ErrorConnection: >>>>>>>> keep-aliveContent-Length: 55Content-Type: text/plain; >>>>>>>> charset=utf-8Date: >>>>>>>> Sun, 11 Apr 2021 23:53:14 GMTServer: nginx/1.16.1500 Internal Server >>>>>>>> ErrorServer got itself in trouble* >>>>>>>> >>>>>>>> I have enabled debug on Nginx but can't see anything indicating on >>>>>>>> why this all of a sudden fails. >>>>>>>> >>>>>>>> Any help is greatly appreciated. >>>>>>>> >>>>>>>> Kind regards, >>>>>>>> >>>>>>>> *Eric Van Steenbergen* >>>>>>>> >>>>>>>> *E-mail: vs.e...@gmail.com <vs.e...@gmail.com>* >>>>>>>> *Skype: ericvs2014* >>>>>>>> *LinkedIn: Eric Van Steenbergen >>>>>>>> <http://es.linkedin.com/pub/eric-van-steenbergen/b/8a4/51b>* >>>>>>>> _______________________________________________ >>>>>>>> Pulp-list mailing list >>>>>>>> Pulp-list@redhat.com >>>>>>>> https://listman.redhat.com/mailman/listinfo/pulp-list >>>>>>> >>>>>>> _______________________________________________ >> Pulp-list mailing list >> Pulp-list@redhat.com >> https://listman.redhat.com/mailman/listinfo/pulp-list > >
_______________________________________________ Pulp-list mailing list Pulp-list@redhat.com https://listman.redhat.com/mailman/listinfo/pulp-list
