Hi Teamn ,
Getting errors as shown here when we are trying to sync RHEL 8 repos (Base OS and Appstream) creatd on Pulp master. The same Pulp master we already using for RHEL 6 and 7 repos with out any issues. Strugling with RHEL 8 repos creation,
1.Could you please let us know whethere RHEL 8 rpm repos sync works on Pulp master version 2.16 or not ?
2.feed_ca_cert "redhat-uep.pem" and feed_cert "rhel-identity.pem" are there . We have no issues with RHEL 6 and 7 repo syncs, those created some years ago and working well.
Is there any thing specifically need to do for RHEL 8 repos in terms of ca cert/feed cert ? We see "failed with code 403 Forbiddenin" in var log messages.
Getting errors as shown here when we are trying to sync RHEL 8 repos (Base OS and Appstream) creatd on Pulp master. The same Pulp master we already using for RHEL 6 and 7 repos with out any issues. Strugling with RHEL 8 repos creation,
1.Could you please let us know whethere RHEL 8 rpm repos sync works on Pulp master version 2.16 or not ?
2.feed_ca_cert "redhat-uep.pem" and feed_cert "rhel-identity.pem" are there . We have no issues with RHEL 6 and 7 repo syncs, those created some years ago and working well.
Is there any thing specifically need to do for RHEL 8 repos in terms of ca cert/feed cert ? We see "failed with code 403 Forbiddenin" in var log messages.
3.pulp-admin tasks details Traceback shows "/usr/lib/python2.7/..."
For this added these 3 lines in /etc/pulp/server/plugins.conf.d/yum_importer.json as recommended here https://pulp.plan.io/issues/6327
{
"validate":true
}
"validate":true
}
After adding that json , I see that RHEL 8 repodata xml.gz in rhel8/x86_64/baseos/os/repodata/ but not "packages" folder created yet , checked that thru pulp web access .
Please help resolving this issue .
Please help resolving this issue .
Feed url: https://cdn.redhat.com/content/dist/rhel8/$releasever/x86_64/baseos/os
Feed url: https://cdn.redhat.com/content/dist/rhel8/$releasever/x86_64/appstream/os
Repoid for these urls are :
rhel-8-server-baseos-x86_64
rhel-8-server-appstream-x86_64
Note: Tried with "8" in place "$releasever" in feed but same error . Our Pulp master ver.2.16 is on CentOS 7.7.
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Tasks performed:
[root@swy01opplppr01 ~]# pulp-admin rpm repo sync run --force-full --repo-id rhel-8-server-baseos-x86_64
+----------------------------------------------------------------------+
Synchronizing Repository [rhel-8-server-baseos-x86_64]
+----------------------------------------------------------------------+
+----------------------------------------------------------------------+
Synchronizing Repository [rhel-8-server-baseos-x86_64]
+----------------------------------------------------------------------+
The following sync configuration options will be used:
Force Full: True
This command may be exited via ctrl+c without affecting the request.
Downloading metadata...
[\]
... completed
Downloading repository content...
[-]
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
[-]
[==================================================] 100%
RPMs: 0/0 items
Delta RPMs: 0/0 items
... completed
Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
[==================================================] 100%
Distributions: 0/0 items
Task Failed
Error retrieving metadata: Forbidden
-------------------------------------------------------------------------------------------------------------------------
From /var/log/messages:
Mar 17 17:11:23 swy01opplppr01 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[c5b01662-a20a-4c44-b114-b1ba595f05fc]
Mar 17 17:11:23 swy01opplppr01 pulp: celery.app.trace:INFO: [55ba0954] Task pulp.server.async.tasks._queue_reserved_task[55ba0954-1a18-410a-9507-f61d74c4776f] succeeded in 0.115055091001s: None
Mar 17 17:11:23 swy01opplppr01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
Mar 17 17:11:23 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:23 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml failed with code 403: Forbidden
Mar 17 17:11:24 swy01opplppr01 pulp: urllib3.connectionpool:INFO: [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:24 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: [fbbc36d3] Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with code 403: Forbidden
Mar 17 17:11:24 swy01opplppr01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
Mar 17 17:11:24 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:24 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml failed with code 403: Forbidden
Mar 17 17:11:25 swy01opplppr01 pulp: urllib3.connectionpool:INFO: [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:25 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: [fbbc36d3] Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with code 403: Forbidden
Mar 17 17:11:25 swy01opplppr01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
Mar 17 17:11:25 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:25 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml failed with code 403: Forbidden
Mar 17 17:11:26 swy01opplppr01 pulp: urllib3.connectionpool:INFO: [fbbc36d3] Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:26 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: [fbbc36d3] Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os failed with code 403: Forbidden
Mar 17 17:11:26 swy01opplppr01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading metadata from https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.
Mar 17 17:11:26 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:27 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/repodata/repomd.xml failed with code 403: Forbidden
Mar 17 17:11:27 swy01opplppr01 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: [fbbc36d3] Downloading additional units.
Mar 17 17:11:27 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:28 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/.treeinfo failed with code 404: Not Found
Mar 17 17:11:28 swy01opplppr01 pulp: urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Mar 17 17:11:29 swy01opplppr01 pulp: nectar.downloaders.threaded:INFO: Download failed: Download of https://cdn.redhat.com/content/dist/rhel8//x86_64/baseos/os/treeinfo failed with code 404: Not Found
Mar 17 17:11:30 swy01opplppr01 pulp: pulp.server.async.tasks:INFO: [fbbc36d3] Task failed : [fbbc36d3-fddd-4f54-9be6-770acecf374f] : Error retrieving metadata: Forbidden
Mar 17 17:11:30 swy01opplppr01 pulp: celery.app.trace:INFO: [fbbc36d3] Task pulp.server.managers.repo.sync.sync[fbbc36d3-fddd-4f54-9be6-770acecf374f] raised expected: PulpCodedException()
Mar 17 17:11:30 swy01opplppr01 pulp: celery.app.trace:INFO: [c5b01662] Task pulp.server.async.tasks._release_resource[c5b01662-a20a-4c44-b114-b1ba595f05fc] succeeded in 0.00344043700079s: None
-----------------------------------------------------------------------------------------------------
[root@swy01opplppr01 ~]# pulp-admin tasks details --task-id fbbc36d3-fddd-4f54-9be6-770acecf374f
+----------------------------------------------------------------------+
Task Details
+----------------------------------------------------------------------+
+----------------------------------------------------------------------+
Task Details
+----------------------------------------------------------------------+
Operations: sync
Resources: rhel-8-server-baseos-x86_64 (repository)
State: Failed
Start Time: 2020-03-17T21:11:23Z
Finish Time: 2020-03-17T21:11:30Z
Result: N/A
Task Id: fbbc36d3-fddd-4f54-9be6-770acecf374f
Worker Name: reserved_resource_worke...@swy01opplppr01.ops.hosting.knxa
Progress Report:
Yum Importer:
Comps:
State: FINISHED
Content:
Details:
Drpm Done: 0
Drpm Total: 0
Rpm Done: 0
Rpm Total: 0
Error Details:
Items Left: 0
Items Total: 0
Size Left: 0
Size Total: 0
State: FINISHED
Distribution:
Error Details:
Items Left: 0
Items Total: 0
State: FINISHED
Errata:
State: FINISHED
Metadata:
State: FINISHED
Purge Duplicates:
State: FINISHED
Traceback: Traceback (most recent call last): File
"/usr/lib/python2.7/site-packages/celery/app/trace.py", line
382, in trace_task R = retval = fun(*args, **kwargs)
File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 529, in __call__ return super(Task,
self).__call__(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 107, in __call__ return super(PulpTask,
self).__call__(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/celery/app/trace.py", line
641, in __protected_call__ return self.run(*args,
**kwargs) File
"/usr/lib/python2.7/site-packages/pulp/server/controllers/repo
sitory.py", line 769, in sync sync_report =
sync_repo(transfer_repo, conduit, call_config) File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 737, in wrap_f return f(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
um/importer.py", line 82, in sync_repo report =
self._current_sync.run() File
"/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
um/sync.py", line 335, in run
reason=self.repomd_not_found_reason) PulpCodedException: Error
retrieving metadata: Forbidden
Resources: rhel-8-server-baseos-x86_64 (repository)
State: Failed
Start Time: 2020-03-17T21:11:23Z
Finish Time: 2020-03-17T21:11:30Z
Result: N/A
Task Id: fbbc36d3-fddd-4f54-9be6-770acecf374f
Worker Name: reserved_resource_worke...@swy01opplppr01.ops.hosting.knxa
Progress Report:
Yum Importer:
Comps:
State: FINISHED
Content:
Details:
Drpm Done: 0
Drpm Total: 0
Rpm Done: 0
Rpm Total: 0
Error Details:
Items Left: 0
Items Total: 0
Size Left: 0
Size Total: 0
State: FINISHED
Distribution:
Error Details:
Items Left: 0
Items Total: 0
State: FINISHED
Errata:
State: FINISHED
Metadata:
State: FINISHED
Purge Duplicates:
State: FINISHED
Traceback: Traceback (most recent call last): File
"/usr/lib/python2.7/site-packages/celery/app/trace.py", line
382, in trace_task R = retval = fun(*args, **kwargs)
File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 529, in __call__ return super(Task,
self).__call__(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 107, in __call__ return super(PulpTask,
self).__call__(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/celery/app/trace.py", line
641, in __protected_call__ return self.run(*args,
**kwargs) File
"/usr/lib/python2.7/site-packages/pulp/server/controllers/repo
sitory.py", line 769, in sync sync_report =
sync_repo(transfer_repo, conduit, call_config) File
"/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py",
line 737, in wrap_f return f(*args, **kwargs) File
"/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
um/importer.py", line 82, in sync_repo report =
self._current_sync.run() File
"/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/y
um/sync.py", line 335, in run
reason=self.repomd_not_found_reason) PulpCodedException: Error
retrieving metadata: Forbidden
-------------------------------------------------------------------------------
Sincerely,
Ramana Bora
Sincerely,
Ramana Bora
_______________________________________________ Pulp-list mailing list Pulp-list@redhat.com https://www.redhat.com/mailman/listinfo/pulp-list