Re: [Pulp-list] pulp 3.2 rel 8 repo sync

[Bin Li (BLOOMBERG/ 120 PARK)]

Hi Tanya, 
I created a new issue https://pulp.plan.io/issues/6717. I didn't have the 2nd 
issue on 3.3.1. 

Thanks

From: ttere...@redhat.com At: 05/12/20 06:15:55To:  Bin Li (BLOOMBERG/ 120 PARK 
) 
Cc:  pulp-list@redhat.com
Subject: Re: [Pulp-list] pulp 3.2 rel 8 repo sync

Hi Bin,

Both look like Pulp issues to me, or at least it's worth investigating if Pulp 
handles everything correctly.
With pulp_rpm 3.3.1, I was able to reproduce #1 but not #2. Could you file a 
bug for #1?

If you are using pulp 3.2, consider upgrading to 3.3.1 and let us know if you 
still encounter the issue #2. 
There are many improvements and fixes in 3.3, including handling of relative 
paths, so it's possible that you'll see it in 3.2 only.

Thank you,
Tanya
On Tue, May 12, 2020 at 3:30 AM Bin Li (BLOOMBERG/ 120 PARK) 
<bli...@bloomberg.net> wrote:

Got two errors  below to sync rel 8 repo that I haven't seen before. Are they 
related to upstream repo or it could be a pulp issue?


1.
rhel-8.2-for-x86_64-appstream-source-rpms{
    "created_resources": [], 
    "error": {
        "description": "integer out of range\n", 
        "traceback": "  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/worker.py\", line 
884, in perform_job\n    rv = job.perform()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\", line 
664, in perform\n    self._result = self._execute()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\", line 
670, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
 line 152, in synchronize\n    dv.create()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py\",
 line 149, in create\n    loop.run_until_complete(pipeline)\n  File 
\"/opt/python/3.7.3/lib64/python3.7/asyncio/base_events.py\", line 584, in 
run_until_complete\n    return future.result()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
 line 228, in create_pipeline\n    await asyncio.gather(*futures)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
 line 43, in __call__\n    await self.run()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
 line 219, in run\n    
RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n
  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/models/content.py\",
 line 48, in bulk_get_or_create\n    return super().bulk_create(objs, 
batch_size=batch_size)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/manager.py\",
 line 82, in manager_method\n    return getattr(self.get_queryset(), 
name)(*args, **kwargs)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
 line 468, in bulk_create\n    self._batched_insert(objs_with_pk, fields, 
batch_size, ignore_conflicts=ignore_conflicts)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
 line 1204, in _batched_insert\n    ignore_conflicts=ignore_conflicts,\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py\",
 line 1186, in _insert\n    return 
query.get_compiler(using=using).execute_sql(return_id)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/sql/compiler.py\",
 line 1375, in execute_sql\n    cursor.execute(sql, params)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
 line 67, in execute\n    return self._execute_with_wrappers(sql, params, 
many=False, executor=self._execute)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
 line 76, in _execute_with_wrappers\n    return executor(sql, params, many, 
context)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
 line 84, in _execute\n    return self.cursor.execute(sql, params)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/utils.py\",
 line 89, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from 
exc_value\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py\",
 line 84, in _execute\n    return self.cursor.execute(sql, params)\n"
    }, 

2.
rhel-8.2-for-x86_64-baseos-rpms
    "error": {
        "description": "No declared artifact with relative path 
\"repodata/adff8e65-8c3c-4ffb-bb72-5d4116fab7c9\" for content 
\"<RepoMetadataFile: pk=d55b4179-7423-44c2-832c-e6054a031fd3>\"", 
        "traceback": "  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/worker.py\", line 
884, in perform_job\n    rv = job.perform()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\", line 
664, in perform\n    self._result = self._execute()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rq/job.py\", line 
670, in _execute\n    return self.func(*self.args, **self.kwargs)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulp_rpm/app/tasks/synchronizing.py\",
 line 152, in synchronize\n    dv.create()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/declarative_version.py\",
 line 149, in create\n    loop.run_until_complete(pipeline)\n  File 
\"/opt/python/3.7.3/lib64/python3.7/asyncio/base_events.py\", line 584, in 
run_until_complete\n    return future.result()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
 line 228, in create_pipeline\n    await asyncio.gather(*futures)\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/api.py\",
 line 43, in __call__\n    await self.run()\n  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
 line 219, in run\n    
RemoteArtifact.objects.bulk_get_or_create(self._needed_remote_artifacts(batch))\n
  File 
\"/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/plugin/stages/artifact_stages.py\",
 line 263, in _needed_remote_artifacts\n    c=d_content.content))\n"
    }, 


_______________________________________________
Pulp-list mailing list
Pulp-list@redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list



_______________________________________________
Pulp-list mailing list
Pulp-list@redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list