I'll take a look. I'm surprised by that error though, it looks like two processes are racing to create a table, and not dealing with losing.
(I suspect we can fix it by pre-creating that tbl,/calling something before we spawn processes, but this really is a bug in celery.) On 19 May 2020 07:58:11 BST, Jarek Potiuk <jarek.pot...@polidea.com> wrote: >Hello Everyone, but mostly I think Kamil, Ash, Kaxil, > >I think we need someone who knows a bit more about Celery Executor to >stabilise one of the tests that is transiently failing. I think this >started to appear recently (so likely it is one of the optimizations >implemented recently) > >You can see example of such failure here but there are many more >similar >ones) > >https://github.com/apache/airflow/runs/687537257?check_suite_focus=true#step:6:387 > >I think there were recently some optimisations done in this area and I >believe it might be the root cause of this problem. Can you please help >to >solve that problem? I do not want to put that problem to Quarantine, as >it >looks like an awfully "real" problem. > > > >/usr/local/lib/python3.7/site-packages/celery/result.py:333: in >maybe_throw > self.throw(value, self._to_remote_traceback(tb)) >/usr/local/lib/python3.7/site-packages/celery/result.py:326: in throw > self.on_ready.throw(*args, **kwargs) >/usr/local/lib/python3.7/site-packages/vine/promises.py:244: in throw > reraise(type(exc), exc, tb) >_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ >_ _ >_ _ > >tp = <class 'Exception'> >value = Exception('<class >\'sqlalchemy.exc.IntegrityError\'>((\'(psycopg2.errors.UniqueViolation) >duplicate key value violates..."pg_type_typname_nsp_index"\\nDETAIL: >Key >(typname, typnamespace)=(celery_tasksetmeta, 2200) already >exists.\\n\',))') >tb = None > > def reraise(tp, value, tb=None): > """Reraise exception.""" > if value.__traceback__ is not tb: > raise value.with_traceback(tb) >> raise value >E Exception: <class >'sqlalchemy.exc.IntegrityError'>(('(psycopg2.errors.UniqueViolation) >duplicate key value violates unique constraint >"pg_type_typname_nsp_index"\nDETAIL: Key (typname, >typnamespace)=(celery_tasksetmeta, 2200) already exists.\n',)) > > > >J. > >-- > >Jarek Potiuk >Polidea <https://www.polidea.com/> | Principal Software Engineer > >M: +48 660 796 129 <+48660796129> >[image: Polidea] <https://www.polidea.com/>
