Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  closed
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:  invalid
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Comment (by David Sanders):

 ok thanks for checking 👍

 Iterables are valid expressions so I doubt that would be something that
 would be the correct approach.

 If anything, the index should probably coerce basic types list list into
 their `Value(…)` counterparts as this solves the issue and is something
 that is done for `db_default` already to solve precisely this issue.  To
 explain: psycopg (3) changed the way lists are rendered as SQL from
 `ARRAY['foo', 'bar']` to simply `{"foo", "bar"}`. The issue is the
 ambiguous string which requires casting; and `Value()` expressions are
 cast.
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e117a63b8-c61f2562-a731-478e-8b69-3f4a1031d842-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  closed
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:  invalid
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Comment (by Adam Zahradník):

 Upon closer inspection and trying to reproduce this, you are right. The
 problem was inside the model definition, which was later fixed in our
 codebase, but the broken migration was still there, but was working on
 psycopg2 (even though incorrectly), so nobody noticed until now.
 `
 So, this is indeed not a bug with Django. It can be considered whether
 passing an iterable to `UniqueConstraint` should not produce some warning.
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0e4c887b-ca0aeba1-9744-4677-b29e-633379a476a6-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  closed
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:  invalid
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Comment (by David Sanders):

 Please paste the _actual_ model field & generated migration for that field
 so we can determine _exactly_ what is happening.

 I'm using Django 4.0.6 and the model

 {{{
 class Foo(models.Model):
 name = models.CharField(max_length=255)
 label = models.CharField(max_length=255)

 class Meta:
 constraints = [
 models.UniqueConstraint(
 "name",
 "label",
 name="unique_pair",
 ),
 ]
 }}}

 generates the migration

 {{{
 migrations.AddConstraint(
 model_name='foo',
 constraint=models.UniqueConstraint(django.db.models.expressions.F('name'),
 django.db.models.expressions.F('label'), name='unique_pair'),
 ),
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0d9a2b5a-18d267b3-ae09-493e-8cba-863bc75eca64-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  closed
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:  invalid
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Comment (by Adam Zahradník):

 When looking at our UniqueConstraint in the model, we never used
 `UniqueConstraint(["field"],...)`, but either
 `UniqueConstraint(fields=[..])` or `UniqueConstraint("field",...)`. Both
 of which are documented in the docs:
 https://docs.djangoproject.com/en/5.0/ref/models/constraints/#uniqueconstraint

 I see how `UniqueConstraint([...])` would create a wrong constraint, as
 the array would be accepted as an expression, but I don't think that is
 the problem here.

 We already used this model in production for quite some time, and it is
 definitely possible to insert values into the table.
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0d8fbdbd-f38d9223-71b5-483d-8d76-742bb7d47987-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  closed
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:  invalid
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Changes (by David Sanders):

 * resolution:   => invalid
 * stage:  Accepted => Unreviewed
 * status:  new => closed

Comment:

 Actually, on second thoughts:

 The problem here is the misunderstanding of using
 `UniqueConstraint(['field_1', 'field_2'])` - on psycopg2 this is
 interpreted as the literal `ARRAY['field_1'::text, 'field_2'::text']`.
 Which will fail for **any** value inserted into the table.

 Given this, I think this should be categorised as "Invalid" 👍
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0c5ffd30-e080619f-fc87-475d-86b1-3cbdbfe0891a-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  new
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:
 Keywords:  | Triage Stage:  Accepted
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+
Changes (by David Sanders):

 * stage:  Unreviewed => Accepted

Comment:

 Thanks for the report 🏆

 Looks like it's not just old migrations but a model with the following
 will produce the same migration & error with psycopg (3)

 {{{
 class Foo(models.Model):
 name = models.CharField()
 label = models.CharField()

 class Meta:
 constraints = [
 models.UniqueConstraint(
 ["name", "label"],
 name="unique_pair",
 ),
 ]
 }}}

 Migration generated:

 {{{
 class Migration(migrations.Migration):
 initial = True

 dependencies = []

 operations = [
 migrations.CreateModel(
 name="Foo",
 fields=[
 (
 "id",
 models.BigAutoField(
 auto_created=True,
 primary_key=True,
 serialize=False,
 verbose_name="ID",
 ),
 ),
 ("name", models.CharField()),
 ("label", models.CharField()),
 ],
 options={
 "constraints": [
 models.UniqueConstraint(["name", "label"],
 name="unique_pair")
 ],
 },
 ),
 ]
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0c4a4dc0-97580e6d-1438-40b1-b437-d65af48faa6c-00%40eu-central-1.amazonses.com.

Re: [Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
+--
 Reporter:  Adam Zahradník  |Owner:  nobody
 Type:  Bug |   Status:  new
Component:  Migrations  |  Version:  5.0
 Severity:  Normal  |   Resolution:
 Keywords:  | Triage Stage:  Unreviewed
Has patch:  0   |  Needs documentation:  0
  Needs tests:  0   |  Patch needs improvement:  0
Easy pickings:  0   |UI/UX:  0
+--
Changes (by Adam Zahradník):

 * type:  Uncategorized => Bug

-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0b520e84-3db339e4-5d03-447d-aded-50e3ded01a81-00%40eu-central-1.amazonses.com.

[Django] #35271: Old migrations with UniqueConstraint fail when using psycopg3

[Django]

#35271: Old migrations with UniqueConstraint fail when using psycopg3
--+
   Reporter:  Adam Zahradník  |  Owner:  nobody
   Type:  Uncategorized   | Status:  new
  Component:  Migrations  |Version:  5.0
   Severity:  Normal  |   Keywords:
   Triage Stage:  Unreviewed  |  Has patch:  0
Needs documentation:  0   |Needs tests:  0
Patch needs improvement:  0   |  Easy pickings:  0
  UI/UX:  0   |
--+
 We have noticed that migrations generated with Django 4.0.6 containing
 UniqueConstraint fail to apply under Django 5.0.3 when using psycopg3.

 The problematic operation:
 {{{
 migrations.AddConstraint(
 model_name="model",
 constraint=models.UniqueConstraint(
["some", "fields", "here"],
name="constraint_name",
 ),
 ),
 }}}

 Which fails with the following error:
 {{{
 psycopg.errors.UndefinedObject: data type unknown has no default operator
 class for access method "btree"
 HINT:  You must specify an operator class for the index or define a
 default operator class for the data type.
 }}}

 However, when using psycopg2, the migration gets applied without any
 problem.

 We also noticed that a migration generated by Django 4.1.5 produces the
 following operation, which runs successfully on both psycopg versions:
 {{{
 migrations.AddConstraint(
 model_name="model",
 constraint=models.UniqueConstraint(
 models.F("some"),
 models.F("fields"),
 models.F("here"),
 name="constraint_name",
 ),
 ),
 }}}

 A current way to fix failing migrations is to pass the list of fields to a
 keyword argument `fields`:
 {{{
 migrations.AddConstraint(
 model_name="model",
 constraint=models.UniqueConstraint(
fields=["some", "fields", "here"],
name="constraint_name",
 ),
 ),
 }}}
-- 
Ticket URL: 
Django 
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/0107018e0b4ea0a8-07997abd-9e04-48f3-ba3c-279e8a3bdbca-00%40eu-central-1.amazonses.com.