On Tue, Dec 1, 2020 at 7:42 PM Mike Bayer <[email protected]> wrote:
> do your "tests" each run in separate processes? > > > Heh, is "tests" surrounding in quotes because we're constructing our > entire data model for each test? FWIW, we call them integration tests, and > we aren't under the illusion that they are unit tests. To answer your > question, when we run the entire test suite, we parallelize ≈13k tests > across tens of processes, and it takes 10-25 minutes. > > right I asked earlier if that's what you were doing. this is not unlike > starting and stopping the database for each test, which would also make > tests take many seconds each so it's better to create the datamodel just > once per process and have it used among many tests (unless a single test is > just one process?) > Yes, this makes sense. When we run the entire test suite, we create the data model just once (per parallelized process), and this part is clear to me. Thank you. or is the use case when you are working on something and just want to run > one test? > > > Yes, this is the use case I'm trying to optimize for. > > for now you'd have to try to limit the import scope or otherwise perhaps > identify if some element of the model is taking a particularly long time to > initialize in which case we can take a look. > Makes sense, thanks. FWIW, I'll link this older issue where you helped our slow test performance problems by updating SQLAlchemy's accessing of an enum's `__members__`: https://github.com/sqlalchemy/sqlalchemy/issues/4758 Obviously, that problem has been addressed, but I wanted to say thank you! Bill > > > Bill > > > -- > SQLAlchemy - > The Python SQL Toolkit and Object Relational Mapper > > http://www.sqlalchemy.org/ > > To post example code, please provide an MCVE: Minimal, Complete, and > Verifiable Example. See http://stackoverflow.com/help/mcve for a full > description. > --- > You received this message because you are subscribed to the Google Groups > "sqlalchemy" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY2pA_6%3Df4mQU21j7oTehHTnCvGe2aYa8%2BynmkPggXKomQ%40mail.gmail.com > <https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY2pA_6%3Df4mQU21j7oTehHTnCvGe2aYa8%2BynmkPggXKomQ%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > > -- > SQLAlchemy - > The Python SQL Toolkit and Object Relational Mapper > > http://www.sqlalchemy.org/ > > To post example code, please provide an MCVE: Minimal, Complete, and > Verifiable Example. See http://stackoverflow.com/help/mcve for a full > description. > --- > You received this message because you are subscribed to the Google Groups > "sqlalchemy" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/sqlalchemy/cb910e44-2c47-4d58-ae08-eb95152ba8a2%40www.fastmail.com > <https://groups.google.com/d/msgid/sqlalchemy/cb910e44-2c47-4d58-ae08-eb95152ba8a2%40www.fastmail.com?utm_medium=email&utm_source=footer> > . > -- SQLAlchemy - The Python SQL Toolkit and Object Relational Mapper http://www.sqlalchemy.org/ To post example code, please provide an MCVE: Minimal, Complete, and Verifiable Example. See http://stackoverflow.com/help/mcve for a full description. --- You received this message because you are subscribed to the Google Groups "sqlalchemy" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/sqlalchemy/CANTn%2BY3LByMbJxiohHUXkwSL%3DpAH_hKePZ_7GvkRUew08LF_cQ%40mail.gmail.com.
