How to disable (or limit) test.check shrinking
I'm using test.check to test a live service. Occasionally it gets a 503 from the service and spends hours trying to shrink the input & reproduce the error. Is there a way to limit the shrinking process to n iterations? Or disable it entirely for some tests? Is there a better approach for using test.check against a live service where transient issues are expected? Should I just retry the actual service call many times before allowing test.check to see it? Thanks, Matt -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to disable (or limit) test.check shrinking
If the 503 is only returned by failures not relating to what you are testing (e.g. load), then one option might be to catch the exception and retry that request? On Thu, Feb 9, 2017 at 6:48 AM 'Matt Bossenbroek' via Clojure < clojure@googlegroups.com> wrote: > I'm using test.check to test a live service. Occasionally it gets a 503 > from the service and spends hours trying to shrink the input & reproduce > the error. > > Is there a way to limit the shrinking process to n iterations? Or disable > it entirely for some tests? > > Is there a better approach for using test.check against a live service > where transient issues are expected? Should I just retry the actual service > call many times before allowing test.check to see it? > > Thanks, > Matt > > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Daniel -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to disable (or limit) test.check shrinking
I considered that, but that only partially fixes the issue. If it does actually find a real problem, it’ll never complete because the shrinking takes too long. In the end I’d rather have something not fully shrunk than something that runs forever. -Matt On February 8, 2017 at 1:19:24 PM, Daniel Compton ( daniel.compton.li...@gmail.com) wrote: If the 503 is only returned by failures not relating to what you are testing (e.g. load), then one option might be to catch the exception and retry that request? On Thu, Feb 9, 2017 at 6:48 AM 'Matt Bossenbroek' via Clojure < clojure@googlegroups.com> wrote: > I'm using test.check to test a live service. Occasionally it gets a 503 > from the service and spends hours trying to shrink the input & reproduce > the error. > > Is there a way to limit the shrinking process to n iterations? Or disable > it entirely for some tests? > > Is there a better approach for using test.check against a live service > where transient issues are expected? Should I just retry the actual service > call many times before allowing test.check to see it? > > Thanks, > Matt > > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clojure@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+unsubscr...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > -- Daniel -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to disable (or limit) test.check shrinking
Wrapping the generator in `gen/no-shrink` will give you a generator that pretends it doesn't know how to shrink. On Thursday, February 9, 2017 at 11:55:38 AM UTC-6, Matt Bossenbroek wrote: > > I considered that, but that only partially fixes the issue. If it does > actually find a real problem, it’ll never complete because the shrinking > takes too long. > > In the end I’d rather have something not fully shrunk than something that > runs forever. > > -Matt > > > On February 8, 2017 at 1:19:24 PM, Daniel Compton (daniel.com...@gmail.com > ) wrote: > > If the 503 is only returned by failures not relating to what you are > testing (e.g. load), then one option might be to catch the exception and > retry that request? > > On Thu, Feb 9, 2017 at 6:48 AM 'Matt Bossenbroek' via Clojure < > clo...@googlegroups.com > wrote: > >> I'm using test.check to test a live service. Occasionally it gets a 503 >> from the service and spends hours trying to shrink the input & reproduce >> the error. >> >> Is there a way to limit the shrinking process to n iterations? Or disable >> it entirely for some tests? >> >> Is there a better approach for using test.check against a live service >> where transient issues are expected? Should I just retry the actual service >> call many times before allowing test.check to see it? >> >> Thanks, >> Matt >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to clo...@googlegroups.com >> >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> clojure+u...@googlegroups.com >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to clojure+u...@googlegroups.com . >> For more options, visit https://groups.google.com/d/optout. >> > -- > > Daniel > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clo...@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+u...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+u...@googlegroups.com . > For more options, visit https://groups.google.com/d/optout. > > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to disable (or limit) test.check shrinking
Perfect - that’s exactly what I’m looking for. Thanks! -Matt On February 9, 2017 at 4:04:17 PM, Gary Fredericks (fredericksg...@gmail.com) wrote: Wrapping the generator in `gen/no-shrink` will give you a generator that pretends it doesn't know how to shrink. On Thursday, February 9, 2017 at 11:55:38 AM UTC-6, Matt Bossenbroek wrote: > > I considered that, but that only partially fixes the issue. If it does > actually find a real problem, it’ll never complete because the shrinking > takes too long. > > In the end I’d rather have something not fully shrunk than something that > runs forever. > > -Matt > > > On February 8, 2017 at 1:19:24 PM, Daniel Compton (daniel.com...@gmail.com) > wrote: > > If the 503 is only returned by failures not relating to what you are > testing (e.g. load), then one option might be to catch the exception and > retry that request? > > On Thu, Feb 9, 2017 at 6:48 AM 'Matt Bossenbroek' via Clojure < > clo...@googlegroups.com> wrote: > >> I'm using test.check to test a live service. Occasionally it gets a 503 >> from the service and spends hours trying to shrink the input & reproduce >> the error. >> >> Is there a way to limit the shrinking process to n iterations? Or disable >> it entirely for some tests? >> >> Is there a better approach for using test.check against a live service >> where transient issues are expected? Should I just retry the actual service >> call many times before allowing test.check to see it? >> >> Thanks, >> Matt >> >> -- >> You received this message because you are subscribed to the Google >> Groups "Clojure" group. >> To post to this group, send email to clo...@googlegroups.com >> Note that posts from new members are moderated - please be patient with >> your first post. >> To unsubscribe from this group, send email to >> clojure+u...@googlegroups.com >> For more options, visit this group at >> http://groups.google.com/group/clojure?hl=en >> --- >> You received this message because you are subscribed to the Google Groups >> "Clojure" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to clojure+u...@googlegroups.com. >> For more options, visit https://groups.google.com/d/optout. >> > -- > > Daniel > -- > You received this message because you are subscribed to the Google > Groups "Clojure" group. > To post to this group, send email to clo...@googlegroups.com > Note that posts from new members are moderated - please be patient with > your first post. > To unsubscribe from this group, send email to > clojure+u...@googlegroups.com > For more options, visit this group at > http://groups.google.com/group/clojure?hl=en > --- > You received this message because you are subscribed to the Google Groups > "Clojure" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to clojure+u...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. > > -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Clojure" group. To post to this group, send email to clojure@googlegroups.com Note that posts from new members are moderated - please be patient with your first post. To unsubscribe from this group, send email to clojure+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/clojure?hl=en --- You received this message because you are subscribed to the Google Groups "Clojure" group. To unsubscribe from this group and stop receiving emails from it, send an email to clojure+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
