also a second question is so in regards of the pro...
# pact-jsj
John Williams
05/31/2022, 9:58 AMalso a second question is so in regards of the pros and cons of contract testing vs say property based testing apis?
m
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:01 AM
Property testing doesn’t care about what the consumer actually does
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:01 AM
it is all about the provider
j
John Williams
05/31/2022, 10:03 AMdo you think it is a good test strategy to create some contract tests and also run property based tests against the apis to find weird edge cases?
m
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:05 AM
contract tests are about preventing API breaking changes (amongst other things), whereas property testing is more about discovering issues with the provider
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:05 AM
so yes, it wouldn’t be a bad idea
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:06 AM
but in my experience I’d say property testing is also not that common
Matt (pactflow.io / pact-js / pact-go)
05/31/2022, 10:06 AM
(not a reason not to do it)
j
John Williams
05/31/2022, 10:06 AMyeah im looking into this tool called schemathesis - looks pretty good
💯 1
t
Timothy Jones
06/06/2022, 2:52 AMI'd be curious to know how you go with Schemathesis - my gut is that you'd run into the problem with things that are hard to express / not expressed in the schema - eg conditional properties based on values of other fields
m
Matt (pactflow.io / pact-js / pact-go)
06/06/2022, 2:57 AM
Yes. It’s hard to do, but they do have some notes/caveats: https://schemathesis.readthedocs.io/en/stable/faq.html#does-schemathesis-support-open-api-discriminators-schemathesis-raises-an-unsatisfiable-error
(sound familiar Tim!)
😂 1
j
John Williams
06/08/2022, 12:09 PMi let you know how i get on with it
👍 1
John Williams
06/20/2022, 1:22 AMI tried out schemathestis it appears to be pretty good actually. Though the only downside i could find from it is that for REST you need to generate a specification file that may not always be possbile?