Yeah that is the common blocker, if you are a .NET developer shop, writing tests in JS could mean you may struggle to adopt developers into maintaining the tests, potentially allowing for drift between the generated contracts and actual implementation, which is really want to you want to avoid, as it gives the provider a hard time in being able to meet the actual applications expectations.
The Pact libraries are also available as command line tools, so they can be language agnostic, if that helps.
see
https://docs.pact.io/implementation_guides/other_languages