Hello guys, I'm using Testbox to run unit/integrat...
# box-products
g
Hello guys, I'm using Testbox to run unit/integration tests on my applications and I've integrated on a GitLab Pipeline and now I want to take a step further and run Test Coverage on my pipeline. To run a coverage test Ortus recommends the use of FusionReactor, the problem is that my company already pays for a similar service and is very unlikely to pay for another one. Is there a way to run test coverages on Testbox with another solution than FusionReactor? Preferably an open source solution, but I'm open to other paid ones. Thanks in advance, sorry by my bad english.
p
Sure, spin up an instance of commandbox and run Testbox against your app's tests.
Did you not just describe how you are doing that on the other post?
g
@Patrick on the other post I describe how to run on the pipeline, but when I run the testbox it checks only if the built tests are working, if they pass then the pipeline succeds. What I want is to run a code coverage, for example, if 70%+ of my code is covered by Unit/Integrations tests then I want the pipeline to succeed, if no then it fails. I can achieve that behaviour by using FusionReactor, but as said before, FusionReactor is a paid software.
b
@Gabriel Rodrigues The answer is no.
😞 1
There is no other solution that exists in the CFML space outside of FR which provides instrumentation of bytecode, and FR is not a free product
Now, what you can do is sign up for a FR cloud account with zero reserved instances and a credit card on file and you'll be charged only for the few minutes that your CI server is running the site during tests since the cloud license is pay as you go
So, depending on how often your tests run, you'll just be paying the $0.13/minute or whatever it comes out to
g
@bdw429s thanks for the response! Really sad that there are no other solutins. I'll try to convince my company to test this solution with FR on cloud.
p
Ahh misunderstood; yea do what Brad said ^
b
Yeah, I guess. I mean, everyone wants stuff for free. Integral, as a company, invested many many hours into their product and making it compatible with both Lucee and Adobe's bytecode and now you wish they would just give you all that work for free. 🙂
Anyone else in the community could create their own version and give it away for free, but the reality is, it's a huge amount of work and why would anyone invest in that?
The only other instrumentation project I was ever aware of was many years ago called Rancho and it directly instrumented CFML code, but only worked on tags and required a separate copy of your code base, lol
g
@bdw429s I understand that the solution would not be free, my problem is that since my company pays for a service similar to FusionReactor they will not be willing to pay for another one that does the exact same thing. I just expected that would be other solutions, even if paid.
b
Out of curiosity, what APM is your company using?
I would be willing to bet FR does much more than it does 🙂
Maybe this is a good chance for them to switch 😉
g
@bdw429s we use Dynatrace
b
Their pricing looks similar to FR's
I can't overstate the extent to which FR is a tool custom designed to monitor ColdFusion servers. A lot of tools out there do "java" or even "servlets", but no other product has the level of integration that FR does with CF engines and common CF frameworks.
m
Adding my voice to the "FR" is amazing push here. They are a trusted Adobe partner and their software is legit.
👍 1
d
And their support is great.