Hi team, Is there any way to export matrix data to...
# pactflow
k
Hi team, Is there any way to export matrix data to file or get it via pactflow CLI command?
m
What are you wanting to achieve?
k
I want matrix data in as reports for management
m
Can you please elaborate on specifically the data (use cases) you want for those reports? The matrix has a lot of data, I suspect you just want a subset of it
k
Looking for columns captured in below screen shot for all records of a week
all versions comparison for given pacticipant
r
Following this thread as well. It would be good to be able to export that data to show on other dashboards and such. Especially for less technical audiences. I am currently in the process of getting buy-in from the managers/product owners/directors across our engineering teams. Being able to show this data next to some of our other dashboards would help to get more buy-in. It would also be more convenient, since then our engineers would not need to go to an additional page to see how their Pact workflows are doing — I could pipe the data export into our centralized developer portal and show it alongside the other health, performance, and test metrics for our apps.
m
There are APIs, I'm just keen to understand the use cases and scenarios. What Dev dashboard tools do you use? What else does it show?
b
e.g. what kind of decision are you trying to make (using the extracted data)?
☝️ 1
m
For further context, the matrix is a really large set of data, across a number of domain models. much of which is transient and probably not useful for decision making. I'm guessing things like "which applications are currently deployable to production" might be useful.
b
(or which aren't, if you're checking weekly)
m
yep. I’m avoiding stating the use cases I think are useful, because I want here from them. We get this kind of question a lot, but the specific information that is useful seems to be much more allusive. I’m not saying it’s the case here, but people want to see “data” but upon closer inspection, they can’t answer why
💯 1
k
all users do not log in to pactflow portal to see the matrix, to understand how many failures in given week / certain duration
is the export feature available or you will plan to add such feature by gathering the requirement?
m
Follow the public API discussion here: https://github.com/pactflow/roadmap/projects/1
There is no “export” feature, at the moment
to understand how many failures in given week / certain duration
so, the matrix doesn’t have this data. Were you planning on taking the data, ingesting it, and then deriving this information from it?
k
yes
y
I think the link should be https://github.com/pactflow/roadmap/issues/94 Please feel free to add any technical requirements or anything additional to there, as it will be useful for tracking, if you wish.
r
Just wanted to jump back in here to say that the API would fit the use cases that I was thinking of. I can't think of a scenario right now where an 'export' would better achieve the need over the API. The only maybe would be exporting the data and then importing it to DataDog for analytics and to build dashboards — but that can also be achieved using the API, just requires a little more processing before uploading to DataDog.
👍 2
k
okay, could you share documentation link where I can find technical steps to implement custom solution
Also could you please confirm the max no. of records / statuses within one integration that pactflow can persist
m
there are no “limits” set in PactFlow, however we do clean data on occasion. See https://docs.pact.io/pact_broker/administration/maintenance for background on how the OSS pact broker cleaning works. At PactFlow, we manage this on your behalf automatically in order to optimise performance, so there are no specific numbers we can provide.
👍 1
There is a
/matrix
endpoint that you can call to get the data. It’s not currently documented, but if you head to the
/can-i-deploy
page in PactFlow or the matrix tab of any integration, you can get a feel for the parameters.
you can also add
--verbose
to the
can-i-deploy
command calls and it will print it out