https://nf-co.re logo
Join Slack
Powered by
Hello! We have an external application that we ar...
# multiqc
r
Hello! We have an external application that we are feeding information to by parsing the 
multiqc_data.json
section 
report_general_stats_data
. The issue we are having is that with the v1.29 release, general stats went from a list of dicts to a dict of dicts, crashing our parsing. To avoid this in the future, what is the recommended file to parse? Which is more stable? Or is multiqc_data.json still the right file to parse?
This wasn't a hot topic, or the question wasn't well formulated... 🦗 😅 We are exploring the possibility of using 
multiqc_general_stats
. I might post our progress. Let me know if you have any pointers!
m
the main maintainer of multiqc is currently on (very well deserved) vacation. so it might take a bit to get a response (hopefully)
r
Hi @mashehu! Aha, I see, thank you for the reply!
p
We started moving from JSON to parquet as the intended official export format, but to be honest it hasn't been entirely plain sailing, and recently I've been thinking of going back to / sticking with the JSON output
So for now, yes I would stick with that json file
Apologises for the disruption in the format change, I do my best to not break the format as I know folks depend on it for downstream processing
We did a lot of internal refactoring around 1.29 and the following couple of versions. Enabling things like being able to generate reports from combining previous MultiQC reports
That's slowed down a lot now as the main developer we hired to do the work got a new position and we don't have funding to replace him, so it's back to me trying to squeeze time in whenever I can 😅
Good news for you as it means things go back to moving slowly again and should be more stable! 😅
🤣 1
r
Hi @Phil Ewels! Thanks for the help; this cleared everything up for us! Great, then we'll just need to patch the parsing Bittersweet! 😅 Wishing you a long and great vacation!
@Phil Ewels I'm scared to post another question (to take more of your time). 😅 But if you compare the 
multiqc_general_stats
file to the 
multiqc_data.json
, which one do you envision as the one users should use for exporting?
p
It's the same data so it doesn't really matter
👌 1
The latter has all the data from the run
Open in Slack
PreviousNext
Powered by