Hi All,
We now have Mentees (Hanh and Lucas) to flesh out the next version of SummaryStats! As spoken to with
@Riley Grindle we will move towards (at least having the option for) a local DB and API (Re-running all analyses everytime is very wasteful after all), PostgreSQL/PostgREST, for querying as I already use this for
https://grit-realtime.tol.sanger.ac.uk/index.html and that works pretty well. In the same vein we could also generate a similar local webpage, and by using VIEWS we would be in a pretty good position to do that, however, that would be outside of the scope for the Mentee's (something I will work on along side them)
Pipeline run -> Data condensing (Plugin Part 1) -> Push to DB -> DB Views updated to include new data (Set intervals other wise this could becoming very expensive) -> Python Script to then pull and update base.config (Plugin Part 2, requires investigation as to wether this is actually possible or would have to be as a pre-pipeline process) and optionally generate the dozen or so graphs that we currently generate.
This will solidify in the coming couple of weeks and then at that point I think it would be good to have a small meeting with this community to gather ideas and suggestions. Thoughts?
I'll introduce Hanh and Lucas properly next week.