I think that also sounds really useful. I don't think this is one project but a series of projects.
The issue I see with that is manually updating each config. If we had a few "supported" genomes those could be automated/ or manageable. Having datasets and updated test runs for each of them would be a major pain.