So I had to first install Solidus with

solidus_starter_frontend

, namespace and cleanly separate everything, commit the changes, then rebase and re-install Solidus but this time without the frontend. Because it forces your app to use Sprockets, so if you're using modern-day Propshaft, it will cause all kinds of difficulties.