Thanks @mammoth-bear-12532. I have leveraged great expectations to validate datatypes, formats (numeric, email, currency) and compliance a bit for ingestion. Was thinking if that can be used to inject custom profiles into the configuration. Also I had posted that the snowflake-usage is failing for some missing fields (expected int, found NoneType) but the error message isn't clear. Is there a way to debug the issue