Is there a way to mount a recipe file so that it w...
# ingestion
r
Is there a way to mount a recipe file so that it will show up in UI ingestion? Or more generally, what are some ways I can manage my UI ingestion sources through source control?
m
Great question, we don't have a way to do this right now, but it would be super powerful. Want to file a feature request with a few more details? e.g. Is there a company local package repository where the ingestion sources could be pulled from? Or are you thinking about the quickstart experience, pulling whatever is locally available?
Feature request portal is here
r
I think it would be useful for a configuration as code approach. I would consider the recipes to be configuration and it would be really helpful to be able to spin up a local instance in docker that already has the same recipes loaded as an instance of Datahub running in the dev stage.
I think it's a similar idea to this thread here
I've been digging into this some more and correct me if I'm wrong, but does the
datahub-ingestion-cron
method provide what I'm looking for (configuring recipes as code) minus having the source appear in the Ingestion UI? How do users typically monitor and manage this ingestion method since there's no UI to browse executions and failures. Also, is there documentation on this ingestion method? I could not find any outside of Slack threads.