Hey Everyone, is anyone running meltano using <Arg...
# getting-startedt
tim_frazer
08/03/2021, 11:43 PMHey Everyone, is anyone running meltano using Argo?
I'm looking at how this might work - and just wondering if anyone else has deployed to production?
s
stephen_bailey
08/03/2021, 11:44 PMWe just deployed it to Argo Workflows and it works great! We have a WorkflowTemplate that maps in the GitHub repo and environment variables, and we set up CronWorfklows for each loading job. Works terrific
t
tim_frazer
08/03/2021, 11:46 PMthat sounds pretty straightforward - anychance you have an opensource repo š
s
stephen_bailey
08/03/2021, 11:47 PMNo but Iād be happy to post the templates in a Gist tomorrow. š The Meltano project is just a vanilla project, so nothing special there
t
tim_frazer
08/03/2021, 11:48 PMyeah that would be awesome - I want to move a process we have thats a trunk and load to using meltano as a proof-of-concept
s
stephen_bailey
08/04/2021, 12:30 AMHere's an example of what we have: https://gist.github.com/stkbailey/affc5983a877bc065002e974626f0883
stephen_bailey
08/04/2021, 12:32 AMFor the template,
1. Mount the Github repo to the container
2. Create an entrypoint script that creates a
.netrcstephen_bailey
08/04/2021, 12:34 AMone thing i love about meltano is that it has made it really easy to deploy workflows that feed into a staging database -- we just point it to
target-snowflake-deva
aaronsteers
08/04/2021, 3:22 AMcc @amanda.folson š š
t
tim_frazer
08/04/2021, 1:45 PM@stephen_bailey this is excellent thank you