<@U03AV0GG20H> <@U03AGP3AFM5> Hi guys! Is it ok th...
# contributek
Konstantin Tyapochkin
03/18/2024, 8:11 PM@Stefan Krawczyk @Elijah Ben Izzy Hi guys! Is it ok that I created a draft PR about integrations with AWS so I can continue working on it? If not, I can just remove it and recreate it after it is ready. The PR: https://github.com/DAGWorks-Inc/hamilton/pull/768
👀 2
🔥 2
👍 1
s
Stefan Krawczyk
03/18/2024, 8:36 PMthis is a great first pass.
Stefan Krawczyk
03/18/2024, 8:36 PMlooks good — draft state is fine.
Stefan Krawczyk
03/18/2024, 8:38 PMI’m excited for it!
🙏 1
Stefan Krawczyk
03/18/2024, 8:40 PMand otherwise this commit seems pretty standalone — I would only add a reference to it / mirror the docs for it on this page too.
e
Elijah Ben Izzy
03/18/2024, 8:57 PMNice work! This is really cool.
🙏 1
s
Stefan Krawczyk
03/22/2024, 6:41 PM@Konstantin Tyapochkin BTW sagemaker connection/story would be helpful. I’ve been asked about it: “how do I go from Hamilton to running on sagemaker?”
k
Konstantin Tyapochkin
03/22/2024, 7:19 PMOk, I thought I would first prepare an example for Glue, but it actually doesn’t matter to me; I can do that for SageMaker. It has its own job processing environment with arbitrary code in a Docker container: https://docs.aws.amazon.com/sagemaker/latest/dg/build-your-own-processing-container.html
So, I’ll prepare the example for SageMaker, and then we’ll decide if it is useful to have anything for that in the plugin format.
Sorry, I’m moving on very slowly; I hope I’ll be able to devote more time to that in the next few days.
👍 1
Konstantin Tyapochkin
03/31/2024, 9:49 PMI finished with the AWS examples. I suppose these three examples for SageMaker, Lambda, and Glue could be enough.
I’ll try to join the office hours on Tuesday to discuss whether we need any additional plugins. Or we can arrange a separate call for that.
👍 1
s
Stefan Krawczyk
03/31/2024, 9:53 PMAwesome. Will take a look. If we merge today/tomorrow we can publicize it with this week’s release.
👍 1
Stefan Krawczyk
03/31/2024, 10:09 PMLooks good @Konstantin Tyapochkin. Let’s merge and do follow up PRs as needed, sound good? Can chat on Tuesday regarding plugins :)
👍 1
k
Konstantin Tyapochkin
04/01/2024, 5:08 AMOk, great!
👍 1
2 Views