Join Slack
Powered by
Is it possible, to spread a single dag across mult...
# hamilton-help
v
Viktor
09/16/2024, 4:12 PM
Is it possible, to spread a single dag across multiple Notebook cells?
s
Stefan Krawczyk
09/16/2024, 4:13 PM
Yes! You can see it in action here -
https://github.com/DAGWorks-Inc/hamilton/blob/main/examples/LLM_Workflows/RAG_document_extract_chunk_embed/simple_pipeline.ipynb
via
%%incr_cell_to_module NAME INDEX
Stefan Krawczyk
09/16/2024, 4:15 PM
Alternatively, you just make different modules from the cells and then get the driver to combine them together.
v
Viktor
09/16/2024, 4:16 PM
amazing! I think the latter is even more suitable for the type of separation of concerns I'm after to achieve already in the Notebook
👍 1
Open in Slack
Previous
Next