set the channel description: Make training large models on flyte easy and highly efficient
f
freezing-airport-6809
02/21/2023, 6:01 PM
Folks welcome,
So we are in the process of completely overhauling the persistence layer in flytekit. And we are also making many things streamable, would love help in design, testing and even implementation
👍 1
a
average-finland-92144
07/19/2023, 3:22 PM
has renamed the channel from "sig-large-models" to "large-language-models"
l
loud-salesmen-31014
10/17/2023, 10:39 AM
@loud-salesmen-31014 has left the channel
h
happy-oyster-4992
01/08/2024, 10:13 PM
This is a very quiet channel. Is that because it all works seamlessly, or no-one is really doing this? I'm about to embark on trying out Flyte for a somewhat large AI company (let's say medium-high volume), and we do image inference, but also video and LLM, and our own internal APIs have struggled to work with both streaming and let's call it "batch" inference.
t
thousands-rocket-364
02/17/2024, 9:22 AM
any code or tutorial to refer how to deploy llama-2 chat using flyte framework