https://flyte.org logo
Join Slack
Powered by
# large-language-models
  • f

    freezing-airport-6809

    02/21/2023, 5:50 PM
    set the channel description: Make training large models on flyte easy and highly efficient
  • f

    freezing-airport-6809

    02/21/2023, 6:01 PM
    Folks welcome, So we are in the process of completely overhauling the persistence layer in flytekit. And we are also making many things streamable, would love help in design, testing and even implementation
    👍 1
  • a

    average-finland-92144

    07/19/2023, 3:22 PM
    has renamed the channel from "sig-large-models" to "large-language-models"
  • l

    loud-salesmen-31014

    10/17/2023, 10:39 AM
    @loud-salesmen-31014 has left the channel
  • h

    happy-oyster-4992

    01/08/2024, 10:13 PM
    This is a very quiet channel. Is that because it all works seamlessly, or no-one is really doing this? I'm about to embark on trying out Flyte for a somewhat large AI company (let's say medium-high volume), and we do image inference, but also video and LLM, and our own internal APIs have struggled to work with both streaming and let's call it "batch" inference.
    f
    b
    • 3
    • 12
  • t

    thousands-rocket-364

    02/17/2024, 9:22 AM
    any code or tutorial to refer how to deploy llama-2 chat using flyte framework
    f
    • 2
    • 2