https://ploomber.io/ logo
Join Slack
Powered by
# hacktoberfest-team-3
  • a

    Alice L

    11/17/2023, 6:52 PM
    I don't built the app. it's just the notebook i tried to deploy
  • a

    Alice L

    11/17/2023, 6:52 PM
    as I dont really know how to build it at the moment
  • e

    Eduardo

    11/17/2023, 6:54 PM
    ok I see what's happening, you're executing
    ploomber build
    in your dockerfile. usually when deploying models, you train the model locally, generate a model file (e.g., model.pkl) and then in your dockerfile you only copy the model file.
  • e

    Eduardo

    11/17/2023, 6:54 PM
    your app is probably crashing because the
    ploomber build
    command takes too many resources
  • e

    Eduardo

    11/17/2023, 6:54 PM
    instead you can run
    ploomber build
    locally and modify your dockerfile so it only copies the output model file
  • a

    Alice L

    11/17/2023, 6:55 PM
    I see. make sense. i tried to do the model.pkl, but don't know how to do it. i tried to look at other team's app, for some reasons, I couldn't be able to see the code. is there any other template to develop model.pkl ?
  • a

    Alice L

    11/17/2023, 6:56 PM
    thanks a lot for your advice!
  • e

    Eduardo

    11/17/2023, 6:59 PM
    the pipeline https://github.com/zhiyiyi/stock-price-predition/blob/new_ml/pipeline.yaml looks like its missing some stuff cause I do not see the model. @Laura Gutierrez Funderburk is there any template?
  • a

    Alice L

    11/17/2023, 7:04 PM
    Laura shared team 5's project, i tried to look at the arima_model_pkl, but the code wasn't readable. also, the app wasn't working. I reached out to Oscar about this and tried to set up a meeting with him. seemed he's a bit busy and still wait for his response at the moment.
  • a

    Alice L

    11/17/2023, 7:04 PM
    I thought we could deployed the ml notebook instead of the app on ploomber
  • a

    Alice L

    11/17/2023, 7:05 PM
    if there's any other template i could look into, that will be great. thanks again!
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:23 PM
    Hi @Eduardo and @Alice L For this team's model deployment the pipeline is still missing quite a bit of work both in terms of the script that generates the pkl file and the ploomber pipeline file
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:23 PM
    We deployed a simpler notebook as a voila deployment
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:25 PM
    @Alice L the workflow we would follow to keep computational costs simpler is 1. Package the code that generates the model into a .py script (the output is a pkl file with the model) 2. Add this script to pipeline.yaml file 3. Run the pipeline locally (or schedule it if you'd like to populate motherduck) 4. Generate a notebook or application that takes as input the pkl file or motherduck db instance and generates visualizations/makes predictions
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:26 PM
    @Eduardo we did manage to get a voila application deployed - it was focused on visualization Alice wanted to deploy an ML model, but the ML model work development started late into the mentorship program
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:27 PM
    We didn't have a chance to work on it during the supported time frame, Alice continued exploring independently
  • l

    Laura Gutierrez Funderburk

    11/17/2023, 7:30 PM
    @Alice L given we are three weeks after the mentorship program ended, what I can do is provide articles on how to package your code into a script, how to upgrade the pipeline.yaml file, and how to call a model using the pkl file. Let me know if this works for you.
  • s

    Slackbot

    11/18/2023, 7:24 AM
    This message was deleted.
    l
    a
    • 3
    • 8
  • z

    Zhiyi Chen

    11/19/2023, 7:28 AM
    Hi team, can you help not merge the PR if it can’t pass all the checks like there is a red on the side of commit “X”
  • z

    Zhiyi Chen

    11/19/2023, 7:30 AM
    ^^ Can you also help not resolve conflicts by merging branch ‘main’, just resolve conflicts (delete code) manually on local or on GitHub interface
  • a

    Alice L

    11/20/2023, 6:51 AM
    got it. i will keep that in mind. thanks for letting us know.
  • s

    Slackbot

    11/20/2023, 3:00 PM
    This message was deleted.
    a
    • 2
    • 1
  • a

    Alice L

    11/29/2023, 6:56 PM
    Hi @Laura Gutierrez Funderburk, sorry for the delay on the video recording. Please find the attachment here. Please let me know if it miss anything else. Thank You, Eduardo and Ploomber's support and guidance!
    Team_3_Hacktoberfest.mp4
  • l

    Laura Gutierrez Funderburk

    11/29/2023, 8:36 PM
    awesome
  • l

    Laura Gutierrez Funderburk

    11/29/2023, 8:36 PM
    thank you @Alice L
  • l

    Laura Gutierrez Funderburk

    11/29/2023, 8:36 PM
    will schedule a post for your team's project
  • a

    Alice L

    11/30/2023, 12:13 AM
    Thank you Laura! sounds great!Thank YOU again for the wonderful opportunity! I've learned a lot during the mentorship program!
  • r

    Rudy Kallis

    11/30/2023, 9:20 PM
    Thank you @Alice L This is amazing! I'm really excited to learn more now. ✅
  • a

    Alice L

    12/01/2023, 3:33 AM
    Thank you Rudy! greatly appreciate it
  • e

    Eduardo

    12/19/2023, 2:35 PM
    archived the channel