This message was deleted.
# ask-for-helps
Slackbot
09/27/2022, 4:35 PMThis message was deleted.
👀 1
🚀 1
j
Judah Rand
09/27/2022, 4:35 PMThe container which was produced using
bentoctl buildJudah Rand
09/27/2022, 4:35 PMThe one using
bentoml containerizeb
Bo
09/27/2022, 4:36 PMCan you tell me which platform you are deploying to?
j
Judah Rand
09/27/2022, 4:36 PMGoogle Cloud Run - but I’m running both containers locally and using
curlJudah Rand
09/27/2022, 4:39 PMThe two container images are called:
model:dbx2jmr6qcggqdsvgoogle-cloud-run-model:dbx2jmr6qcggqdsvJudah Rand
09/27/2022, 4:39 PMSo they’re definitely based on the same Bento
Judah Rand
09/27/2022, 4:40 PMOne is just 100x slower than the other
b
Bo
09/27/2022, 4:40 PMGot it.
Bo
09/27/2022, 4:42 PMI saw in the previous thread that you are able to update main.tf and get it working. And now it is the very long latency problem. Is that right?
j
Judah Rand
09/27/2022, 4:44 PMWell, I was trying to disable AdaptiveBatching because I was seeing latencies around the 10s mark when deployed to Google Cloud Run so thought it might be the
max_latency_msJudah Rand
09/27/2022, 4:45 PMOnce I discovered how difficult it is to override this globally I just disabled batching at the Model level (retrained and saved with
batching: FalseJudah Rand
09/27/2022, 4:45 PMThen decided to test locally
Judah Rand
09/27/2022, 4:46 PMAnd still have incredibly high latency on the
google-cloud-run-Judah Rand
09/27/2022, 4:46 PMSo the high latency problem is what prompted the other problem 😛
Judah Rand
09/27/2022, 4:46 PMOr at least the debugging of the high latency
b
Bo
09/27/2022, 4:47 PMGot it. Do you have time today for office hour?
j
Judah Rand
09/27/2022, 4:48 PMI’m in the UK so was just about to sign off for the day almost 6pm here — so unfortunately not 😞
Judah Rand
09/27/2022, 4:48 PMCould fit something in early your time / late in the day my time tomorrow if that would be possible.
b
Bo
09/27/2022, 4:49 PMyeah that should work. And you can find a time on my calendly too https://calendly.com/bo-bentoml/office-hours
Bo
09/27/2022, 4:50 PMWhat’s the time requirement you have right now?
Bo
09/27/2022, 4:50 PMis this for production or for development and poc?
j
Judah Rand
09/27/2022, 4:52 PMis this for production or for development and poc?We’re aiming to deploy a model as an internal tool. So production but not customer facing.
What’s the time requirement you have right now?Aiming to deploy this week.
yeah that should work. And you can find a time on my calendly too https://calendly.com/bo-bentoml/office-hoursUnfortunately, all of those times are between midnight and 5am my time 😞
b
Bo
09/27/2022, 4:57 PMI see. Let’s find a time works better for you. Do you have time tmw 4pm london time/8am PST?
j
Judah Rand
09/27/2022, 4:58 PMThat absolutely works for me. Could even do a bit later if it’s better for you (5pm london time?)
b
Bo
09/27/2022, 4:58 PMyeah, that would be amazing!
Bo
09/27/2022, 4:58 PMReally appreciated it
Bo
09/27/2022, 4:58 PMcould you dm me your email and I will sent out invite
Bo
09/27/2022, 5:00 PMI appreciate your patience and support on this project.
s
Sean
09/28/2022, 3:27 AM@Judah Rand would you be comfortable sharing the images with us?
4 Views