Hey folks. Does Envoy sidecar being used for Ploom...
# generalc
Chan Jong Na
08/20/2024, 5:03 AMHey folks. Does Envoy sidecar being used for Ploomber services?
If that's the case, can I modify the timeout on the Envoy proxy?
When I am streaming LLM response, it times out at 15 second so I am not getting entirety of response back
i
Ido (Ploomber)
08/20/2024, 2:22 PM
Hey Chan, we do use app mesh that uses an Envoy version under the hood. We didn’t have issues with 15 seconds timeout yet, but I’ll open an issue and we’ll get to it at some point. We do have a prioritization queue but that’s for higher tiers.
c
Chan Jong Na
08/22/2024, 7:41 PMIt only popped up at Chrome browser
👍 1
Chan Jong Na
08/22/2024, 7:41 PMYes please. Thanks for taking a look
👍 1
Chan Jong Na
08/22/2024, 8:37 PMI think it's because Chrome takes forever to offload Stream text.
And it is hitting that 15 second limits.
Firefox/Safari didn't take upto 10 second for same stream
e
Eduardo
09/19/2024, 6:51 PM
@Chan Jong Na we just increased the timeout for Pro customers, let me know if this fixes the issue for you!
c
Chan Jong Na
09/20/2024, 6:10 PMAwesome! Thanks