Hello everyone, I've deployed containerized Bentos...
# ask-for-help
a
Hello everyone, I've deployed containerized Bentos in EKS and configured the traffic settings with a timeout of 120 seconds and a maximum concurrency of 50, as shown below:
Copy code
@bentoml.service(
    traffic={
        "timeout": 120,
        "max_concurrency": 50,
However, I'm still encountering a "504 Gateway Timeout" error, even though the model's processing time is well within the 120-second limit. Any insights on what might be causing this?