Howdy - we’re experiencing issues with the metabase source, where the failure report is too big to send to cloudwatch, as the watchtower lib sets

max_message_size

to 262144 by default:

[2022-03-21 04:12:56,631] {{logging_mixin.py:104}} WARNING - /usr/local/lib/python3.7/site-packages/watchtower/__init__.py:199 WatchtowerWarning: Failed to deliver logs: An error occurred (InvalidParameterException) when calling the PutLogEvents operation: Log event too large: 666943 bytes exceeds limit of 262144

is there any way to configure this or would it require a code change?

We don't directly use watchtower in any of our scripts, this would be an issue on Metabase or whichever library is using watchtower.

yea that makes sense; I’m guessing it’s out of our control as we utilize MWAA (Managed Workflow for Apache Airflow) by AWS, and they are likely using it under their hood

Yeah, unfortunately. From searching around looks like some other integrations have been bitten by this as well and it might be fixed in a later version of watchtower, but Airflow pins the version 😞