Me again 🙂. In testing the tableau connector more, I'm getting a big memory explosion. A large snowflake ingestion job or dbt ingestion job comfortably run in a container with ~1GB of memory. My Tableau ingestion job is still getting OOM Killed at 16GB of memory!
Before I go down a big debugging hole - has anyone else seen very very high memory usage when running the tableau ingestion source? For any of the people who wrote the original, any hints on where the issue might be would be very helpful - otherwise I'll start diving into this one myself.
(I'll work on this before I pick up any of the deleted entities stuff I mentioned above - I need to get the job to complete before I start upgrading it! 😄 ).