hi everyone! in my project I’m running dbt models ...
# community-support
g
hi everyone! in my project I’m running dbt models and running tests periodically and the elementary report, generated via
edr send-report
, is a very useful piece to understand how things are performing and tweak things accordingly. for analysis purposes, I typically generate a 30 days report but for the past couple days it’s been OOM’ing on me. I understand that throwing more memory or reporting on a lower amount of days will help fixing the issue for now, however as the project is quickly growing (and I expect it to grow quite big, hundreds of models next by next year) and we’ll have quite a good bunch of, model builds, tests, etc to report on, simply adding more resources or minimizing the report period is not a practical solution on the long term. I see possibly dumping data to swap or other forms of disk-based alternatives has been discussed before in some older threads, with no resolution. kindly wanted to ask, are there any plans to stop dumping everything into memory such that it won’t eventually take a gigantic compute instance just to run a useful report? 😁 thanks in advance!