I wanted to share a quick update on the embedding search tool training runs as I will not be able to make it to the meet today: With Aditya's latest modal training script the ray-related issues were resolved helping debug the MCP-related thread exhaustion issue faster. I'm able to start training stably but the current issue is that ChromaDB has memory leaks which makes the training restart after a certain number of steps. I'm migrating to FAISS which is more stable in this regard. Based on the release date, I'll try to get the results in time