Is this information correct? I can only find 88mb ...
# agents
f
Is this information correct? I can only find 88mb SmolLM2 model at minimum and it gives ~200ms ttft but here it says 66 and 15ms latency
where can I find the model and code using it ?
the reason I am asking - I am trying to build and llama.cpp LLM plugin and hook with super quick SmolLM2 to give some quick short responses
but I am getting 200-500ms responses right now from SmolLM2
p
These are turn detection models, unsure if you are looking for LLM response models
f
yes, they are turn detection models
but it's still the same SmolLM2 135m fine tuned on data
I can't find SmolLM2 that small (66mb) and with such latency
p
Got it - sorry for misunderstanding.
🙌 1