https://www.boundaryml.com logo
how to create chatGPT style thinking UI
# help
b
So I was trying to understand how to show on the UI chatgpt style “thinking tokens” as the user enters query. I know it comes from reasoning tokens in reasoning model but what I am not sure is how come it shows so fast. IMO reasoning models themselves take time to generate, does the thinking tokens can immediately be shown on UI the moment a user enters query? Any code snippets if someone has for reference much appreciated
v
i'm actually releasing an update for this on next release! see: #1360258688891228312
b
When?
v
today!
b
link pls
v
will post when the release goes out! @baml-sam will be doing it 🙂