This message was deleted.
# sdk-rusts
steep-balloon-41261
11/12/2023, 11:51 AMThis message was deleted.
b
boundless-energy-78552
11/13/2023, 7:32 AMI’ve done the exact same thing using our Python SDK here
🙌 1
boundless-energy-78552
11/13/2023, 7:32 AMShould be very similar using the Rust SDK
b
blue-grass-88145
11/16/2023, 6:00 PMJust seeing this, I came up with a super hacky way using the whisper-rs crate (https://github.com/cs50victor/kitt_2/blob/main/lkgpt/src/stt.rs), but the performance is really poor. I'll try using your example
b
boundless-energy-78552
11/17/2023, 12:52 PMHey, I may be because you’re doing the inference inside the tokio runtime
boundless-energy-78552
11/17/2023, 12:52 PMYou should not block inside the runtime
boundless-energy-78552
11/17/2023, 12:53 PMYou can use spawn_blocking and await it
b
blue-grass-88145
11/17/2023, 7:01 PMhmm. interesting. thanks I'll try that. I was wondering if there is some form of limit to the number of threads the server can spawn without being too computationally intensive?
blue-grass-88145
11/19/2023, 2:57 AMjust tested the whisper example and I got this segmentation fault