Fav
09/18/2024, 2:16 PMproviders:
- id: 'http://127.0.0.1:11434/api/generate'
config:
method: 'POST'
headers:
'Content-Type': 'application/json'
body:
model: 'llama3'
prompt: '{{prompt}}'
responseParser: 'json.output'
stream: false
I also tried this :
providers:
- id: 'http://127.0.0.1:11434/api/generate'
config:
method: 'POST'
headers:
'Content-Type': 'application/json'
body:
model: 'llama3'
prompt: '{{prompt}}'
stream: false
responseParser: 'json.output'
It looks like the problem has already been solved for the call to ollama directly from ollama:llama3 (here : https://discord.com/channels/1153767083381903389/1280149322968596602) but I have the impression that it hasn't been solved for a call directly from the URL (maybe I'm making the call wrong too!).
Thanks a lot for your help !ian
09/18/2024, 5:36 PMstream. maybe you can try with LOG_LEVEL=debug and see what's being sent directly to ollama (or maybe there is some debugging facility on the ollama side)Fav
09/19/2024, 8:20 AMFav
09/19/2024, 3:49 PM