Hi! First off thanks for creating such a useful and concise tool - its really easy to set up and use.
We're improving models for an internet denied use case and use RAG with a pdf. Is there a way of including this pdf in the calls made to OpenAI or will I need to create a custom call (e.g. using the python provider) manually? As at the mo the OpenAI calls don't have the document to reference and hence fail. I'm using:
- id: openai:gpt-3.5-turbo
prompts:
- openai_prompt
context: "Answer the question as concisely as possible."
Reference: https://platform.openai.com/docs/assistants/tools/file-search/quickstart
i
ian
06/12/2024, 7:35 PM
interesting - I think one way to do this is create the assistant with the files e.g. in the OpenAI playground. Then you can reference the assistant in the eval. But if you want the files to be unique per thread, that is currently not supported.