jamesbraza
09/28/2023, 6:36 PMpromptfoo-action ([link](https://github.com/promptfoo/promptfoo-action)), and have a few questions:
- Why does restore-keys not use v1 at the end?
- With the line "This step will actually run the before/after evaluation", what is a before/after evaluation?
- If I have `prompts/config1.yaml`/`prompts1.txt` and `prompts/config2.yaml`/`prompts2.txt`, should I have two steps invoking typpo/promptfoo-action@v1, one per each config?ian
09/28/2023, 7:16 PMrestore-keys is a prefix, so it will match any version
- "before/after" just describes the webview. One column for the original prompt, one column for the updated prompt
- Yeah, each config will have to be run in a separate stepjamesbraza
09/28/2023, 7:28 PMian
09/28/2023, 7:32 PMjamesbraza
09/28/2023, 7:53 PMPROMPTFOO_DISABLE_TELEMETRY=1? I am wondering if you care that CI agents will bias the telemetry collection numbersian
09/28/2023, 8:25 PMian
09/28/2023, 8:26 PMjamesbraza
09/28/2023, 9:06 PMpromptfoo-actions? I hit an issue where it fails to run git fetch origin main, opened a bug report thereian
09/28/2023, 9:10 PM