the reworked LLM forecaster causes a model to appear twice on the leaderboard, once with the zero shot prompt and once with the zero-shot with freeze values prompt.
For the Tournament and Preliminary leaderboards, we should drop the:
- zero shot prompt models when the model does not have other tools enabled (E.g. web search)
- zero shot with freeze values prompt when the model has tools enabled
the reworked LLM forecaster causes a model to appear twice on the leaderboard, once with the zero shot prompt and once with the zero-shot with freeze values prompt.
For the Tournament and Preliminary leaderboards, we should drop the: