Hello authors,
I am really impressed with your efforts in creating this benchmark!
One small thing I notice is that OpenAI seems to limit the 'logprobs' argument to at most 5 (https://platform.openai.com/docs/api-reference/completions/create), while you set to 100. In this case, will your results be affected?
Hello authors,
I am really impressed with your efforts in creating this benchmark!
One small thing I notice is that OpenAI seems to limit the 'logprobs' argument to at most 5 (https://platform.openai.com/docs/api-reference/completions/create), while you set to 100. In this case, will your results be affected?