Skip to content

Unable to use gpt-4o-copilot #38

Open
@fradav

Description

@fradav

When using the model gpt-4o-copilot, which has been optimized for autocompletion purpose (FIM, autocomplete etc.), the api server is responding :

curl http://localhost:3000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "gpt-4o-copilot",
    "max_tokens": 2000,
    "messages": [
      { "role": "system", "content": "Always answer in rhymes. Today is Thursday" },
      { "role": "user", "content": "What day is it today?" }
    ]
 }'

Response:

{
  "error": {
    "message": "{\"error\":{\"message\":\"Model is not supported for this request.\",\"code\":\"model_not_supported\",\"param\":\"model\",\"type\":\"invalid_request_error\"}}\n",
    "type": "error"
  }
}

Is there somithing we can do about it, a missing parameter in the payload ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions