Info

Model Info V1

Provides more info about each model in /models, including config.yaml descriptions (except api key and api base)

Parameters: litellm_model_id: Optional[str] = None (this is the value of x-litellm-model-id returned in response headers)

- When litellm_model_id is passed, it will return the info for that specific model
- When litellm_model_id is not passed, it will return the info for all models

Returns: Returns a dictionary containing information about each model.

Example Response:

{
    "data": [
                {
                    "model_name": "fake-openai-endpoint",
                    "litellm_params": {
                        "api_base": "https://exampleopenaiendpoint-production.up.railway.app/",
                        "model": "openai/fake"
                    },
                    "model_info": {
                        "id": "112f74fab24a7a5245d2ced3536dd8f5f9192c57ee6e332af0f0512e08bed5af",
                        "db_model": false
                    }
                }
            ]
}

GET/v1/model/info

Authorization

APIKeyHeaderAPIKeyHeaderAPIKeyHeaderAPIKeyHeader

Query parameters

Response

200422

Successful Response

Body

application/json

any

Request

JavaScriptCurlPythonHTTP

const response = await fetch('/v1/model/info', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

422

{
  "detail": [
    {
      "loc": [
        "text"
      ],
      "msg": "text",
      "type": "text"
    }
  ]
}

Model Info V1

Provides more info about each model in /models, including config.yaml descriptions (except api key and api base)

Parameters: litellm_model_id: Optional[str] = None (this is the value of x-litellm-model-id returned in response headers)

- When litellm_model_id is passed, it will return the info for that specific model
- When litellm_model_id is not passed, it will return the info for all models

Returns: Returns a dictionary containing information about each model.

Example Response:

{
    "data": [
                {
                    "model_name": "fake-openai-endpoint",
                    "litellm_params": {
                        "api_base": "https://exampleopenaiendpoint-production.up.railway.app/",
                        "model": "openai/fake"
                    },
                    "model_info": {
                        "id": "112f74fab24a7a5245d2ced3536dd8f5f9192c57ee6e332af0f0512e08bed5af",
                        "db_model": false
                    }
                }
            ]
}

GET/model/info

Authorization

APIKeyHeaderAPIKeyHeaderAPIKeyHeaderAPIKeyHeader

Query parameters

Response

200422

Successful Response

Body

application/json

any

Request

JavaScriptCurlPythonHTTP

const response = await fetch('/model/info', {
    method: 'GET',
    headers: {},
});
const data = await response.json();

Response

422

{
  "detail": [
    {
      "loc": [
        "text"
      ],
      "msg": "text",
      "type": "text"
    }
  ]
}