Nvidia Hardware

Returns available hardware and pricing for a given model.

Called by NVIDIA to show users their options and redirect them based on what we support. Only serverless options are returned.

GET /inference/nvidia/v2/hardware

Nvidia Hardware

cURL

curl --request GET \
  --url https://api.example.com/inference/nvidia/v2/hardware \
  --header 'Authorization: Bearer <token>'

200

{
  "hardware": [
    {
      "id": "<string>",
      "name": "<string>",
      "type": "<string>",
      "pricing": {
        "cents_per_million_input_tokens": 123,
        "cents_per_million_output_tokens": 123
      },
      "specs": {}
    }
  ]
}

Authorizations

Authorization · string · header · required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Query Parameters

model · string · required

Model name without the publisher prefix

Response

200

application/json

Successful Response

hardware · NvidiaHardwareOption · object[] · required

Show child attributes