Prerequisites

Set up your environment, API key, and dependencies before using the Serverless Inference service through the API or UI.

Complete these steps before using the Serverless Inference service through the API or UI.

Before starting, review the usage information and limits to understand costs and restrictions.

Set up your W&B account and project

You need these items to access Serverless Inference:

1. A W&B account
   Sign up at W&B

2. A W&B API key

   To create an API key, select the Personal API key or Service Account API key tab for details.

   Personal API key

   To create a personal API key owned by your user ID:

   1. Log in to W&B, click your user profile icon, then click User Settings.
   2. Click Create new API key.
   3. Provide a descriptive name for your API key.
   4. Click Create.
   5. Copy the displayed API key immediately and store it securely.

   Service account API key

   To create an API key owned by a service account:

   1. Navigate to the Service Accounts tab in your team or organization settings.
   2. Find the service account in the list.
   3. Click the action () menu, then click Create API key.
   4. Provide a name for the API key, then click Create.
   5. Copy the displayed API key immediately and store it securely.
   6. Click Done.

   You can create multiple API keys for a single service account to support different environments or workflows.

   The full API key is only shown once at creation time. After you close the dialog, you cannot view the full API key again. Only the key ID (first part of the key) is visible in your settings. If you lose the full API key, you must create a new API key.

   For secure storage options, see Store API keys securely.

3. A W&B project
   Create a project in your W&B account to track usage

Set up your environment (Python)

To use the Inference API with Python, you also need to:

1. Complete the general requirements above

2. Install the required libraries:

   pip install openai weave
   

Note

The weave library is optional but recommended. It lets you trace your LLM applications. Learn more in the Weave Quickstart.

See usage examples for code samples using Serverless Inference with Weave.

Next steps

After completing the prerequisites:

• Check the API reference to learn about available endpoints
• Try the usage examples to see the service in action
• Use the UI guide to access models through the web interface