Skip to main content
This is the reference for integrating the OpenAI and Anthropic SDKs with SERV. For a five-minute setup, start with the Quickstart. SERV exposes three HTTP endpoints under one base URL: https://inference-api.openserv.ai

OpenAI SDK

Chat completions

Responses

Use the Responses API to receive the reasoning trace alongside the answer. OpenAI models only.

Anthropic SDK

Messages

Important details

Base URL differs by SDK

Auth field differs by SDK

A system prompt is required

Every request needs a system prompt. Requests without one are rejected with a 400 whose message starts with A system prompt is required. and names the field that endpoint expects. A Responses request that continues a conversation with previous_response_id is the one exception. Where the system prompt goes depends on the endpoint:

Parameter map

Moving an integration across SDKs comes down to this mapping.

See also