Skip to main content
For an OpenAI-compatible integration, update the key and base URL:
Check that each SERV-enabled request includes the required system instructions, uses a model ID from the catalog, and sets token limits high enough to avoid truncation. For the official Anthropic SDK, use baseURL: "https://inference-api.openserv.ai" without /v1 and keep the top-level system field. See SDK Integration and SDK Migration for Python, Vercel AI SDK, LangChain, and raw HTTP examples.