Skip to main content
An existing application request crossing from a provider gateway into the SERV gateway
For an OpenAI-compatible integration, update the key and base URL:
Then verify that every request has a system prompt, the model ID exists in the catalog, and token limits are high enough to avoid truncation. For the official Anthropic SDK, use baseURL: "https://inference-api.openserv.ai" without /v1 and keep the top-level system field. See SDK Integration and SDK Migration for Python, Vercel AI SDK, LangChain, and raw HTTP examples.