Skip to main content
Set stream: true and iterate over the returned stream.
Streaming is supported by Chat Completions, Responses, and Messages, using each endpoint’s normal event format. Prompt Guard can return a streamed refusal. The output content filter runs on Chat Completions and Responses streams, but not Messages streams. You cannot combine streaming with serv_shadow_agent. SERV rejects that combination with a 400 response because Shadow Agent must validate a completed response.