Skip to main content

API: Frequently Asked Questions

TopicQuestionAnswerNotes
BillingIf the end user drops the connection before a request finishes, does billing still apply?YesBased on how other providers handle this
When the model errors out or the engine crashes, is the failed run billed?No
Tool CallingCan tool calling be used together with streaming?Yes
Is tool calling still "Beta", or is it production-grade ("fully tested and stable")?Stable
Structured OutputIs structured output that conforms to a JSON Schema supported?Yes
With streaming enabled, is structured output fully tested and stable?Yes