Support OpenAI Response API

[kaichen]

https://platform.openai.com/docs/api-reference/responses

New API set with more powerful features.

[kwaa]

Since this API is not yet generalized, xsAI is not considering supporting it now. Nonetheless, this issue will be kept to track progress.

[kaichen]

Wanted to ask about the future direction of this project - are we planning to keep the API design aligned with Vercel's AI SDK, or will we develop own unique approach?

[kwaa]

Wanted to ask about the future direction of this project - are we planning to keep the API design aligned with Vercel's AI SDK, or will we develop own unique approach?

Considering that we now have the @xsai-ext/compat package, we can be non-compatible with the Vercel AI SDK when we have a good reason to be.

The main reason for compatibility with the Vercel AI SDK is to reduce migration costs for users. Nevertheless, xsAI has adopted a structure that is closer to the Chat Completion API in the design of messages, tools, etc.

[bitsnaps]

@kwaa Currently Groq supports Response API, and I believe more providers will do as soon as they support multi-modality, tools, rag...etc.