Skip to content

Recommended query format for supported models #504

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
pocman opened this issue Feb 26, 2025 · 0 comments
Open

Recommended query format for supported models #504

pocman opened this issue Feb 26, 2025 · 0 comments

Comments

@pocman
Copy link

pocman commented Feb 26, 2025

Feature request

Add a section in the readme of "Supported Models" to highlight the recommended inputs format for each model.

For example, for Qwen2, should we use the Instruct: {task_description}\nQuery: {query}' format or just query ?

Motivation

In the readme, the list of supported models is really clear and helpful.
However, when it comes to querying the model once the endpoint is deployed, a doubt remains on the format of the string that should be used in the http query.

Your contribution

I'm having the doubt on the best format to query Qwen2 so I can't really help here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant