You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add a section in the readme of "Supported Models" to highlight the recommended inputs format for each model.
For example, for Qwen2, should we use the Instruct: {task_description}\nQuery: {query}' format or just query ?
Motivation
In the readme, the list of supported models is really clear and helpful.
However, when it comes to querying the model once the endpoint is deployed, a doubt remains on the format of the string that should be used in the http query.
Your contribution
I'm having the doubt on the best format to query Qwen2 so I can't really help here.
The text was updated successfully, but these errors were encountered:
Feature request
Add a section in the readme of "Supported Models" to highlight the recommended
inputs
format for each model.For example, for Qwen2, should we use the
Instruct: {task_description}\nQuery: {query}'
format or justquery
?Motivation
In the readme, the list of supported models is really clear and helpful.
However, when it comes to querying the model once the endpoint is deployed, a doubt remains on the format of the string that should be used in the http query.
Your contribution
I'm having the doubt on the best format to query Qwen2 so I can't really help here.
The text was updated successfully, but these errors were encountered: