-
Notifications
You must be signed in to change notification settings - Fork 1.6k
Open
Labels
bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK botmodels[Component] Issues related to model support[Component] Issues related to model support
Description
** Please make sure you read the contribution guide and file the issues in the right place. **
Contribution guide.
Describe the bug
When using LiteLlm inside LlmAgent or SequentialAgent with stream=True, ADK does not actually stream the response.
To Reproduce
Steps to reproduce the behavior:
- Set up a LlmAgent using LiteLlm(stream=True)
- Use Runner.run_async() to handle a message
- Observe that no streaming happens; full response is returned after delay
Expected behavior
Streaming responses via LiteLLM and Ollama should work when stream=True is passed to LiteLlm.
Metadata
Metadata
Assignees
Labels
bot triaged[Bot] This issue is triaged by ADK bot[Bot] This issue is triaged by ADK botmodels[Component] Issues related to model support[Component] Issues related to model support