Skip to content

LiteLlm model in ADK ignores stream=True — no streaming happens #2231

@Asvin31

Description

@Asvin31

** Please make sure you read the contribution guide and file the issues in the right place. **
Contribution guide.

Describe the bug

When using LiteLlm inside LlmAgent or SequentialAgent with stream=True, ADK does not actually stream the response.

To Reproduce
Steps to reproduce the behavior:

  1. Set up a LlmAgent using LiteLlm(stream=True)
  2. Use Runner.run_async() to handle a message
  3. Observe that no streaming happens; full response is returned after delay

Expected behavior
Streaming responses via LiteLLM and Ollama should work when stream=True is passed to LiteLlm.

Metadata

Metadata

Assignees

Labels

bot triaged[Bot] This issue is triaged by ADK botmodels[Component] Issues related to model support

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions