Skip to content
This repository was archived by the owner on Jul 1, 2025. It is now read-only.
This repository was archived by the owner on Jul 1, 2025. It is now read-only.

Example binaries should handle HostManager active request limit #2816

Open
@nickgg

Description

@nickgg

The HostManager enforces a limit of 100 active runs at a time, and will return an error when this limit is reached. Our example code should handle this error code and back off new requests until there are slots available (rather than just failing and deadlocking).

repro: run the resnet-runtime example with more than 100 images.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions