Support runtime configuration #8279
GregoryComer
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
🚀 The feature, motivation and pitch
We need a method for the user to pass in runtime configuration options, especially to specific delegates, but potentially to the core runtime as well. Motivating use cases include enabling/disabling workspace sharing or weight caching in the XNNPACK delegate. Ideally we would be able to expose both global and per-model configurations. @dbort has an older proposal for runtime configuration APIs that we can likely iterate on and implement.
Alternatives
No response
Additional context
No response
RFC (Optional)
No response
cc @JacobSzwejbka @dbort
Beta Was this translation helpful? Give feedback.
All reactions