Get actual GPU memory usage #10803
Unanswered
iliyanpetrovcleverpine
asked this question in
Q&A
Get actual GPU memory usage
#10803
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, SGLang Team!
I would like to see what is the current GPU memory usage and add it to Prometheus.
Is there any way to get this info from somewhere? Maybe combination of some metrics coming from "/metrics" endpoint can help to achieve this?
Beta Was this translation helpful? Give feedback.
All reactions