Pinned Loading

1. kserve/kserve kserve/kserve Public

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Go 5k 1.3k

2. opendatahub-io/odh-model-controller opendatahub-io/odh-model-controller Public

   Go 4 89

3. opendatahub-io/llm-d-inference-scheduler opendatahub-io/llm-d-inference-scheduler Public

   Forked from llm-d/llm-d-inference-scheduler

   Inference scheduler for llm-d

   Go 11

4. inference-perf inference-perf Public

   Forked from kubernetes-sigs/inference-perf

   GenAI inference performance benchmarking tool

   Python