GPUStack

All

10 repositories

llama-box
Public
LM inference server implementation based on *.cpp.
cpp transformer diffusion gguf openai-compatible-api
C++
•
MIT License
•16•203•1•0•Updated May 31, 2025May 31, 2025
gpustack-installer
Public
Python
•
Apache License 2.0
•1•0•3•0•Updated May 30, 2025May 30, 2025
gpustack
Public
Manage GPU clusters for running AI models
metal cuda inference distributed openai llama maas rocm ascend llm
Python
•
Apache License 2.0
•282•2.8k•390•11•Updated May 30, 2025May 30, 2025
gguf-parser-go
Public
Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
go llama-cpp gguf stable-diffusion-cpp llama-box
Go
•
MIT License
•16•173•0•0•Updated May 30, 2025May 30, 2025
gpustack-ui
Public
TypeScript
•
Apache License 2.0
•25•36•0•0•Updated May 30, 2025May 30, 2025
vox-box
Public
A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
python text-to-speech tts speech-to-text stt audio-processing asr openai-compatible-api
Python
•
Apache License 2.0
•15•115•10•0•Updated May 26, 2025May 26, 2025
.github
Public
Meta-Github repository for all GPUStack repositories.
github-metadata
Dockerfile
•
Apache License 2.0
•0•0•0•0•Updated May 22, 2025May 22, 2025
gpustack.github.io
Public
HTML
•1•0•0•0•Updated May 21, 2025May 21, 2025
fastfetch
Public
Like neofetch, but much faster because written mostly in C.
C
•
MIT License
•512•1•0•0•Updated Oct 24, 2024Oct 24, 2024
gguf-packer-go
Public
Deliver LLMs of GGUF format via Dockerfile.
go llama gguf
Go
•
MIT License
•3•12•0•0•Updated Oct 24, 2024Oct 24, 2024