Skip to content

@InftyAI InftyAI

Change the repository type filter

All

    Repositories list

    13 repositories

    • llmaz

      Public
      ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
      kubernetesinferencehuggingfacellmmodelscopellamacppvllmtext-generation-inferenceollamasglang
      Go
      •
      Apache License 2.0
      •44•269•39•10•Updated Nov 24, 2025Nov 24, 2025

    • Awesome-LLMOps

      Public
      🎉 An awesome & curated list of best LLMOps tools.
      awesomeaiawesome-listllmllmopsai-developer-tools
      Python
      •
      Apache License 2.0
      •31•171•1•0•Updated Nov 24, 2025Nov 24, 2025

    • alphatrion

      Public
      ⚒️ AlphaTrion is an open-source framework to help build GenAI applications, including experiment tracking, adaptive model routing, prompt optimization and performance evaluation.
      observabilityai-applicationsai-agentllmops
      Python
      •
      Apache License 2.0
      •3•10•6•0•Updated Nov 22, 2025Nov 22, 2025

    • website

      Public
      Website and Blogs.
      blogwebsite
      HTML
      •
      MIT License
      •1•1•2•0•Updated Nov 20, 2025Nov 20, 2025

    • omnistore

      Public
      🎯 An unified python client to communicate with various kinds of object-store providers.
      pythonosss3gcsminioobject-store
      Python
      •
      MIT License
      •3•2•3•0•Updated Nov 18, 2025Nov 18, 2025

    • AMRS

      Public
      The adaptive model routing system for exploration and exploitation.
      llmops
      Makefile
      •
      MIT License
      •4•19•1•0•Updated Nov 14, 2025Nov 14, 2025

    • .github

      Public
      Apache License 2.0
      •1•0•0•0•Updated Nov 12, 2025Nov 12, 2025

    • template-repo

      Public template
      A template repo.
      Apache License 2.0
      •1•0•0•0•Updated Sep 19, 2025Sep 19, 2025

    • karpenter

      Public
      This is a fork of Karpenter focused on GPU scaling with llmaz.
      Go
      •
      Apache License 2.0
      •388•0•1•0•Updated Jun 18, 2025Jun 18, 2025

    • scheduler-plugins

      Public
      Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
      Go
      •
      Apache License 2.0
      •3•11•1•0•Updated Jun 16, 2025Jun 16, 2025

    • community

      Public
      The InftyAI community.
      Apache License 2.0
      •1•0•1•0•Updated Apr 18, 2025Apr 18, 2025

    • Manta

      Public archive
      💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
      kubernetesdistributed-systemscachep2p-networkllm
      Go
      •
      Apache License 2.0
      •3•24•14•1•Updated Dec 6, 2024Dec 6, 2024

    • PR-Copilot

      Public archive
      Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
      Python
      •
      MIT License
      •3•3•2•0•Updated Jun 29, 2024Jun 29, 2024