Skip to content

AI-Hypercomputer/jetstream-pytorch

Error
Looks like something went wrong!

About

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Topics

inference pytorch batching attention llama gemma model-serving tpu llm llm-inference llama2

Resources

Readme

License

Apache-2.0 license
Activity
Custom properties

Stars

60 stars

Watchers

8 watching

Forks

17 forks
Report repository

Releases 6

jetstream-v0.2.3 Latest
Jun 19, 2024
+ 5 releases

Packages

No packages published

Contributors 15

Languages