Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: SciSharp/LLamaSharp
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.17.0
Choose a base ref
...
head repository: SciSharp/LLamaSharp
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
Loading
Showing 368 changed files with 15,222 additions and 10,214 deletions.
6 changes: 6 additions & 0 deletions .github/_typos.toml
Original file line number Diff line number Diff line change
@@ -14,3 +14,9 @@ extend-exclude = [
"LLama.Benchmark/Assets/",
"LLama.Examples/Assets/"
]

[default.extend-words]
# Used in a comment in SafeLLamaSamplerHandle.cs, as a prefix of "hello"
teh = "hel"
# ot is the shorthand version of llama.cpp's override-tensor parameter
ot = "ot"
7 changes: 2 additions & 5 deletions .github/workflows/benchmark.yml
Original file line number Diff line number Diff line change
@@ -16,13 +16,10 @@ jobs:
strategy:
fail-fast: false
matrix:
build: [cuda11, cuda12]
build: [cuda12]
include:
- build: cuda11
image: nvidia/cuda:11.7.1-devel-ubuntu22.04
modeldir: /llamasharp_ci/models_benchmark
- build: cuda12
image: nvidia/cuda:12.1.1-devel-ubuntu22.04
image: nvidia/cuda:12.4.0-devel-ubuntu22.04
modeldir: /llamasharp_ci/models_benchmark

container:
Loading