Search results

Sliding-window KV cache + prefill longer than window breaks causality (ring-buffer overwrite + mask not position-aware)

bugSomething isn't workingSomething isn't working

Status: Open.

#2182 In Lightning-AI/litgpt;

· sea-with-sakura opened on Jan 7, 2026

When Installed from source, pylance has difficulties to resolve the imports

bugSomething isn't workingSomething isn't working

Status: Open.

#2181 In Lightning-AI/litgpt;

· sanggusti opened on Jan 6, 2026

KV cache dimension error in sequential generation for models with rope_local_base_freq

bugSomething isn't workingSomething isn't working

Status: Open.

#2178 In Lightning-AI/litgpt;

· adi776borate opened on Jan 4, 2026

difference during inference with or without kvcache

bugSomething isn't workingSomething isn't working

Status: Open.

#2165 In Lightning-AI/litgpt;

· guangyuli-uoe opened on Nov 27, 2025

Initial and final evaluation in <code>finetune</code> scripts do not accumulate over devices

bugSomething isn't workingSomething isn't working

Status: Open.

#2116 In Lightning-AI/litgpt;

· mseeger opened on Aug 30, 2025

AssertionError: Rank 2 has different values for step: 49996.0 Other ranks: 49991.0

bugSomething isn't workingSomething isn't working

waiting on author

Status: Open.

#2032 In Lightning-AI/litgpt;

· VJJJJJJ1 opened on May 12, 2025

finetune_lora on gemma bug

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#2020 In Lightning-AI/litgpt;

· qqandy0120 opened on Apr 26, 2025

Multiple redundant calls to generate_example() when using multiple GPUs

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1957 In Lightning-AI/litgpt;

· TheLukaDragar opened on Mar 10, 2025

error: cannot unpack non-iterable ActionTypeHint object

bugSomething isn't workingSomething isn't working

Status: Open.

#1931 In Lightning-AI/litgpt;

· pvaldivia4 opened on Jan 31, 2025

Bug: Incorrect gradient accumulation steps calculation in multi-node training due to missing world size information

bugSomething isn't workingSomething isn't working

Status: Open.

#1927 In Lightning-AI/litgpt;

· pratyushmaini opened on Jan 30, 2025

Raise error if disk is full before downloading weights

bugSomething isn't workingSomething isn't working

waiting on author

Status: Draft (not ready).

Lightning-AI/litgptnumber 1903

#1903 In Lightning-AI/litgpt;

· rasbt opened on Jan 8, 2025

failure converting pretrained litgpt checkpoints to HF format: a reproducible example

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#1871 In Lightning-AI/litgpt;

· 2533245542 opened on Dec 12, 2024