An option to offload clip and llama to a secondary gpu would be great allowing primary GPU to focus on Lora training would be great!