Fail to install flash-attn on Ubuntu WSL2 partition

[GiambaDS86]

Requirements are installed correctly but cnnaot install flash-attn, due to missing cuda toolkit / torch incompatibilities;

[iris2c]

Requirements are installed correctly but cnnaot install flash-attn, due to missing cuda toolkit / torch incompatibilities;

If you prefer not to install flash-attn, you can try to change the code in inspiremusic/transformer/qwen_encoder.py，
self.model = Qwen2ForCausalLM.from_pretrained(pretrain_path, device_map="auto", attn_implementation="flash_attention_2", torch_dtype=self.dtype)
into
self.model = Qwen2ForCausalLM.from_pretrained(pretrain_path, device_map="cpu", torch_dtype=self.dtype)