Unable to run or load the model file.

[maiguangyang]

I installed rkllama on an rk3588 development board, but when I run the following commands, I get errors:

rkllama run TinyLlama-1.1B-Chat-v1.0-rk3588-w8a8-opt-0-hybrid-ratio-0.5
rkllama load TinyLlama-1.1B-Chat-v1.0-rk3588-w8a8-opt-0-hybrid-ratio-0.5

How can I fix this error?

[maiguangyang]

[wozwdaqian]

我也出现同样的问题

[cselip]

same, on rk3576

[cselip]

switching to commit 2bfcab1 fixed it for me, haven't checked which commit actually broke it though