you should have said that it is for NVidia GPUs and for all other it would fall back to CPU which is quiet slow. I'll have claude have a go at porting it for AMD.
update:
@VRM your repo is broken, because the models folder is not included, the readme.md in the models folder is not in the repo...