jaxiiruff@lemmy.ziptoTechnology@lemmy.world•AMD announces unified UDNA GPU architecture — bringing RDNA and CDNA together to take on Nvidia's CUDA ecosystemEnglish
0·
1 month agoYeah I hear ya. How do you happen to be running it? I use NixOS and its a challenge there for me but I found atleast some success using docker since the dependencies are so out of control for AI at the moment.
Also give Ollama-rocm + Open Webgui a shot as an alternative to koboldcpp if you cant get atleast some text generation to work because that is the only thing I have got working with rocm.
You just made me think of something cool, no idea if this was said anywhere or thought of before but R.O.B.O.T.
Remote Operated Body Of Technology
Sounds neat to me.