minus-squareL_Acacia@lemmy.onetoSelfhosted@lemmy.world•Guide to Self Hosting LLMs Faster/Better than OllamalinkfedilinkEnglisharrow-up2·1 day agollama.cpp works on windows too (or any os for that matter), though linux will vive you better performances linkfedilink
llama.cpp works on windows too (or any os for that matter), though linux will vive you better performances