minus-squareRandomlyRight@sh.itjust.workstoSelfhosted@lemmy.world•Using Mac M2 Ultra 192GB to Self-Host LLMs?linkfedilinkEnglisharrow-up2·3 days agoTake a look at NVIDIA Project Digits. It’s supposed to release in May for 3k usd and will be kind of the only sensible way to host LLMs then: https://www.nvidia.com/en-us/project-digits/ linkfedilink
RandomlyRight@sh.itjust.works to Lemmy Shitpost@lemmy.world · 1 year agoMe when I accidentally open a reddit link and try to unsee their content and ads before spez winssh.itjust.worksimagemessage-square0fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageMe when I accidentally open a reddit link and try to unsee their content and ads before spez winssh.itjust.worksRandomlyRight@sh.itjust.works to Lemmy Shitpost@lemmy.world · 1 year agomessage-square0fedilink
Take a look at NVIDIA Project Digits. It’s supposed to release in May for 3k usd and will be kind of the only sensible way to host LLMs then:
https://www.nvidia.com/en-us/project-digits/