Hello forumers!
Bit of a different guide for us; we are setting up LLMs locally on some serious hardware (and not the smallest, most low-power device possible)! We have been playing around with the DGX Spark and its insane 128GB of RAM, and booting up some LLMs with NIM. Has been a blast, and we might have a few more videos on the way setting these up for business environments, check it out: “Getting Started with the NVIDIA DGX Spark | Local LLMs & NIM”
Read more
