Tom Fenton moves from local AI concepts to hands-on tools for matching LLMs to hardware, running local chatbots with Ollama and benchmarking AI performance.
The below demo displays a NVIDIA GeForce RTX 4090 running on a remote machine (right pane). Left pane is a Mac running a docker container with nvidia utils installed. The docker container runs this ...