An app presently called “Harbor” will help turn multiple Macs into a private AI inference server, keeping data local while also making the process of creating an AI server much easier.
The Mac Studio is great for AI work
The Mac has become a very useful tool for AI research, but it could be even more useful. Apple is working on an app that can make it easier to run large language models (LLMs) locally, so long as you have enough processing power and memory available.
Formerly known as Fabric, Harbor is the app that creates a private AI inference server on a Mac, according to Aaronp613 on X. It is capable of running open-weight models on the Mac itself, and apparently is extremely user-friendly.