HowTo: Use Apple Foundation Models (on-device) for MacOS – DETECTX

My first experiment with GPT-3 was to ask it to create a 3D rotating cube using processing.org. and that was amazing.

Now less than 3 years later, I asked my Apple Silicon M5 with a NPU (Neural Processing Unit) the same question and it worked. (In Three.Js) Take notice..

I wrote a blog few years ago Apple can win the AI race.. This is all private/local as per my previous post. I already built a harness to loop this and then hand off errors and planing to frontier models.

Apple just released (macOS 27), it contains built-in Foundations Models and ability to access Cloud Models in the near future. After upgrade type

sudo fm license
which fm
fm available
fm chat

echo 'Apple Foundation models' | fm respond

M1 and above.

So, you can chat without a subscription all locally on your laptop, that is the future of LLMs. There is a Python SDK, etc. will be interesting how the Cloud models perform.