Ollama

It is an open-source tool that allows users to run models on their local machine.

Basic usage

• ollama serve: start ollama locally
• ollama pull modelname:num_parameters: download the complete model package
• ollama run modelname: start playing