Dolphin 3.0 Llama 3.1 8B

Good fit for

People who want to set application-specific system prompts around a locally run assistant.

Why consider it

The model documentation identifies an instruction-tuned Llama 3.1 8B release for coding, math and general use.

Main limitations

Control over the system prompt is not a claim that outputs are safe, accurate, lawful or appropriate for every use. No unrestricted-content filter or adult category is added. Function calling needs application support, and the 4.9GB package is not a RAM minimum.

Cost and access

No hosted subscription or token fee for local inference within the license’s permitted uses. Hardware, electricity and setup are separate. Llama 3.1 Community License Agreement and associated obligations apply.

Getting started

Install a current compatible Ollama version, review the exact model license, then run: ollama run dolphin3:8b. API means the local runtime endpoint, not a hosted service included with the weights.