IBM Granite 4.0 Micro 3B

Good fit for

People seeking a smaller local model for structured text tasks and configurable assistant integrations.

Why consider it

The catalog identifies 3b as the Micro variant and documents text extraction, summarization, code tasks and multilingual dialogue.

Main limitations

The 3b entry is the non-hybrid alternative, not the separate 3b-h hybrid Mamba-2 model. A 2.1GB package is not a memory requirement. RAG and function calling need software integration; weights alone do not search the web or execute code.

Cost and access

Local package without a hosted subscription or per-token inference charge. Hardware, electricity and setup remain separate. License: Apache 2.0.

Getting started

Install a compatible Ollama version, review the model license, then run: ollama run granite4:3b. API access means the local runtime endpoint, not an included hosted API.