LocalLLaMA Spots IBM Granite 4.0 3B Vision for Focused Document Extraction

A LocalLLaMA post pushed attention toward IBM Research's Granite-4.0-3B-Vision, a compact VLM aimed at document extraction rather than broad consumer chat. That positioning is important. Instead of promising a general multimodal assistant, IBM is targeting a narrower but commercially useful workload: turning charts, tables, and semi-structured business documents into machine-readable outputs.

The Hugging Face model card says Granite-4.0-3B-Vision is built as a LoRA adapter on top of Granite 4.0 Micro. In practice, that means teams can keep a single base deployment for text-only requests and attach the vision adapter only when image or document understanding is required. For operators who care about memory pressure and serving simplicity, that design may matter as much as the raw benchmark numbers.

The supported task surface is concrete. The model exposes tags for chart extraction, including chart-to-CSV, chart-to-summary, and chart-to-code. It also supports table extraction to HTML, JSON, or OTSL, plus schema-driven key-value pair extraction for document pipelines. IBM positions the model as a fit for enterprise document AI, where accuracy on structured extraction tasks usually matters more than open-ended creativity.

The benchmark section explains why the LocalLLaMA community noticed it. IBM compares the model against other small VLMs on chart extraction and table extraction tasks, and reports 85.5% exact-match accuracy on the VAREX benchmark for key-value pair extraction, placing it third among 2B to 4B parameter models as of March 2026. The release is Apache 2.0, dated March 27, 2026, and includes both Transformers and vLLM serving paths, including a native LoRA runtime option and a merged-at-load option for faster inference.

• Enterprise focus: charts, tables, and KVP extraction instead of generic image chat.
• Deployment angle: LoRA on Granite 4.0 Micro lets teams separate text-only and multimodal workloads.
• Ecosystem fit: integration with Docling and documented vLLM support lower the barrier to production use.

The LocalLLaMA interest here is easy to understand. Small open models win attention when they solve one real workflow clearly. Granite-4.0-3B-Vision is not trying to be everything. It is trying to be a practical document extraction component that can slot into existing pipelines, and that kind of constrained ambition often matters more than another vague general-purpose VLM launch.