Follow AI Builders — Not Influencers
Xanadu!
@levelsio @csonotes <insert mandatory Xanadu from Citizen Kane reference, with 'Rosebud' obviously being longing for the early nomad life years>
View quoted postWe built state-of-the-art models for reading forms 📋 Form documents have the following properties that trip up VLMs: ✅ They carry much more structure than can be represented in standard markdown. You need consistent types for checkboxes, textboxes, labels, signature fields. ✅ They can be extremely complicated (forms can be scanned, there can handwriting scribbles, some forms are dense with ~100+ fields) but accuracy requirements need to be close to 100% ✅ Any form parser requires accurate grounding and attribution. Not only should you extract the values, but you should also be able to precisely locate where each value came from in the source doc ✅ Any form needs to be not only accurate, but cheap/fast We've done a deep-dive into what it takes to build a form parser in this blog post: https://www.llamaindex.ai/blog/why-vlms-can-t-read-forms If you want to try out our form models, check out LlamaParse: https://cloud.llamaindex.ai/
Parsing forms still trips up the latest frontier VLMs. A form isn't text on a page. It's a set of fields, grouped into sections, each tied to a specific box. That's why forms need purpose-built parsing, not a bigger general model: ✅️ Detect every field, not just the obvious
