Skip to content
QUANTIFYING VALUE

Insurance AI Benchmark Results 

Not all AI models are created equal. This is especially true when working on complex enterprise insurance use cases. While general LLMs offer broad capabilities, purpose-built models like InsurGPT deliver unparalleled precision for underwriting and claims activities. Benchmarking is crucial: it's how we rigorously compare these distinct AI types to quantify potential ROI, ensuring your chosen AI partner substantially increases accuracy and minimizes your rework.  

benchmark-image

Roots Delivers The Highest Accuracy

For common insurance activities like document classification and data extraction Roots delivers more accurate outputs than LLMs.  

 

Roots vs mistral

Roots scored 99% for claims accuracy Mistral AI reached 62%

Roots vs chatgpt

Roots scored 93% for underwriting accuracy GPT 4.1 only 67%

Roots vs gemini

Roots scored 93% for underwriting accuracy Gemini 2.5 Flash got 83%

Built by Insurance Experts, for Insurance Experts 

InsurGPT™ is the generative AI model built by insurance operators, for insurance operators. Trained on millions of insurance-specific data points, it understands the unique language and complexities of the insurance industry. Experience AI tailored to solve your challenges, delivering accuracy and intelligent automation like never before.

Insurance experts

Roots Outperforms General Knowledge LLMs 

98%+ Accuracy Guaranteed

Pricing-mobile

 

Claims Extraction Benchmark Results

Roots AI models top OpenAI and Mistral across all key insurance fields, showing a considerable advantage with a confidence threshold.

Roots Logo Full Color
Roots Logo Full Color
GPT-4
 
Mistral - 7B PE
 
Fine Tuned 
No Threshold 
Fine Tuned
Threshold > 0.9
Insurance Data
Claim Number
52
32
Claimant Name
98
88
Date of Report
87
72
Date of Service 
78
57

Underwriting Extraction Benchmark Results

Roots AI models outperform state-of-the-art GPT, Gemini, and Deepseek models across key underwriting extraction fields.

Roots Logo Full Color
GPT-4.1
 
Deepseek-r1
 
Gemini-2.5-flash
 
Roots
 
Underwriting Field Extracts
Financial Field Extracts
62
70
80
General Field Extracts
71
83
86
Overall Accuracy
67
77
83

Loss Run Extraction Benchmark Results

Roots AI models beat commonly used frontier, state-of-the-art models across key loss run insurance data extraction fields.

Roots Logo Full Color
Data Extraction Category
 
GPT4.1
 
Deepseek-r1
 
Gemini-2.5-flash
 
Roots
Data Field
Indemnity Paid
Financials
65
83
74
Total Incurred
Financials
66
52
71
Recoveries
Financials
52
64
71
Paid Medical
Financials
44
74
74
Medical Reserves
Financials
44
59
64
Indemnity Reserves
Financials
63
70
74
Total Paid
Financials
67
85
78
Total Reserve
Financials
59
69
81
Allocated Expenses Paid
Financials
86
84
Allocated Expense Reserves
Financals
76
55
Claimant Name
General
80
90
Date of Incident
General
80
89
Claim Reported Date
General
83
89
82
Claim Number
General
45
43
61
Line of Business
General
76
95
95
Carrier
General
75
88
93
Policy Number
General
65
81
91
Policy Year
General
78
94
Status
General
57
88
68
Accident State
General
88
90
96
Claimant Closed Date
General
72
89
85
Accident Description
General
54
60
77

For common insurance activities like document classification and data extraction Roots delivers more accurate outputs than LLMs.  

Our model has achieved 85% straight through processing rates in production using a 90% confidence threshold.

How InsurGPT™ Works

Advanced AI-Powered Automation

InsurGPT™ powers the Roots Platform, driving AI Agents that automate complex processes involving both structured and unstructured data. This increases data accuracy to reduce errors and improve team capacity by learning from every human interaction. 

98%+ Accuracy

Unlike generic AI models, InsurGPT™ is fine-tuned for insurance. It interprets documents and data with over 98% accuracy across most use cases. This includes understanding complex insurance documents, such as tables, checkboxes, and intricate forms.

Document Intelligence

InsurGPT™ is built with an advanced understanding of unstructured insurance documents, making it capable of reading and processing documents just like a human would.

Ensemble AI Model

InsurGPT™ uses a “best of breed” approach, selecting the most suitable AI methods for specific tasks, that delivers highly accurate and cost-effective AI outcomes tailored specifically for the insurance document and task needed at that moment. 

Managed for AI Model Drift

Roots delivers an evergreen insurance AI model, InsurGPT™, that is continuously managed for drift, bias, and transparency, ensuring consistent, reliable performance.

Turnkey Models Improve ‘Zeroshot’ Accuracy

Roots’ approach to AI model curation provides continuously updated turnkey models that enhance zero-shot accuracy, minimize fine-tuning needs and significantly reduce operating and hosting costs.

Federated Learning

Root’s federated learning approach allows all insurers to benefit from platform-wide document interactions, improving overall accuracy intelligence and performance while protecting customer specific data.

Key Features of InsurGPT™

docs
Trained on Millions of Insurance-Specific Data Points
InsurGPT™ is fine-tuned using millions of proprietary insurance documents, parameters, and business processes, giving it a deep understanding of the language and complexities of the insurance industry.
humanintheloop
Patented Human-in-the-Loop (HITL) Capabilities
The system incorporates real-time human oversight, allowing subject matter experts to intervene when necessary, ensuring data accuracy and process control. 
false
Reduced False Positives & Hallucinations
Unlike generic AI models, InsurGPT™ significantly reduces errors and hallucinations, ensuring more reliable outputs.
compliance
Enterprise-Ready & Compliant
InsurGPT™ is built for enterprise-scale operations with robust security, including SOC2-Type 2, ISO27001, CCPA, GDPR, HIPAA, and NYCRR 500 compliance.

Benefits of Leveraging InsurGPT™

Automate & Transform Insurance Processes    

InsurGPT™ lets insurers automate traditionally manual tasks, reducing operational friction, freeing up team resources, and allowing staff to focus more on customer engagement.

Platform - Main
Claims leakage

Increase Efficiency & Lower Risk    

By enabling faster, more accurate quotes and reducing the risk of claims leakage, InsurGPT™ enhances your revenue potential while minimizing operational risks. 

Scalable & Secure    

InsurGPT™ delivers AI-driven automation that scales with your business, ensuring that data is handled securely and accurately at every step. 

Safety-1
REAL RESULTS

Empower Your Insurance Operations

Loss Run 2
accuracy (1)
Improved Accuracy
Achieve over 98% accuracy in interpreting complex insurance documents and data. 
insurgpt
humanintheloop
AI & Human Collaboration
With built-in Human-in-the-Loop capabilities, InsurGPT™ combines the power of AI with the oversight of industry experts, ensuring the highest levels of control and precision. 
Platform - Main
compliance
Compliance & Security Built In
Trust in InsurGPT™’s enterprise-level security with industry-standard certifications, protecting sensitive data and ensuring compliance.  
TRUST CENTER

Secure & Compliant  


Roots meets ISO 27001, SOC 2 Type 2, HIPAA and CCPA compliance requirements.

Building AI Responsibly  


At Roots, our singular focus is supporting insurance companies in delivering on their customer promises while keeping the trust and security of our AI at the forefront of everything we do.

shine
Our Commitment to Responsible AI
Insurers must prioritize fairness and transparency to make unbiased, fact-based AI decisions. Roots simplifies this with an ethical AI framework based on eight core principles, ensuring explainable decisions, strong data protection, and ongoing improvement to maintain trust and compliance. 

Learn More

lab
Roots’ AI Research and Development
Roots is dedicated to AI research that yields practical solutions. Our work emphasizes advanced post-training methods and reasoning capabilities, enabling AI models to simplify complex operations, make business processes more effective, automate routine tasks, and improve decision-making.  

Experience how InsurGPT™ can transform your insurance operations.

Schedule a personalized solution demonstration to see how Roots AI Agents can transform your business.