Skip to content
QUANTIFYING VALUE

Insurance AI Benchmark Results 

Not all AI models are created equal. This is especially true when working on complex enterprise insurance use cases. While general LLMs offer broad capabilities, purpose-built models like InsurGPT deliver unparalleled precision for underwriting and claims activities. Benchmarking is crucial: it's how we rigorously compare these distinct AI types to quantify potential ROI, ensuring your chosen AI partner substantially increases accuracy and minimizes your rework.  

benchmark-image

Roots Delivers The Highest Accuracy

For common insurance activities like document classification and data extraction Roots delivers more accurate outputs than LLMs.  

 

Roots vs mistral

Roots scored 99% for claims accuracy Mistral AI reached 62%

Roots vs GPT5

Roots scored 93% for underwriting accuracy GPT 5.0 only 80%

Roots vs Gemini3Pro

Roots scored 93% for underwriting accuracy Gemini 3.0 Pro got 84%

Built by Insurance Experts, for Insurance Experts 

InsurGPT™ is the generative AI model built by insurance operators, for insurance operators. Trained on millions of insurance-specific data points, it understands the unique language and complexities of the insurance industry. Experience AI tailored to solve your challenges, delivering accuracy and intelligent automation like never before.

Insurance experts

Roots Outperforms General Knowledge LLMs 

98%+ Accuracy Guaranteed

Pricing-mobile

 

Claims Extraction Benchmark Results

Roots AI models top OpenAI and Mistral for accuracy across all key insurance fields, showing a considerable advantage with a confidence threshold.

Roots Logo Full Color
Roots Logo Full Color
GPT-4
 % Accuracy
Mistral - 7B PE
 % Accuracy
Fine Tuned 
% Accuracy
No Threshold 
Fine Tuned
 % Accuracy
Threshold > 0.9
Insurance Data
Claim Number
52
32
Claimant Name
98
88
Date of Report
87
72
Date of Service 
78
57

Underwriting Extraction Benchmark Results

Roots AI models outperform state-of-the-art GPT and Gemini models across key underwriting extraction fields.

Roots Logo Full Color
GPT-4.1
  % Accuracy
GPT-5.0
  % Accuracy
Gemini-3.0-Pro
  % Accuracy
Roots
  % Accuracy
Underwriting Field Extracts
Overall Accuracy
81
80
84

Loss Run Extraction Benchmark Results

Roots AI models beat commonly used frontier, state-of-the-art models across key loss run insurance data extraction fields.

December 2025 results.

Roots Logo Full Color
Data Extraction Category
GPT-4.1
  % Accuracy
GPT-5.0
  % Accuracy
Gemini-3.0-Pro
  % Accuracy
Roots
 % Accuracy
Data Field
Accident Description
Claim
88
53
81
Accident State
Claim
90
53
83
Allocated Expense Reserves
Claim
85
60
91
Allocated Expenses Paid
Claim
88
57
86
Carrier
Claim
75
56
74
Claim Number
Claim
83
54
76
Claim Reported Date
Claim
89
59
86
Claimant Closed Date
Claim
93
61
90
Claimant Name
Claim
88
58
84
Date of Incident
Claim
88
58
85
Indemnity Paid
Claim
66
53
81
Indemnity Reserves
Claim
80
53
84
Line of Business
Claim
91
60
86
Medical Reserves
Claim
86
60
91
Nature of Injury
Claim
53
40
72
Paid Medical
Claim
90
59
89
Policy Number
Claim
84
53
81
Policy Year
Claim
81
53
74
Recoveries
Claim
97
61
91
Status
Claim
70
46
69
Total Incurred
Claim
73
48
72
Total Paid
Claim
74
52
73
Total Reserve
Claim
69
54
83
Type
Claim
36
26
32
Roots Logo Full Color
Data Extraction Category
GPT-4.1
  % Accuracy
GPT-5.0
  % Accuracy
Gemini-3.0-Pro
  % Accuracy
Roots
 % Accuracy
Data Field
Allocated Expense Reserves
Policy
81
89
Allocated Expenses Paid
Policy
80
87
Carrier
Policy
73
72
75
Experience Mod
Policy
88
90
90
Expiration Date
Policy
72
65
74
Inception Date
Policy
81
74
Indemnity Paid
Policy
77
88
84
Indemnity Reserves
Policy
81
88
87
Line of Business
Policy
76
81
80
Medical Reserves
Policy
86
90
88
Named Insured
Policy
90
92
91
Paid Medical
Policy
84
87
84
Policy Number
Policy
72
77
81
Policy Year
Policy
86
86
88
Recoveries
Policy
86
91
89
Total Claims
Policy
84
83
87
Total Closed Claims
Policy
80
85
68
Total Incurred
Policy
75
78
79
Total Open Claims
Policy
89
85
91
Total Paid
Policy
69
72
73
Total Reserve
Policy
64
81
76
Validation Date
Policy
78
63

For common insurance activities like document classification and data extraction Roots delivers more accurate outputs than LLMs.  

Our model has achieved 85% straight-through processing rates in production using a 90% confidence threshold.

Loss Run Extraction Benchmark Results

Roots AI models beat commonly used frontier, state-of-the-art models across key loss run insurance data extraction fields.

July 2025 results.

Roots Logo Full Color
Data Extraction Category
GPT4.1
  % Accuracy
Deepseek-r1
  % Accuracy
Gemini-2.5-flash
  % Accuracy
Roots
 % Accuracy
Data Field
Indemnity Paid
Financials
65
83
74
Total Incurred
Financials
66
52
71
Recoveries
Financials
52
64
71
Paid Medical
Financials
44
74
74
Medical Reserves
Financials
44
59
64
Indemnity Reserves
Financials
63
70
74
Total Paid
Financials
67
85
78
Total Reserve
Financials
59
69
81
Allocated Expenses Paid
Financials
86
84
Allocated Expense Reserves
Financals
76
55
Claimant Name
General
80
90
Date of Incident
General
80
89
Claim Reported Date
General
83
89
82
Claim Number
General
45
43
61
Line of Business
General
76
95
95
Carrier
General
75
88
93
Policy Number
General
65
81
91
Policy Year
General
78
94
Status
General
57
88
68
Accident State
General
88
90
96
Claimant Closed Date
General
72
89
85
Accident Description
General
54
60
77

How InsurGPT™ Works

Advanced AI-Powered Automation

InsurGPT™ powers the Roots Platform, driving AI Agents that automate complex processes involving both structured and unstructured data. This increases data accuracy to reduce errors and improve team capacity by learning from every human interaction. 

98%+ Accuracy

Unlike generic AI models, InsurGPT™ is fine-tuned for insurance. It interprets documents and data with over 98% accuracy across most use cases. This includes understanding complex insurance documents, such as tables, checkboxes, and intricate forms.

Document Intelligence

InsurGPT™ is built with an advanced understanding of unstructured insurance documents, making it capable of reading and processing documents just like a human would.

Ensemble AI Model

InsurGPT™ uses a “best of breed” approach, selecting the most suitable AI methods for specific tasks, that delivers highly accurate and cost-effective AI outcomes tailored specifically for the insurance document and task needed at that moment. 

Managed for AI Model Drift

Roots delivers an evergreen insurance AI model, InsurGPT™, that is continuously managed for drift, bias, and transparency, ensuring consistent, reliable performance.

Turnkey Models Improve ‘Zeroshot’ Accuracy

Roots’ approach to AI model curation provides continuously updated turnkey models that enhance zero-shot accuracy, minimize fine-tuning needs and significantly reduce operating and hosting costs.

Federated Learning

Root’s federated learning approach allows all insurers to benefit from platform-wide document interactions, improving overall accuracy intelligence and performance while protecting customer specific data.

Key Features of InsurGPT™

docs
Trained on Millions of Insurance-Specific Data Points
InsurGPT™ is fine-tuned using millions of proprietary insurance documents, parameters, and business processes, giving it a deep understanding of the language and complexities of the insurance industry.
humanintheloop
Patented Human-in-the-Loop (HITL) Capabilities
The system incorporates real-time human oversight, allowing subject matter experts to intervene when necessary, ensuring data accuracy and process control. 
false
Reduced False Positives & Hallucinations
Unlike generic AI models, InsurGPT™ significantly reduces errors and hallucinations, ensuring more reliable outputs.
compliance
Enterprise-Ready & Compliant
InsurGPT™ is built for enterprise-scale operations with robust security, including SOC2-Type 2, ISO27001, CCPA, GDPR, HIPAA, and NYCRR 500 compliance.

Benefits of Leveraging InsurGPT™

Automate & Transform Insurance Processes    

InsurGPT™ lets insurers automate traditionally manual tasks, reducing operational friction, freeing up team resources, and allowing staff to focus more on customer engagement.

Platform - Main
Claims leakage

Increase Efficiency & Lower Risk    

By enabling faster, more accurate quotes and reducing the risk of claims leakage, InsurGPT™ enhances your revenue potential while minimizing operational risks. 

Scalable & Secure    

InsurGPT™ delivers AI-driven automation that scales with your business, ensuring that data is handled securely and accurately at every step. 

Safety-1
REAL RESULTS

Empower Your Insurance Operations

Loss Run 2
accuracy (1)
Improved Accuracy
Achieve over 98% accuracy in interpreting complex insurance documents and data. 
insurgpt
humanintheloop
AI & Human Collaboration
With built-in Human-in-the-Loop capabilities, InsurGPT™ combines the power of AI with the oversight of industry experts, ensuring the highest levels of control and precision. 
Platform - Main
compliance
Compliance & Security Built In
Trust in InsurGPT™’s enterprise-level security with industry-standard certifications, protecting sensitive data and ensuring compliance.  
TRUST CENTER

Secure & Compliant  


Roots meets ISO 27001, SOC 2 Type 2, HIPAA and CCPA compliance requirements.

Building AI Responsibly  


At Roots, our singular focus is supporting insurance companies in delivering on their customer promises while keeping the trust and security of our AI at the forefront of everything we do.

shine
Our Commitment to Responsible AI
Insurers must prioritize fairness and transparency to make unbiased, fact-based AI decisions. Roots simplifies this with an ethical AI framework based on eight core principles, ensuring explainable decisions, strong data protection, and ongoing improvement to maintain trust and compliance. 

Learn More

lab
Roots’ AI Research and Development
Roots is dedicated to AI research that yields practical solutions. Our work emphasizes advanced post-training methods and reasoning capabilities, enabling AI models to simplify complex operations, make business processes more effective, automate routine tasks, and improve decision-making.  

Experience how InsurGPT™ can transform your insurance operations.

Schedule a personalized solution demonstration to see how Roots AI Agents can transform your business.