Financial ServicesAgentic AILarge Language Models
Marsh McLennan saves over 1 million hours with agentic AI assistant LenAI
Marsh McLennan
Professional services firm Marsh McLennan built LenAI, an AI assistant now used by its roughly 90,000 employees for around 20 million requests annually. To fix intent-recognition problems in the original GPT-3.5-based assistant, Marsh McLennan worked with Predibase to fine-tune a Llama-3.1-8B-Instruct model using LoRA and Turbo LoRA, improving accuracy by 10-12% over GPT-3.5 and 7% over GPT-4o-mini, and cutting response time below 4 seconds. Since its December 2023 launch, LenAI has handled over 25 million cumulative queries and saved more than 1 million hours of team time in its first year.
