Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
MNP deploys a fine-tuned LLM with RAG on Databricks to deliver client insights in weeks
…MNP CUSTOMER STORY Supporting customers with next-generation financial services 6 weeks To GenAI solution deployment To strengthen their market leadership in professional services, MNP chose to ad…
Description
MNP, a Canadian professional services firm, used the Databricks Data + AI Platform, AI Search and Foundation Model APIs to deploy a retrieval-augmented generation system on a Mixtral 8x7B model, letting client-facing teams get contextual, up-to-date insights from structured and unstructured data. Supported by the Databricks GenAI Advisory Program, MNP's data team built a model from start to QA testing within four weeks and reached GenAI solution deployment in six weeks.
…lient-facing teams pinpoint the most relevant information for specific queries. AI Search provided seamless access to optimized data, crucial for deploying LLMs, specifically MNP’s eventual choice of Mixtral 8x7B. A mixture-of-experts (MoE) model like Mixtral 8x7B would enable MNP to tailor t…
…accurate insights and building models that helped clients with discoverability. It also allowed the firm’s data team to build a model from start to quality assurance testing within four weeks. With a stable data environment, the adoption of LLMs and RAG applications withi…
…MNP CUSTOMER STORY Supporting customers with next-generation financial services 6 weeks To GenAI solution deployment To strengthen their market leadership in professional services, MNP chose to ad…
Company
MNP
…ous industries. Data limitations impede the rollout of advanced client services MNP, a leading Canadian professional services firm with nearly 9,000 team members and 127 offices nationwide, wanted to modernize their conventional data and analytics platforms to better…
Country
Canada
…ous industries. Data limitations impede the rollout of advanced client services MNP, a leading Canadian professional services firm with nearly 9,000 team members and 127 offices nationwide, wanted to modernize their conventional data and analytics platforms to better…
Industry
Financial Services
…size along their digital journey, visit MNPdigital.ca . Share this post Details Industry : Financial Services Use Case : Artificial Intelligence Cloud : Azure Product : Agent Bricks Ready t…
Problem
MNP's conventional data and analytics platforms could not support the processing required for advanced data analytics and ML applications; their initial foundation model deployment was tightly coupled to the existing data warehouse, suffered lag from a poor time-to-first-token metric, and had prohibitive total cost of ownership from heavy GPU usage and frequent retraining.
…better enable the new capabilities they wanted to implement. Most importantly, MNP’s systems couldn’t support the processing required to accommodate the advanced data analytics and machine learning (ML) applications like the language-based prototype it was fine-tuning on Llama 2 13B and 70B. MN…
…2 13B and 70B. MNP faced several roadblocks in their initial GenAI deployment. First, the foundation model’s tight integration with their existing data warehouse hindered experimentation with other solutions. Moreover, the “time-to-first-token” evaluation metric caused lag issues, negatively affecting user experience. Finally, the total cost of ownership (TCO) became prohibitive due to significant GPU usage from the large data volume required for a reliable corpus and frequent retraining and serving of the model. Add in the complexity of MNP’s diverse clients, and the organization was at a c…
Solution
MNP consolidated structured, semi-structured and unstructured data into the Databricks Data + AI Platform, adopted AI Search as a serverless vector database for data embeddings, and after evaluating models selected Mixtral 8x7B, a mixture-of-experts model, choosing retrieval augmented generation (RAG) as the preferred refinement strategy to work with datasets that required regular updates; MNP used Databricks Foundation Model APIs and Model Serving to deploy and manage the LLM, supported by the Databricks GenAI Advisory Program. An earlier prototype had been fine-tuned on Llama 2 13B and 70B but was superseded by this RAG-based Mixtral 8x7B deployment.
…ysis to ultimately provide faster, more contextual and precise client insights. The Databricks Data + AI Platform served as a unifying force to consolidate MNP’s structured, semi-structured and unstructured data into a single repository. The new approach simplified data governance, management and security in handlin…
…instructions and enhance parallel processing to support simultaneous workloads. After the firm completed their model evaluation and selection, their data team selected retrieval augmented generation (RAG) as their preferred refinement strategy. This choice was influenced by the need to work with datasets that required regu…
…o make insightful, data-driven decisions about their businesses and industries. Databricks Foundation Model APIs helped MNP monitor the essential components for deploying and managing LLMs. Acting as a conduit between the raw computational power of the lakehouse infras…
…accommodate the advanced data analytics and machine learning (ML) applications like the language-based prototype it was fine-tuning on Llama 2 13B and 70B. MNP faced several roadblocks in their initial GenAI deployment. First, the fou…
Business value
MNP's data team built a model from start to quality assurance testing within four weeks and reached GenAI solution deployment in six weeks, enabling faster, more contextual and precise client insights while maintaining information security through Private AI standards and Unity Catalog governance.
…accurate insights and building models that helped clients with discoverability. It also allowed the firm’s data team to build a model from start to quality assurance testing within four weeks. With a stable data environment, the adoption of LLMs and RAG applications withi…
…MNP CUSTOMER STORY Supporting customers with next-generation financial services 6 weeks To GenAI solution deployment To strengthen their market leadership in professional services, MNP chose to ad…
…adoption of LLMs and RAG applications within the Databricks Data + AI Platform ensures that MNP’s data remains isolated and secure via “Private AI” standards. More importantly, the firm has a concrete understanding of how foundation mode…
AI capabilities
Retrieval-Augmented Generation, Large Language Models
…neous workloads. After the firm completed their model evaluation and selection, their data team selected retrieval augmented generation (RAG) as their preferred refinement strategy. This choice was influenced by the need to work with datasets that required reg…
Technology
Databricks AI Search, Foundation Model APIs, Databricks Model Serving, Unity Catalog, Mixtral 8x7B, Agent Bricks
…o make insightful, data-driven decisions about their businesses and industries. Databricks Foundation Model APIs helped MNP monitor the essential components for deploying and managing LLMs. Acting as a conduit between the raw computational power of the lakehouse infras…
…Industry : Financial Services Use Case : Artificial Intelligence Cloud : Azure Product : Agent Bricks Ready to get started? Try Databricks for free Learn more about our product Talk…
Headline outcome
…MNP CUSTOMER STORY Supporting customers with next-generation financial services 6 weeks To GenAI solution deployment To strengthen their market leadership in professional services, MNP chose to ad…
Use case type
Decision support
…rivate enterprises. To support their clients in their continued growth journey, MNP aimed to simplify data analysis to ultimately provide faster, more contextual and precise client insights. The Databricks Data + AI Platform served as a unifying force to consolidate MN…
Deployment model
cloud
…s post Details Industry : Financial Services Use Case : Artificial Intelligence Cloud : Azure Product : Agent Bricks Ready to get started? Try Databricks for free Learn more…
Deployment options
cloud
…s post Details Industry : Financial Services Use Case : Artificial Intelligence Cloud : Azure Product : Agent Bricks Ready to get started? Try Databricks for free Learn more…
