Databricks Model Serving

14 use cases using this technology · by Databricks

14published use cases

9industries

5countries on record

Generative AI

top AI capability

Evidence mix: High 14 · Medium 0 · Low 0 — bands are computed from each record's evidence signals.

Industry

Country

14 use cases

Financial ServicesRetrieval-Augmented GenerationLarge Language Models

MNP deploys a fine-tuned LLM with RAG on Databricks to deliver client insights in weeks

MNP, a Canadian professional services firm, used the Databricks Data + AI Platform, AI Search and Foundation Model APIs to deploy a retrieval-augmented generation system on a Mixtral 8x7B model, letting client-facing teams get contextual, up-to-date insights from structured and unstructured data. Supported by the Databricks GenAI Advisory Program, MNP's data team built a model from start to QA testing within four weeks and reached GenAI solution deployment in six weeks.

MNP· CanadaDatabricks AI Search · Foundation Model APIs · Databricks Model Serving +3

EnergyRetrieval-Augmented GenerationConversational AI

Hawaiian Electric builds a RAG chatbot on Databricks to answer regulatory compliance queries in seconds

Hawaiian Electric Company (HECO) worked with Databricks Professional Services to build a retrieval augmented generation proof of concept using Databricks AI Search and a RAG model-serving endpoint, letting its regulatory team query extensive regulatory documentation through a conversational chatbot instead of manually reading full texts. The implementation took two weeks to go from zero to a working RAG system and cut the time to answer a single regulatory query from about five minutes to five seconds.

Hawaiian Electric CompanyDatabricks AI Search · Spark Declarative Pipelines · Unity Catalog +2

HealthcareLarge Language ModelsDocument IntelligenceFraud & Anomaly Detection

Orizon fine-tunes GenAI models on Databricks to automate 63% of healthcare fraud-detection code documentation

Orizon, a Brazilian health tech fraud-detection company managing 40,000+ medical billing rules, fine-tuned Llama2-code and DBRX models on Databricks using MLflow and Model Serving, and embedded the resulting LLM chatbot into Microsoft Teams via Unity-Catalog-governed data, so business users could get instant rule explanations instead of waiting on C++ developers. The system now automates 63% of documentation workflows, cut documentation time to under five minutes, freed up 1.5 developers, and is estimated to add 1 billion BRL in productivity.

Orizon· BrazilDelta Lake · MLflow · Databricks Model Serving +5

Technology & SoftwareRetrieval-Augmented GenerationLarge Language Models

Circuitry.ai builds RAG chatbots on Databricks to give manufacturers' customers decision intelligence

Circuitry.ai used Delta Lake, Unity Catalog, MLflow and Model Serving on Databricks to build customer-specific retrieval augmented generation chatbots, powered by Llama and DBRX, that let manufacturers of complex products like heavy equipment and automotive parts query proprietary product documentation instead of searching large PDF manuals. The RAG-powered Decision AIdvisor tool cut the time customers spend searching for information by 60-70%.

Circuitry.aiDelta Lake · Unity Catalog · MLflow +3

MarketingGenerative AIConversational AI

Locala builds a GenAI virtual assistant on Databricks that explains ad campaign data in natural language

Locala, an omnichannel advertising platform, fine-tuned a Llama 2 model on Databricks using MLflow, Lakeflow Jobs and Model Serving to build 'Insights AI,' a virtual assistant that lets planners and clients ask natural-language questions and receive explanations of advertising campaign performance charts and figures. A single data scientist was able to build the tool, which is now used in client-facing sales presentations, and Locala plans to evolve it into a RAG system for broader querying.

LocalaLlama 2 · MLflow · Lakeflow Jobs +4

Financial ServicesNatural Language ProcessingMachine Learning

FiscalNote streamlines ML and NLP legislative-analytics model deployment on Databricks, tripling release cadence

FiscalNote, a legislative and regulatory data analytics company, used Databricks MLflow and Model Serving to automate tracking, deployment and no-disruption updates of its machine learning and NLP models, which perform tasks like legislative outcome sentiment analysis and binary classification of how a congressperson will vote. The change let FiscalNote deploy ML models 3x faster and increased the number of models it ships annually compared to before Databricks.

FiscalNoteMLflow · Databricks Model Serving · Agent Bricks

Technology & SoftwareGenerative AIComputer VisionDocument Intelligence

MediaRadar | Vivvix uses GenAI and computer vision on Databricks to automate video ad classification

MediaRadar | Vivvix built a GenAI pipeline on Databricks using Spark Structured Streaming, the Ray cluster, Whisper for transcription/translation and OCR to classify video ads across millions of product categories. A dual-layer approach combines GenAI product identification with in-house classification models, increasing hourly ad-classification throughput from about 800 to 2,000 creatives and cutting model-experimentation time from two days to half a day.

MediaRadar | VivvixDatabricks · Databricks Model Serving · Unity Catalog +2

ManufacturingGenerative AIConversational AI

Grainger builds a GenAI RAG-powered product search to help call center agents navigate 2.5 million products

Grainger implemented a retrieval augmented generation (RAG) search system on the Databricks Data + AI Platform, using Databricks AI Search and Model Serving to let customer service and sales teams retrieve accurate product information from a 2.5 million-item catalog with over 400,000 daily product changes, improving search recall and reducing errors for call center agents.

GraingerDatabricks · Databricks AI Search · Databricks Model Serving +1

HealthcareGenerative AIRetrieval-Augmented Generation

Accolade creates seamless healthcare experiences with a RAG solution on Databricks

Healthcare technology company Accolade consolidated fragmented data from AWS Redshift and Snowflake into a Databricks lakehouse with Unity Catalog and built a RAG solution using the open-source DBRX model via Agent Bricks Custom Agents to help internal teams quickly and accurately answer complex member inquiries.

AccoladeDatabricks Data + AI Platform · Unity Catalog · Agent Bricks +3

TelecommunicationsGenerative AIAgentic AIConversational AI

LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving

LG U+, one of Korea's leading telecom carriers, migrated its U+one AI Search service to Databricks Model Serving to reduce dependence on a single external LLM vendor. Databricks hosts Gemini 2.5 Flash in a dedicated availability zone through a partnership with Google, letting LG U+ keep its existing LangChain interfaces and model while removing its direct reliance on Google's own infrastructure. The company also rebuilt its search architecture with an AI Gateway, Query Orchestration, a Semantic Elastic Cache, Hybrid Reasoning Retrieval, and Agentic Self-Correction Loops running within an LLMOps framework. In controlled tests, Gemini calls routed through Databricks showed 48% higher throughput, 22% faster average response times, and a 90% lower failure rate versus direct calls; in production, operating costs fell 36% and response speed improved 64% even as system complexity grew 107%. LG U+ is extending the same infrastructure to its ixi-O Voice AI services.

LG U+· South KoreaDatabricks Model Serving · LangChain · Gemini 2.5 Flash +3

Financial ServicesPredictive AnalyticsConversational AIAgentic AI

Delivering One Highstreet Experience Through Connected Data and Intelligence

Highstreet Insurance Partners, an insurance brokerage that has grown through partnerships with more than 200 independent agencies, built Ora, a proprietary unified digital intelligence platform on Databricks that combines trusted data, analytics, intelligent automation and AI. Ora manages more than 49 billion data points spanning client, policy and carrier history for roughly 500,000 active client relationships. Highstreet built a knowledge graph connecting clients, policies, coverages, documents, and communications to ground AI agent recommendations, uses Unity Catalog for governance across data and ML assets, and Databricks Model Serving to run machine learning models that surface renewal-likelihood scores and cross-sell opportunities. Highstreet reduced the time to onboard a new agency partner's data into Ora from as much as six months to less than two weeks, and increased daily data refresh success from 35% to more than 95% after re-engineering Ora's data foundation with Lakeflow pipelines and Delta Lake.

Highstreet Insurance Partners· United StatesUnity Catalog · Delta Lake · Lakeflow Jobs +2

EnergyGenerative AIRetrieval-Augmented GenerationConversational AIDocument Intelligence

Axpo boosts operational efficiency across the energy value chain

Axpo Group, a major player in the Swiss energy sector, built a GenAI knowledge platform on the Databricks Data + AI Platform to give employees secure, permission-aware search across internal data sources including technical standards, specifications and best practices. The architecture uses a medallion pattern (Bronze/Silver/Gold layers), Lakeflow Jobs for orchestration, RAG-based AI Search, GPT-4o for conversational responses, and Mistral OCR for scanned documents. The tool achieved a 90% approval rating and delivered 30% time savings for power users, with a 3x increase in user adoption as it expanded beyond engineering.

Axpo Group· SwitzerlandDatabricks Data + AI Platform · Databricks Lakeflow Jobs · GPT-4o +2

EducationMachine LearningFraud & Anomaly DetectionAI Model Development & MLOps

GoGuardian: Safer schools, empowered teachers, thriving students

GoGuardian, which powers safe, focused learning for half of U.S. K-12 students, migrated its ML infrastructure to Databricks to manage billions of daily inferences for web filtering, classroom management and harm prevention while maintaining a PII-free, COPPA/FERPA-compliant data environment. Using Delta Lake, Lakeflow, Unity Catalog, MLflow and Databricks Model Serving, GoGuardian achieved up to 50% reduction in machine learning operational costs, 90% operational cost savings with its Delphi website classification model, and a 62% reduction in inappropriate device use among students. AI-driven prioritization also cut the volume of records requiring human review for high-risk content by over 95%, from 1 million to 35,000-45,000.

GoGuardian· United StatesDelta Lake · Databricks Lakeflow · Unity Catalog +6

Consumer GoodsRetrieval-Augmented GenerationGenerative AIRecommendation & PersonalizationAgentic AI

Empowering Marketing Teams to Drive Greater Impact at Reckitt

Reckitt built an AI system called the Insight Engine on the Databricks Data + AI Platform, unifying consumer research, product reviews and social listening signals to give marketing teams faster, actionable insights. The system uses Databricks Model Serving to deploy multiple LLMs including OpenAI's ChatGPT-4 and Google's Gemini, AI Search for retrieval-augmented generation, and Agent Bricks AI Gateway for governance. Reckitt's marketing teams achieved a 40% improvement in task execution, a 40-60% reduction in time to develop campaign concepts, 60% faster concept development, and 30% faster ad adaptation and localization, with hundreds of marketers using the AI tools across the organization by the end of 2025.

ReckittDatabricks Data + AI Platform · Databricks Model Serving · OpenAI ChatGPT-4 +3