Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving
LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Databricks Model Serving | Databricks Skip to main content Login Why Databricks Discover For App Develop…
Company
LG U+
…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / LG U+ CUSTOMER STORY LG U+ Reduced LLM Vendor Dependency and Cut Costs 36% with Datab…
Description
LG U+, one of Korea's leading telecom carriers, migrated its U+one AI Search service to Databricks Model Serving to reduce dependence on a single external LLM vendor. Databricks hosts Gemini 2.5 Flash in a dedicated availability zone through a partnership with Google, letting LG U+ keep its existing LangChain interfaces and model while removing its direct reliance on Google's own infrastructure. The company also rebuilt its search architecture with an AI Gateway, Query Orchestration, a Semantic Elastic Cache, Hybrid Reasoning Retrieval, and Agentic Self-Correction Loops running within an LLMOps framework. In controlled tests, Gemini calls routed through Databricks showed 48% higher throughput, 22% faster average response times, and a 90% lower failure rate versus direct calls; in production, operating costs fell 36% and response speed improved 64% even as system complexity grew 107%. LG U+ is extending the same infrastructure to its ixi-O Voice AI services.
…aude and GPT right alongside one another. What mattered most for LG U+ was that Databricks hosts Gemini 2.5 Flash in a dedicated availability zone through a partnership with Google. The company could keep running the exact same model it already trusted while r…
Problem
LG U+ had become heavily dependent on external large language models. With nearly every request riding on an external LLM call, token costs, response speed, output quality and uptime all sat in the hands of outside vendors, and its primary model, Gemini, still ran on a single vendor's infrastructure, so any latency spike or outage there landed straight on service quality.
…, structural problem was how much the service leaned on external LLM providers. With nearly every request riding on an external LLM call, token costs, response speed, output quality and uptime all sat in the hands of outside vendors. LG U+ had built a multi-model architecture with proprietary traffic controls t…
Implementation approach
LG U+ chose Databricks because it met the three things the team needed most: reduce vendor dependency, allow a fast migration with minimal code changes, and hold performance and reliability at the levels the service already met. LG U+ integrated the platform while keeping its standard LangChain interfaces intact.
…iness Enablement Team. Reducing Vendor Dependence with Databricks Model Serving LG U+ chose Databricks because it met all three of the things the team needed most: reduce vendor dependency, make for a fast migration with minimal code changes and hold performance and r…
Industry
Telecommunications
…peed improved 64%, even as system complexity grew 107%. Share this post Details Industry : Communications Use Case : Artificial Intelligence , Data Science , Orchestration Product : AI/…
Technology
Databricks Model Serving, LangChain, Gemini 2.5 Flash, AI Gateway, Semantic Elastic Cache, Hybrid Reasoning Retrieval
…tion picks the best search strategy for each request as it comes in. From there a Semantic Elastic Cache speeds up answers to similar questions while keeping costs down, Hybrid Reasoning Retrieval pulls together multiple da…
AI capabilities
Generative AI, Agentic AI, Conversational AI
…al pulls together multiple data sources to surface the most relevant answer and Agentic Self-Correction Loops keep refining accuracy over time. The whole system runs inside an LLMOps framework built for continuous learning…
Deployment options
cloud
…aude and GPT right alongside one another. What mattered most for LG U+ was that Databricks hosts Gemini 2.5 Flash in a dedicated availability zone through a partnership with Google. The company could keep running the exact sam…
Country
South Korea
…e, and the telecommunications industry sits at the center of that shift. LG U+, one of Korea's leading carriers, generates more than KRW 15 trillion in annual revenue…
