Title
Transforming Data Pipelines to Power Faster Credit Decisions
Transforming data pipelines to power faster credit decisions | Databricks Skip to main content Login Why Databricks Discover For App Develop…
Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
Transforming Data Pipelines to Power Faster Credit Decisions
Transforming data pipelines to power faster credit decisions | Databricks Skip to main content Login Why Databricks Discover For App Develop…
Description
Capital One's data and engineering teams built a centralized Feature Hub on Databricks, using Photon as the compute engine and Delta Lake as the foundation, to serve as a single environment for historical and operational feature pipelines supporting its credit line increase program and credit decisioning models. The hub curates records across millions of accounts to provide a unified customer view for both modeling and daily decisioning. Capital One reports 60x faster compute performance for large-scale backfills and an 80% decrease in time and cost per job after migrating production pipelines to Databricks, shortening feature development and deployment from prior timelines to weeks.
…decisions. Standardizing features on Databricks To overcome these constraints, Capital One’s data and engineering teams built a centralized Feature Hub on Databricks. With Photon as the compute engine and Delta Lake as the foundation, the hub became the single environment for both historical and operational feature pipelines. It now curates records across millions of accounts, providing a 360-degree view…
Company
Capital One
…y to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / Capital One CUSTOMER STORY Transforming data pipelines to power faster credit decisions 60X…
Problem
Capital One's credit line increase program relies on intelligent and trusted data and insights to enable financial empowerment for its customers, but growing data volumes and complex pipelines led Capital One to establish a new centralized feature hub to further streamline data management and enhance performance.
…pital One solves industry problems and delivers value to millions of customers. Its credit line increase program relies on intelligent and trusted data and insights to enable financial empowerment for its customers. But growing data volumes and complex pipelines led Capital One to establish a new centralized feature hub to further streamline data management and enhance performance. With Databricks, Capital One was able to unify data pipelines, accelerate data…
Solution
Capital One's data and engineering teams built a centralized Feature Hub on Databricks, using Photon as the compute engine and Delta Lake as the foundation, as the single environment for both historical and operational feature pipelines. It curates records across millions of accounts, providing a 360-degree view of customer insights that supports both modeling and daily decisioning. Engineers used Databricks APIs to automate job triggers, monitoring and reruns, while autoscaling clusters matched resources to workloads.
…er than other available systems.” Automation was key to multiplying efficiency. Engineers used Databricks APIs to automate job triggers, monitoring, and reruns, while autoscaling clusters matched resources to workloads for optimal spend and performance. As a result, developing and deploying new model features only takes weeks, incl…
Business value
Capital One improved job completion speeds by 60X and saw an 80% decrease in time and cost per job after migrating production pipelines to Databricks, with developing and deploying new model features, including full historical backfills, now taking only weeks.
…r decisions The Databricks Data + AI Platform delivered transformative results. Capital One improved job completion speeds by 60X, which has the potential to unlock significant efficiency gains as workloads scale. The benefits also carried over to daily operations. By migrating production pip…
…matched resources to workloads for optimal spend and performance. As a result, developing and deploying new model features only takes weeks, including full historical backfills. Raquel Goosey, Data Engineering Manager at Capital One emphasized, “Once we hav…
Industry
Financial Services
…pital One solves industry problems and delivers value to millions of customers. Its credit line increase program relies on intelligent and trusted data and insights to enable financial empowerment for its customers. But growing data volumes and complex pipelines led Capital One to establish a n…
Technology
Photon, Delta Lake
…One’s data and engineering teams built a centralized Feature Hub on Databricks. With Photon as the compute engine and Delta Lake as the foundation, the hub became the single environment for both historical and operational feat…
AI capabilities
Predictive Analytics
…Databricks. With Photon as the compute engine and Delta Lake as the foundation, the hub became the single environment for both historical and operational feature pipelines. It now curates records across millions of accounts, providing a 360-degree vie…