Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
Kantar rebuilds its Worldpanel Plus data processing platform on Databricks for faster brand insights
…o help clients understand people, shape the future and inspire growth. In 2020, Kantar turned to Databricks to develop a new data processing platform (DPP) for its Worldpanel Plus research service, which translates shopping data from large samples of consumers into actionable…
Description
Kantar replaced three in-house architectures with a new data processing platform on the Databricks Data + AI Platform on Azure to process 3 million+ consumer purchase receipts per month for its Worldpanel Plus research service, using Unity Catalog, Delta Sharing, Spark Declarative Pipelines and MLflow, cutting the time to reprocess five years of historical data from several months to two days.
…ata from large samples of consumers into actionable insights for their clients. Replacing three architectures that had been created in-house, the Databricks Data + AI Platform on Azure has transformed the way Kantar realizes its vision of helping brands grow through meaningful data and offering strategic brand adv…
Company
Kantar
…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / Kantar CUSTOMER STORY Helping brands grow through real-time, actionable insights Watch…
Industry
Marketing
…ance capabilities of the Databricks Data + AI Platform. Share this post Details Industry : Marketing , Technology and Software Use Case : Data Science , Data Engineering Cloud : Azure Product : Delta Lake ,…
Problem
Kantar's previous SQL Server-based platform could process new receipts but struggled with reprocessing five years of historical purchase data, which was crucial for delivering trend insights such as market share changes; the legacy SAS system was also too rigid, complex and costly to maintain, making machine learning models simply not possible.
…ccurate data. Richard Goldsby-West, Global Product Owner at Kantar, commented, “Our previous platform based on SQL Server was able to process new receipts but struggled with reprocessing of historical data. One of our key services is providing trends over time, such as market share cha…
Solution
Kantar built a new data processing platform for its Worldpanel Plus research service on the Databricks Data + AI Platform on Azure. Purchase receipts scanned via OCR flow into the platform, which uses Unity Catalog for governance, Delta Sharing to deliver data to clients, Spark Declarative Pipelines for streaming, and MLflow with Databricks Model Serving to develop and deploy machine learning models for data cleaning and insight generation.
…s through its dedicated Shoppix app, equating to 3 million+ receipts per month. Each receipt is scanned through an optical character recognition (OCR) system before reaching the data processing platform as structured, uncleaned data, together with demographics for each customer. Th…
Technology
Delta Lake, Unity Catalog, MLflow, Delta Sharing, Spark Declarative Pipelines
…ill become even more prevalent for Kantar in the future. Garrido confirmed that Spark Declarative Pipelines makes streaming simple and workflows more visible, as users are able to see the workflow in the UI. The data team is able to see…
Use case type
Document processing
…s through its dedicated Shoppix app, equating to 3 million+ receipts per month. Each receipt is scanned through an optical character recognition (OCR) system before reaching the data processing platform as structured, uncleaned data, tog…
Headline outcome
…ER STORY Helping brands grow through real-time, actionable insights Watch video 2 days To process 5 years of data (reduced from several months) 3M+ Receipts processed per month Additional use cases Kantar uses Databricks to…
Business value
Kantar can now process five years of data in two days instead of potentially several months, processes more than 3 million receipts per month, deployed a new client data-sharing capability in just one week, and was able to pivot to real-time daily reporting for clients during the COVID-19 pandemic.
…is has allowed Kantar to easily create new ways to deliver data to its clients. The process took just one week to deploy. Streaming will become even more prevalent for Kantar in the future. Garrido con…
AI capabilities
Document Intelligence, Machine Learning
…s able to easily handle large-scale volumes, combine multiple data sources, and leverage machine learning and AI technology to deliver clean, accurate data. Richard Goldsby-West, Global Product Owner at Kantar, commented, “Our previous…
Deployment options
cloud
…Marketing , Technology and Software Use Case : Data Science , Data Engineering Cloud : Azure Product : Delta Lake , Spark Declarative Pipelines Ready to get started? Try Da…
