Spark Declarative Pipelines
2 use cases using this technology
Operationalizing Analytics Data at Scale (DEICHMANN SE)
DEICHMANN SE
DEICHMANN SE, Europe's largest footwear retailer with roughly 4,700 stores in more than 30 countries and about 8.7 billion euros in 2024 revenue, adopted Databricks Lakebase, a managed PostgreSQL database integrated with its Databricks Lakehouse, to activate governed customer and product data for e-commerce marketing without building separate integration pipelines. Lakebase reduced a data-product publishing pipeline to 3 clicks and about 30 seconds, and is now in production across Europe feeding SAP Emarsys for e-commerce marketing.
GoGuardian: Safer schools, empowered teachers, thriving students
GoGuardian
GoGuardian, which powers safe, focused learning for half of U.S. K-12 students, migrated its ML infrastructure to Databricks to manage billions of daily inferences for web filtering, classroom management and harm prevention while maintaining a PII-free, COPPA/FERPA-compliant data environment. Using Delta Lake, Lakeflow, Unity Catalog, MLflow and Databricks Model Serving, GoGuardian achieved up to 50% reduction in machine learning operational costs, 90% operational cost savings with its Delphi website classification model, and a 62% reduction in inappropriate device use among students. AI-driven prioritization also cut the volume of records requiring human review for high-risk content by over 95%, from 1 million to 35,000-45,000.