Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
SafeGraph optimizes geospatial data processing with Databricks and Delta Sharing
…emo Login Contact Us Try Databricks Customer Stories / SafeGraph CUSTOMER STORY Empowering industries with geospatial insights 2x–10x Faster spatial querying, indexing and partitioning 50% Reduction in peak…
Description
SafeGraph used the Databricks Data + AI Platform, Delta Lake, Delta Sharing and MLflow to process petabytes of geospatial data and feed predictive models, achieving 2x-10x faster spatial querying, indexing and partitioning and a 50% reduction in peak memory consumption compared to other platforms, while reducing data access time for partners from months to minutes via Delta Sharing.
…ories / SafeGraph CUSTOMER STORY Empowering industries with geospatial insights 2x–10x Faster spatial querying, indexing and partitioning 50% Reduction in peak memory consumption as compared to other platforms SafeGra…
Company
SafeGraph
…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / SafeGraph CUSTOMER STORY Empowering industries with geospatial insights 2x–10x Faster spa…
Industry
Technology & Software
…l data to keep pace with real-world demand and change.” Share this post Details Industry : Technology and Software Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , A…
Problem
Working with petabytes of historical geospatial data, SafeGraph's lean team of engineers was challenged with massive volumes of data and incomplete data sets; processing high volumes of information while accurately analyzing the nuances of each data set was time-consuming and resource-intensive, and the team found that cloud storage was not an ideal place to write or manage such massive data sets.
…n geospatial data sets that illustrate where people spend their time and money. Working with petabytes of historical data, SafeGraph’s lean team of engineers was challenged with massive volumes of data and incomplete data sets. The Databricks Data + AI Platform enables SafeGraph to optimize workflows and f…
Solution
SafeGraph built its analytics system on the Databricks Data + AI Platform, using Delta Lake as the foundation to unify data sets and build scalable data pipelines feeding analytics and machine learning models, Delta Sharing to securely exchange large data sets with customers and partners, and MLflow for predictive model deployment, monitoring and performance tracking, alongside AWS Redshift, EKS Kubernetes, and Elasticsearch.
…manage massive data sets, so they turned to the Databricks Data + AI Platform. Delta Lake, an open format storage layer that brings reliability, security and performance to the data lake, serves as the foundation of SafeGraph’s analytics system — allowing them to unify all their data sets and build scalable data pipelines…
Business value
SafeGraph achieved 2x-10x faster spatial querying, indexing and partitioning, and a 50% reduction in peak memory consumption compared to other platforms; adopting Delta Sharing also reduced data-exchange access time from months to minutes for customers and partners.
…nations without the complexities of having to deploy a specific platform first. This reduces access time from months to minutes and greatly reduces work for data providers who want to reach as many users as possible. With data feeding their predictive models to help businesses make smarter decis…
AI capabilities
Machine Learning, Predictive Analytics
…ly reduces work for data providers who want to reach as many users as possible. With data feeding their predictive models to help businesses make smarter decisions, they use MLflow for model deployment, monitoring and performance tracking. “Machine learning matters here,” said Cheung. “It’s an essential part of our ar…
Technology
Databricks Data + AI Platform, Delta Lake, Delta Sharing, MLflow, AWS Redshift, EKS Kubernetes, Elasticsearch
…e keenly interested in, both internally and externally.” Along with Databricks, SafeGraph employs AWS Redshift to warehouse their data, EKS Kubernetes for containerized execution, and Elasticsearch for fuzzy queries to help with misspellings and other data quality problems. “As more data is ing…
Use case type
Analytics augmentation
…ndustries succeed. Scaling geospatial data in parallel with real-world behavior SafeGraph is a geospatial data company focused on aggregating complex data — points of interest (POI), foot traffic, as well as other non-personal identif…
Headline outcome
…h geospatial insights 2x–10x Faster spatial querying, indexing and partitioning 50% Reduction in peak memory consumption as compared to other platforms SafeGraph serves businesses the data they need to make key decisions about ever…
Deployment model
Cloud (AWS)
…s Industry : Technology and Software Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , Agent Bricks Ready to get started? Try Databricks for fr…
Deployment options
cloud
…s Industry : Technology and Software Use Case : Data Science , Data Engineering Cloud : AWS Product : Delta Lake , Agent Bricks Ready to get started? Try Databricks for fr…
