Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
U.S. Department of Transportation builds a real-time aviation database with Databricks
…Databricks Customer Stories / U.S. Department of Transportation CUSTOMER STORY Activating aviation data with real-time ML 90% Reduction in compute costs In an effort to comply with updated Bureau of T…
Description
The U.S. Department of Transportation used the Databricks Data + AI Platform on Azure with Delta Lake and Apache Kafka to unify FAA SWIM streaming data with on-premises Oracle and Sybase databases into a real-time commercial flight database, powering ML-driven predictions of air traffic patterns and reducing the cost of collecting and ingesting streaming data by 90% compared to other cloud solutions.
…related to flights, airports and passenger behavior. After careful evaluation, the USDOT chose Microsoft Azure and the Databricks Data + AI Platform because of the ability to democratize all their various data sources, including on-premises databases like Oracle and Sybase, with real-time streaming via Apache Kafka. “Databricks gives users an efficient way to create job schedules, scale cluster…
Company
U.S. Department of Transportation
…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / U.S. Department of Transportation CUSTOMER STORY Activating aviation data with real-time ML 90% Reduction in com…
Industry
Government & Public Sector
…treaming data by 90% compared to other cloud solutions. Share this post Details Industry : Public Sector Use Case : Data Science , Data Engineering Cloud : Azure Product : Agent Bricks…
Problem
USDOT needed to unify fragmented on-premises databases (Oracle, Sybase) and public FAA SWIM streaming data into a real-time commercial flight database to comply with updated Bureau of Transportation requirements, in an industry that traditionally relied on on-premises platforms rather than the cloud, making it hard to control data quality and scale without heavy manual review.
…at challenge was the U.S. Department of Transportation solving with Databricks? The U.S. Department of Transportation (USDOT) needed to build a real-time commercial aviation flight database to unite fragmented on-premises and streaming data, accurately measure aviation system performance and report on flight operations in compliance with Bureau of Transportation requirements. How does the USDOT process and unify its aviation data streams? The USDOT combi…
Solution
USDOT chose Microsoft Azure and the Databricks Data + AI Platform to democratize its various data sources, including on-premises databases like Oracle and Sybase, with real-time streaming via Apache Kafka, using Delta Lake to build reliable pipelines that feed Tableau and Power BI dashboards and machine learning models predicting air traffic patterns and passenger impact.
…n requirements. How does the USDOT process and unify its aviation data streams? The USDOT combines public FAA System-Wide Information Management (SWIM) data feeds with on-premises databases such as Oracle and Sybase, using Microsoft Azure, Apache Kafka and the Databricks Data + AI Platform. What role does Delta Lake play in the USDOT's data architecture? Delta Lake ena…
Technology
Delta Lake, Apache Kafka
…agement (SWIM) data feeds with on-premises databases such as Oracle and Sybase, using Microsoft Azure, Apache Kafka and the Databricks Data + AI Platform. What role does Delta Lake play in the USDOT's data architecture? Delta Lake en…
Use case type
Predictive operations
…Databricks help the USDOT improve passenger experiences and flight forecasting? By running predictive analytics and machine learning on real-time data, the USDOT forecasts air traffic patterns, evaluates on-time/delayed flights and accurately predicts the resources needed…
Headline outcome
…as been able to implement a unique approach for data conversion and processing, reducing the cost of collecting and ingesting streaming data by 90% as compared to other cloud-based solutions. Databricks provided everything the USDOT data team needed to automate complex…
Business value
USDOT reduced the cost of collecting and ingesting streaming data by 90% compared to other cloud-based solutions, and its data engineers, scientists and analysts now collaborate on one platform to deliver real-time aviation dashboards and more accurate predictions about resource needs.
…needs. The USDOT data team is more productive these days, too. With Databricks, all their data teams — from data engineers to data scientists and analysts — are able to collaborate better and be more productive with their data. “We now have a very efficient way to work,” said Hashemipour. “It’s simple to…
AI capabilities
Predictive Analytics, Machine Learning
…Databricks help the USDOT improve passenger experiences and flight forecasting? By running predictive analytics and machine learning on real-time data, the USDOT forecasts air traffic patterns, evaluates on-time/delayed flights and accurately predicts the resources needed…
Deployment options
cloud
…ost Details Industry : Public Sector Use Case : Data Science , Data Engineering Cloud : Azure Product : Agent Bricks , Delta Lake Ready to Get Started? Try Databricks for fr…
