From high costs to near real-time insights with Zerobus Ingest
Beusa Energy
Beusa Energy, a 30-year energy sector company spanning electric hydraulic fracturing, mobile power generation, electrical distribution, field gas processing and industrial manufacturing, migrated its high-frequency telemetry ingestion from a custom SQL Statement API pipeline to Databricks' Zerobus Ingest direct-write API. The migration required only swapping the write path (same .NET worker, same MQTT subscriptions), cutting ingestion cost from roughly 689 DBU per GB to about 0.29 DBU per GB, a 99% cost reduction, while eliminating the need for a separate streaming broker tier. Today more than 6,000 devices stream telemetry at 1 Hz across about 250 remote assets, ingesting ~22 million rows daily into a unified lakehouse with end-to-end latency of about three seconds, governed by Unity Catalog. Beusa is now using this high-frequency telemetry, combined with maintenance history, to train predictive-maintenance models forecasting remaining useful life of assets, moving from condition-based to predictive and eventually prescriptive maintenance.
Overview
Beusa Energy, a 30-year energy sector company spanning electric hydraulic fracturing, mobile power generation, electrical distribution, field gas processing and industrial manufacturing, migrated its high-frequency telemetry ingestion from a custom SQL Statement API pipeline to Databricks' Zerobus Ingest direct-write API. The migration required only swapping the write path (same .NET worker, same MQTT subscriptions), cutting ingestion cost from roughly 689 DBU per GB to about 0.29 DBU per GB, a 99% cost reduction, while eliminating the need for a separate streaming broker tier. Today more than 6,000 devices stream telemetry at 1 Hz across about 250 remote assets, ingesting ~22 million rows daily into a unified lakehouse with end-to-end latency of about three seconds, governed by Unity Catalog. Beusa is now using this high-frequency telemetry, combined with maintenance history, to train predictive-maintenance models forecasting remaining useful life of assets, moving from condition-based to predictive and eventually prescriptive maintenance.
The challenge
As Beusa Energy's device counts and data volumes grew, the cost-per-GB of its custom MQTT-to-lakehouse pipeline (a .NET worker writing to Delta tables via the SQL Statement API) became visibly unsustainable -- the SQL Statement API was not designed for high-frequency operational telemetry.
The solution
Beusa migrated its high-frequency telemetry ingestion to Databricks' Zerobus Ingest direct-write API, requiring only a single change: swapping the SQL Statement API call for the Zerobus gRPC endpoint, with the same .NET 9 worker, same MQTT subscriptions, and same Sparkplug B and JSON payload handling. This avoided standing up a separate streaming broker tier such as Kafka, Azure Event Hubs, or HiveMQ.
Reported business value
Ingestion cost dropped from roughly 689 DBU per GB to about 0.29 DBU per GB, a 99% cost reduction. Today more than 6,000 devices stream telemetry at 1 Hz across approximately 250 remote assets, ingesting ~22 million rows daily, with end-to-end latency from sensor to queryable Delta table of around three seconds, governed by Unity Catalog.
Sources
Open any source and check the claim yourself — that is the point of the register.
Other energy entries in the register.
Building a clean energy future with natural language analytics
Williams, a large-scale natural gas infrastructure operator, deployed Databricks AI/BI Genie to give commercial, regulatory, accounting and technical staff natural-language, self-serve access to analytics. The team flattened 27 disparate tables into SQL models that Genie Spaces reason over, encoding internal acronyms and business logic into Genie's instructions, powered by Databricks Unity Catalog. A data request that previously took an analyst five days now completes in seconds with validated accuracy, and the weekly backlog of data requests dropped from up to ten to one or two, freeing analysts for predictive modeling and enterprise projects.
Plenitude builds machine learning models on Databricks to forecast energy demand and renewable production
Eni-owned energy company Plenitude, which serves 10 million households and businesses across Europe, uses statistical models and machine learning on the Databricks Data + AI Platform to forecast customer energy consumption at hourly and daily granularity, forecast wind and solar generation from its renewable asset portfolio, and run customer segmentation and propensity models across 60 implemented use cases.
TotalEnergies builds Pangea 5 supercomputer with Dell Technologies and NVIDIA
TotalEnergies is building Pangea 5, a next-generation supercomputer developed with Dell Technologies and NVIDIA that will increase the company's computing power to support seismic imaging, advanced simulation and AI-driven research in the energy sector.
AES accelerates renewable energy adoption with Claude on Google Cloud
AES, a global energy company, built a multi-agent AI system using Claude on Google Cloud to automate internal safety audits of its renewable energy assets. The system uses document processing agents, task breakdown agents, and report generation agents to process hundreds of pages of safety documentation, evaluate compliance, and produce audit reports. Audit reports that previously took up to two weeks to complete (across roughly 1,550 internal audits annually) can now be generated in about an hour, a 99% reduction in time, alongside a 10-20% improvement in audit accuracy and a 99% reduction in audit costs.
Was this helpful?
Your feedback helps us improve our use case database