Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
Abnormal Security detects email attacks with behavioral AI on Databricks
…Demo Login Contact Us Try Databricks Customer Stories / Abnormal CUSTOMER STORY Stopping sophisticated ransomware in its tracks 20% Reduction in successful email attacks 40% Reduction in infrastructure costs…
Description
Abnormal Security migrated from a legacy Hadoop system to the Databricks Data + AI Platform on AWS, using Delta Lake and Databricks SQL to stream threat signals from Kinesis Firehose and power behavioral AI models analyzing over 50,000 signals to detect email attacks, achieving a 20% reduction in successful email attacks, a 40% reduction in infrastructure costs, and a 30%+ increase in productivity.
…ail attacks 40% Reduction in infrastructure costs 30+% Increase in productivity Abnormal Security’s behavior AI analyzes over 50,000 signals to detect and remediate all email attacks. Knowing that their legacy Hadoop system wasn’t going to allow them to scale eff…
Company
Abnormal Security
…um of targeted email attacks is fast becoming a top priority across industries. In 2017, Abnormal Security entered the stage with a specific mission: to provide companies with a level of email security that could rise to the increasingly complex challenges of modern cyberattacks.…
Problem
Abnormal Security's legacy Hadoop system with long-running AWS EMR clusters wasn't going to scale efficiently with rapidly increasing demand, and engineers were spending too much time managing Spark infrastructure instead of building pipelines that would make the product better; a shared Jupyter notebook server also slowed processing for everyone when heavy applications ran.
…r roadblock to success as the amount of data to be ingested continued to grow. “We were spending too much time managing our Spark infrastructure,” added Carlos Gasperi, a software engineer at Abnormal Security. “What we needed to be doing with that time was build the pipelines that would m…
Solution
Abnormal Security migrated to the Databricks Data + AI Platform on AWS, using Delta Lake to stream threat signals from Kinesis Firehose into near real-time storage and Databricks SQL for dashboards, powering behavioral AI models that analyze over 50,000 signals to detect and remediate email attacks.
…ty and performance on your data lake — for both streaming and batch operations. Data flows from Kinesis Firehose into Delta Lake, making threat signals data instantly available to data scientists. With Databricks SQL, data scientists are then able to create visualizations using rich dashboards to drive product decisions and improve detection efficacy. In addition to making their data actionable, Databricks also provided the colla…
Business value
Abnormal Security achieved a 20% reduction in successful email attacks, a 40% reduction in infrastructure costs, and 30%+ productivity gains for its data science and data engineering teams, while processing thousands of emails per second.
…l attacks. Not only are infrastructure costs for individual pipelines down, but Abnormal Security was able to experience average productivity gains of 30+% for both the data science and data engineering teams. Next up, Abnormal Security will use Databricks to focus on democratizing threat…
Industry
Cybersecurity
…0% reduction in successful email attacks for customers. Share this post Details Industry : Cybersecurity , Digital and AI-Native Business , Technology and Software Use Case : Data Scie…
Technology
Delta Lake, Databricks SQL
…tware Use Case : Data Science , Data Warehousing , Data Engineering Cloud : AWS Product : Agent Bricks , Databricks SQL , Delta Lake Ready to get started? Try Databricks for free Learn more about our product Talk…
Use case type
Fraud and anomaly detection
…their data infrastructure with ease, process thousands of emails per second and deploy machine learning models that detect the smallest of anomalies that signal suspicious behavior, to protect their customers from email-based attacks. The need for speed in ema…
Headline outcome
…ories / Abnormal CUSTOMER STORY Stopping sophisticated ransomware in its tracks 20% Reduction in successful email attacks 40% Reduction in infrastructure costs 30+% Increase in productivity Abnormal Se…
AI capabilities
Fraud & Anomaly Detection, Machine Learning
…their data infrastructure with ease, process thousands of emails per second and deploy machine learning models that detect the smallest of anomalies that signal suspicious behavior, to protect their customers from email-based attacks. The need for speed in ema…
Deployment options
cloud
…performance of data pipelines and analytics via Delta Lake and Databricks SQL. “Once we implemented Databricks on AWS, the need to manage long-running AWS EMR clusters went away entirely,” said Gas…
