Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
Kythera Labs builds its business on Spark Declarative Pipelines and the Databricks Data + AI Platform
…Customer Stories / Kythera Labs PRODUCT SPOTLIGHT: Spark Declarative Pipelines Kythera Labs builds its business on Spark Declarative Pipelines and the Databricks Data + AI Platform 3+ petabytes Of raw healthcare data efficiently stored and processed into actio…
Description
Kythera Labs, a healthcare big-data company processing about 2 billion medical and 3 billion prescription transactions annually, uses the Databricks Data + AI Platform with Spark Declarative Pipelines, Delta Sharing and Unity Catalog to remaster over 3 petabytes of raw healthcare data into analysis-ready products via its Wayfinder offering. This delivered a 99%+ reduction in query pipeline processing time (from 2 days to 2-4 minutes) and 80% faster time to market.
…abs. Achieving its mission means Kythera must manage an enormous data pipeline. The company collects and manages data from about 2 billion medical transactions and approximately 3 billion prescription transactions annually. When Kythera was founded in 2019, the company struggled to store and process it…
…amount of complex data available. Kythera Labs is on a mission to change that. The organization is using the Databricks Data + AI Platform — including Spark Declarative Pipelines, Delta Sharing and Unity Catalog — to deliver enormous remastered healthcare data sets and derived data products ready for analysis that leads the healthcare industry to more precise insights with higher confidence. Big data storage and processing challenges restrict long-term vision Kythera La…
…s business on Spark Declarative Pipelines and the Databricks Data + AI Platform 3+ petabytes Of raw healthcare data efficiently stored and processed into actionable insights 99%+ Reduction in query pipeline processing time 80% Faster time to market More…
…f raw healthcare data efficiently stored and processed into actionable insights 99%+ Reduction in query pipeline processing time 80% Faster time to market More healthcare data is available today than ever bef…
…essed into actionable insights 99%+ Reduction in query pipeline processing time 80% Faster time to market More healthcare data is available today than ever before. In 2019, the founders…
Company
Kythera Labs
…rity and Trust Ready to get started? Get a Demo Login Contact Us Try Databricks Customer Stories / Kythera Labs PRODUCT SPOTLIGHT: Spark Declarative Pipelines Kythera Labs builds its business…
Industry
Healthcare
…ity to access data and discover the answers they need.” Share this post Details Industry : Healthcare and Life Sciences Use Case : Data Engineering Cloud : AWS Product : Spark Declarative Pipelines ,…
Problem
Healthcare and life sciences organizations often struggle to extract actionable insights and value from the massive and continuously increasing amount of complex data available. When Kythera was founded in 2019, the company struggled to store and process its big healthcare data efficiently and cost-effectively.
…al opportunities to develop breakthrough clinical and commercial solutions. Yet healthcare and life sciences organizations often struggle to extract actionable insights and value from the massive and continuously increasing amount of complex data available. Kythera Labs is on a mission to change that. The organization is using the Dat…
…al transactions and approximately 3 billion prescription transactions annually. When Kythera was founded in 2019, the company struggled to store and process its big healthcare data efficiently and cost-effectively. To realize its vision to help drive improvements in the healthcare ecosystem, K…
Solution
Kythera uses Spark Declarative Pipelines to automate and simplify the orchestration of ETL pipelines, which helps deliver better insights because the data is more reliable and higher quality. The lakehouse architecture unifies data so Kythera can use it for both analysis and machine learning while reducing the risk of data egress and helping customers lower costs.
…the Databricks Data + AI Platform because of expandable storage and processing. Kythera uses Spark Declarative Pipelines to automate and simplify the orchestration of ETL pipelines, which helps deliver better insights because the data is more reliable and higher quality. Kythera primarily uses Spark Declarative Pipelines for its patient event assets…
…2 weeks for our competitors that don’t use Databricks,” says McDonald. Finally, the lakehouse architecture unifies data so Kythera can use it for both analysis and machine learning while reducing the risk of data egress and helping customers lower costs, especially compared to Snowflake. “Customers tell us their Snowflake costs are…
Technology
Spark Declarative Pipelines, Unity Catalog, Delta Sharing
…n to change that. The organization is using the Databricks Data + AI Platform — including Spark Declarative Pipelines, Delta Sharing and Unity Catalog — to deliver enormous remastered healthcare data sets and derived data products…
Deployment model
AWS
…ost Details Industry : Healthcare and Life Sciences Use Case : Data Engineering Cloud : AWS Product : Spark Declarative Pipelines , Unity Catalog Ready to get started? Try…
Deployment options
cloud
…ost Details Industry : Healthcare and Life Sciences Use Case : Data Engineering Cloud : AWS Product : Spark Declarative Pipelines , Unity Catalog Ready to get started? Try…
AI capabilities
Predictive Analytics
…2 weeks for our competitors that don’t use Databricks,” says McDonald. Finally, the lakehouse architecture unifies data so Kythera can use it for both analysis and machine learning while reducing the risk of data egress and helping customers lower costs, espec…
Headline outcome
…f raw healthcare data efficiently stored and processed into actionable insights 99%+ Reduction in query pipeline processing time 80% Faster time to market More healthcare data is available today than ever bef…
…the use of Spark Declarative Pipelines translates into time and cost savings. “Before Spark Declarative Pipelines (on Databricks), we could design, test and run a query pipeline in 2 days. With Spark Declarative Pipelines, we can do it in 2 to 4 minutes. It can take about 2 weeks for our competitors that don’t use Databricks,” says…
