Each colour maps a published value to the exact source passage used to support it. Only bounded excerpts are public; administrators can inspect the complete captured source.
Title
Synthesia Accelerates AI Text-to-Video Model Training 30x on NVIDIA GPUs via AWS
…tion using NVIDIA GPU–powered Amazon EC2 Instances and PyTorch on AWS. Benefits improvement in ML model training throughput 30x recent user growth 456% Overview Businesses looking to enrich their brand prese…
Description
AI video company Synthesia moved ML model training for its text-to-video SaaS, Synthesia Studio, from on-premises computers to NVIDIA GPU-powered Amazon EC2 instances (P5/H100, P4/A100, G5/A10G) using PyTorch, Amazon EKS, AWS ParallelCluster and AWS Batch, accelerating model training by 30 times and supporting 456% user growth.
…Model Training by a Factor of 30 Using NVIDIA GPU–powered Amazon EC2 instances The company adopted Amazon EC2 P5 Instances powered by NVIDIA H100 Tensor Core GPUs and Amazon EC2 P4 Instances powered by NVIDIA A100 Tensor Core GPUs accelerated model training by 30 times. It also uses Amazon EC2 G5 Instances powered by NVIDIA A10G Tensor Core GPUs fo…
…n Amazon Web Services (AWS) to significantly speed up and scale its ML training to support a user base growth of 456 percent. About Synthesia Synthesia is an artificial intelligence (AI) technology company…
Company
Synthesia
…e its ML training to support a user base growth of 456 percent. About Synthesia Synthesia is an artificial intelligence (AI) technology company that develops a text-to-video software-as-a-service product for companies to generate instructional videos quickly using AI. Opportunity |…
Industry
Technology & Software
…deo content have traditionally faced steep production costs and a long process. Artificial intelligence (AI) technology startup Synthesia offers generative AI video creation as a service for customers to create realistic videos from text prompts in just minutes. Syn…
Problem
After growing rapidly to 350 employees and 50,000 customers, Synthesia found that training ML models on on-premises computers had become inefficient. Its production facilities generate many terabytes of data each week, and with more than 50 ML researchers training large models, the company needed a large, scalable data lake and compute cluster to run multiple generative AI models 24/7.
…Authenticity Initiative, which promotes the responsible use of synthetic media. After growing rapidly to 350 employees and 50,000 customers, Synthesia found that training ML models on on-premises computers had become inefficient. In 2023, it decided to optimize its ML pipeline on AWS. Synthesia’s production…
…ek, and it requires high compute capacity to train its text-to-video ML models. With more than 50 ML researchers training large models, the company needed a large, scalable data lake and compute cluster to run multiple generative AI models 24/7. Synthesia chose AWS because its fully managed services meet several critical re…
Solution
Synthesia switched to multi-node compute clusters for distributed ML model training on Amazon EC2 P5 Instances (NVIDIA H100 GPUs) and Amazon EC2 P4 Instances (NVIDIA A100 GPUs), and uses Amazon EC2 G5 Instances (NVIDIA A10G GPUs) for data processing and to optimize video rendering runtime. The company manages compute capacity using Amazon EKS, AWS ParallelCluster and AWS Batch, stores large datasets in Amazon S3, and builds its AI workflows on PyTorch and NVIDIA CUDA for video rendering and inference.
…ct the right services as well as financial planning to make it cost effective.” On AWS, Synthesia switched to multi-node compute clusters to do distributed ML model training on Amazon Elastic Compute Cloud (Amazon EC2) instances powered by a variety of…
…g hundreds of avatars that deliver natural, lifelike performances and content.” The company manages its compute capacity using Amazon EKS , AWS ParallelCluster , and AWS Batch . “We needed to train AI models and serve AI workloads at a large scale, and havi…
Business value
Using these managed services and NVIDIA GPU-powered compute instances, Synthesia reduced ML model training time for smaller voice models from days to hours, and supported a user base growth of 456 percent.
…al and efficient compute infrastructure depending on the use case” says Starck. Using these managed services and NVIDIA GPU–powered compute instances, Synthesia reduced ML model training time for smaller voice models from days to hours. It’s also storing its large datasets using Amazon Simple Storage Service (Amazo…
Technology
Amazon EC2 P5 Instances, Amazon EC2 P4 Instances, Amazon EC2 G5 Instances, Amazon EKS, AWS ParallelCluster, AWS Batch, Amazon S3, PyTorch, NVIDIA CUDA
…Model Training by a Factor of 30 Using NVIDIA GPU–powered Amazon EC2 instances The company adopted Amazon EC2 P5 Instances powered by NVIDIA H100 Tensor Core GPUs and Amazon EC2 P4 Instances powered by NVIDIA A100 Tensor Core GPUs accelerated model training by 30 times. It also uses Amazon EC2 G5 Instances po…
Deployment model
cloud
…at training ML models on on-premises computers had become inefficient. In 2023, it decided to optimize its ML pipeline on AWS. Synthesia’s production facilities generate many terabytes of data each week, a…
Deployment options
cloud
…at training ML models on on-premises computers had become inefficient. In 2023, it decided to optimize its ML pipeline on AWS. Synthesia’s production facilities generate many terabytes of data each week, a…
Headline outcome
…tion using NVIDIA GPU–powered Amazon EC2 Instances and PyTorch on AWS. Benefits improvement in ML model training throughput 30x recent user growth 456% Overview Businesses looking to enrich their brand prese…
Use case type
Content generation
…long process. Artificial intelligence (AI) technology startup Synthesia offers generative AI video creation as a service for customers to create realistic videos from text prompts in just minutes. Synthesia wanted to make its video-generation software as a se…
AI capabilities
Generative AI, Computer Vision
…long process. Artificial intelligence (AI) technology startup Synthesia offers generative AI video creation as a service for customers to create realistic videos from text prompts in just minutes. Synthesia wanted to make its video-generation software as a se…
