{"slug":"domyn-builds-colosseum-355b-a-sovereign-ai-foundation-model-using-nvidia-dgx-cloud","url":"https://findausecase.com/use-cases/domyn-builds-colosseum-355b-a-sovereign-ai-foundation-model-using-nvidia-dgx-cloud","title":"Domyn builds Colosseum 355B, a sovereign AI foundation model, using NVIDIA DGX Cloud","description":"Domyn (formerly iGenius), an Italian AI company serving highly regulated sectors such as financial services and public administration, used NVIDIA DGX Cloud with over 3,000 NVIDIA H100 GPUs to continue-pretrain Colosseum 355B, a 355-billion-parameter foundation LLM. Within one week Domyn had access to the dedicated infrastructure, and within two months completed continued pretraining, achieving 82.04% accuracy on the MMLU benchmark. The model powers Domyn's business intelligence agent, Crystal, a sovereign AI solution deployed on private infrastructure.","company":"Domyn","industry":"Technology & Software","country":"Italy","aiCapabilities":["Large Language Models","AI Model Development & MLOps","Agentic AI"],"technology":["NVIDIA DGX Cloud","NVIDIA H100 GPUs","NVIDIA NeMo Framework","NVIDIA NeMo Aligner","Colosseum 355B"],"deployment":"Public Cloud","problemStatement":"Domyn aimed to develop a state-of-the-art foundational LLM within a tight timeline but faced challenges accessing large-scale GPU clusters (thousands of GPUs) and securing support for highly scalable training frameworks.","solutionApproach":"Domyn collaborated with NVIDIA to build Colosseum 355B using NVIDIA DGX Cloud infrastructure with over 3,000 H100 GPUs on a dedicated, high-bandwidth RDMA-based network with 500 TB of Lustre-based high-performance storage and the NVIDIA NeMo Framework. Domyn used continued pretraining (CPT) in FP8 precision via NeMo Framework's Transformer Engine, followed by supervised fine-tuning and Direct Preference Optimization (DPO) using NVIDIA NeMo Aligner. The model powers Domyn's business intelligence agent, Crystal, a sovereign AI solution built as an end-to-end stack including database integration, AI-assisted configuration, LLM-powered orchestration for tool usage, query execution and generation, and private deployment infrastructure.","businessValue":"In less than one week, Domyn had access to dedicated large-scale infrastructure with over 3K GPUs, and within two months had completed continued pretraining for Colosseum 355B, achieving 82.04% accuracy on the MMLU benchmark in a 5-shot setting. By optimizing training configuration, Domyn improved Model FLOP/s Utilization (MFU) from an initial 25% to 40% in BF16, and accelerated the overall training step 1.15x by moving to FP8.","evidence":{"band":"high"},"sourceUrl":"https://developer.nvidia.com/blog/continued-pretraining-of-state-of-the-art-llms-for-sovereign-ai-and-regulated-industries-with-domyn-and-nvidia-dgx-cloud","dates":{"publishedAt":"2026-08-15T22:11:11.715Z","publishedAtSource":"ledger","updatedAt":"2026-08-26T06:58:31.559Z"},"license":"Open for reading and citing with a link to https://findausecase.com/use-cases/domyn-builds-colosseum-355b-a-sovereign-ai-foundation-model-using-nvidia-dgx-cloud. Bulk republication requires permission."}