Databricks Training

Evidence mix: High 2 · Medium 0 · Low 0 — bands are computed from each record's evidence signals.

Use cases (2)Related technologies (3)Products & vendor

Technology & SoftwareCode GenerationLarge Language ModelsGenerative AI

Empowering the next billion software creators

Replit used Databricks Training infrastructure to build its own multi-billion parameter code-completion LLM from scratch, scaling up to 256 GPUs and launching the model in under a week to meet an accelerated product deadline. The model powers Replit's AI suite, which completes, explains and transforms code for its 25 million platform users, and Databricks Training reduced Replit's total cost of ownership for deploying the code-generation LLM.

REReplitDatabricks Training · Agent Bricks

Technology & SoftwareLarge Language ModelsMachine Learning

Model Experimentation Made Easier

Refuel.AI built Refuel LLM, a purpose-built model for data labeling and enrichment, by instruction-tuning a Llama-v2-13b base model on more than 5 billion tokens using Databricks Training infrastructure. The initial training run produced a 78% increase in label quality, and subsequent fine-tuning on a cluster of 8x H100s added a further 16% performance gain, outperforming trained human annotators and several other LLMs on a 15-dataset text labeling benchmark.

RERefuel.AIRefuel LLM · Llama-v2-13b · Databricks Training +1