4 calculators in this category
- Transformer Parameter Count CalculatorGive this calculator the six numbers from a model config — hidden size, layer count, feed-forward width, attention heads…
- LLM Training Compute (FLOPs) CalculatorC = 6ND scaling estimate (Kaplan et al. 2020; Hoffmann et al. 2022)This calculator turns a parameter count and a token budget into the three numbers that decide whether a pre-training run is…
- Fine-Tuning vs Long-Prompt Break-Even CalculatorFixed-versus-variable cost break-even analysisFine-tuning trades a one-off training bill, and usually a higher per-token serving rate, against never sending your few-shot…
- Model Training Time Estimate CalculatorData-parallel scaling modelThis calculator converts a dataset size, a per-device batch size and an epoch count into the number the scheduler cares about…
Which one do you need?
- Transformer Parameter Count Calculator
- Count the parameters of a decoder-only transformer from hidden size, layers, feed-forward width, KV heads and vocabulary, with an attention/MLP breakdown.
- LLM Training Compute (FLOPs) Calculator
- Estimate training compute with C = 6ND: total FLOPs, petaflop-days, GPU-hours and wall-clock time for your parameter and token budget, plus Chinchilla check.
- Fine-Tuning vs Long-Prompt Break-Even Calculator
- Compare a one-off fine-tuning cost and a higher serving rate against carrying a long few-shot prompt on every request, and find where each wins.
- Model Training Time Estimate Calculator
- Estimate how long a training job runs: total steps from dataset, batch and epochs, wall-clock hours at your step rate, multi-GPU scaling loss and total cost.
More ai, llm & machine learning engineering categories
Related categories in other subjects
Where this work overlaps other trades and disciplines.