Back to Developer Roadmap

Repetition Penalties

src/data/roadmaps/prompt-engineering/content/[email protected]

4.0382 B
Original Source

Repetition Penalties

Repetition penalties discourage LLMs from repeating words or phrases by reducing the probability of selecting previously used tokens. This includes frequency penalty (scales with usage count) and presence penalty (applies equally to any used token). These parameters improve output quality by promoting vocabulary diversity and preventing redundant phrasing.