Repetition Penalties

Repetition penalties discourage LLMs from repeating words or phrases by reducing the probability of selecting previously used tokens. This includes frequency penalty (scales with usage count) and presence penalty (applies equally to any used token). These parameters improve output quality by promoting vocabulary diversity and preventing redundant phrasing.

Visit the following resources to learn more:

• @article@Stop the LLM From Rambling: Using Penalties to Control Repetition
• @video@What are LLM Presence and Frequency Penalties?