ContextQMD
Back to Text Generation Webui

02 Default And Notebook Tabs

docs/02 - Default and Notebook Tabs.md

4.7.32.2 KB
Original Source

Used to generate raw completions starting from your prompt.

Default tab

This tab contains two main text boxes: Input, where you enter your prompt, and Output, where the model output will appear.

Input

The number on the lower right of the Input box counts the number of tokens in the input. It gets updated whenever you update the input text as long as a model is loaded (otherwise there is no tokenizer to count the tokens).

Below the Input box, the following buttons can be found:

  • Continue: starts a new generation taking as input the text in the "Output" box.
  • Generate: starts a new generation.
  • Stop: stops an ongoing generation as soon as the next token is generated (which can take a while for a slow model).

In the Prompt menu, you can select from saved prompts stored in user_data/logs/notebook. The New button creates a new prompt, the Rename button renames the selected prompt, and the 🗑️ button deletes it. The 🔄 button refreshes the list.

Output

Five tabs can be found:

  • Raw: where the raw text generated by the model appears.
  • Markdown: it contains a "Render" button. You can click on it at any time to render the current output as markdown. This is particularly useful for models that generate LaTeX equations like GALACTICA.
  • HTML: displays the output in an HTML style that is meant to be easier to read. Its style is defined under textgen/css/html_readable_style.css.
  • Logits: when you click on "Get next token probabilities", this tab displays the 50 most likely next tokens and their probabilities based on your current input. If "Use samplers" is checked, the probabilities will be the ones after the sampling parameters in the "Parameters" > "Generation" tab are applied. Otherwise, they will be the raw probabilities generated by the model.
  • Tokens: allows you to tokenize your prompt and see the ID numbers for the individual tokens.

Notebook tab

Precisely the same thing as the Default tab, with the difference that the output appears in the same text box as the input.

It contains the following additional button:

  • Regenerate: uses your previous input for generation while discarding the last output.