homeneox

[View code on Github](https://github.com/labmlai/annotated_deep_learning_paper_implementations/tree/master/labml_nn/neox/ init.py)

#

GPT-NeoX

This is a simple implementation of Eleuther GPT-NeoX for inference and fine-tuning.

• Model definition
• Tokenizer
• Checkpoint downloading and loading helpers
• Utilities
• LLM.int8() quantization

[Samples](samples/ init.py)

• Generating text
• Fine-tuning the biases with pipeline-parallel
• Generating text with LLM.int8()

[Evaluation](evaluation/ init.py)

• Evaluating half precision model on a single GPU
• Evaluating LLM.int8() model

Official Eleuther GPT-NoeX is source code is available at eleutherai/gpt-neox.

labml.ai