Back to Unilm

Command-line Tools

kosmos-2/fairseq/docs/command_line_tools.rst

latest1.8 KB
Original Source

.. _Command-line Tools:

Command-line Tools

Fairseq provides several command-line tools for training and evaluating models:

  • :ref:fairseq-preprocess: Data pre-processing: build vocabularies and binarize training data
  • :ref:fairseq-train: Train a new model on one or multiple GPUs
  • :ref:fairseq-generate: Translate pre-processed data with a trained model
  • :ref:fairseq-interactive: Translate raw text with a trained model
  • :ref:fairseq-score: BLEU scoring of generated translations against reference translations
  • :ref:fairseq-eval-lm: Language model evaluation

.. _fairseq-preprocess:

fairseq-preprocess

.. automodule:: fairseq_cli.preprocess

    .. argparse::
        :module: fairseq.options
        :func: get_preprocessing_parser
        :prog: fairseq-preprocess


.. _fairseq-train:

fairseq-train
~~~~~~~~~~~~~
.. automodule:: fairseq_cli.train

    .. argparse::
        :module: fairseq.options
        :func: get_training_parser
        :prog: fairseq-train


.. _fairseq-generate:

fairseq-generate
~~~~~~~~~~~~~~~~
.. automodule:: fairseq_cli.generate

    .. argparse::
        :module: fairseq.options
        :func: get_generation_parser
        :prog: fairseq-generate


.. _fairseq-interactive:

fairseq-interactive

.. automodule:: fairseq_cli.interactive

.. argparse::
    :module: fairseq.options
    :func: get_interactive_generation_parser
    :prog: fairseq-interactive

.. _fairseq-score:

fairseq-score

.. automodule:: fairseq_cli.score

    .. argparse::
        :module: fairseq_cli.score
        :func: get_parser
        :prog: fairseq-score


.. _fairseq-eval-lm:

fairseq-eval-lm

.. automodule:: fairseq_cli.eval_lm

.. argparse::
    :module: fairseq.options
    :func: get_eval_lm_parser
    :prog: fairseq-eval-lm