Back to Tokenizers

Encoding

docs/source-doc-builder/api/encoding.mdx

0.23.1505 B
Original Source

Encoding

<tokenizerslangcontent> <python> ## Encoding

[[autodoc]] tokenizers.Encoding - all - attention_mask - ids - n_sequences - offsets - overflowing - sequence_ids - special_tokens_mask - tokens - type_ids - word_ids - words </python> <rust> The Rust API Reference is available directly on the Docs.rs website. </rust> <node> The node API has not been documented yet. </node> </tokenizerslangcontent>