Back to Tensorflow

tflite_support.metadata_writers.metadata_info.BertTokenizerMd

tensorflow/lite/g3doc/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd.md

2.21.05.3 KB
Original Source

page_type: reference description: A container for the Bert tokenizer 1 metadata information.

<link rel="stylesheet" href="/site-assets/css/style.css"> <!-- DO NOT EDIT! Automatically generated file. --> <div itemscope itemtype="http://developers.google.com/ReferenceObject"> <meta itemprop="name" content="tflite_support.metadata_writers.metadata_info.BertTokenizerMd" /> <meta itemprop="path" content="Stable" /> <meta itemprop="property" content="__init__"/> <meta itemprop="property" content="create_metadata"/> </div>

tflite_support.metadata_writers.metadata_info.BertTokenizerMd

<!-- Insert buttons and diff --> <table class="tfo-notebook-buttons tfo-api nocontent" align="left"> <td> <a target="_blank" href="https://github.com/tensorflow/tflite-support/blob/v0.4.4/tensorflow_lite_support/metadata/python/metadata_writers/metadata_info.py#L172-L201">
View source on GitHub
</a> </td> </table>

A container for the Bert tokenizer 1 metadata information.

<section class="expandable"> <h4 class="showalways">View aliases</h4> <p> <b>Main aliases</b> <p><a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.audio_classifier.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.audio_classifier.metadata_writer.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.bert_nl_classifier.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.bert_nl_classifier.metadata_writer.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.image_classifier.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.image_classifier.metadata_writer.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.image_segmenter.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.image_segmenter.metadata_writer.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.nl_classifier.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.nl_classifier.metadata_writer.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.object_detector.metadata_info.BertTokenizerMd</code></a>, <a href="https://www.tensorflow.org/lite/api_docs/python/tflite_support/metadata_writers/metadata_info/BertTokenizerMd"><code>tflite_support.metadata_writers.object_detector.metadata_writer.metadata_info.BertTokenizerMd</code></a></p> </p> </section> <pre class="devsite-click-to-copy prettyprint lang-py tfo-signature-link"> <code>tflite_support.metadata_writers.metadata_info.BertTokenizerMd( vocab_file_path: str ) </code></pre> <!-- Placeholder for "Used in" --> <!-- Tabular view --> <table class="responsive fixed orange"> <colgroup><col width="214px"><col></colgroup> <tr><th colspan="2"><h2 class="add-link">Args</h2></th></tr> <tr> <td> `vocab_file_path`<a id="vocab_file_path"></a> </td> <td> path to the vocabulary file. </td> </tr> </table>

Methods

<h3 id="create_metadata"><code>create_metadata</code></h3>

<a target="_blank" class="external" href="https://github.com/tensorflow/tflite-support/blob/v0.4.4/tensorflow_lite_support/metadata/python/metadata_writers/metadata_info.py#L187-L201">View source</a>

<pre class="devsite-click-to-copy prettyprint lang-py tfo-signature-link"> <code>create_metadata() -> <a href="../../../tflite_support/metadata_schema_py_generated/ProcessUnitT"><code>tflite_support.metadata_schema_py_generated.ProcessUnitT</code></a> </code></pre>

Creates the Bert tokenizer metadata based on the information.

<!-- Tabular view --> <table class="responsive fixed orange"> <colgroup><col width="214px"><col></colgroup> <tr><th colspan="2">Returns</th></tr> <tr class="alt"> <td colspan="2"> A Flatbuffers Python object of the Bert tokenizer metadata. </td> </tr> </table>