StringLookup

A preprocessing layer that maps strings to (possibly encoded) indices.

Abstract Signature:

StringLookup(max_tokens: int, num_oov_indices: int = 1, mask_token: str, oov_token: str = [UNK], vocabulary: List[str], invert: bool = False, output_mode: str = int, pad_to_max_tokens: bool = False, sparse: bool = False, encoding: str = utf-8)

PyTorchJAX (Core)KerasTensorFlowFlax NNX

PyTorch

API: —

Strategy: Plugin (string_lookup_shim)

JAX (Core)

API: —

Strategy: Plugin (string_lookup_shim)

Keras

API: keras.layers.StringLookup

Strategy: Direct Mapping

Official Docs ↗

TensorFlow

API: tf.keras.layers.StringLookup

Strategy: Direct Mapping

Official Docs ↗

Flax NNX

API: —

Strategy: Plugin (string_lookup_shim)