VQNgrammerΒΆ

Implements a VQ based ngrammer layer which looks up latent ngram id.

Abstract Signature:

VQNgrammer(ngram_vocab_size: int, ngram_emb_dim: int)

PyTorch

API: β€”
Strategy: Custom / Partial

PaxML / Praxis

API: praxis.layers.VQNgrammer
Strategy: Direct Mapping