gm.testing.use_hermetic_tokenizer

gm.testing.use_hermetic_tokenizer#

gemma.gm.testing.use_hermetic_tokenizer()[source]

Use the local tokenizer, to avoid TFHub calls.