Foundations & tokens / 001
EasySingle choice
A token is not a word
The same sentence produces different token counts under two subword tokenizers. Which explanation is most accurate?
0 submissionsOriginal practice · not company interview leaks
The same sentence produces different token counts under two subword tokenizers. Which explanation is most accurate?