Assistant
I can help with reading practice using the files in this workspace. What would you like to work on?
I can help with reading practice using the files in this workspace. What would you like to work on?
Only the exact source text in these blocks, using o200k_base. Teaching notes are excluded. The 16k limit is a teaching example; counts exclude provider formatting and output allowance.
A token is a small piece of text represented by a number. It can be a word, part of a word, punctuation, or whitespace. Colors show the boundaries; they do not indicate meaning.
This view uses the o200k_base encoding. Different encodings can split the same text differently. OpenAI tokenizer ↗
Some characters span multiple tokens. Those tokens share a color in Text view to preserve the character; Token IDs shows every ID.