GPT-style tokenisers are trained with Byte-Pair Encoding: repeatedly find the most frequent adjacent pair of symbols and merge it into a new symbol.
Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.
Start 7-day free trial