Schedule Requests Under RPM and TPM Limits

medium
Unit 21 · APIs & Retrieval0/2 to milestone

LLM APIs enforce two limits at once: requests per minute (RPM) and tokens per minute (TPM). A batch job must schedule its requests so that neither is exceeded in any rolling 60-second window.

Pro problem

Unlock this and every premium problem across all tracks — plus hidden-test grading, advanced AI engineering modules and new content every week.

Start 7-day free trial
solution.py · Python 3.13
Run your code to see results. ⌘↵ to run · ⌘⇧↵ to submit
Schedule Requests Under RPM and TPM Limits · TechGradify