i cache aggressively and my latency and my bill both thank me

the static parts of my prompts barely change between calls. caching them turned a slow expensive call into a fast cheap one. check what you are resending every time.