Feels weird we have to say it but 💯 "Error level messages should be a reliable sign that something is actually wrong"
utcc.utoronto.ca/~cks/space/b...

Prompt caching: 10x cheaper LLM tokens, but how? | ngrok blog A far more detailed explanation of prompt caching than anyone asked for.

ngrok.com/blog/prompt-...

I had the pleasure of watching Fred's talk in the front row. He is such a good storyteller. Whenever you see a widely adopted OSS project, check out the folks behind it. There's a high chance they have strong weaving skills.