Structured Outputs | OpenRouter Enforce structured outputs for models

Hitting any supported model for a structured output is as simple as requesting a "response_format"

Get started with the example in our docs! openrouter.ai/docs/structu...

Models | OpenRouter Browse models on OpenRouter

Multi-model routing is a lot easier if you can constrain parts of the output.

Supported models include OpenAI, Gemini (including 2.0), Cohere, Llama 3, QwQ, Mixtral, and more.

Browse here, and filter by price or context length: openrouter.ai/models?fmt=c...

Structured outputs are very underrated. It's often much easier to constrain LLM outputs to a JSON schema than asking for a tool call.

OpenRouter now normalizes structured outputs for
- 46 models
- 8 different model companies
- 8 free models!

Demo:

Llama 3.3 (shown in brown) is now 35% of Llama token traffic 👀
openrouter.ai/meta-llama

Models - PydanticAI Agent Framework / shim to use Pydantic with LLMs

ai.pydantic.dev/models/#api_...

PydanticAI now supports OpenRouter!

You can now filter for LLM providers on our /models page

OpenRouter has prevented 13k Sonnet requests from failing in the last 2 days

LLMs are getting insanely cheap – just analyzed 500+ websites for under $0.01 via @openrouter.bsky.social using llama3.1 🤯

OpenRouter support for Discourse AI We are happy to announce native OpenRouter support for DiscourseAI. For those unfamiliar, OpenRouter provides a unified interface that allows integration of hundreds of language models from dozens...

First post here, and we're excited to announce that Discourse AI now supports @openrouter.bsky.social!

With hundreds of models, including free options, AI is now more accessible. Select your provider and fine-tune results in the Discourse UI.

Learn more 👇
meta.discourse.org/t/openrouter...

Models | OpenRouter Browse models on OpenRouter

🍊Mistral 7B Instruct v0.3: 50% cheaper, now $0.03 (was $0.055)
🍊Mistral Nemo: 70% cheaper, now $0.04 (was $0.13)
🍏Gemma 2 9B: 50% cheaper, now $0.03 (was $0.06)
👼Hermes 3B: $0.03 (was $0.14)
👼Hermes 70B: $0.20 (was $0.40)
👼Hermes 405B: $0.90 (was $1.80)

See the whole catalogue: openrouter.ai/models

🔷Qwen2.5 Coder 32B Instruct: 10% cheaper, now $0.08 (was $0.09)
🔷Qwen2.5 72B Instruct: 40% cheaper, now $0.23 (was $0.35)
🔷Qwen 32B Coder: $0.09 (was $0.18)

ICYMI, lots of price cuts last week. helping you get best-in-market:

🦙Llama 3.2 3B Instruct: 40% cheaper, now $0.018 (was $0.03)
🦙Llama 3.1 Nemotron: $0.20 (was $0.35)
🦙Llama 3.1 8B: $0.30 (was $0.60)
🦙Llama 3.1 70B: $0.20 (was $0.40)
🦙Llama 3.1 405B: $0.90 (was $2.80)

Amazon - Models Browse models from Amazon

See them all on the new Author page: openrouter.ai/amazon

Amazon Nova is now live on OpenRouter ☄️
...along with Bedrock! more coming soon

Only took 40 minutes

Llama 3.3 is live! 🦙🦙🦙
openrouter.ai/meta-llama/l...

OpenRouter now generates about 'one Wikipedia' worth of words every day

Incredible work! love seeing the live progress

Overall $ volume on OpenRouter is up by over 2300% 📈
even though LLM prices declined by 90% 📉
due to a lotta tokens:

“My AI startups is just a GPT Wrapper”

The Reality for AI Startups

QwQ 32B, an open-source model comparable with o1-preview and Claude 3.5 Sonnet, is now live!

Scores 50 on the AIME, compared to
- 44.6 for o1-preview
- 16 for Sonnet

Try it out here: openrouter.ai/qwen/qwq-32b...