Tech & AI News
Hacker News

Show HN: We built open OpenRouter that turns usage into a better model

The project is an open-source Rust-native gateway that consolidates self-hosted, frontier, and open-source models, adding less than 1 ms latency for BYOK requests and under 2 ms when using Experiential’s provider key. It supports every major inference provider, refreshes 1,000+ models daily via a codex agent, and uses standardized OTel traces, simulated rollouts, an LLM judge, and a nearest-neighbor classifier to select the optimal model for each request, improving cost/quality trade-offs.