HN Debrief

Launch HN: Speko (YC S26) – OpenRouter for Voice AI

  • AI
  • Developer Tools
  • Open Source
  • Infrastructure

Speko says it solves a very real operational problem in voice AI: production systems are usually stitched together from speech-to-text, an LLM, and text-to-speech, and teams rarely revisit those choices because every model swap turns into another integration project. The product combines public benchmarks with a router that picks a stack based on constraints like accuracy, latency, cost, language, and region. It also ships an open source sidecar gateway for teams that want provider switching without putting another network hop in the audio path or handing over API keys.

If you run production voice systems, the obvious takeaway is to stop treating model choice as a one-time setup decision and build for periodic re-evaluation. The harder product question is whether customers want another routing layer, or mostly want trusted benchmarks and easy swap-outs inside infrastructure they already control.

Discussion mood

Mostly positive and curious. People liked the benchmark-heavy approach and saw a real problem in voice stack selection, but several pushed hard on whether routing is the durable value or just packaging around evals, especially if end-to-end speech models or local open-weight models keep improving.

Key insights

  1. 01

    Turn-taking is a measurable bottleneck

    What stood out was not that turn-taking matters, but that it can be benchmarked in a way that exposes how weak naive implementations are. Speko says it scores 200-plus real human clips by checking whether a model correctly treats speech as finished or merely paused. On that test, a tuned detector reached 94.0 percent while a basic voice activity detection silence timer hit 46.9 percent. That reframes turn-taking from UX polish into a core accuracy problem in voice agents.

    If your agent still relies on a simple silence timeout, test that decision directly before tuning anything else. You may get a bigger gain from better end-of-turn detection than from swapping your main model.

      Attribution:
    • webo #1
    • abdik #1
  2. 02

    Domain vocabulary breaks generic STT rankings

    The useful point here is that transcription quality depends heavily on the words your users actually say. Product names, acronyms, and industry jargon like medical terms can swing error rates far more than generic benchmarks suggest. Speko says its own runs show a spread of roughly 8 percent to 19 percent word error rate on medical vocabulary, and commenters added two practical fixes that often beat blind model shopping: prompt or custom vocabulary support in Whisper-style systems, and fine-tuning with synthetic data.

    Benchmark speech recognition on your own call transcripts, glossary, and acronyms before trusting any leaderboard. Ask vendors specifically about vocabulary prompting or adaptation support, because that may matter more than their default score.

      Attribution:
    • maho #1
    • omneity #1
    • jeffrwells #1
    • abdik #1
  3. 03

    Enterprise voice stacks still favor cascades

    The debate over end-to-end speech-to-speech versus separate STT, LLM, and TTS stacks landed in a practical place. People with enterprise deployment experience said buyers still prefer cascaded systems because they are easier to observe, debug, and tune, and because you can replace one weak layer without rebuilding the whole system. Speko agreed and claimed around 95 percent of real use cases it sees are still cascaded, even while speech-to-speech quality improves.

    Design your architecture around component swaps and instrumentation, not around the assumption that one omni model will replace the stack this year. End-to-end models are worth watching, but enterprise requirements still reward modular systems.

      Attribution:
    • narrationbox #1
    • abdik #1 #2
    • cootsnuck #1
    • jvwww #1
  4. 04

    Open speech-to-speech is not ready for long calls

    The most concrete datapoint on open-weight voice models was not about demos. It was about failure modes over time. Speko says NVIDIA NemotronLabs VoiceChat 11B ran more than 40 sessions without hard errors, yet by turn thirteen it often stopped speaking while still returning answers. That is a much more useful test than a short clip, because production voice agents have to survive sustained back-and-forth over many turns.

    When you evaluate voice-to-voice models, include long scripted conversations and look for degradation after the first few turns. A model that feels fine in a short demo can still be unusable in real support or sales calls.

      Attribution:
    • Tepix #1
    • jakswa #1
    • abdik #1
  5. 05

    This competes on portability, not agent hosting

    The distinction from products like Vapi and LiveKit Gateway is that Speko is not mainly selling a managed voice app platform. It is selling model selection and switchability while letting teams keep their own orchestration and infrastructure. The open source gateway running as a sidecar is part of that story. It lets teams route across providers without adding another audio hop or handing cloud credentials to Speko.

    If you already have voice orchestration in place, compare vendors on how easily you can preserve your stack and change providers later. Routing and benchmarks are more valuable to mature teams than a full managed platform if lock-in is already a concern.

      Attribution:
    • MikhailTal #1
    • abdik #1

Against the grain

  1. 01

    Automatic evals may outlast routing

    The sharpest pushback was that the durable value is not provider routing at all. It is trusted evaluation data, especially if the market keeps consolidating toward larger end-to-end models and prompt-based voice generation. In that world, buyers may still need a neutral system that compares style consistency, quality, and prompt behavior across providers, but they may not need another runtime layer in the middle of every call.

    Watch whether customers adopt Speko for active routing or mostly for model selection and procurement decisions. If you are building in this space, the independent eval layer may be the safer long-term wedge.

      Attribution:
    • narrationbox #1
    • vdev123 #1
  2. 02

    Local models could erase part of the market

    A minority view said hosted voice vendors are a temporary convenience and that on-device or open-weight models will absorb more of the stack over time. That claim was backed less by enterprise evidence than by adjacent consumer examples like local translation and open TTS benchmarks, but it still matters because those use cases often move first and reset price expectations for everyone else.

    Do not build your cost model around hosted APIs staying premium forever. Track local and open-weight performance in your target languages, especially for single-user workflows where privacy and marginal cost matter most.

      Attribution:
    • cjjuice #1
    • abdik #1
    • bewareofscams #1
    • robbomacrae #1
    • sparkling #1

In plain english

LLM
Large Language Model, a machine learning model trained to generate and analyze human-like text.
open-weight
A model released with downloadable parameters, so others can run it or build on it, though the full training code and data may still be closed.
speech-to-speech
An end-to-end voice model that takes spoken input and returns spoken output without splitting the job into separate transcription, language, and synthesis systems.
STT
Speech-to-text, the process of converting spoken audio into written text.
TTS
Text-to-Speech, software that converts written text into spoken audio.

Reference links

Speko product and benchmark resources

Speko technical write-ups and code

Competing or adjacent products

Open-weight and local model references