HN Debrief

How We Made IPFS Content Publishing 10x Faster

  • Infrastructure
  • Open Source
  • Networking
  • Developer Tools

The post describes an IPFS change to content publishing, also called "providing" in the DHT, that stops waiting for all 20 target peers to acknowledge a publish before returning control to the user. Instead it returns after most writes succeed, then completes the rest in the background and later runs a sweep to restore the desired replication level. The headline claim is a 10x improvement in publish time, but the mechanism is not a cheaper network path or a more efficient protocol. It is an earlier success threshold plus cleanup after the fact.

If you dismissed IPFS a few years ago for unusable latency, that assumption may be outdated for lookup and possibly for publish UX. But if you need predictable deletion, tight privacy defaults, or simple browser-native deployment, the operational objections raised here still look more important than this one speedup.

Discussion mood

Cautiously skeptical. People liked the engineering tradeoff and accepted that early return is a sensible fix for tail latency, but many still see IPFS as a system with a damaged reputation, unclear mainstream fit, awkward deployment, and unresolved privacy and operational concerns.

Key insights

  1. 01

    Why returning after 15 writes works

    The 20-peer publish target is treated more like a safety margin than a hard correctness rule. Because consumers also search across a redundant slice of the DHT, getting a CID onto about 10 to 15 nearby peers is usually enough for discovery to succeed quickly, while the background reprovide sweep preserves long-term redundancy without forcing users to wait on the slowest nodes.

    If you run probabilistic distributed systems, separate the user-visible success threshold from the network’s ideal steady state. Keep the repair path, but stop blocking foreground work on the tail.

      Attribution:
    • Groxx #1
    • WorldMaker #1
    • pocksuppet #1
  2. 02

    Lookup speed may no longer be the bottleneck

    Several people pushed back on the old mental model that IPFS takes minutes to find content. They pointed to current ProbeLab measurements showing CID lookup under 200 milliseconds in Europe and said the worst delays came from stale provider records and NATed peers that polluted the DHT, not from an inherently slow lookup design.

    Re-test IPFS on current software before using its old latency reputation in planning. If your evaluation is more than a couple of years old, your objections may now be about client ergonomics or trust, not raw lookup speed.

      Attribution:
    • throwaway8388 #1
    • yiannisbot #1
    • davidwritesbugs #1
  3. 03

    Real use exists, but it is niche

    The strongest evidence for production use came from edge cases, not a breakout mainstream workload. People cited serving JavaScript and static sites through gateways, internal binary distribution on a private Meta deployment, order metadata on swap.cow.fi, container image experiments through containerd stargz snapshotter, and browser access via service-worker-gateway. That reads less like platform adoption and more like a toolkit that works when its content-addressed model matches the problem exactly.

    Treat IPFS as a specialized primitive, not a general replacement for web delivery. It is worth considering when you benefit directly from content addressing, multi-gateway distribution, or peer-backed replication.

      Attribution:
    • ValdikSS #1 #2
    • ydj #1
    • errpunktjose #1
    • preisschild #1
    • dannyobrien #1
  4. 04

    What IPFS adds beyond BitTorrent

    The clearest defense of IPFS over BitTorrent was not speed. It was object-level content addressing and mutable naming. Files can be deduplicated and shared across different directories or datasets by content hash, and a mutable pointer like IPNS can update a dataset without forcing every existing file into a new swarm identity. Commenters noted BitTorrent v2 closes some of this gap, but adoption remains limited.

    When comparing IPFS with BitTorrent, focus on naming and update behavior more than transfer mechanics. If your dataset changes incrementally and you want stable references, IPFS may fit better than classic torrents.

      Attribution:
    • ValdikSS #1
    • OneDeuxTriSeiGo #1

Against the grain

  1. 01

    This is mostly a UX speedup

    The sharpest objection was that the system is not actually making content discoverable much sooner. It is declaring success earlier while the network continues doing nearly the same work in the background. If your mental model of "published" means fully propagated, the 10x number overstates what changed.

    When you report performance wins from asynchronous completion, define the new success boundary precisely. Users and downstream systems need to know whether you sped up the network or just shortened the wait.

      Attribution:
    • embedding-shape #1
  2. 02

    Privacy and security defaults still scare people

    One commenter said IPFS’s default DHT participation used to expose internal and external IP allocations and called its security posture unacceptable. That complaint landed because it speaks to a deeper adoption blocker than speed. Infrastructure teams can forgive latency if the trust model is clean. They usually will not forgive leaky defaults.

    Before adopting peer-to-peer infrastructure, audit what node participation reveals about your network and hosts. Fixing latency will not rescue a deployment if the default exposure model violates your security baseline.

      Attribution:
    • nekusar #1
  3. 03

    Deletion remains a weak fit

    The answer to removing content was basically the same as with torrents. Stop hosting it and hope nobody else cares enough to keep it alive. That is philosophically consistent with content-addressed systems, but it makes IPFS a bad fit for products that need enforceable takedowns, expiry, or strong control over where data persists.

    Do not put revocable or compliance-sensitive data on a content-addressed public network unless you are comfortable losing practical control over retention. Design for that property up front instead of treating it as an implementation detail.

      Attribution:
    • deno #1
    • somat #1

In plain english

BitTorrent v2
A newer version of the BitTorrent protocol that improves hashing and file-level deduplication compared with the original format.
CDN
Content Delivery Network, a distributed system of servers that speeds up delivery of websites and content.
CID
Content identifier, the hash-based address IPFS uses to refer to a specific piece of content.
containerd
An open source container runtime used to manage container images and execution.
DeFi
Decentralized finance, software for financial services built on blockchain networks.
DHT
Distributed hash table, a decentralized index that lets peers find which nodes claim to have a given piece of content.
Filecoin
A blockchain-based storage network and token project that is related to the broader IPFS ecosystem but distinct from IPFS itself.
IPFS
InterPlanetary File System, a peer-to-peer system for storing and retrieving content by its cryptographic hash instead of by server location.
IPNS
InterPlanetary Naming System, a mutable naming layer for IPFS that lets a stable name point to updated content.
NATed
Behind Network Address Translation, meaning a device is not directly reachable from the public internet.
Reprovide Sweep
A background IPFS process that republishes provider records so content remains discoverable across the network.
service worker
A browser feature that runs scripts in the background and can intercept network requests, enabling offline behavior and custom caching or routing.
stargz snapshotter
A containerd plugin that lazily fetches container image data, allowing faster startup by downloading only needed parts first.

Reference links

IPFS benchmarks and browser access

Production and ecosystem examples

  • Neocities IPFS issue
    Referenced as an example of an IPFS website publishing feature that was later removed.
  • swap.cow.fi
    Cited as a live service using IPFS for order metadata.

BitTorrent and related alternatives

Content moderation and Web3 references