Back to Kubo

Kubo changelog v0.42

docs/changelogs/v0.42.md

0.42.023.6 KB
Original Source

Kubo changelog v0.42

<a href="https://ipshipyard.com/"></a>

This release was brought to you by the Shipyard team.

v0.42.0

Overview

๐Ÿ”ฆ Highlights

๐ŸŽฏ Announce CIDs on demand with ipfs provide once

ipfs provide once <cid>... announces CIDs to the routing system immediately, without waiting for the next scheduled reprovide. Use it when you want fine-grained control over when specific CIDs are announced.

CIDs can be streamed in on stdin, so you can pipe arbitrarily large lists without growing daemon memory:

sh
# Announce every locally pinned CID.
ipfs pin ls | awk '{print $1}' | ipfs provide once
sh
# Announce every block reachable from a root (here, ~350 GiB of Wikipedia).
ipfs refs -r bafybeiaysi4s6lnjev27ln5icwm6tueaw2vdykrtjkwiphwekaywqhcjze | ipfs provide once

In a terminal, the command shows a running count of queued CIDs. With --enc=json it emits one {"Queued":"<cid>"} line per CID, so downstream scripts can consume events as they arrive.

ipfs routing provide keeps working but is deprecated. See ipfs provide once --help for usage and migration notes.

๐Ÿงฉ Export and import partial CARs with --local-only

ipfs dag export --local-only writes a CAR with only the blocks you have locally; any missing blocks (and their subtrees) are skipped instead of failing the export. ipfs dag import --local-only reads such a partial CAR without trying to pin its roots.

This is useful when:

  • you want to share part of a DAG (for example an MFS tree) that is only partly cached locally
  • you fetched a partial CAR from a gateway that supports IPIP-0402 and want to add what you got to your local store

--local-only sets the matching companion flag automatically: on export it implies --offline; on import it implies --pin-roots=false. See ipfs dag export --help and ipfs dag import --help for details.

โš™๏ธ Provide.DHT.Interval=0 no longer disables providing

Provide.DHT.Interval=0 now disables only the periodic reprovide schedule. New CIDs still announce via fast-provide-root and ipfs provide once. To fully disable providing, set Provide.Enabled=false.

[!IMPORTANT] The daemon now refuses to start when Provide.DHT.Interval=0 is set without an explicit Provide.Enabled. Operators upgrading from an earlier kubo version must opt in to one of the two semantics:

  • Provide.Enabled=false to fully disable providing (the previous behaviour of Interval=0).
  • Provide.Enabled=true to keep ad-hoc providing while skipping the periodic reprovide schedule.

The startup error names both options. Pick the one that matches your intent.

๐Ÿ› Fixed pin operations hanging under pinned reprovide strategies

ipfs pin ls, ipfs add, and other pin-touching operations could block for hours on nodes running with Provide.Strategy set to pinned, roots, or pinned+mfs (including +unique / +entities variants). The pin index held a read lock for the entire reprovide cycle, which on large pinsets takes many hours. Any pin operation issued during that window blocked, and further pin ls / ipfs add calls piled up behind it until the cycle finished.

The pinner now snapshots the index under the read lock and releases it before the reprovider starts, so pin operations are no longer blocked by the reprovide cycle. The default Provide.Strategy=all was not affected.

๐Ÿ› Smoother first-run upgrades from very old repos

The one-time migration for repos from go-ipfs or Kubo older than v0.27 now retries across several gateways with HTTP timeouts, so a single slow or blocked gateway no longer hangs the daemon. Set Migration.DownloadSources to use your own gateway list.

๐Ÿ› Reliable shutdown and container health checks

Sending SIGTERM or SIGINT to kubo could leave the daemon stuck "half-shutdown": internal subsystems had stopped, but the process kept running and answering the RPC API. Docker and Kubernetes health checks reported the node as healthy while it had quietly stopped serving content. Recovery required a manual docker restart. Separately, the pinner could log a pebble: closed panic trace when the datastore closed before ongoing pin operations finished.

What changed:

  • Bounded shutdown. A new Internal.ShutdownTimeout caps how long a stuck shutdown can run, so a zombie daemon recovers instead of staying half-alive. Routine shutdowns finish in seconds; this is a belt-and-suspenders ceiling against unknown bugs and future regressions. The 12-hour default is high enough that no real-world deployment hits it and low enough to recycle a stuck node well before its DHT provider records expire (22 hours). On expiry, the daemon logs which subsystem failed and exits with status 1. Set 0 to disable.

  • ipfs diag healthy subcommand. Returns non-zero as soon as shutdown begins, even if the RPC API still answers. The kubo Docker image's HEALTHCHECK now uses it, so under --restart=on-failure or a Kubernetes liveness probe a half-shutdown daemon is recycled within seconds.

  • Pinner shuts down cleanly. The pinner cancels and waits for ongoing pin work before the datastore closes, removing the pebble: closed panic trace from shutdown logs.

  • DHT provider deadlines. ipfs provide stat now returns promptly when the caller cancels, instead of blocking on a slow keystore lookup (previously seen at over an hour). Each provider record sent to a peer is capped by Provide.DHT.SendProviderRecordTimeout, so an unresponsive peer cannot stall a reprovide cycle.

๐Ÿšจ ERROR log for explicit listeners blocked by Swarm.AddrFilters

If you list a specific address in Addresses.Swarm and a rule in Swarm.AddrFilters blocks it, no incoming connection reaches that listener. Kubo now logs one ERROR per such listener, naming the listener, the matching rule, and the field to remove the rule from.

The common trigger: a /ip4/127.0.0.1/tcp/.../ws listener fronted by nginx or Caddy on a server-profile node. The profile adds /ip4/127.0.0.0/ipcidr/8 to Swarm.AddrFilters, which rejects every proxy connection over loopback. See the reverse-proxy override row for the fix.

Wildcard listens (/ip4/0.0.0.0, /ip6/::) stay out of the ERROR log. Even if their interface expansion lands inside a filtered CIDR, the listener still accepts traffic on the interfaces outside that CIDR, so the filter is working as intended. These matches log at DEBUG instead, so you can still trace which interfaces an AddrFilters rule strips when you need to.

Addresses.NoAnnounce matches also log at DEBUG. Hiding addresses there is the point of the field, but the log line helps when you ask "why isn't this interface in my identify or DHT records?" and the answer is a CIDR rule you forgot you set.

๐Ÿ“Š OpenTelemetry: scope info now exposed as labels

The Prometheus endpoint no longer emits the otel_scope_info metric. Each metric now carries otel_scope_name, otel_scope_version, and otel_scope_schema_url labels identifying the instrumentation library that produced it. Update dashboards or queries that read otel_scope_info to consume these labels instead. See docs/metrics.md for details.

๐Ÿ”ง Cleaner progress bars

ipfs add, ipfs cat, and ipfs get now hide their progress bar when stderr is piped or redirected, so a command like ipfs add file 2> log.txt no longer fills the log with progress-bar noise. Pass --progress=true to force the bar on, or --progress=false to hide it.

ipfs dag export and ipfs dag stat now correctly recognize MSYS2 and Git Bash terminals on Windows. Previously the bar was suppressed there even when running interactively.

๐Ÿ“ฆ๏ธ Dependency updates

๐Ÿ“ Changelog

<details><summary>Full Changelog</summary>
  • github.com/ipfs/kubo:
  • github.com/ipfs/boxo (v0.39.0 -> v0.40.0):
  • github.com/ipfs/go-ds-dynamodb (v0.2.2 -> v0.3.0):
  • github.com/ipfs/go-ds-pebble (v0.5.10 -> v0.5.11):
  • github.com/ipfs/go-ipfs-cmds (v0.16.0 -> v0.16.1):
  • github.com/ipfs/go-log/v2 (v2.9.1 -> v2.9.2):
    • v2.9.2 bump (#184) (ipfs/go-log#184)
    • chore: flag WithGroup as a known no-op
    • fix: resolve slog LogValuer in zap bridge
    • fix: inline top-level empty-key slog.Group
    • fix: support slog.Group in the zap bridge
  • github.com/ipfs/go-unixfsnode (v1.10.3 -> v1.10.4):
  • github.com/ipld/go-car/v2 (v2.16.0 -> v2.16.1-0.20260428045700-c4b9f366f20c):
    • feat(cmd): Make "extract" arguments more closely mirror common archive tools (#653) (ipld/go-car#653)
    • fix: use %w when wrapping errors to preserve error chain (#658) (ipld/go-car#658)
    • chore(release): modernise goreleaser config
    • fix: remove broken trailing data check in "inspect --full" for CARv1 (#654) (ipld/go-car#654)
    • Allow the car binary to provide a version. (#645) (ipld/go-car#645)
    • Add car put-block command (#629) (ipld/go-car#629)
  • github.com/ipshipyard/p2p-forge (v0.8.0 -> v0.9.0):
  • github.com/libp2p/go-libp2p-kad-dht (v0.39.1 -> v0.40.0):
  • github.com/libp2p/go-libp2p-pubsub (v0.15.0 -> v0.16.0):
    • Release v0.16.0 (#693) (libp2p/go-libp2p-pubsub#693)
    • fix: properly log topic string (#694) (libp2p/go-libp2p-pubsub#694)
    • rename {Add/Remove}Peer to On{New/Closed}OutboundStream
    • Fix leaked state with OnNewIncomingStream/onClosedIncomingStream
    • test: Add failing test demonstrating leak
    • partialmessages: init fanout if empty (#690) (libp2p/go-libp2p-pubsub#690)
    • log on error when handling rpc in extensions (#668) (libp2p/go-libp2p-pubsub#668)
    • feat: add WithMessageFilter option to filter messages early in the notification pipeline (#678) (libp2p/go-libp2p-pubsub#678)
    • partialmsgs: remove unused struct
    • partialmsgs: PeerRequestsPartial means PeerRequestsPartial
    • partialmsgs: Change Gossip Callback to have application call PublishPartial
    • feat: FanoutOnly topic option (#676) (libp2p/go-libp2p-pubsub#676)
    • Partial Messages API refactor (#671) (libp2p/go-libp2p-pubsub#671)
    • Revert "Refactor parts metadata to an interface (#669)"
    • Add threadsafe dynamic direct peer handling to GossipSub (#673) (libp2p/go-libp2p-pubsub#673)
    • Refactor parts metadata to an interface (#669) (libp2p/go-libp2p-pubsub#669)
    • Add Rpc.From()
    • partialmsgs: Implement Partial Message gossip
    • partialmsgs: Add explicit EagerPartialMessageBytes method
    • partialmsgs: remove outdated comment
    • partialmessages: Send fewer partsMetadata messages
    • partialmessages: Change EagerPush to EagerPushWithParts
    • partialmessages: PublishPartial to peers in group state as well
    • fix stale comment in partialmessages
    • fix logic of omitting IDONTWANT to peers that support partial messages
    • fix bug of not sending full messages to peers that requested partial
    • rename PartialMessagesExtension for consistency
    • partialmessages: rename field to reflect use
    • partialmessages: add per peer bounds on peer initiated groups
    • partialmessages: Add pairwise interaction test
    • add test for SupportsPartial subscribe option
    • Add support for supportsPartial
    • pb: add supportsPartial field in SubOpts
    • support fanout topics for partial messages
    • limit the number of peer initiated group states we track
    • nit: rename method from old form
    • Add ability to update peer scores if using partial messages
    • refactor score methods to accept topic string
    • set write deadline for outgoing messages
    • ensure that the Hello Packet is the first rpc sent
    • add todo
    • don't send IDONTWANT to partial message peers
    • Add documentation for the RequestPartialMessages topic option
    • partialmessages: add explicit MergePartsMetadata function
    • partialmessages: add basic bitmap package
    • add partial messages to gossipsub router
    • implement Partial Messages
    • add structured rpc logging
    • update protobufs for partial messages
</details>

๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿ‘งโ€๐Ÿ‘ฆ Contributors

ContributorCommitsLines ยฑFiles Changed
@lidel42+7059/-920188
@MarcoPolo43+5818/-2113122
@guillaumemichel8+1422/-16517
@ChayanDass2+421/-1810
@parkan1+339/-03
@gammazero12+142/-13528
@Vinayak97691+145/-7810
@laciferin20241+209/-03
@rvagg4+160/-186
@Wondertan1+154/-44
@cortze1+125/-195
@sukunrt3+58/-275
@davidebeatrici1+55/-304
@hsanjuan1+33/-155
@willscott1+10/-22