Back to Kubo

Kubo changelog v0.21

docs/changelogs/v0.21.md

0.41.019.9 KB
Original Source

Kubo changelog v0.21

v0.21.1

v0.21.0

Overview

๐Ÿ”ฆ Highlights

Saving previously seen nodes for later bootstrapping

Kubo now stores a subset of connected peers as backup bootstrap nodes (kubo#8856). These nodes are used in addition to the explicitly defined bootstrappers in the Bootstrap configuration.

This enhancement improves the resiliency of the system, as it eliminates the necessity of relying solely on the default bootstrappers operated by Protocol Labs for joining the public IPFS swarm. Previously, this level of robustness was only available in LAN contexts with mDNS peer discovery enabled.

With this update, the same level of robustness is applied to peers that lack mDNS peers and solely rely on the public DHT.

Gateway: DeserializedResponses config flag

This release introduces the Gateway.DeserializedResponses configuration flag.

With this flag, one can explicitly configure whether the gateway responds to deserialized requests or not. By default, this flag is enabled.

Disabling deserialized responses allows the gateway to operate as a Trustless Gateway limited to three verifiable response types: application/vnd.ipld.raw, application/vnd.ipld.car, and application/vnd.ipfs.ipns-record.

With deserialized responses disabled, the Kubo gateway can serve as a block backend for other software (like bifrost-gateway, IPFS in Chromium etc) without the usual risks associated with hosting deserialized data behind third-party CIDs.

client/rpc migration of go-ipfs-http-client

The go-ipfs-http-client RPC has been migrated into kubo/client/rpc.

With this change the two will be kept in sync, in some previous releases we updated the CoreAPI with new Kubo features but forgot to port those to the http-client, making it impossible to use them together with the same coreapi version.

For smooth transition v0.7.0 of go-ipfs-http-client provides updated stubs for Kubo v0.21.

Gateway: DAG-CBOR/-JSON previews and improved error pages

In this release, we improved the HTML templates of our HTTP gateway:

  1. You can now preview the contents of a DAG-CBOR and DAG-JSON document from your browser, as well as follow any IPLD Links (CBOR Tag 42) contained within them.
  2. The HTML directory listings now contain updated, higher-definition icons.
  3. On gateway error, instead of a plain text error message, web browsers will now get a friendly HTML response with more details regarding the problem.

HTML responses are returned when request's Accept header includes text/html.

DAG-CBOR PreviewError Page

Gateway: subdomain redirects are now text/html

HTTP 301 redirects from path to subdomain no longer include the target data in the body. The data is returned only once, with the final HTTP 200 returned from the target subdomain.

The HTTP 301 body now includes human-readable text/html message for clients that do not follow redirects by default:

console
$ curl "https://subdomain-gw.example.net/ipfs/${cid}/"
<a href="https://${cid}.ipfs.subdomain-gw.example.net/">Moved Permanently</a>.

Rationale can be found in kubo#9913.

Gateway: support for partial CAR export parameters (IPIP-402)

The gateway now supports optional CAR export parameters dag-scope=block|entity|all and entity-bytes=from:to as specified in IPIP-402.

Batch block retrieval minimizes round trips, catering to the requirements of light HTTP clients for directory enumeration, range requests, and content path resolution.

ipfs dag stat deduping statistics

ipfs dat stat now accept multiple CIDs and will dump advanced statistics on the number of shared blocks and size of each CID.

console
$ ipfs dag stat --progress=false QmfXuRxzyVy5H2LssLgtXrKCrNvDY8UBvMp2aoW8LS8AYA QmfZDyu2UFfUhL4VdHaw7Hofivmn5D4DdQj38Lwo86RsnB

CID                                           	Blocks         	Size
QmfXuRxzyVy5H2LssLgtXrKCrNvDY8UBvMp2aoW8LS8AYA	3              	2151
QmfZDyu2UFfUhL4VdHaw7Hofivmn5D4DdQj38Lwo86RsnB	4              	3223

Summary
Total Size: 3326
Unique Blocks: 5
Shared Size: 2048
Ratio: 1.615755

ipfs --enc=json dag stat's keys are a non breaking change, new keys have been added but old keys with previous semantics are still here.

Accelerated DHT Client is no longer experimental

The accelerated DHT client is now the main recommended solution for users who are hosting lots of data. By trading some upfront DHT caching and increased memory usage, one gets provider throughput improvements up to 6 millions times bigger dataset. See the docs for more info.

The Experimental.AcceleratedDHTClient flag moved to Routing.AcceleratedDHTClient. A config migration has been added to handle this automatically.

A new tracker estimates the providing speed and warns users if they should be using AcceleratedDHTClient because they are falling behind.

๐Ÿ“ Changelog

<details><summary>Full Changelog</summary>
  • github.com/ipfs/kubo:
  • github.com/ipfs/boxo (v0.8.1 -> v0.10.2-0.20230629143123-2d3edc552442):
    • chore: version 0.10.2
    • fix(gateway): include CORS on subdomain redirects (#395) (ipfs/boxo#395)
    • fix(gateway): ensure 'X-Ipfs-Root' header is valid (#337) (ipfs/boxo#337)
    • docs: prepare changelog for next release [ci skip]
    • chore: version 0.10.1 (#359) (ipfs/boxo#359)
    • fix(gateway): allow CAR trustless requests with path
    • blockstore: replace go.uber.org/atomic with sync/atomic
    • fix(gateway): remove handleUnsupportedHeaders after go-ipfs 0.13 (#350) (ipfs/boxo#350)
    • docs: update RELEASE.md based on 0.9 release (#343) (ipfs/boxo#343)
    • chore: v0.10.0 (#345) (ipfs/boxo#345)
    • docs(changelog): car params from ipip-402
    • docs(changelog): add gateway deserialized responses (#341) (ipfs/boxo#341)
    • feat(gateway): implement IPIP-402 extensions for gateway CAR requests (#303) (ipfs/boxo#303)
    • chore: release v0.9.0
    • changelog: update for 0.8.1 and 0.9.0
    • provider: second round of reprovider refactor
    • feat(unixfs): change protobuf package name to unixfs.v1.pb to prevent collisions with go-unixfs. Also regenerate protobufs with latest gogo
    • feat(ipld/merkledag): remove use of go-ipld-format global registry
    • feat(ipld/merkledag): updated to use its own global go-ipld-legacy registry instead of a shared global registry
    • chore: do not rely on deprecated logger
    • changelog: add changelog for async pin listing (#336) (ipfs/boxo#336)
    • pinner: change the interface to have async pin listing
    • provider: revert throughput callback and related refactor
    • fix(gateway): question marks in url.Path when redirecting (#313) (ipfs/boxo#313)
    • fix(gateway)!: no duplicate payload during subdomain redirects (#326) (ipfs/boxo#326)
    • provider: add breaking changes to the changelog (#330) (ipfs/boxo#330)
    • relocated magic numbers, updated Reprovide Interval from 24h to 22h
    • provider: refactor to only maintain one batched implementation and add throughput callback
    • feat(gateway): HTML preview for dag-cbor and dag-json (#315) (ipfs/boxo#315)
    • coreiface: add a testing.T argument to the provider
    • feat(gateway): improved templates, user friendly errors (#298) (ipfs/boxo#298)
    • feat(gateway)!: deserialised responses turned off by default (#252) (ipfs/boxo#252)
    • fix(gw): missing return in error case (ipfs/boxo#319)
    • feat(routing/http): pass records limit on routing.FindProviders (#299) (ipfs/boxo#299)
    • bitswap/client: fix PeerResponseTrackerProbabilityOneKnownOneUnknownPeer
    • feat(gw): add ipfs_http_gw_car_stream_fail_duration_seconds (#312) (ipfs/boxo#312)
    • feat(gw): add ipfs_http_gw_request_types metric (#311) (ipfs/boxo#311)
    • refactor: simplify ipns validation in example
    • feat: add deprecator
    • fix(routing/v1): add newline in NDJSON responses (#300) (ipfs/boxo#300)
    • feat(gateway): redirect ipns b58mh to cid (#236) (ipfs/boxo#236)
    • refactor: replace assert.Nil for assert.NoError
    • tar: add test cases for validatePlatformPath
    • feat(ipns): helper ValidateWithPeerID and UnmarshalIpnsEntry (#294) (ipfs/boxo#294)
    • Revert "feat: reusable ipns verify (#292)"
    • feat: reusable ipns verify (#292) (ipfs/boxo#292)
    • refactor: remove badger, leveldb dependencies (#286) (ipfs/boxo#286)
    • feat(routing/http): add streaming support (#18) (ipfs/boxo#18)
    • feat(routing): allow-offline with routing put (#278) (ipfs/boxo#278)
    • refactor(gateway): switch to xxhash/v2 (#285) (ipfs/boxo#285)
  • github.com/ipfs/go-ipfs-util (v0.0.2 -> v0.0.3):
  • github.com/ipfs/go-ipld-format (v0.4.0 -> v0.5.0):
  • github.com/ipfs/go-ipld-legacy (v0.1.1 -> v0.2.1):
  • github.com/ipfs/go-unixfsnode (v1.6.0 -> v1.7.1):
    • chore: bump to v1.7.1
    • test: remove unnecessary t.Log
    • test: check if reader reads only necessary blocks
    • fix: do not read extra block if offset = at+childSize
    • doc: added simple doc for testutil package
    • bump v1.7.0
    • feat(testutil): add test data generation utils (extracted from Lassie)
  • github.com/libp2p/go-libp2p (v0.27.3 -> v0.27.7):
  • github.com/libp2p/go-libp2p-kad-dht (v0.23.0 -> v0.24.2):
    • chore: release v0.24.2
    • chore: release v0.24.1
    • fix: decrease tests noise, update kbucket and fix fixRTIUfNeeded
    • refactor: remove goprocess
    • fix: leaking go routines
    • chore: release v0.24.0
    • fix: don't add unresponsive DHT servers to the Routing Table (#820) (libp2p/go-libp2p-kad-dht#820)
  • github.com/libp2p/go-libp2p-kbucket (v0.5.0 -> v0.6.3):
  • github.com/libp2p/go-libp2p-routing-helpers (v0.6.2 -> v0.7.0):
    • chore: release v0.7.0
    • fix: iterate over keys manually in ProvideMany
  • github.com/libp2p/go-reuseport (v0.2.0 -> v0.3.0):
  • github.com/multiformats/go-multicodec (v0.8.1 -> v0.9.0):
    • Bump v0.9.0
    • Bump v0.8.2
    • chore: update submodules and go generate
    • chore: update submodules and go generate
    • chore: update submodules and go generate
    • chore: update submodules and go generate
    • chore: update submodules and go generate
    • chore: update submodules and go generate
  • github.com/multiformats/go-multihash (v0.2.1 -> v0.2.3):
</details>

๐Ÿ‘จโ€๐Ÿ‘ฉโ€๐Ÿ‘งโ€๐Ÿ‘ฆ Contributors

ContributorCommitsLines ยฑFiles Changed
Jorropo47+4394/-4458202
Henrique Dias48+4344/-3962205
ลukasz Magiera68+3604/-886172
Adin Schmahmann8+1754/-105737
galargh7+1355/-130215
Gus Eggert7+1566/-65533
rvagg1+396/-3893
Michael Murรฉ3+547/-20214
Guillaume Michel - guissou5+153/-49417
guillaumemichel15+446/-18928
Laurent Senta4+472/-15229
Rod Vagg6+554/-3723
Marcin Rataj11+330/-8221
Arthur Gavazza1+296/-877
Lucas Molas1+323/-566
Marco Munizaga5+227/-9717
Alex8+163/-11610
Steven Allen11+154/-11414
Marten Seemann6+214/-4112
web3-bot9+76/-7528
Hector Sanjuan2+5/-964
Sukun1+83/-173
Steve Loeppky2+100/-02
Edgar Lee1+46/-4612
Ivan Schasny1+67/-54
imthe11+65/-35
godcong2+30/-315
Will Scott4+36/-236
Petar Maymounkov1+45/-91
Ross Jones1+43/-12
William Entriken1+38/-01
Joรฃo Pedro1+35/-01
jhertz1+21/-02
Nikhilesh Susarla1+21/-03
Matt Joiner1+11/-92
Vlad2+4/-22
Russell Dempsey2+4/-22
Will2+2/-22
Piotr Galar1+1/-11
Joel Gustafson1+1/-11
Dennis Trautwein1+1/-11
Bryan Stenson1+1/-11