>> to @helia/verified-fetch

to

dweb.link

enabling trustless in-browser access

a library for apps and hot-linked content

ipfs.io and dweb.link have played a foundational role in IPFS adoption—serving over 614 million requests and 45TB of data to 10 million users daily. However, this centralized infrastructure has become a major obstacle to sustainability and decentralization.

<< from Apps & Hotlinks

from:

Provide Sweep: Solving the DHT Bottleneck for Self-Hosting IPFS at Scale dweb.link

ipfs-shipyard-self.hosting-at.scale-provide.sweep-annnotated

to IPFS Forum Kubo v-.28 annuncemnt

caching peers

adaptive timeout fail fast

skip slow peers

sounds good

to IPNS Record Protocol

shipyard

devgrants

Desktop users and home servers -

can now provide at scale. =

converging supporting personal firs

interpersonal networks

useful for applications requiring faster peer and content discovery

Provider records may be sent to peers that have gone offline or are no longer closest to the CID, since the snapshot is only refreshed hourly

Accelerated DHT Client

or more, you should increase the number of provide workers - to handle the higher throughput.

Reprovide Sweep

Default

tradeoff

continuous crawling vs zero-latency lookup

serves from map lookup no network request

spiky vs regular

Reprovide Sweep 132k requests 22 h

vs

Accelerated DHT client 1,87 million requests 22h

100k CIDs within a 3-hour window single thread

this burst approach creates temporary peaks in resource usage—high CPU load, network bandwidth consumption, and numerous concurrent connections

it pops all CIDs from the same region as the head of the queue and provides them together in a single batch

Wow caps at 3k lookups

independently of the number of CIDs being provided

since every content is contextualized =

can just lookup adjacent peers by shift of focus

keyspace prefix

20 peers

replication factor

into a smooth, continuous background process that distributes the load over time.

Reprovide Sweep

Metaphysics of Adjacency

Provide Sweep finds them once and delivers all relevant provider records together.

lots of records to the same server

if you have far more CIDs to provide than there are DHT servers in the network, then each server must be allocated multiple CIDs. Since each CID must be stored on 20 servers (the replication factor), and there are approximately 10,000 active DHT servers, a node providing hundreds of thousands of CIDs will send dozens or even hundreds of provider records to the same servers.

CIDs that are close together

inpractical for smaller scale IPFS users

expensive

consider timebound focus

peer ids of near contacts two hops!

network robust churn

lookup

complete map of the network

Interpersonal connectivity may help to scale this

scaling salience

conrifmed

kubo can only reprovide 5k CIDs in 22 hours

new content arrive faster

can't keep up

pateience and retries

bottleneck lookup

In my experience it does not seem to work!

Need to pay attention to provide.strategy

to why pinning is key + mfs

slef-hosting

is magic

indeed key

Yes

defunding

key

reproviding would happen oranically with interpersonal traffic

scales organcally

renew within 48 hours

Yes, IPNS records need to be renewed every 48 hours!

TTL 48 hours

to validity 48 hours

directory

to - record provider peers

to restore-restart

replication factor of 20

to bucket size 20 Kadmelia

obtainable by interpersonal cross referencing linking and sharing

Key Idea Individuals form and maintain their own autonomous shards!

undiscoerable

steps

peers

closer peer

calculate distance

link to that private Lcuel Unique Ids that form a Personal Indranet Worspace nidirectionally meaningfully linked strucured deeply meaningfully intentionlly intertwingled spaces enScapes that encapsulate curated associative complexes

reusable repurposable with full provi=enace and history of its own co-evolution and

Conversations that are continuous without being synchronous

People cantered interest based emergent networks

where connecting People Ideas and Reelevant resources

simultaneously scaling mutual learning, synthesis, and Reach. Searches including the ability to exchange searches and results serendioity engine

Pensieve

distributed key value store

Interpersonal

network indexer

content at scale

map CIDs to peers

Discovery probem

can be further aleviated by weaving meaningfullyintentionally transparently named connections,trails that are marked.

decopulies identity from where it ives

batching CIDs - that get allocated to the same DHT servers and - sweeping through the keyspace systematically,

we’ve unlocked dramatic efficiency gains.

For a node providing 100k CIDs, - this means a 97% reduction in lookup operations.

Resource-constrained nodes can now handle - hundreds of thousands of CIDs,

while high-capacity nodes can - scale to hundreds of millions and beyond

—all with - smooth, - predictable

resource usage - distributed over time.

DHT lookup

5-10k

becomes viable for regular users, businesses and organizations.

Resource-constrained hardware (like Raspberry Pi) can now provide hundreds of thousands of CIDs; high-capacity nodes scale to hundreds of millions and beyond.

Write a protocol

beyond protocols?

But we must have all, available local-first yet omni present ready to share and collaborate autonomously. Tha tis the promise of IPFS

the internet today has been described as this big nervous system for humanity, right?

the pronlem of Location Addressing =

why we must distribute the Web

or uh you have some new ideas about what humanity should uh be able to do, you can just

write a protocol uh and then you implement it and if you're right uh and it works then you tell the world and

then it gets deployed and then a lot of people will use it and the world will be a better place

https://search.brave.com/search?q=save+string+to+ipfs+local+gateway+browser

/💻/thinkpad/now/2025-12/12

do.how

???

to Path Gateway Spec

<< search

<< https://search.brave.com/search?q=save+string+to+ipfs+local+gateway+browser

to

<< Provider Seek

verifiable

mutable pointers

to objects -

Metanoia

10 years later

going Inter - - Personal and - Planetary

It is not semantics

we need Mutual learning Trails

TrailBlazers for Human InterIntellect Aumentation

Indy Learning commons

Symmathesy

Symmatheticist in the medium of Softwrae

Let People do it All For Themeselves

for - contextualized

holistic life-long digital archive

Research Objects

contextualize

to

conplexualize

asoociative complexes

two way linked intentionally/semantically transparence

scaling findp=bility and recall

digital pensive

contextualizing

conlexualizing

from provider strategy

restore or restsart

from - smart-resume

from expiration mechanism

from [pointers peers](https://hyp.is/SSfiDtaeEfCReP-M16GHLQ/ipshipyard.com/blog/2025-dht-provide-sweep/}

from - replication factor of 20

fast root CID

IPFS Desktop

IPLD Primer

h

explicit versioning is fragile

not turing complete

compact high-entropy schemafull

easier to "eyeball" =

and understand

without a schema

design langauge for IPLD

schemas

contxt free reference

selectors

1 to 1

semantics?

incidental choices that must be made but do not matter pers

IPLD

maps and lists

data model independent of syntax AST

// master ♖ document

📝next/0.0.2/index16.html

z

use inbrowser.link

https://bafybeibc6bqagreyg5oggwyomlj6pxvjmv45r44b4hjufzqkd73aafck7a.ipfs.inbrowser.link/

Owner avatar js-kubo-rpc-client

IPFS in JavaScript

https://k51qzi5uqu5div1auuxm59ygav4p7gdg9z4e9iggtu6m43rmc3xw75mczx2b7x.ipns.dweb.link/me/indy0Pad/?isPathWritable=true&path=https://bafybeibo3cfxbpled7ybk5mp6o2xdthk7af5ebxgzm7y3haemte6ntxjnm.ipfs.dweb.link/me/%F0%9F%A7%8A-me.html&isPathWritable=true

it took some time

Next Step is to see if all this will work in Agregore

That would enable anyone with IPFS Desktop and Agregore browser to be a create and share documents on the IndyWeb

We need 1s with Peergos Account to be able to share

secret links and establish trusted collaboation between poeple they know

Use IPFS and IPNS for

me/indy)Pad and documents under me

save manually on corresponding Peergos space

download it and upload it to IPFS Desktop

to get this document describing the work towards this goal

gloss

from-HAMT

lazy grow

Hash Array Mapped trie

HAMT

gloss

commercial offering

Hypothesis mission

enable conversation over the world's knowledge to

on mobile

javascript:(function(){window.hypothesisConfig=function(){return{showHighlights:true,appType:'bookmarklet'};};var d=document,s=d.createElement('script');s.setAttribute('src','https://hypothes.is/embed.js');d.body.appendChild(s)})();

sunset via

x

4 object pronoun from

object pronoun

to

to.do

setup for editing this with Indy0Pad Inter planetary constellation edition

dweb.link: setup-indy0wiki.pad.html

Using the latest indy0pad that produces HTML documents that on Peergos at the point of creation of an index,htmlk file in the right path do - embed hypothesis social annotation tool - set encoding to UTF8 - set title based on the as the last three elements of the path - has a folly operational counterpart in the Inter Planetary Constellation wich is now ready for prime time as IPFS Desktop is now able to share because it is using the new sweep algorithm

The current verison as of 2025-12-09

take this published version as the basis and will be edited with the InterPlanetary Indy0Pad

will use the annotation margin to save updated dweb.links and add them to the document using the Indy0Pad editor @ IPFS which actually save changes into local Storage

and will be able to save to IPFS in the next round of development

x

secret.link: setup-indy0wiki.pad

self

secret.link: setup-indy0wiki.pad update - 2025-12-09 // new way of self-identifying documents that are not web hosed using secret links to Peergos files and auto open to view and in response to sunsetting upr via.hypothes.is

HyperPost Presentation setup via IPFS Desktop on ThinkPad still experimental but got it to work

dweb-hyperpost slides

and we can annotate the presentation

e cannot

The legacy provider problem: The legacy system processes CIDs one at a time, requiring a separate DHT lookup (10-20 seconds each) to find the 20 closest peers for each CID. This sequential approach typically handles less than 10,000 CID over 22h (Provide.DHT.Interval). If your node has more CIDs than can be reprovided within Provide.DHT.Interval, provider records start expiring after amino.DefaultProvideValidity, making content undiscoverable.

from

to

What’s new: Kubo v0.39 ships Provide Sweep as the default provider system.

todo

• save images to files and provide dweb.links
• add canonical/alternate

Peergos Secret Link to

Does not allow annotations

But 1 can add Page Notes

https://co-nation.net/

add the ability to share openly with foll proenance and verifiable record of the sharing

4<br /> hermeticism

google.com/search?q=role+of+the+individual+in+the+hermetic+tradition&

4<br /> hermeticism

SICP

4 hermeticism

personally archive @gyuri https://bafybeicid7zd2l56yipy5nxra2qttovqqjh46x3cqu4qsmlhfevsku5lcq.ipfs.dweb.link?filename=Release%20v0.47.0%20%C2%B7%20ipfs_ipfs-desktop%20%C2%B7%20GitHub%20(30_11_2025%2012%EF%BC%9A29%EF%BC%9A13).html

and annotated it with https://hypothes.is

and the self-hosted archved page snarfed with single File has been instantly available!

A real Milestone

get help

great slogan

Bing YOur own Communities BYOC

DIYO

delighted to see my annotation 5 years ago showing up here

Ever since I learned about hypothesis in 2017 I worked to follow hypothesis example of making

Reading active and social

to "lock the web open" and make Colaborative Writing and interpersonal collaboration linked to annotation possible.

Use hypothesis as a an interpersonal search engine

archived.by @gyuri

ipfs://🧊/ ♖/ hyperpost/~/gyuri/🏛️/2025/12/search/Build.YOur.own.Communities

archived.by @gyuri ipfs://🧊/ ♖/ hyperpost/~/gyuri/🏛️/2025/12/search/Build.YOur.own.Communities

naming is creating

archived.by @gyuri ipfs://🧊/ ♖/ hyperpost/~/gyuri/🏛️/2025/12/search/Build.YOur.own.Communities

archived.by @gyuri ipfs://🧊/ ♖/ hyperpost/~/gyuri/🏛️/2025/12/search/Build.YOur.own.Communities

https://bafybeifr4fk4z5vpoqrjbcgmuevpofvhaccopzltutgfe4iixqv6ozfbo4.ipfs.dweb.link/?

from https://hyp.is/0P36ttA6EfCi2eMjvaZA7Q/web.hypothes.is/help/annotation-basics/

Oiginaly annotated the IPFS version https://bafybeig7nrhxx3nyb5rfmuj7cfy5xbl4ldtwr57ol6lykibww625qkxnke.ipfs.dweb.link/?filename=hyperpost-0.html

the one showing should be the canonical

Instead of shipping early shipping often

or "Get IT Right First time"

Get the IT right first.

If you do that IT can self-host and self-realize the IT

as a Conversations

After all Software is a Symmathetic Conversaiton creating the Medium, the Sweet spot, just above the threshold that is trully required.

Proving that the "Worse IS Not Better"

Need the Jewel like Diamond approach

This is truly working in the Open Learning Commons

creating the Indy (Mutual) Learning Commons

The work is not only Open Souce

developing Open constructs

easy to emulate compelling to do and etend expand exapt

but it shipf with Open Sauce

i

☑️The most up to date version will be the canonical version that will point to the latest version using IPNS

all versions thus will be available via links

My to do list is on the annotation margins

use hypothesis search to see a reverse chronological listing of todo tasks

https://jonudell.info/h/facet/?user=gyuri&max=50&exactTagSearch=true&addQuoteContext=true&any=%E2%98%91%EF%B8%8F

This annotation is at the top of that list when this annotation was made

No Groan Zome

but

Not just Converge but UpVerge in an autopoietic emregent upward spiral

Beyond all expectations

Imagined a whole new way what that leads to is beyond prior imaginings

Origo Folder for my hyperpost Peergos Account

No Graon Zome

but

/hyperpost/🌐/🎭/gyuri/do/web/snarf/📅/2025/10/2/Metaphysics.of.Adjacency.html

/hyperpost/🌐/🎭/gyuri/do/web/snarf/📅/2025/10/2/Metaphysics.of.Adjacency.html

what if these aren't models

but are in morphic resonance with something that is outside the brain driven by the shift of attention

indey.dweb.archived@🧊/ ~/ gyuri/ 2025-12