WIP: v0.19 ensemble hosts #1502

vyzo · 2026-09-17T18:12:49Z

vyzo commented

2026-09-17 18:12:49 +00:00

the ensemble host abstraction, on top of the ensemble network; see #1493

codesigned and implemented with astra with the help of sol and local models; guidance, review, and oversight by gerbilosaurus rex 🦖

the ensemble host abstraction, on top of the ensemble network; see #1493 codesigned and implemented with astra with the help of sol and local models; guidance, review, and oversight by gerbilosaurus rex 🦖

vyzo added 95 commits

2026-09-17 18:12:49 +00:00

move ensemble prototype to TODIE 05fe8d1e44

add ensemble ucan interface 9b912accd1

add ensemble ucan did utilities and tests cf2aeac014

add base58 multibase support and simplify did decoding 777a40203b

document stdlib coding conventions 1c63754858

improve crypto error handling and key derivation support dee5c785dd

add encrypted ensemble keystores 8b25518e88

add ensemble ucan capability utilities and tests 4c9edb1273

add schema execution and improve statement caching 2e3d66bf5c

add cached ucan database backend and documentation bdfd429b86

expand stdlib coding conventions 2345cafecc

recommend shared SQL schema execution helper f9df02a8b7

add ucan capability context with cached keys 192ecf4da2

add ucan capability context extensions 9e76b00bcb

add ensemble network interfaces and DID-named TLS contexts 1d617024db

document ensemble network design 7f82f3f8ec

add ensemble network configuration and limits 3a970226e3

extend ensemble network interface contracts 7a171d3932

align ensemble network contract annotations 25b600982f

reuse network no-timeout default sentinel 957702a881

summarize ensemble Network interface 6eb6b56596

add ensemble network wire codecs 95dcab2c0e

fix BIO buffer cache capacity buckets b737fad1a0

prioritize BIO buffer cache positive-size requests dd2981a0e6

refine ensemble wire codec types and access 3fa700e504

verify capability context anchors before insertion a473d32713

trust capability context principals as implicit roots 2ab56f5d01

add ensemble network authentication foundations 87e91837a3

remove vacuous ensemble network interface tests 279bdb2af1

fix buffered UTF-8 writer retries after buffer growth d4f97dada6

remove redundant buffered writer documentation b995e0574f

allow an explicit timeout for SSL server upgrade e2726b3211

remove redundant BIO buffer cache documentation fd9af6f459

add thread join with original exception propagation fac2fb5904

add staged ensemble network handshakes 28481d45f8

fix stream-listen internet endpoint dispatch a74b43afdc

add ensemble network listener lifecycle 96b72bfe80

add ensemble network outgoing transport setup 87766a582e

add ensemble connector credential retry choices 61ee511f78

specialize stdlib network setup errors 1ac60c4c92

fix SSL cleanup after shared socket closure c9020c3243

add ensemble connection retry and election foundations 07db976c6c

add bounded ensemble stream buffers and credits 72862ebb58

fix condition variable type predicate 163b1b2ef9

add blocking ensemble stream IO f76873d57a

avoid copying queues for non-destructive iteration 313aa58b5a

add bounded ensemble connection scheduling f8bc832ac9

record scheduler and make fix handoff 67616f9518

integrate ensemble stream control scheduling ead2176264

simplify stream quantum positivity checks 31fef6f73a

add ensemble parent wakeups and idle stream expiry d94c15c3f6

add explicit Interrupt exception af3cd3bc59

fix RWLock interrupted acquisition cleanup cd084fc801

fix socket Reader minimum-input handling 0354191f36

enforce ensemble connection transport lifetimes 7b5305c8fe

record public network end-to-end milestone 212c681279

use exception-only cleanup in stdlib resource paths 3460e3a579

adopt exception-only cleanup in audited ensemble paths d2358f28c5

record framed transport implementation handoff e0246ffdc0

translate thread join timeouts to Timeout 4c891acee1

add framed ensemble connection transport 140cf87e1b

remove Interrupt and asynchronous lock recovery e909ac0f87

implement public ensemble networks and authorized streams 12ced54f06

fix ensemble whole-buffer writes and test large transfers bc50d2287a

design renewable connection and stream leases a866385366

fix SSL operation error queue isolation ee0a0d2798

implement renewable connection and stream leases 982f666759

adopt native nullable contracts in ensembles da95f19b6f

harden ensemble renewal ownership and failure cleanup 396e197054

complete bounded ensemble renewal coverage 06edd20c9a

complete ensemble network acceptance and expose protocol constants eb7a342594

document ensemble network interactions and close handoff 0058fcb7eb

implement actor reply protocols and unify host sending 43e8745306

plan persistent address books and resolver registries 4ba2a10fbf

implement address book values and codec fce5484df9

add structured exception logging macro 39afb501c7

fix SQLite filename encoding and binding error checks 2f9e42208a

implement durable SQLite address book 98904d9601

prepare resolver protocol and topology implementation handoff 831afb29fe

checkpoint resolver protocols and durable topology c733e97904

Add Phase 3 contracts, separate request protocols, wire validation, topology storage and deterministic tests. Include canonical DID normalization and trusted address-book read simplifications.

Record the Host authorization decisions and remaining trusted-state/test follow-up. This checkpoint precedes the next implementation pass and does not close the Phase 3 review gate.

complete resolver phase 3 review and retire stale handoffs 230915fa4f

Trust validated topology rows while preserving reopen compatibility and transaction cleanup. Use transparent Handle equality and strengthen receipt, actor, relay and SQL resource regressions.

Record Phase 3 acceptance, remove four completed handoff documents and update retained design/status references. Verified with the eight-core stdlib build, 35 resolver cases and 88 dependency cases.

add spawn! body shorthand 00a1a04417

add actor protocol wildcards and spliced unexpected reactions da1aa05c89

implement bounded concurrent resolver actor aff9aa3804

Serve resolver requests in detached actors with a spinlock-protected concurrency limit and serialized topology mutation and closure. Add standard actor controls, private fatal notifications, Source peer contracts, and the nonblocking Host send contract.

Record reviewed behavior and verification, retire stale Phase 4 handoff references, and leave serialized reply-size accounting for the next increment.

remove resolver-specific message size limits f7074f23c3

implement bounded upstream resolution and finite static answers 8ee63f1c67

checkpoint sequential resolver fallback and rotation e3558e8540

complete resolver fallback deadline verification 6713e5504a

complete independent resolver queries and production diagnostics b826862563

remove retired resolver implementation handoffs 1a4976e9e8

propagate actor error codes and messages and finalize protocol structs 443b3fbb82

qualify actor error codes by protocol and code resolver failures 930f71c969

add single-pass resolver publication handoff e68b3929be

complete Host-configured runtime resolver cleanup e3353e5417

add public resolver API and wrapper documentation 543690dfb2

vyzo changed target branch from v0.19-staging to v0.19-std-ensemble

2026-09-17 18:16:31 +00:00

vyzo changed target branch from v0.19-std-ensemble to v0.19-staging

2026-09-17 18:17:56 +00:00

vyzo force-pushed v0.19-std-ensemble-host from 543690dfb2 to e75c454499

2026-09-17 18:21:54 +00:00

Compare

vyzo changed target branch from v0.19-staging to v0.19-std-ensemble

2026-09-17 18:22:41 +00:00

vyzo force-pushed v0.19-std-ensemble-host from e75c454499 to 3491ed1ea9

2026-09-18 08:48:09 +00:00

Compare

vyzo added 7 commits

2026-09-19 06:02:15 +00:00

define compositional Host views and record routing design d04cc0865e

prepare local ActorHost implementation handoff d03fb271d2

implement local ActorHost routing and shadow lifecycle d6efa74a30

add explicit sync flush for deflate writers 8273444130

record remote actor framing design and message IO handoff eac7227d59

fix inflate reads across fragmented compressed input c358cf9d46

add bounded message IO with reusable buffered views 498b7dfdb2

vyzo changed target branch from v0.19-std-ensemble to v0.19-staging

2026-09-22 12:10:40 +00:00

vyzo force-pushed v0.19-std-ensemble-host from 498b7dfdb2 to cdcb8b406d

2026-10-31 16:16:28 +00:00

Compare

vyzo added 23 commits

2026-11-09 18:09:11 +00:00

Checkpoint ensemble server configuration and service designs d118e422c8

Add atomic one-shot Host stream handlers c06420f77f

Fix detachable I/O wrapper construction 5fc6c9caff

Add capability-scoped one-shot data downloads dc9a3555d4

Record standard service dependencies and Logger lifecycle 3fa48dbb5f

Add rotating log sink lifecycle notifications 982fae3f8a

Fix rotating log archive accounting and naming 330a093e36

Add ordered system log sink removal 5bc09553c8

Start log sinks in system logger dispatch order 9f7881193e

Add ensemble logger lifecycle and administration 38bd4c0604

Use typed actor requests and shared actor-control !Status, remove failed sinks before invoking policy, and manage configured and dynamic sinks through the existing system logger. Format sink failures safely for console reporting.

Validation: source expansion and source-loaded logger, rotating sink, system logger, and format-reader suites passed. No native rebuild.

Coordinate supervisor restarts across hard dependencies 7bde1a3673

Replace per-edge loss policies with prerequisite names. Stop transitive dependents before their prerequisites, restart prerequisites before dependents, and complete restart requests only after the entire affected group is ready.

Preserve cleanup ownership and cancel replacement on failure or timeout, handle intersecting losses, and reject self-joins through dependent subtrees. Declare generic Server status and restart methods and exercise Logger replacement through the Host supervisor.

Validation: 73 source-loaded tests passed, including 43 supervisor cases; source expansion and whitespace checks passed. No native rebuild.

Add Logger inventory and one-shot log downloads 225a4955dc

Use versioned canonical binary input for token signatures c989e1e135

Add isolated parallel gxtest execution with labeled output fa3a6b5213

Fix Logger client result types and refresh token test fixtures 59955f6da4

Add capability-authorized Logger search cursors 0ff29338b1

Add Server ownership and supervised service lifecycle e2f9cc84f1

Add Delimited mixin and remaining-byte dispatch f85a030a8b

Add optional strict EOF validation to zlib readers a77faad50e

Add FS service and capability-authorized uploads 8e3d8017fc

Consume closing markers after binary dotted-list tails d8778e1b2f

Add named, filterable Logger streams with runtime controls f48e8feaf2

Pin Gambit with upstream stack overflow undo fix d13bc33e82

vyzo added 1 commit

2026-11-09 22:33:21 +00:00

Annotate locked Logger level result for native compilation b353a24231

This pull request is marked as a work in progress.

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin v0.19-std-ensemble-host:v0.19-std-ensemble-host

git switch v0.19-std-ensemble-host

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch v0.19-staging

git merge --no-ff v0.19-std-ensemble-host

git switch v0.19-std-ensemble-host

git rebase v0.19-staging

git switch v0.19-staging

git merge --ff-only v0.19-std-ensemble-host

git switch v0.19-std-ensemble-host

git rebase v0.19-staging

git switch v0.19-staging

git merge --no-ff v0.19-std-ensemble-host

git switch v0.19-staging

git merge --squash v0.19-std-ensemble-host