The Phase 0 OQ ledger (OQ-TN-01..10) promoted into
docs/architecture/open-questions.md (now OQ-TN-01..14, with four
new Phase 1 residues). Six ADRs and four spec docs, all Draft, all
decision-shaped per the SDD process (ADRs carry the WHY; specs carry
the WHAT and reference by number):
ADRs:
- 001 open-params-layout: params = {resource, substrate} — the
producer's stable name, not an address; wire-stable from the first
consumer; unknown substrates fail loudly at schema time
- 002 alpn-strategy: single alk/tunnel ALPN (option A); substrate in
params selects the framing; prior art (SSH/SOCKS5/udpgw) gives no
reason for the split
- 003 codec-and-udp-framing: raw pass-through (stream) / mandatory
[len: u16 BE] (UDP) — F-2 mandate recorded (the codec is mandatory
for correctness, not cosmetics); len=0 = legal empty datagram;
OQ-TN-13 resolved fail-loud (truncation)
- 004 no-backend-trait: halves functions at the assembly layer;
listen is an establisher shape; hub re-produce deferred(OQ-TN-12);
trait re-evaluated at the alknet ADR-078 convergence threshold
- 005 consumer-session-owns-teardown: TunnelSession with
open/adopt/stream_halves/take_halves/pump_against/close/join/Drop —
the W3 adopter gap closes structurally; Drop is the best-effort
fallback
- 006 access-control-posture: the open gate is the boundary;
TUNNEL_OPEN_SCOPE = tunnel:open (stable once published); op-level
ACL; ownership seam; no allowlists in v1; identity = 0.7.0's
precedence chain
Spec docs:
- overview.md: purpose, resource model, deps (alkcall 0.7.0,
wasm-clean default, local feature), module map
- wire.md: the open op (params/reply/typed errors), the data plane
by substrate, sentinels + half-close, byte diagrams
- producer.md: spec, establisher (dial + listen shapes), pump
handler (pump_bidi inline, R-02), registration API, ACL posture
- consumer.md: TunnelSession (forward open + reverse adopt
construction), data plane, teardown API (close/join/Drop incl.
pump-less join semantics)
- bast.md: the BAST doc for the UDP codec (convention 12's trigger
fired — the framing IS binary beyond pass-through)
- open-questions.md: OQ-TN-01..14; 01..10 promoted (faithful to the
phase-0 ledger's final states), 11 partially resolved (collision
domain = per-producer registry per ADR-001; lifecycle open),
12 deferred(scope), 13 resolved fail-loud (ADR-003), 14 open
Verified by an architecture-reviewer pass (2 criticals, 6 majors,
10 minors — all fixed: ADR-001/003-vs-OQ decision-state contradictions
resolved; the Layer-2 mislabel corrected to the ADR-047 §4 per-session
fork; alktty/alknet ADR misattributions fixed; codec placement pinned
to the establisher (pump stays substrate-agnostic); reverse-path
construction named (TunnelSession::adopt + pump_against); security
posture promoted to ADR-006; BAST doc written; F-2 rationale deduped;
README tables completed; channel_id > 0; MTU wording fixed; ADR-047 §5
attributions corrected; impacts lines added to unresolved OQs; review/
ledger pointer paths added to README references).
Verification: doc set internal cross-refs all resolve; cargo test,
fmt --check, doc --no-deps clean
109 lines
4.4 KiB
Markdown
109 lines
4.4 KiB
Markdown
---
|
|
status: draft
|
|
last_updated: 2026-09-07
|
|
---
|
|
|
|
# alktunnels — BAST Document for the `alk/tunnel` Wire Format
|
|
|
|
This document is the **BAST (Binary Abstract Syntax Tree)**
|
|
specification for the binary portions of the `alk/tunnel` wire format
|
|
— per AGENTS.md convention 12, the mandatory UDP length-framing codec
|
|
([ADR-003](decisions/003-codec-and-udp-framing.md)) is binary framing
|
|
beyond pass-through, so the BAST document exists even though the
|
|
format is trivial. It is a normative JSON document conforming to the
|
|
BAST meta-schema at `https://alk.dev/bast/v1/schema` (JSON Schema
|
|
Draft 2020-12); any Draft 2020-12 validator can check well-formedness.
|
|
|
|
**alktunnels does not depend on alktype.** The hand-rolled
|
|
`frame_datagram` / `DatagramReader` (the `src/wire.rs` shape the POCs
|
|
ran) is the runtime codec; this BAST document is the human-readable
|
|
contract describing what those functions round-trip. If runtime
|
|
validation against the BAST becomes desirable later, alktype becomes
|
|
an optional dep and this document is there to feed it.
|
|
|
|
## Scope
|
|
|
|
The `alk/tunnel` wire format is: a JSON open op on the channels call
|
|
plane (a UTF-8 JSON object inside the channels envelope — not a
|
|
binary layout; specified in [wire.md](wire.md) §The Open Op and
|
|
implemented by `TunnelParams`/`tunnel_open_spec` in the Rust source),
|
|
and a binary data plane inside the channel `BiStream`.
|
|
|
|
Per the BAST format spec, a BAST document describes **binary data
|
|
layouts** — not JSON payloads
|
|
([`validate_bytes` vs `validate_json`](https://alk.dev/bast/v1/spec)).
|
|
This document therefore covers only the data plane's binary framing:
|
|
|
|
1. **The datagram frame** (`[len: u16 BE][datagram bytes]`) — the
|
|
UDP-substrate codec (ADR-003; mandatory, F-2). Stream substrates
|
|
ride raw pass-through — zero tunnel-level framing, so there is
|
|
nothing for BAST to describe there.
|
|
|
|
What this BAST deliberately does **not** cover:
|
|
|
|
- **The open-op params JSON shape** (`{resource, substrate}`) — UTF-8
|
|
JSON on the call plane; specified in
|
|
[ADR-001](decisions/001-open-params-layout.md) and
|
|
[wire.md](wire.md), implemented by `TunnelParams`.
|
|
- **The channels 8-byte chunk header** — the channels layer's own
|
|
framing (alknet ADR-071/093); stripped transparently before the
|
|
tunnel data plane sees bytes. Specified upstream, not here.
|
|
- **The EOF sentinel** — the channels-level zero-length chunk
|
|
(upstream); the tunnel codec never emits it (that is the F-2
|
|
invariant).
|
|
|
|
## The BAST document
|
|
|
|
```json
|
|
{
|
|
"$schema": "https://alk.dev/bast/v1/schema",
|
|
"$defs": {
|
|
"DatagramFrame": {
|
|
"kind": "struct",
|
|
"endian": "big",
|
|
"fields": [
|
|
{ "name": "len", "kind": "uint16" },
|
|
{ "name": "datagram", "kind": "bytes", "encoding": "length-prefixed", "maxLength": 65535 }
|
|
]
|
|
}
|
|
}
|
|
}
|
|
```
|
|
|
|
## Annotations
|
|
|
|
### `DatagramFrame` — binary, exact
|
|
|
|
Maps 1:1 to the on-wire bytes. `len` as `uint16` big-endian (2 bytes)
|
|
followed by exactly `len` bytes of datagram payload. The zero-byte
|
|
payload (`len == 0`) is a legal empty datagram — a real datagram, NOT
|
|
EOF (the F-2 invariant; EOF is the channels-level sentinel, outside
|
|
this codec). The `maxLength: 65535` encodes the u16 bound; the codec
|
|
rejects framing a larger datagram at frame time (`Oversize`) rather
|
|
than wrapping the length field.
|
|
|
|
One frame per datagram, in both directions of the channel
|
|
`BiStream`. Frames are self-delimiting on the byte stream; a decoder
|
|
is an incremental state machine across chunk boundaries (chunk
|
|
splitting/batching is transparent — forward POC, 7-byte chunk splits
|
|
verified).
|
|
|
|
### Layering note
|
|
|
|
The codec sits at the substrate/pump boundary (the establisher wraps
|
|
the dialed UDP half in the framed adapter — ADR-003's placement, so
|
|
the pump handler stays substrate-agnostic). The BAST describes the
|
|
wire inside the `BiStream` only; the pump/pump_bidi contract
|
|
(ADR-050) is upstream's, not re-specified here.
|
|
|
|
## References
|
|
|
|
- [ADR-003](decisions/003-codec-and-udp-framing.md) (the codec
|
|
decision + F-2 mandate), [ADR-001](decisions/001-open-params-layout.md)
|
|
(the JSON open-op shape — outside BAST scope)
|
|
- [wire.md](wire.md) (the normative prose; §Normative byte diagrams)
|
|
- alktty `tty-bast.md` (the BAST precedent — same meta-schema, same
|
|
"binary framing only" scope rule)
|
|
- Forward POC `docs/research/poc-summary.md` §3 (the codec's
|
|
validation matrix); reverse POC
|
|
`docs/research/reverse-poc-summary.md` §F-2 (the mandate) |