Files
cthulhu/docs/tentacle-remote-braille.md
Chase CichorzandClaude Opus 5.5 551ef86d5f Export and display Remote Braille through the reader
A controlled reader renders accepted application frames in a new
virtual-only cthulhu-braille mode at the controller's width and applies
its pan and route gestures; reader UI, flashes and secure frames are
never exported, and hidden frames are unroutable. A controller reader
reports its display width, shows peer cells as an untranslated raw
frame and forwards local pan and routing keys. The physical helper now
reports its width and edge pans.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-11-06 16:06:38 -05:00

64 lines
3.7 KiB
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# Remote Braille IPC
Protocol 1.1 carries Remote Braille through one child-to-host method,
`remote.braille`, and one host-to-child event kind of the same name. Both need
the current process session's live lease with the separately approved
`braille-stream` grant; requests share the operation sequence. Every message
carries one `braille` object whose `op` selects its form:
| `op` | Direction and role | Fields |
| --- | --- | --- |
| `size` | controlled child to host | `width` 0–4,096: the controller's display; 0 stops export |
| `gesture` | controlled child to host; host to controller child | `gesture` `pan-left`, `pan-right` or `route`, with `index` for route |
| `cells` | host to controlled child; controller child to host | `cells`: 1–4,096 final dot values 0–255, never text |
| `geometry` | controller child to host (no width); host reply event with `width` | 0 means no local display |
The request reply acknowledges admission into a 16-item reader mailbox; a full
mailbox revokes the lease. Without an attached reader owner the method returns
owner-unavailable. No AT-SPI identity, object path, routing map or native
handle crosses this boundary: routes are cell indexes into the latest exported
frame only. `Session.EnableRemoteBraille`, `PublishRemoteBraille`, the Go
`RemoteBraille` types and validators and the Python `valid_remote_braille` and
`valid_remote_braille_request` validators implement the contract. Go/Python
SDK-process tests cover each direction, role denial, invalid values,
saturation and revocation.
## Reader owners
`start_remote_braille` attaches an owner for sessions installed with
`braille-stream`, from local launch and managed startup.
**Controlled computer.** A `size` request starts `cthulhu-braille --virtual`,
a helper mode that opens no display and reuses the physical helper's
viewport, liblouis translation, wrapping, panning and routing maps. The owner
installs an exporter on the Braille worker that receives only accepted
application frames. Reader UI, flashed messages and secure-input frames are
never exported. A frame stored while reader UI, a protected confirmation or a
peer's cells hide it is exported with ID 0 so it cannot be routed. Rendered
cells become `cells` events. Gestures pan the virtual viewport or route a cell;
a route reaches the application only if it names the frame currently shown
here, so a stale or hidden frame is ignored.
Ordinary frames have no BRLTTY to translate them, so the virtual helper uses an
explicit table, `en-us-comp8.ctb` (computer Braille); contracted frames keep the
user's configured table. The cursor is a static dots-7-8 overlay, not BRLTTY's
configured cursor shape or blink.
**Controller.** The physical helper now reports its width in its ready line
(`ready N`; a bare `ready` is still accepted), answering `geometry`. Peer
`cells` are shown as Unicode Braille runes in a raw frame, sent without
contraction or word wrap so the helper writes the exact dots. They take the
place of the application frame, which keeps updating underneath; reader UI and
flashed messages still take precedence and restore to the peer's cells. The
helper now also reports a pan key that cannot move the local viewport; on a
peer frame that, and a routing key, become `gesture` events. Revocation, lock
or handoff restores the application frame.
Tests: liblouis-backed virtual helper tests (computer Braille, cursor overlay,
pan and pan-back, routing, contracted table, invalid input); a smoke run of the
built helper; and app tests with a fake helper and a real Go SDK child for both
roles: application-only export, unroutable frames under reader UI, routing to
the application, gesture forwarding, peer cells overriding local frames,
stale-route rejection and restoration on revocation. No physical display was
used.