toki/iop

History

toki c8e98d4e10 refactor(runtime): promote provider-only execution boundary		2026-08-02 20:28:45 +09:00
..
cmd/edge	refactor(runtime): promote provider-only execution boundary	2026-08-02 20:28:45 +09:00
internal	refactor(runtime): promote provider-only execution boundary	2026-08-02 20:28:45 +09:00
Dockerfile	feat(edge): envsubst 템플릿 기반으로 설정을 전환한다	2026-06-02 18:06:44 +09:00
README.md	refactor(runtime): promote provider-only execution boundary	2026-08-02 20:28:45 +09:00

README.md

IOP Edge

IOP Edge owns Node registration, dispatch readiness, provider-pool routing, queue admission, leases, reconnect fencing, external inference surfaces, and Control Plane operations.

Provider boundary

Public model ids resolve to provider adapter/target routes.
Normalized inference uses ordered run events; OpenAI-compatible passthrough uses provider tunnel frames.
session_id is correlation only and never resumes local execution state.
Cancellation targets an active run id.
Edge operations are health.check, node.status, and provider.command.
Provider commands are limited to capabilities, transport status, and the Ollama API tunnel.
Caller metadata remains an ordinary bounded string map.

Edge and Node preserve standard OpenAI/Anthropic-compatible inference, streaming, tools, usage, provider lifecycle, capacity, queues, and reconnect behavior. They do not own interactive host programs, persistent conversations, terminal emulation, arbitrary host commands, or local filesystem execution context.

Development

go test -count=1 ./apps/edge/...
go test -race -count=1 ./apps/edge/internal/service ./apps/edge/internal/openai
make test-e2e

Canonical contracts:

agent-contract/outer/openai-compatible-api.md
agent-contract/outer/anthropic-compatible-api.md
agent-contract/inner/edge-node-runtime-wire.md
agent-contract/inner/control-plane-edge-wire.md