- Implement stream.go with sideband passthrough support
- Update chat_handler.go with streaming handler changes
- Add run_dispatch.go with new dispatch service logic
- Add server tests for streaming and sideband functionality
- Archive old plan/code-review docs for cloud-G07
docs/edge-local-dev-guide.md의 18083 포트 예시를 18081로 수정하여
openai.listen과 일관성을 맞춘다.
또한 관련 review follow-up 작업을 archive로 정리하고,
openai_text_tool_call_boundary 새 plan/review를 추가한다.
Remove all *_preview zap.String/Any fields from OpenAI-compatible log
calls (chat_handler, responses_handler, stream) so that prompt, content,
reasoning, source, and delta values are never written in plain to
operational logs.
Replace preview fields with non-content metadata:
- prompt_len, content_len, reasoning_len, delta_len, source_len
- message_count, content_len, finish_reason, tool_call_count
Also remove the now-unused previewString helper from types.go.
Add log_safety_test.go with regression tests that:
- verify no *_preview fields exist on any log line
- verify operational metadata fields are retained for observability
- verify logOpenAICompatStreamOutput does not emit delta_preview
vLLM-MLX provider-pool에서 strict output이 thinking을 끄지 않도록 하고, queue_timeout_ms=0을 IOP queue timeout 없음으로 해석해야 한다. long reasoning/long-context 요청은 IOP queue timeout이 아니라 caller cancellation과 backend timeout 정책으로 제어한다.
- Update control-plane edge wire and edge-node runtime wire contracts
- Refactor model queue service with admission control
- Update chat handler and responses handler for edge
- Modify run dispatch and status provider logic
- Add/modify runtime proto definitions
- Move G07 status logs to archive
- Add config refresh classification and test coverage
- Update OpenAI chat/responses/stream handlers with config refresh support
- Add comprehensive server tests for config refresh
- Update local dev guide with config refresh information
- Extend config package with ConfigRefresh field
