Commit graph

19 commits

Author SHA1 Message Date
fc16a1e05c feat(edge): implement openai compatible raw tunnel sideband passthrough for edge stream
- Implement stream.go with sideband passthrough support
- Update chat_handler.go with streaming handler changes
- Add run_dispatch.go with new dispatch service logic
- Add server tests for streaming and sideband functionality
- Archive old plan/code-review docs for cloud-G07
2026-07-08 06:18:00 +09:00
toki
ca5eb4685c fix(edge): provider-pool thinking과 queue 정책을 정리한다
vLLM-MLX provider-pool에서 strict output이 thinking을 끄지 않도록 하고, queue_timeout_ms=0을 IOP queue timeout 없음으로 해석해야 한다. long reasoning/long-context 요청은 IOP queue timeout이 아니라 caller cancellation과 backend timeout 정책으로 제어한다.
2026-07-06 10:16:43 +09:00
5b95208f4c feat: edge runtime model queue and status dispatch updates
- Update control-plane edge wire and edge-node runtime wire contracts
- Refactor model queue service with admission control
- Update chat handler and responses handler for edge
- Modify run dispatch and status provider logic
- Add/modify runtime proto definitions
- Move G07 status logs to archive
2026-07-05 20:01:27 +09:00
b2754b871f feat: long context admission support - refactor edge server, add input estimator 2026-07-05 19:26:06 +09:00
2c9faad1f3 feat: long context admission support - refactor edge server, add input estimator 2026-07-05 18:18:58 +09:00
c0d2748361 feat(edge): model queue priority routing with runtime config refresh
- Add classify.go/classify_test.go for config-based priority routing
- Add model_queue.go/test with priority queue support
- Update run_dispatch.go to use priority routing
- Add edge.yaml config for model priority settings
- Add config.go/config_test.go for priority config parsing
- Remove G06 priority routing plan/review (merged into main flow)
- Add archive for m-node-provider-first-config-surface task
2026-07-01 21:07:29 +09:00
f8d4e12e43 feat: routing status refresh and config validation updates 2026-06-30 09:47:34 +09:00
e30fb2494e feat(edge): node resource model unification - update phase/SDD docs and edge service
- Move node-resource-model-unification milestone and SDD to archive
- Update PHASE.md for operational-observability-provider-management
- Refactor edge node registration and model queue logic
- Add status provider tests for model queue validation
- Update edge config and Go config structs
2026-06-29 14:39:27 +09:00
b7801ee0af refactor(edge): unify resource model, update dispatch & status, add tests, clean up review docs 2026-06-28 22:46:49 +09:00
445716cc3e feat(edge): runtime config refresh mechanism implementation
- Add configrefresh package for config classification, request handling
- Add bootstrap refresh_admin.go for admin-level config refresh
- Add edgevalidate package for config validation
- Update edge bootstrap runtime with refresh capabilities
- Update edge service layer with config refresh integration
- Update openai layer routes/chat_handler/server for config refresh
- Update edgecmd config handling with refresh support
- Update input manager, transport server, status provider
- Add edge.yaml config updates and go/config package changes
- Add hostsetup templates and test updates
- Update roadmap and phase documentation for runtime-reconnect-config-refresh
2026-06-21 21:35:50 +09:00
06f1d36fa3 feat: provider catalog device status - edge dispatch implementation
- Add agent-task archive for 02+01_edge_dispatch
- Remove outdated plan and code review docs
- Update edge bootstrap, input manager, and openai handlers
- Update model queue, run dispatch, and service layer
- Add status provider tests
2026-06-20 16:59:55 +09:00
1eda14e8ac chore: update edge service queue policy files and add test 2026-06-17 07:26:26 +09:00
957700c2d6 feat: model route queue policy alignment phase added and edge service updates
- Add model-route-queue-policy-alignment milestone to inference provider extension phase
- Add SDD documentation for inference provider extension
- Update edge chat/responses handlers for OpenAI compatible API
- Update edge config with new queue policy settings
- Add config tests for queue policy support
- Update task tracking for model route queue policy alignment
2026-06-16 22:30:36 +09:00
bcc60ff48c feat: edge model group queue scheduling improvements
- Add status_provider_test.go for queue status coverage
- Update model_queue.go with queue simplification
- Update run_dispatch.go with dispatch logic improvements
- Update status_provider.go with status tracking
- Update server tests for a2a, openai, and opsconsole
- Remove archived PLAN and CODE_REVIEW documents for 02+01 surface snapshot contract
- Archive 02+01_surface_snapshot_contract to 2026/06
2026-06-16 10:58:30 +09:00
dba289d0fa feat(edge): 모델 그룹 큐 스케줄링 구현
- 모델 그룹별 큐 기반 디스패팅 로직 추가
- ModelQueue 관리자로 모델 인스턴스 큐 처리
- OpenAPI chat 및 responses 핸들러 업데이트
- edge 서비스 테스트 코드 개선
2026-06-16 10:16:05 +09:00
a758926593 feat: openai workspace agent execution contract milestone and edge updates
- Add milestone doc for openai-workspace-agent-execution-contract
- Update edge chat/responses handlers and types
- Update edge service run dispatch logic
- Add edge and service tests
- Update edge README
2026-06-13 16:33:00 +09:00
b963e13bf9 fix(edge): run stream 종료 시 실패 경로를 고정한다
run stream 또는 node event 채널이 조기에 닫히는 경우에도 nil/closed 상태를 안전하게 처리해 무한 대기를 막고, A2A/OpenAI 경로가 일관되게 오류를 반환하도록 하여 예외 상태에서 서비스 장애 전파를 개선한다.
2026-06-09 04:13:27 +09:00
672b4cdb5d refactor(bridge): 실행 경계 선행 안정화를 반영한다
원격 터미널 브리지 POC 전에 Client HTTP lifecycle과 Edge run result surface 계약을 고정해야 하므로 관련 구현, 테스트, 로드맵 상태를 함께 정리한다.
2026-06-07 08:40:36 +09:00
6b684ee5cf refactor: edge service split and OpenAI surface separation
- Split edge service into dedicated modules (control_command, node_command, run_dispatch, status_provider)
- Separate OpenAI handlers (chat_handler, ollama_passthrough, routes, stream, strict_output, types)
- Archive completed milestone documents (02_edge_service_split, 03+02_openai_surface_split)
- Update architecture refactor foundation milestone
2026-06-06 12:18:33 +09:00