Commit graph

15 commits

Author SHA1 Message Date
toki
ca5eb4685c fix(edge): provider-pool thinking과 queue 정책을 정리한다
vLLM-MLX provider-pool에서 strict output이 thinking을 끄지 않도록 하고, queue_timeout_ms=0을 IOP queue timeout 없음으로 해석해야 한다. long reasoning/long-context 요청은 IOP queue timeout이 아니라 caller cancellation과 backend timeout 정책으로 제어한다.
2026-07-06 10:16:43 +09:00
5b95208f4c feat: edge runtime model queue and status dispatch updates
- Update control-plane edge wire and edge-node runtime wire contracts
- Refactor model queue service with admission control
- Update chat handler and responses handler for edge
- Modify run dispatch and status provider logic
- Add/modify runtime proto definitions
- Move G07 status logs to archive
2026-07-05 20:01:27 +09:00
35eb21959f feat: queue skip support in model queue 2026-07-05 19:50:11 +09:00
b2754b871f feat: long context admission support - refactor edge server, add input estimator 2026-07-05 19:26:06 +09:00
b55d1a2e85 fix: document and verify provider priority leveling 2026-07-04 15:05:36 +09:00
c0d2748361 feat(edge): model queue priority routing with runtime config refresh
- Add classify.go/classify_test.go for config-based priority routing
- Add model_queue.go/test with priority queue support
- Update run_dispatch.go to use priority routing
- Add edge.yaml config for model priority settings
- Add config.go/config_test.go for priority config parsing
- Remove G06 priority routing plan/review (merged into main flow)
- Add archive for m-node-provider-first-config-surface task
2026-07-01 21:07:29 +09:00
f8d4e12e43 feat: routing status refresh and config validation updates 2026-06-30 09:47:34 +09:00
e30fb2494e feat(edge): node resource model unification - update phase/SDD docs and edge service
- Move node-resource-model-unification milestone and SDD to archive
- Update PHASE.md for operational-observability-provider-management
- Refactor edge node registration and model queue logic
- Add status provider tests for model queue validation
- Update edge config and Go config structs
2026-06-29 14:39:27 +09:00
b7801ee0af refactor(edge): unify resource model, update dispatch & status, add tests, clean up review docs 2026-06-28 22:46:49 +09:00
c341d622ea implement round-robin rotation for equal-ratio candidate selection in model queue
- Replace float64 ratio comparison with integer-only load ratio math
  to avoid floating-point precision issues.
- Collect all equal-ratio candidates and rotate via lastSelectedSlot so
  equally loaded providers do not pin to a single provider.
- Add loadRatioLess and loadRatioEqual helper functions.
- Track lastSelectedSlot in admit and tryDispatchLocked paths.
2026-06-24 22:43:37 +09:00
6706b5e1da feat(edge): runtime reconnect config refresh 구현 및 테스트 개선
- Edge 노드 runtime 재연결 시 설정 리프레시 로직 구현
- configrefresh classify/result 모듈 개선
- bootstrap refresh_admin 및 runtime 관련 코드 refactor
- model_queue 및 edgecmd 테스트 개선
- 관련 test 파일의 assertion 및 mock 구조 개선
2026-06-21 23:19:05 +09:00
06f1d36fa3 feat: provider catalog device status - edge dispatch implementation
- Add agent-task archive for 02+01_edge_dispatch
- Remove outdated plan and code review docs
- Update edge bootstrap, input manager, and openai handlers
- Update model queue, run dispatch, and service layer
- Add status provider tests
2026-06-20 16:59:55 +09:00
69efa4ea3f feat: provider catalog device status implementation
- Add provider catalog and device status management for edge nodes
- Update edge config and model queue services
- Add status provider tests
- Update proto definitions for runtime
- Add agent-task for m-provider-catalog-device-status
2026-06-20 08:54:18 +09:00
bcc60ff48c feat: edge model group queue scheduling improvements
- Add status_provider_test.go for queue status coverage
- Update model_queue.go with queue simplification
- Update run_dispatch.go with dispatch logic improvements
- Update status_provider.go with status tracking
- Update server tests for a2a, openai, and opsconsole
- Remove archived PLAN and CODE_REVIEW documents for 02+01 surface snapshot contract
- Archive 02+01_surface_snapshot_contract to 2026/06
2026-06-16 10:58:30 +09:00
dba289d0fa feat(edge): 모델 그룹 큐 스케줄링 구현
- 모델 그룹별 큐 기반 디스패팅 로직 추가
- ModelQueue 관리자로 모델 인스턴스 큐 처리
- OpenAPI chat 및 responses 핸들러 업데이트
- edge 서비스 테스트 코드 개선
2026-06-16 10:16:05 +09:00