iop/apps/edge/internal/service
toki ca5eb4685c fix(edge): provider-pool thinking과 queue 정책을 정리한다
vLLM-MLX provider-pool에서 strict output이 thinking을 끄지 않도록 하고, queue_timeout_ms=0을 IOP queue timeout 없음으로 해석해야 한다. long reasoning/long-context 요청은 IOP queue timeout이 아니라 caller cancellation과 backend timeout 정책으로 제어한다.
2026-07-06 10:16:43 +09:00
..
control_command.go
model_queue.go fix(edge): provider-pool thinking과 queue 정책을 정리한다 2026-07-06 10:16:43 +09:00
model_queue_test.go fix(edge): provider-pool thinking과 queue 정책을 정리한다 2026-07-06 10:16:43 +09:00
node_command.go feat(edge): provider availability capacity queue foundation 2026-06-14 17:19:06 +09:00
run_dispatch.go fix(edge): provider-pool thinking과 queue 정책을 정리한다 2026-07-06 10:16:43 +09:00
run_dispatch_internal_test.go
service.go feat(edge): runtime config refresh mechanism implementation 2026-06-21 21:35:50 +09:00
service_internal_test.go feat: long context admission support - refactor edge server, add input estimator 2026-07-05 19:26:06 +09:00
service_test.go feat: long context admission support - refactor edge server, add input estimator 2026-07-05 18:18:58 +09:00
status_provider.go feat: edge runtime model queue and status dispatch updates 2026-07-05 20:01:27 +09:00
status_provider_test.go feat: edge runtime model queue and status dispatch updates 2026-07-05 20:01:27 +09:00