Commit graph

37 commits

Author SHA1 Message Date
0bfcb0f189 feat: usage metrics - identity metering, usage token logging, and runtime proto 2026-07-10 17:54:23 +09:00
toki
ff7330680f refactor: reject transformed mode and responses for provider-pool/tunnel routes 2026-07-09 12:47:20 +09:00
toki
b6363f7dd2 feat(openai): explicit reasoning 보존 로직 추가 및 관련 핸들러 개선
Strict output 모드에서 reasoning이 명시적으로 요청된 경우 이를 보존할 수 있도록
normalizeCompletionOutput 함수와 관련 핸들러들의 로직을 업데이트한다.
2026-07-09 11:23:34 +09:00
893aad6edb sync: edge openai raw tunnel sideband passthrough - contracts, specs, implementation, and tests 2026-07-08 07:51:23 +09:00
1bf5eec31a sync: edge openai raw tunnel sideband passthrough implementation, stream and test updates, roadmap phase sync 2026-07-08 07:17:40 +09:00
fc16a1e05c feat(edge): implement openai compatible raw tunnel sideband passthrough for edge stream
- Implement stream.go with sideband passthrough support
- Update chat_handler.go with streaming handler changes
- Add run_dispatch.go with new dispatch service logic
- Add server tests for streaming and sideband functionality
- Archive old plan/code-review docs for cloud-G07
2026-07-08 06:18:00 +09:00
59e09cdb07 refactor: mattermost 통합 정리 및 openai tool boundary 개선 2026-07-06 21:06:36 +09:00
2b3793149c fix(edge/openai): remove preview fields from production logs
Remove all *_preview zap.String/Any fields from OpenAI-compatible log
calls (chat_handler, responses_handler, stream) so that prompt, content,
reasoning, source, and delta values are never written in plain to
operational logs.

Replace preview fields with non-content metadata:
  - prompt_len, content_len, reasoning_len, delta_len, source_len
  - message_count, content_len, finish_reason, tool_call_count

Also remove the now-unused previewString helper from types.go.

Add log_safety_test.go with regression tests that:
  - verify no *_preview fields exist on any log line
  - verify operational metadata fields are retained for observability
  - verify logOpenAICompatStreamOutput does not emit delta_preview
2026-07-06 15:21:50 +09:00
toki
ca5eb4685c fix(edge): provider-pool thinking과 queue 정책을 정리한다
vLLM-MLX provider-pool에서 strict output이 thinking을 끄지 않도록 하고, queue_timeout_ms=0을 IOP queue timeout 없음으로 해석해야 한다. long reasoning/long-context 요청은 IOP queue timeout이 아니라 caller cancellation과 backend timeout 정책으로 제어한다.
2026-07-06 10:16:43 +09:00
5b95208f4c feat: edge runtime model queue and status dispatch updates
- Update control-plane edge wire and edge-node runtime wire contracts
- Refactor model queue service with admission control
- Update chat handler and responses handler for edge
- Modify run dispatch and status provider logic
- Add/modify runtime proto definitions
- Move G07 status logs to archive
2026-07-05 20:01:27 +09:00
2c9faad1f3 feat: long context admission support - refactor edge server, add input estimator 2026-07-05 18:18:58 +09:00
59e55d409e feat: openai-compatible tool call boundary hardening & knowledge tool optimization 2026-07-04 18:21:27 +09:00
9b4c6ac644 feat: edge server-side streaming refactoring and contract/docs update 2026-07-04 13:46:39 +09:00
77ab36cbd1 feat: edge config refresh and OpenAI handlers update
- Add config refresh classification and test coverage
- Update OpenAI chat/responses/stream handlers with config refresh support
- Add comprehensive server tests for config refresh
- Update local dev guide with config refresh information
- Extend config package with ConfigRefresh field
2026-07-04 09:33:00 +09:00
37bab752d0 feat(openai): think 컨트롤 필드 전달과 include_reasoning 옵션을 지원한다
node 어댑터에서 think, reasoning_effort, thinking_token_budget 필드를
vllm, lemonade 등 제공자별로 변환하여 전달하도록 변경한다.
vllm은 chat_template_kwargs로, lemonade는 직접 필드로 전달한다.
에드지는 include_reasoning=false일 때 reasoning_content를
스트림과 비스트림 응답에서 모두 삭제하도록 변경한다.
관련 테스트를 추가한다.
2026-07-03 15:05:39 +09:00
3e1248d584 chore: update knowledge-tool-optimization-extension phase, SDD, and openai changes 2026-07-03 14:29:51 +09:00
c3b40cbe1c feat(edge): tool validation contract and chat completion retry 2026-07-03 05:08:02 +09:00
90bce8336f feat: edge openai handler updates and node provider first config surface
- Modify edge openai chat/stream handlers for priority routing
- Update responses_handler and run_result
- Add model queue test updates
- Add node provider first config surface task
- Archive inflight accounting recovery docs
2026-07-01 10:44:48 +09:00
9529af8dfc fix(openai): store 요청 필드를 호환 처리한다 2026-06-27 23:50:23 +09:00
ea7388cfe9 fix(openai): native tool unsupported fallback 추가 2026-06-27 22:24:06 +09:00
a32264e908 fix(openai): native tool 인자를 schema에 맞춘다 2026-06-27 22:06:43 +09:00
7dc0788f88 fix(openai): provider tool call을 그대로 전달한다 2026-06-27 21:44:49 +09:00
135259619e fix(openai): Cline 도구 호출 변환을 지원한다
Cline이 텍스트 XML 블록으로 도구 호출을 내보내는 경우 OpenAI-compatible tool_calls 응답으로 변환해야 클라이언트 실행 루프가 멈추지 않는다.

Node resource model 로드맵과 agent-task 문서는 요청된 전체 변경 범위에 포함한다.
2026-06-27 13:16:49 +09:00
912e900244 feat(runtime): workspace_root 제거와 tool 호환을 반영한다
Node store/workspace 위치를 Edge가 내려주는 runtime payload에서 분리한다. Chat Completions tool 요청은 내부 실행에서 tool_choice=none으로 낮춰 downstream 자동 tool 호출 요구로 실패하지 않게 맞춘다.
2026-06-27 11:32:45 +09:00
46bd8563e2 feat: OpenAI compatible API 변경 사항 적용
- agent-contract: OpenAI compatible API 계약 문서 업데이트
- apps/edge: OpenAI API smoke/test 스크립트 및 핸들러 개선
- scripts: e2e 테스트 스크립트 업데이트
2026-06-27 05:16:25 +09:00
445716cc3e feat(edge): runtime config refresh mechanism implementation
- Add configrefresh package for config classification, request handling
- Add bootstrap refresh_admin.go for admin-level config refresh
- Add edgevalidate package for config validation
- Update edge bootstrap runtime with refresh capabilities
- Update edge service layer with config refresh integration
- Update openai layer routes/chat_handler/server for config refresh
- Update edgecmd config handling with refresh support
- Update input manager, transport server, status provider
- Add edge.yaml config updates and go/config package changes
- Add hostsetup templates and test updates
- Update roadmap and phase documentation for runtime-reconnect-config-refresh
2026-06-21 21:35:50 +09:00
06f1d36fa3 feat: provider catalog device status - edge dispatch implementation
- Add agent-task archive for 02+01_edge_dispatch
- Remove outdated plan and code review docs
- Update edge bootstrap, input manager, and openai handlers
- Update model queue, run dispatch, and service layer
- Add status provider tests
2026-06-20 16:59:55 +09:00
747fa27fa7 feat: update inference provider extension phase and edge app changes
- Update PHASE.md for inference-provider-extension
- Archive vllm-provider-serving-validation milestone and SDD
- Update edge app OpenAI handlers (chat, responses, stream, run_result)
- Update tests and e2e scripts for vLLM integration
- Update READMEs for edge and node apps
2026-06-18 09:45:38 +09:00
957700c2d6 feat: model route queue policy alignment phase added and edge service updates
- Add model-route-queue-policy-alignment milestone to inference provider extension phase
- Add SDD documentation for inference provider extension
- Update edge chat/responses handlers for OpenAI compatible API
- Update edge config with new queue policy settings
- Add config tests for queue policy support
- Update task tracking for model route queue policy alignment
2026-06-16 22:30:36 +09:00
dba289d0fa feat(edge): 모델 그룹 큐 스케줄링 구현
- 모델 그룹별 큐 기반 디스패팅 로직 추가
- ModelQueue 관리자로 모델 인스턴스 큐 처리
- OpenAPI chat 및 responses 핸들러 업데이트
- edge 서비스 테스트 코드 개선
2026-06-16 10:16:05 +09:00
c34fec8f6b chore: update edge openai handlers and reorganize task archive 2026-06-13 17:18:21 +09:00
ca9fcd12a9 feat: openai workspace agent execution contract implementation
- Add workspace boundary enforcement for edge OpenAI API
- Update edge config with workspace settings
- Refactor catalog routing for workspace-scoped agents
- Move completed task to archive
- Update e2e scripts and documentation
2026-06-13 16:54:59 +09:00
a758926593 feat: openai workspace agent execution contract milestone and edge updates
- Add milestone doc for openai-workspace-agent-execution-contract
- Update edge chat/responses handlers and types
- Update edge service run dispatch logic
- Add edge and service tests
- Update edge README
2026-06-13 16:33:00 +09:00
738bd1939c feat: m-node-multi-target-serving-foundation G07/G08 work - route catalog, engine profiles, edge/node updates 2026-06-11 14:43:24 +09:00
80fcbca74f feat(edge): Responses 입력 표면을 추가한다
NomadCode Core가 OpenAI Responses shape로 Edge 실행을 요청할 수 있도록 non-streaming /v1/responses 경계와 metadata 전달, smoke 검증을 함께 고정한다.
2026-06-08 15:16:25 +09:00
672b4cdb5d refactor(bridge): 실행 경계 선행 안정화를 반영한다
원격 터미널 브리지 POC 전에 Client HTTP lifecycle과 Edge run result surface 계약을 고정해야 하므로 관련 구현, 테스트, 로드맵 상태를 함께 정리한다.
2026-06-07 08:40:36 +09:00
6b684ee5cf refactor: edge service split and OpenAI surface separation
- Split edge service into dedicated modules (control_command, node_command, run_dispatch, status_provider)
- Separate OpenAI handlers (chat_handler, ollama_passthrough, routes, stream, strict_output, types)
- Archive completed milestone documents (02_edge_service_split, 03+02_openai_surface_split)
- Update architecture refactor foundation milestone
2026-06-06 12:18:33 +09:00