Commit graph

27 commits

Author SHA1 Message Date
b38f978652 feat: update edge config runtime refresh, openai compatible provider, and mapper 2026-07-11 09:48:54 +09:00
0bfcb0f189 feat: usage metrics - identity metering, usage token logging, and runtime proto 2026-07-10 17:54:23 +09:00
toki
b6363f7dd2 feat(openai): explicit reasoning 보존 로직 추가 및 관련 핸들러 개선
Strict output 모드에서 reasoning이 명시적으로 요청된 경우 이를 보존할 수 있도록
normalizeCompletionOutput 함수와 관련 핸들러들의 로직을 업데이트한다.
2026-07-09 11:23:34 +09:00
toki
909f916df8 fix(openai): passthrough 응답 모델 alias를 보존한다 2026-07-08 16:14:14 +09:00
893aad6edb sync: edge openai raw tunnel sideband passthrough - contracts, specs, implementation, and tests 2026-07-08 07:51:23 +09:00
1bf5eec31a sync: edge openai raw tunnel sideband passthrough implementation, stream and test updates, roadmap phase sync 2026-07-08 07:17:40 +09:00
fc16a1e05c feat(edge): implement openai compatible raw tunnel sideband passthrough for edge stream
- Implement stream.go with sideband passthrough support
- Update chat_handler.go with streaming handler changes
- Add run_dispatch.go with new dispatch service logic
- Add server tests for streaming and sideband functionality
- Archive old plan/code-review docs for cloud-G07
2026-07-08 06:18:00 +09:00
59e09cdb07 refactor: mattermost 통합 정리 및 openai tool boundary 개선 2026-07-06 21:06:36 +09:00
2b3793149c fix(edge/openai): remove preview fields from production logs
Remove all *_preview zap.String/Any fields from OpenAI-compatible log
calls (chat_handler, responses_handler, stream) so that prompt, content,
reasoning, source, and delta values are never written in plain to
operational logs.

Replace preview fields with non-content metadata:
  - prompt_len, content_len, reasoning_len, delta_len, source_len
  - message_count, content_len, finish_reason, tool_call_count

Also remove the now-unused previewString helper from types.go.

Add log_safety_test.go with regression tests that:
  - verify no *_preview fields exist on any log line
  - verify operational metadata fields are retained for observability
  - verify logOpenAICompatStreamOutput does not emit delta_preview
2026-07-06 15:21:50 +09:00
9b64a26f18 Update roadmap and openai server implementation 2026-07-05 05:19:02 +09:00
59e55d409e feat: openai-compatible tool call boundary hardening & knowledge tool optimization 2026-07-04 18:21:27 +09:00
0ca170013d feat: openai-compatible tool call boundary hardening changes 2026-07-04 17:31:03 +09:00
9b4c6ac644 feat: edge server-side streaming refactoring and contract/docs update 2026-07-04 13:46:39 +09:00
77ab36cbd1 feat: edge config refresh and OpenAI handlers update
- Add config refresh classification and test coverage
- Update OpenAI chat/responses/stream handlers with config refresh support
- Add comprehensive server tests for config refresh
- Update local dev guide with config refresh information
- Extend config package with ConfigRefresh field
2026-07-04 09:33:00 +09:00
37bab752d0 feat(openai): think 컨트롤 필드 전달과 include_reasoning 옵션을 지원한다
node 어댑터에서 think, reasoning_effort, thinking_token_budget 필드를
vllm, lemonade 등 제공자별로 변환하여 전달하도록 변경한다.
vllm은 chat_template_kwargs로, lemonade는 직접 필드로 전달한다.
에드지는 include_reasoning=false일 때 reasoning_content를
스트림과 비스트림 응답에서 모두 삭제하도록 변경한다.
관련 테스트를 추가한다.
2026-07-03 15:05:39 +09:00
9ecf7f9fef feat: add OpenAI compat stream trace logging
- Add stream trace logging to edge server streamChatCompletion
- Add stream trace logging to node adapter openai_compat provider
- Enable trace via IOP_OPENAI_COMPAT_TRACE_STREAM env var or iop_trace_stream metadata
- Track content, reasoning, tool_calls chunks with think tag detection
2026-07-03 11:54:26 +09:00
c3b40cbe1c feat(edge): tool validation contract and chat completion retry 2026-07-03 05:08:02 +09:00
90bce8336f feat: edge openai handler updates and node provider first config surface
- Modify edge openai chat/stream handlers for priority routing
- Update responses_handler and run_result
- Add model queue test updates
- Add node provider first config surface task
- Archive inflight accounting recovery docs
2026-07-01 10:44:48 +09:00
e66e9fd236 feat(openai): stream 개선 및 테스트 추가 2026-06-28 06:57:20 +09:00
ea7388cfe9 fix(openai): native tool unsupported fallback 추가 2026-06-27 22:24:06 +09:00
a32264e908 fix(openai): native tool 인자를 schema에 맞춘다 2026-06-27 22:06:43 +09:00
7dc0788f88 fix(openai): provider tool call을 그대로 전달한다 2026-06-27 21:44:49 +09:00
135259619e fix(openai): Cline 도구 호출 변환을 지원한다
Cline이 텍스트 XML 블록으로 도구 호출을 내보내는 경우 OpenAI-compatible tool_calls 응답으로 변환해야 클라이언트 실행 루프가 멈추지 않는다.

Node resource model 로드맵과 agent-task 문서는 요청된 전체 변경 범위에 포함한다.
2026-06-27 13:16:49 +09:00
747fa27fa7 feat: update inference provider extension phase and edge app changes
- Update PHASE.md for inference-provider-extension
- Archive vllm-provider-serving-validation milestone and SDD
- Update edge app OpenAI handlers (chat, responses, stream, run_result)
- Update tests and e2e scripts for vLLM integration
- Update READMEs for edge and node apps
2026-06-18 09:45:38 +09:00
b963e13bf9 fix(edge): run stream 종료 시 실패 경로를 고정한다
run stream 또는 node event 채널이 조기에 닫히는 경우에도 nil/closed 상태를 안전하게 처리해 무한 대기를 막고, A2A/OpenAI 경로가 일관되게 오류를 반환하도록 하여 예외 상태에서 서비스 장애 전파를 개선한다.
2026-06-09 04:13:27 +09:00
672b4cdb5d refactor(bridge): 실행 경계 선행 안정화를 반영한다
원격 터미널 브리지 POC 전에 Client HTTP lifecycle과 Edge run result surface 계약을 고정해야 하므로 관련 구현, 테스트, 로드맵 상태를 함께 정리한다.
2026-06-07 08:40:36 +09:00
6b684ee5cf refactor: edge service split and OpenAI surface separation
- Split edge service into dedicated modules (control_command, node_command, run_dispatch, status_provider)
- Separate OpenAI handlers (chat_handler, ollama_passthrough, routes, stream, strict_output, types)
- Archive completed milestone documents (02_edge_service_split, 03+02_openai_surface_split)
- Update architecture refactor foundation milestone
2026-06-06 12:18:33 +09:00