Summary
A governed AI customer-service runtime that supports host mounting, tools, human handoff, knowledge governance, and multi-channel access.
Business Value
Turned AI customer service from simple knowledge Q&A into a governed runtime that can be mounted, connected to business tools, and handed off to humans.
Engineering Depth
Showcases a layered runtime, plugin registry, auth bridging, provider adaptation, knowledge governance, cost governance, RAG evaluation, handoff queues, and multi-tenant boundary control.
Evidence
本地仓库 README / STAR-HIGHLIGHTS / RESUME_SNIPPETS / runtime tests / recent commits
Repository · Confidence High · Verified 2026-06-10
- Evidence level: strict review (core sections only show verifiable metrics)
- Source type: Repository / code records
- Source link: public link provided for independent review
- Verified at: 2026-06-10 (7 days ago, fresh evidence)
Rationale: High confidence: organized under strict evidence rules, traceable to repository or code records, includes an accessible source link, verified 7 days ago.
View evidenceBackground
目标是在统一多通道接入和宿主系统复用的前提下,交付可转人工、可治理、可行业扩展的客服运行时。
Challenge
如果将文本、语音、RTC、业务工具、鉴权和转人工能力写死在单一流程中,宿主系统难接入、租户边界难控制,运行诊断和知识治理也难持续演进。
Action and Results
Solution
- 搭建分层运行时:将渠道接入、宿主桥接、核心引擎、业务增强、插件平台、提供商适配六层解耦,统一 4 类接入模式。
- 设计路由协同机制:通过
route_confidence、intent_stack、page_context、business_objects 组合决策,在低置信度或高风险场景优先澄清或转人工。 - 沉淀插件扩展体系:提供 Route、BusinessTool、Handoff、Industry、AuthBridge、Context、Response 7 类扩展点,支持插件启停、范围过滤与宿主鉴权复用。
- 补齐治理能力:完善知识版本、chunk 优化、反馈闭环、provider billing 与 usage 对账、安全知识缓存、8 个本地 RAG eval cases、SQLite 人工接管队列、外部 readiness 审计、诊断导出、request_id 贯通、限流与提示词脱敏。
Result
交付可独立运行或宿主挂载的客服运行时,形成覆盖业务接入、人工协同、知识治理、成本观测、评测复现、租户隔离与运行审计的工程基线。
Key Signals
设计渠道接入、宿主桥接、核心引擎、业务增强、插件平台、提供商适配六层架构,统一文本、Voice API、RTC WebSocket 与 FastAPI 挂载 4 类接入形态。 实现 `route_confidence` 分层、`intent_stack` 回退及 `page_context` / `business_objects` 感知路由,在低置信度与高风险场景优先澄清或转人工。 提供 Route、BusinessTool、Handoff、Industry、AuthBridge、Context、Response 7 类插件扩展点,支持宿主鉴权复用与业务能力按需挂载。 补齐知识版本管理、chunk 优化、消息级反馈、provider billing 与 usage 对账、安全知识缓存、8 个本地 RAG eval cases、SQLite 人工接管队列、外部 readiness 审计、request_id 贯通、限流与提示词脱敏,强化多租户治理与审计能力。 Tech Stack
PythonFastAPIAsyncIOPydanticOpenAIVoice / RTCQdrantPlugin RuntimeMulti-tenantAuth Bridge