AI 智能体 model-serving 更新于 2026-11-05

Model Serving 工程规则

Model serving rules: pinned model revisions and measured latency budgets

✓ 应当这么做

✓ Bootstrap a host with a single idempotent script or image, not interactive steps
✓ Expose the smallest possible port surface and pin TLS configuration
✓ Keep runtime configuration in versioned files under the operator account

42 篇

Vector search rules: chunking strategy, recall evaluation and index rebuild path

Feature store rules: point-in-time correctness and train/serve parity

Skill design rules: narrow triggers, explicit boundaries and verifiable outputs

Tool-call rules: server-side authorisation and deny-by-default allow-lists

Memory rules: scoped retrieval, expiry and user-visible deletion

RAG rules: citation-grade retrieval and evaluated recall before shipping