Add eight AgentX-era glossary terms and refresh nine definitions / 新增八条 AgentX 相关术语并更新九条释义 - #850
Merged
Merged
Conversation
Two weeks of AgentX work shipped concepts the glossary did not define, and left several existing entries describing behavior the dashboard no longer has. Add entries for E2E Normalized Interactivity (#847, #848), tokens per dollar (#770, #787, #793), energy per token (#734, #735), context parallelism (#745), KV cache offload (#729, #818), KV cache manager, KV-aware routing, and TileRT (#843). Refresh nine entries against current behavior: agentic curves merge speculative decoding into point-level metadata (#695) while fixed-sequence curves still split on it; best-per-SKU views merge permitted optimizations into one curve; cost and energy are derived from interpolated throughput rather than splined (#726); AgentX is the deliberate exception to the prefix-caching-disabled rule; agentic ISL/OSL is a lognormal distribution rather than a single pair (#810, #811). 中文:新增八条 AgentX 相关术语并更新九条既有释义。新增:端到端归一化交互性、 每美元 token 数、每 token 能耗、上下文并行、KV cache offload、KV cache 管理器、 KV 感知路由和 TileRT。更新内容对齐当前行为:agentic 曲线把投机解码作为数据点级 元数据合并(定长场景仍按曲线区分);每个 SKU 最佳配置视图合并允许的优化;成本与 能耗由插值吞吐量推导而非单独样条;AgentX 是禁用前缀缓存规则的有意例外;agentic 的 ISL/OSL 是对数正态分布而非单一取值。中英文条目同步更新。
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
I read the 104 commits merged since 2026-08-11 and pulled out the concepts that became user-visible in that window but had no glossary entry, plus the entries whose text now describes behavior the dashboard no longer has. Both languages updated in the same change.
Glossary is 54 entries → 62.
New terms (8)
kv_offload_backendis recorded run metadata; Mooncake / LMCache / HiCache sit under the enginesEach entry follows the existing shape: plain-English gloss, definition, mechanism, why it matters, and an InferenceX-specific
benchmarkContextthat says how to read it on this dashboard rather than restating the definition.Refreshed definitions (9)
Corrections, not cosmetic edits:
speculative-decodingsaid InferenceX "distinguishes MTP-enabled and disabled curves". Since Merge mixed speculative decoding points on agentic curves #695 that is only true for fixed-sequence scenarios; agentic curves treat spec decode as point-level metadata and merge the points. Also records the fixed acceptance-length methodology, which exists because replayed AgentX content is synthetic.kv-cacheandprefix-cachingboth said prefix caching is disabled on random data. Still true for fixed-sequence, but AgentX is the deliberate exception: reuse is the property being measured, and hit rate is a reported per-point quantity.iso-interactivitynow records the rule from fix(inference): derive $/M tok and J/token from throughput instead of splining them / 每 token 成本与能耗改为按吞吐量推导而非直接插值 #726 — the frontier is built on throughput vs interactivity, and $/M tok and J/token are derived from the interpolated throughput rather than splined separately, because splining a per-chip constant over throughput breaks the identity between knots.pareto-frontiernow explains that best-per-SKU views merge permitted optimizations into one curve per model/SKU/engine, so adjacent points on a line can differ in spec decode, disaggregation, or offload.input-output-sequence-lengthnow covers agentic runs, where there is no single ISL/OSL pair to quote and the point view plots a fitted lognormal with percentiles (feat(inference): plot agentic ISL/OSL distributions as lognormal / 将智能体 ISL/OSL 分布改为对数正态呈现 #810, feat: show resident ISL and OSL percentiles #811).interactivity,performance-per-dollar,tokens-per-megawattcross-link to the new metrics that supersede or complement them on the current axes.Notes for reviewers
getAllGlossaryEntries()/getAllZhGlossaryEntries(), so/glossary/*and/zh/glossary/*pick up all eight terms automatically in both languages.articleSlugson the new entries point only at posts that actually discuss the term; most cite the AgentX v3 port, which is where these concepts are documented at length.Verification
bun run test:unit— 4,772 tests pass. The relevant guards:glossary.test.ts(unique slugs, 8–40 word plain-English gloss, ≥90 word body, ≥3 resolvable related terms, ≥1 real article, no em/en dashes, complete zh translation with a Han-character floor and distinctmeasurementlabels) andzh-copy.test.ts(mechanical Chinese rules, including the untranslated-chipand duplicated-loanword checks).bun run lint,bun run fmt,bun run typecheckclean.中文说明
我梳理了 2026-08-11 以来合入的 104 个提交,挑出这段时间内新出现在用户界面、但术语表尚未收录的概念,以及释义已经与仪表板当前行为不符的条目,中英文在同一 PR 中同步更新。术语表条目从 54 条增加到 62 条。
新增术语(8 条)
kv_offload_backend已作为运行元数据记录;Mooncake / LMCache / HiCache 位于引擎之下每条新增条目都沿用既有结构:通俗解释、定义、机制、意义,以及说明在本仪表板上如何解读的
benchmarkContext,而不是重复定义。更新释义(9 条)
这些是纠错而非文字润色:
speculative-decoding原文称 InferenceX「区分开启和关闭 MTP 的曲线」。自 Merge mixed speculative decoding points on agentic curves #695 起这只对定长场景成立,agentic 曲线已把投机解码作为数据点级元数据并合并这些点。同时补充了固定接受长度的方法说明——之所以需要它,是因为 AgentX 回放内容是合成的。kv-cache与prefix-caching原本都称在随机数据上禁用前缀缓存。这对定长场景仍然成立,但 AgentX 是有意为之的例外:复用正是被测量的性质,命中率是逐点上报的指标。iso-interactivity补充了 fix(inference): derive $/M tok and J/token from throughput instead of splining them / 每 token 成本与能耗改为按吞吐量推导而非直接插值 #726 的规则:前沿建立在吞吐量与交互性之上,每百万 token 成本和每 token 焦耳由插值吞吐量推导,而不是各自单独做样条,否则会破坏「每芯片常数除以吞吐量」这一恒等关系。pareto-frontier说明每个 SKU 最佳配置视图会把允许的优化合并成一条曲线,因此同一条线上相邻的点可能在投机解码、分离式部署或 offload 上不同。input-output-sequence-length补充了 agentic 运行的情况:没有单一 ISL/OSL 取值可引用,点详情视图会绘制拟合的对数正态分布并给出分位数(feat(inference): plot agentic ISL/OSL distributions as lognormal / 将智能体 ISL/OSL 分布改为对数正态呈现 #810、feat: show resident ISL and OSL percentiles #811)。interactivity、performance-per-dollar、tokens-per-megawatt增加了与新指标的交叉链接。评审提示
getAllGlossaryEntries()/getAllZhGlossaryEntries()派生,因此/glossary/*与/zh/glossary/*会自动收录全部八条术语。articleSlugs只指向确实讨论该术语的文章,多数引用 AgentX v3 移植文,因为这些概念在那里有充分说明。验证
bun run test:unit— 4,772 项测试通过。相关守卫:glossary.test.ts(slug 唯一性、通俗解释 8–40 词、正文 ≥90 词、≥3 个可解析的相关术语、≥1 篇真实文章、禁用长破折号、中文翻译完整且汉字数量达标、measurement标签需与英文不同)与zh-copy.test.ts(机械性中文规则,包括未翻译的chip和重复借词检查)。bun run lint、bun run fmt、bun run typecheck均通过。🤖 Generated with Claude Code
Note
Low Risk
Documentation-only changes to glossary data in two lib files; no runtime logic, auth, or API behavior changes.
Overview
Expands the InferenceX glossary from 54 to 62 entries by adding eight AgentX-era concepts in
glossary.tswith matchingglossary-zh.tstranslations. New terms cover dashboard-visible metrics and serving features: E2E Normalized Interactivity, tokens per dollar (default chart Y-axis), energy per token, context parallelism (PCP/DCP), KV cache offload, KV cache manager, KV-aware routing, and TileRT.Nine existing entries get corrected
benchmarkContext(not cosmetic copy): fixed-sequence vs AgentX behavior for prefix caching and speculative decoding; iso-interactivity derivation of cost/energy from interpolated throughput; Pareto best-per-SKU merged curves; agentic ISL/OSL distributions; and cross-links from interactivity, perf/$, and tokens/MW to the new metrics.relatedTermsare updated so glossary navigation stays consistent.No new routes or files—
/glossary/*and/zh/glossary/*pick up slugs fromgetAllGlossaryEntries()/getAllZhGlossaryEntries()automatically.Reviewed by Cursor Bugbot for commit b4d5c6c. Bugbot is set up for automated code reviews on this repo. Configure here.