Simon Willison·· 3 小时前AI 评分18
llm-echo 0.5 发布:调试插件更新 token 用量统计
llm-echo 0.5
AI 导读
Simon Willison 发布 llm-echo 0.5,这个不调用 LLM、只回显提示词的调试插件现在会把工具调用、系统提示词和推理 token 计入模拟的 token 用量。示例中 `llm -m echo 'hi there' -o thinking 1 --usage` 显示 2 input、24 output token。
正文
I'm working towards a new LLM release, and testing PRs caused me to revisit the llm-echo debug plugin. This plugin provides a "model" which doesn't involve an LLM at all - it just repeats back the prompts that have been fed to it. The new release now updates the simulated token usage counts to take tool calls, system prompts, and reasoning tokens into account.
Example usage:
uvx --with llm-echo llm -m echo 'hi there' -o thinking 1 --usage
Outputs:
First I consider the prompt, then I decide what to say.
{
"prompt": "hi there",
"system": "",
"attachments": [],
"stream": true,
"previous": []
}
Token usage: 2 input, 24 output
来源:Simon Willison · simonwillison.net