ModelRunner:输入可以省写,输出合同保持一致
用真实 Provider 端口执行一次模型交互,返回 value 和本次 invocation。
invoke('文本') 与 invoke({input:'文本'}) 都返回 ModelResult<string>;输入省写不产生第二套输出格式。结构化传输只改变 value 的类型,不切换为裸结果。错误通过 Promise 拒绝。
Runner 是请求级执行对象:调用次数和 journal 会累积,不应把已经用尽预算的 Runner 当成永久单例。稳定模型配置可绑定到 Engine,每次 Workflow 执行会获得请求内 Runner。
默认值来自 modelRunnerDefaults,属于缺参时的运行基线,不是供应商容量或所有场景的最佳值。字符正文、传输声明、输出字符和 token 预留是不同预算。没有明确 token 计数器时,不猜测字符/token 比例。lastCall 是最近完成的快照,不能用它关联并发请求,应使用各次返回的 invocation。
由简到繁的同业务示例
同一输出的两种输入
入门 · Node.js
ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages: readonly { content: string }[]) {
yield '收到:' + messages.at(-1)!.content;
},
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages) {
yield '收到:' + messages.at(-1).content;
},
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);增加预算与请求取消
配置 · Node.js
ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages: readonly { content: string }[]) {
yield '收到:' + messages.at(-1)!.content;
},
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
maxOutputChars: 2000, callTimeoutMs: 15000,
execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages) {
yield '收到:' + messages.at(-1).content;
},
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
maxOutputChars: 2000, callTimeoutMs: 15000,
execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);增加独立的有序输出接收器
扩展 · Node.js
sink.output 按序等待。model.output 是尚未完整校验的提议,不能在此执行模型提出的工具操作。
ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages: readonly { content: string }[]) {
yield '收到:' + messages.at(-1)!.content;
},
};
const events: string[] = [];
const runner = new ModelRunner({ provider, sink: {
async output(event) { events.push(event.type); },
} });
const result = await runner.invoke('你好');
console.log(result.value, events);js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
async *stream(messages) {
yield '收到:' + messages.at(-1).content;
},
};
const events = [];
const runner = new ModelRunner({ provider, sink: {
async output(event) { events.push(event.type); },
} });
const result = await runner.invoke('你好');
console.log(result.value, events);