Skip to content
English

ModelRunner:输入可以省写,输出合同保持一致 ​

用真实 Provider 端口执行一次模型交互,返回 value 和本次 invocation。

invoke('文本') 与 invoke({input:'文本'}) 都返回 ModelResult<string>;输入省写不产生第二套输出格式。结构化传输只改变 value 的类型,不切换为裸结果。错误通过 Promise 拒绝。

Runner 是请求级执行对象:调用次数和 journal 会累积,不应把已经用尽预算的 Runner 当成永久单例。稳定模型配置可绑定到 Engine,每次 Workflow 执行会获得请求内 Runner。

默认值来自 modelRunnerDefaults,属于缺参时的运行基线,不是供应商容量或所有场景的最佳值。字符正文、传输声明、输出字符和 token 预留是不同预算。没有明确 token 计数器时,不猜测字符/token 比例。lastCall 是最近完成的快照,不能用它关联并发请求,应使用各次返回的 invocation。

由简到繁的同业务示例 ​

同一输出的两种输入 ​

入门 · Node.js

ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到:' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);
js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到:' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);

增加预算与请求取消 ​

配置 · Node.js

ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到:' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
  maxOutputChars: 2000, callTimeoutMs: 15000,
  execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);
js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到:' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
    maxOutputChars: 2000, callTimeoutMs: 15000,
    execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);

增加独立的有序输出接收器 ​

扩展 · Node.js

sink.output 按序等待。model.output 是尚未完整校验的提议,不能在此执行模型提出的工具操作。

ts
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到:' + messages.at(-1)!.content;
  },
};
const events: string[] = [];
const runner = new ModelRunner({ provider, sink: {
  async output(event) { events.push(event.type); },
} });
const result = await runner.invoke('你好');
console.log(result.value, events);
js
import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到:' + messages.at(-1).content;
    },
};
const events = [];
const runner = new ModelRunner({ provider, sink: {
        async output(event) { events.push(event.type); },
    } });
const result = await runner.invoke('你好');
console.log(result.value, events);

策略与实现 ​

接口参考、使用示例与开发指南。