ModelRunnerOptions

CORE · type · 类型合同

Full runner construction options: provider, transports, sinks and named limits.

导入

TypeScript

import type { ModelRunnerOptions } from '@jangts/agent-core/model';

JavaScript

/** @typedef {import('@jangts/agent-core/model').ModelRunnerOptions} ModelRunnerOptions */

其他公开入口：@jangts/agent-core、@jangts/agent-core/model、@jangts/agent-core/types、@jangts/agent-core/structs。

定义

类型： ModelRunnerOptions<Transports>

泛型参数

类型参数	约束	默认类型
Transports	readonly ModelTransportDefinition[]	readonly ModelTransportDefinition[]

字段结构

字段	类型	必需	说明
provider	ChatProvider	必需	见类型定义及调用场景。
execution	ExecutionOptions | undefined	可省略	见类型定义及调用场景。
transports	Transports | undefined	可省略	见类型定义及调用场景。
sink	{ output?: ModelRunnerPorts["onOutput"]; } | undefined	可省略	见类型定义及调用场景。
errors	{ inputBudget?: ModelRunnerPorts["inputBudgetError"]; outputBudget?: ModelRunnerPorts["outputBudgetError"]; } | undefined	可省略	见类型定义及调用场景。
children	ModelChildPolicy | undefined	可省略	只读。见类型定义及调用场景。
maxInputChars	number | undefined	可省略	Character budget for the assembled input.
maxSchemaChars	number | undefined	可省略	Character allowance for registered capability schemas.
tokenBudget	ModelTokenBudget | undefined	可省略	见类型定义及调用场景。
maxOutputTokens	number | undefined	可省略	Default output reservation; invoke can override it for one call.
maxCalls	number | undefined	可省略	Calls allowed for the whole request, including descendant runners' reservations.
callTimeoutMs	number | undefined	可省略	Deadline for one provider call, in milliseconds.
maxOutputChars	number | undefined	可省略	Cap on streamed output characters; exceeding it fails the call.
usage	boolean | undefined	可省略	Request and record provider usage for each call.

使用示例

• ModelRunner：输入可以省写，输出合同保持一致：用真实 Provider 端口执行一次模型交互，返回 value 和本次 invocation。

同一输出的两种输入

入门 · Node.js

TypeScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到：' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);

JavaScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到：' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);

增加预算与请求取消

配置 · Node.js

TypeScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到：' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
  maxOutputChars: 2000, callTimeoutMs: 15000,
  execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);

JavaScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到：' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
    maxOutputChars: 2000, callTimeoutMs: 15000,
    execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);

相关策略源码

• Core 的基础预算缺省值

相关定义

• ChatProvider
• ExecutionOptions
• ModelChildPolicy
• ModelRunnerPorts
• ModelRunnerSettings
• ModelTokenBudget
• ModelTransportDefinition