ModelRunnerPorts

CORE · interface · 类型合同

Host ports a model runner needs in addition to its provider and transports.

导入

TypeScript

import type { ModelRunnerPorts } from '@jangts/agent-core/model';

JavaScript

/** @typedef {import('@jangts/agent-core/model').ModelRunnerPorts} ModelRunnerPorts */

其他公开入口：@jangts/agent-core、@jangts/agent-core/model、@jangts/agent-core/types、@jangts/agent-core/structs。

定义

interface ModelRunnerPorts

字段结构

字段	类型	必需	说明
onOutput	((event: ModelOutputEvent) => void | Promise<void>) | undefined	可省略	Ordered delivery of model events; awaits each call before continuing.
transports	readonly ModelTransportDefinition<unknown>[] | undefined	可省略	Transports available by id and instance.
diagnostics	DiagnosticContext | undefined	可省略	见类型定义及调用场景。
maxSchemaChars	number | undefined	可省略	Separate allowance for registered schemas; existing context budgets keep their meaning.
tokenBudget	ModelTokenBudget | undefined	可省略	见类型定义及调用场景。
inputBudgetError	((limit: number) => Error) | undefined	可省略	Builds the error for an input that exceeds the character or token limit.
outputBudgetError	(() => Error) | undefined	可省略	Builds the error for output that exceeds the character limit.

使用示例

• ModelRunner：输入可以省写，输出合同保持一致：用真实 Provider 端口执行一次模型交互，返回 value 和本次 invocation。

同一输出的两种输入

入门 · Node.js

TypeScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到：' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);

JavaScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到：' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider });
const first = await runner.invoke('你好');
const second = await runner.invoke({ input: '你好' });
console.log(first.value, second.value);
console.log(first.invocation.invocationId);

增加预算与请求取消

配置 · Node.js

TypeScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
  async *stream(messages: readonly { content: string }[]) {
    yield '收到：' + messages.at(-1)!.content;
  },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
  maxOutputChars: 2000, callTimeoutMs: 15000,
  execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);

JavaScript

import { ModelRunner } from '@jangts/agent-core/model';
const provider = {
    async *stream(messages) {
        yield '收到：' + messages.at(-1).content;
    },
};
const runner = new ModelRunner({ provider, maxCalls: 2, maxInputChars: 4000,
    maxOutputChars: 2000, callTimeoutMs: 15000,
    execution: { signal: AbortSignal.timeout(20000) },
});
const result = await runner.invoke({ input: '你好', stageId: 'reply', maxOutputTokens: 600 });
console.log(result.value, runner.remainingCalls);

相关策略源码

• Core 的基础预算缺省值

相关定义

• DiagnosticContext
• ModelOutputEvent
• ModelTokenBudget
• ModelTransportDefinition