Tianyi Cui
fd54b5c848
Combine agent initiator scoping and exact Cordis JSDoc inspection with post-step compaction and bounded request recovery. Regenerate the Cordis and website API catalogs, and classify the recovery and compaction types required by the current catalog link-coverage gate.
4.1 KiB
ctx.llm
LlmService — provided by @deepseek-ai/dsh-llm.
The abstract llm service: an adapter registry plus a streaming model-call surface, interceptable via the llm/stream waterfall.
ctx.llm.registerAdapter(providers, adapter)
/**
* Register an adapter for the given provider routes. Throws `LlmError` with code
* `DUPLICATE_ADAPTER` if any provider already has an adapter (all-or-nothing).
* Disposed with the fiber.
* @param providers - every provider route this adapter should serve.
* @param adapter - the adapter that streams calls for those providers.
* @returns the disposer that unregisters all of them.
*/
registerAdapter(providers: string[], adapter: LlmAdapter): () => void
Register an adapter for the given provider routes. Throws LlmError with code DUPLICATE_ADAPTER if any provider already has an adapter (all-or-nothing). Disposed with the fiber.
providers— every provider route this adapter should serve.adapter— the adapter that streams calls for those providers.
Returns the disposer that unregisters all of them.
ctx.llm.listProviders()
/**
* Describe provider routes with a registered adapter.
* @returns detached provider metadata in registration order.
*/
listProviders(): LlmProviderInfo[]
Describe provider routes with a registered adapter.
Returns detached provider metadata in registration order.
ctx.llm.listModels(provider)
/**
* Discover models advertised by one registered provider. Catalog membership
* is advisory and never changes routing or request validation.
* @param provider - registered provider route to inspect.
* @returns detached model metadata in adapter-preferred order.
*/
async listModels(provider: string): Promise<LlmModelInfo[]>
Discover models advertised by one registered provider. Catalog membership is advisory and never changes routing or request validation.
provider— registered provider route to inspect.
Returns detached model metadata in adapter-preferred order.
ctx.llm.stream(options)
/**
* Stream one model call as raw chunks (token-level deltas). Throws
* `LlmError` with code `NO_ADAPTER` if no adapter is registered for
* `options.provider`. Replay state is retained only when the same adapter
* instance owns its historical provider and the target provider. Final
* adapter selection, dispatch, and iteration failures retain their original
* Error identity and are tagged in a call-local scope for narrow agent-loop
* request recovery; middleware and nested-call failures remain untagged for
* the outer call.
* @param options - the full request; `options.provider` selects the adapter.
* @returns the chunk stream, possibly wrapped by `llm/stream` listeners.
*/
stream(options: GenerateOptions): AsyncIterable<StreamChunk>
Stream one model call as raw chunks (token-level deltas). Throws LlmError with code NO_ADAPTER if no adapter is registered for options.provider. Replay state is retained only when the same adapter instance owns its historical provider and the target provider. Final adapter selection, dispatch, and iteration failures retain their original Error identity and are tagged in a call-local scope for narrow agent-loop request recovery; middleware and nested-call failures remain untagged for the outer call.
options— the full request;options.providerselects the adapter.
Returns the chunk stream, possibly wrapped by llm/stream listeners.