Skip to content

Features

Beyond the GenerateRequest contract, OmniRT provides several cross-cutting capabilities for validation, queuing, caching, observability, and service integration.

Feature Purpose Page
Presets fast / balanced / quality / low-vram tags that bundle steps / dtype / guidance Presets
Request validation Catch contract errors before using real hardware Validation
Service schema Field-level reference for GenerateRequest / GenerateResult / RunReport Service Schema
Dispatch queue Async engine, concurrency, dynamic batching, JobStore, remote workers Dispatch & Queue
Telemetry RunReport, Prometheus, OTLP traces, SSE / WebSocket event streams Telemetry