Lightweight client for Roboflow's hosted inference API with WebRTC streaming support

win32-x64 prebuilt binary for @livekit/local-inference

Tiny, type-safe wrapper around MSW for type inference from OpenAPI schemas.

HuggingFace Inference API provider for @workglow/ai.

Calculate prices for calling LLM inference APIs

An inference client library for OctoAI.

A composable browser-native WebGPU inference runtime with cooperative scheduling, tensors, kernels, programs, and route adapters.

Self-learning LLM runtime — TurboQuant KV-cache (6-8x compression), SONA adaptive learning, FlashAttention, speculative decoding, GGUF inference

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

TypeScript-first schema declaration and validation library with static type inference

Namira Software Corporation Inference NPM Package

OpenAPI client for neuronpedia-inference-client

WASM bindings for RuvLLM - browser-compatible LLM inference runtime with WebGPU acceleration

The **Cerebras provider** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for [Cerebras](https://cerebras.ai), offering high-speed AI model inference powered by Cerebras Wafer-Scale Engines and CS-3 systems.

Determine the level of support for function name inference.

A llama.cpp-based inference server with slightly extended capabilities in realtime inference control.

Command-line tools for Bayesian modelling, MCMC inference, and post-inference diagnostics across probabilistic programming languages.

TypeScript-first schema validation library with static type inference.

A type inference plugin for ESDoc [PoC]

A lightweight, TypeScript-first functional programming library with excellent type inference