Calculate prices for calling LLM inference APIs

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

LLM inference provider evals

Private, in-browser LLM inference for FeltDB applications

WASM bindings for RuvLLM - browser-compatible LLM inference runtime with WebGPU acceleration

In-Browser LLM inference

WebLLM provider for Vercel AI SDK v5+ (High-performance in-browser LLM inference)

Expo module for Google MediaPipe LLM inference

Official TypeScript SDK for the Pendra LLM inference API

Pi extension for configuring multiple local LLM inference engine connections.

Core inference backend — llamafile wrapper for local LLM inference

LLM inference provider registry for Pondoknusa

Composable LLM inference with multi-provider support, tool execution, streaming, structured output, and approval workflows

Browser LLM inference on WebGPU using Three.js TSL compute shaders.

High-performance LLM inference for React Native using LiteRT-LM. Optimized for Gemma 4 and other on-device language models.

LLM inference node distributed over Pear. Installs over P2P and updates itself over OTA.

Typesafe prompt construction for LLM inference with zod-parsed results

Conformance and capability test suite for LLM inference engines. Scores surface coverage, spec conformance, and whether the model is semi-capable.

ElizaOS plugin for pay-per-request LLM inference via x402 on Solana USDC - no API keys, no accounts

Expo module for on-device LLM inference via Apple Foundation Models (iOS) and Gemini Nano (Android)